Senior Consultant- Databricks

John Keells Information Technology (Pvt) Ltd (JKIT), a fully owned subsidiary of John Keells Holdings PLC, Sri Lanka's largest conglomerate listed on the Colombo Stock Exchange, is a global IT professional services leader, transforming enterprises with cutting-edge digital solutions.

JKIT is a 100% cloud-native solutions provider, offering end-to-end digital transformation solutions in collaboration with global Principals like Microsoft, SAP, and Salesforce. Driven by a Cloud-first, Mobile-first and AI-first strategy, JKIT empowers businesses with innovation, agility, growth, and state-of-the-art security.

We invite applications from suitably qualified individuals for the post of Senior Consultant- Databricks. The selected candidate will report to the Practice Manager.

.

The Senior Consultant- Databricks will be responsible for:

• Designing, developing, deploying, and supporting scalable batch and streaming data pipelines using Azure Databricks, Spark, PySpark, Python, and SQL.
• Implementing Lakehouse solutions using Delta Lake, Unity Catalog, Databricks SQL, Workflows, Jobs, and Clusters.
• Developing ETL/ELT frameworks and supporting data platform modernization and migration from legacy platforms.
• Applying best practices in data modelling, warehousing, Medallion Architecture, governance, security, data quality, metadata, lineage, orchestration, and production support.
• Optimizing Spark workloads, SQL, clusters, and storage for performance and cost efficiency.
• Implementing secure access controls and compliance using Unity Catalog and Azure security services.
• Developing and maintaining CI/CD pipelines using Git, Azure DevOps, or similar tools.
• Collaborating with architects, analysts, cloud and AI/ML teams, and customers on solution design, workshops, code reviews, troubleshooting, documentation, and mentoring.

.

The ideal candidate should possess:

• A Bachelor’s degree in Computer Science, Data Science, or a related discipline.
• 5+ years of experience in Data Engineering, Analytics, BI, or software engineering, including 2+ years of enterprise Databricks experience.
• Strong expertise in Spark, PySpark, Python, SQL, Delta Lake, Databricks SQL, Notebooks, Workflows, and Repos.
• Experience with Azure Databricks, Data Factory, Data Lake Storage, Synapse, Microsoft Fabric, and Power BI.
• Experience with CI/CD, Git, automated testing, and release management.
• Databricks Professional certification is mandatory; Delivery Expert or Project Expert certification is an added advantage. Azure/Fabric certifications are desirable.
• Strong analytical, communication, documentation, customer engagement, and teamwork skills, with the ability to work independently and mentor junior engineers in Agile environments.
• Exposure to Asset Bundles, IaC, MLflow, MLOps, GenAI, Purview, data observability, event streaming, presales, estimations, POCs, and customer demonstrations.
• Ability to deliver secure, scalable, production-ready solutions while meeting quality, performance, and cost targets and contributing to reusable assets and engineering standards.

If you’re up for the challenge, please send your resume to careers@johnkeellsit.com or Click on the advert to apply. Please state the position you’re interested in the subject line of your email.