Databricks Lead – Delivery & Engineering
At a glance
Senior Data Engineering role at Jade Global. Pune · full-time.
Pay not stated Data Engineering salary
dataroles summary, based on the employer's posting.
What you'll do
- Lead Databricks engineering teams and deliver hands-on work that follows CoE standards
- Build and tune Spark and Delta Lake pipelines, including batch and streaming ingestion
- Create Lakehouse data platforms, Bronze/Silver/Gold models and scalable ETL/ELT flows
- Set up Databricks Jobs, Workflows and CI/CD, then improve Spark performance and DBU use
- Strengthen pipeline reliability and observability while contributing accelerators and standards
What you bring
- Ten to twelve years in data engineering, including three to five years working directly with Databricks
- Deep Databricks, Apache Spark and Delta Lake knowledge, plus PySpark or Spark SQL skills
- Experience shaping Lakehouse architectures and understanding of data modeling, quality and lineage
Who this fits
This senior role suits someone who can lead engineering teams while staying hands-on with Databricks delivery. The role is based in Pune, India.
From the employer
Lead hands-on Databricks delivery, ensuring adherence to CoE standards and best practices.
Key Responsibilities
Lead Databricks engineering teams
Build and optimize Spark & Delta Lake pipelines
Implement Databricks Jobs, Workflows, CI/CD
Optimize performance and DBU usage
Contribute to Databricks accelerators and standards
Design and implement end-to-end data platforms using Databricks Lakehouse
Lead development of:
Data ingestion (batch & streaming)
Delta Lake data modeling (Bronze/Silver/Gold)
Scalable ETL/ELT pipelines
Optimize Spark workloads for performance and cost
Ensure reliability, scalability, and observability of data pipelines
Experience
10–12 years in data engineering
3–5 years hands-on Databricks experience
Skills
Deep expertise in Databricks, Apache Spark, Delta Lake
Strong hands-on experience with PySpark / Spark SQL (core, SQL, streaming)
Experience designing Lakehouse architectures
Strong understanding of data modeling, data quality, and lineage
Databricks platform features
Cloud-native data engineering
Performance tuning & troubleshooting
Certifications (Preferred)
Databricks Data Engineer Associate and Professional