Senior Databricks Specialist Lead | AI & Data | Sydney

Job Requisition ID: 39344

• Be part of market-leading projects with global scale and complexity.
• Have your voice heard through people panels and leader forums.
• Prioritise in-person connection with your team and clients, with flexibility to balance work and life.

Deloitte’s AI & Data team is transforming how businesses leverage cloud-native technologies to solve complex challenges in data, machine learning, and AI. As a Director, you will lead strategic initiatives, drive innovation, and deliver impactful solutions for our clients.

What will your typical day look like?  

As a Senior Databricks Specialist, your typical day is centred around designing, building, and scaling modern data and AI platforms that help enterprise clients unlock real business value from their data.

• You will work within Deloitte’s Data & AI practice, leveraging cloud native and Databricks Lakehouse technologies to solve complex data engineering, machine learning, and AI challenges across large scale transformation programs.
• Your day will involve leading technical solution design sessions with clients, architecting end to end Databricks platforms, and guiding engineering teams on best practices across Spark, Delta Lake, and cloud data engineering patterns.
• You will collaborate with stakeholders across business and technology teams to translate requirements into scalable data solutions, while also ensuring performance, reliability, and governance standards are met.
• A key part of your role will include driving delivery across multiple workstreams, mentoring engineers, and supporting continuous improvement of CI CD pipelines, infrastructure as code, and automated deployment practices.
• You will also contribute to shaping Deloitte’s cloud and AI capabilities, working on some of the most complex and high impact data programs across Australia and the APAC region.
• You’ll also be responsible for coaching, developing, and inspiring your team, setting high standards for delivery excellence and technical leadership.

Join us as we continue to expand into a cloud-centric and AI driven future, working on some of the largest and most complex projects within Australia & APAC.

About the team:   

Our diverse AI & Data team comprises over 500 specialist practitioners across Australia, each of whom are constantly curious and excited about combining their business acumen and technological expertise to create data-centric solutions that help solve complex problems and transform, or reinvent our client’s business.

Our Data & AI teamwork with public and private sector clients helping them to design and implement world leading solutions and capabilities. From solving air and ground transport network issues through our industry-first Optimal Reality digital twin solution, bringing automation capabilities to vaccine rollout programs, to helping our clients move to a sustainable world, we are the partner of choice for our clients and our alliance vendors.

Our relationships with market leading vendors such as AWS, Databricks, Google, dbt Labs, Snowflake, Salesforce, and Informatica enable our practitioners to be at the forefront of new and emerging capabilities and to deliver our suite of services at scale. We are consistently recognised as leaders in Cloud, Data, Analytics and AI, including in the latest analyst reports.

Enough about us, let’s talk about you.   

We are seeking a Senior Databricks Specialist Lead to join our Data & AI consulting practice, driving enterprise scale data platform and lakehouse transformations for leading clients.

Key capabilities:

• 8 to 12 years of experience in Data Engineering, Cloud, or Software Engineering, with strong hands on Python and backend development expertise.
• Deep expertise in Databricks and Lakehouse architecture, including Apache Spark (PySpark or Scala), Delta Lake, and Medallion architecture.
• Proven experience delivering large scale data and AI solutions on AWS, Azure, or Google Cloud using Databricks as a core platform.
• Strong consulting and client facing experience, with ability to lead solution design, stakeholder engagement, and end to end delivery.
• Expertise in modern data engineering practices including batch, streaming, and real time analytics pipelines for AI and advanced analytics use cases.
• Strong experience with CI CD and Infrastructure as Code (Terraform, Git, automated deployment pipelines) in cloud data environments.
• Advanced SQL and performance tuning skills across distributed data systems, along with strong troubleshooting and optimisation capability in Spark and cloud environments.
• Leadership experience in mentoring engineers, defining best practices, and driving technical excellence across teams and client engagements.
• Industry certifications in Databricks (Databricks Certified Data Engineer / Databricks Certified Professional) and cloud platforms (AWS, Azure, or GCP) are highly desirable and strongly preferred.

Why Deloitte?

At Deloitte, we focus our energy on interesting and impactful work. We’re always learning, innovating and setting the standard; making a positive difference to our clients and our society. We put coaching at the heart of what we do, helping our people grow their careers in any direction – whether it be up, moving into something new, or even moving across the world.   

We embrace diversity, equity and inclusion. We have a diverse collection of people from different backgrounds, with different experiences, gender identities, abilities and thinking styles. What binds us together is a shared commitment to value everyone’s perspective and to cultivate inclusion; so that our work environment is a safe space we can all belong.  

We value in-person connection with our clients and our colleagues. We offer several ways for you to work flexibly so that you can serve your clients, stay connected with your team, and manage your personal priorities.

We help you live and work well. To support your personal and professional life, we offer a range of perks and benefits, including retail discounts, wellbeing leave, paid volunteering days, twelve flexible working options, market-leading parental leave and return to work support package.  

 

Next Steps  

Sound like the sort of role for you? Apply now, we’d love to hear from you!  

By applying for this job, you’ll be assessed against the Deloitte Talent Standards. We’ve designed these standards so that you can grow in your career, and we can provide our clients with a consistent and exceptional Deloitte employee experience globally. The preferred candidate will be subject to background screening by Deloitte or by their external third-party provider.