Databricks Technical Lead
At a glance
Senior Data Engineering role at G MASS. Dublin · full-time.
Pay not stated Data Engineering salary
dataroles summary, based on the employer's posting.
What you'll do
- Lead work to build and improve banking data platforms and applications on Databricks and AWS
- Create and tune large data pipelines with Spark or PySpark, Delta Lake and Databricks Workflows
- Set up Databricks governance and access controls, including Unity Catalog, and manage Terraform infrastructure deployments
- Guide technical quality through mentoring, code reviews, documentation and CI/CD improvements
- Shape architecture for scale, performance, cost and reliability, while promoting automated tests and clean code
What you bring
- You have worked across the enterprise software development lifecycle and have financial services experience, including banking
- You bring practical Databricks skills across Spark or PySpark, Delta Lake, Databricks SQL and Workflows, plus Python or Scala
- You have AWS and Terraform experience, along with CI/CD work using Jenkins
- You know Unity Catalog and governance in regulated settings, and hold a computer science degree or equivalent experience
Who this fits
This senior technical lead role suits someone who can set technical direction while staying hands-on with data platforms and cloud infrastructure. The role is based onsite in Dublin; the listing also identifies Cork and Amsterdam as possible locations. It is a permanent position.
From the employer
G MASS are seeking an experienced Databricks Technical Lead to support the development and ownership of strategic data platforms and cloud-based applications within a financial services environment.
The role will focus on defining technical direction and architecture across Databricks and the wider AWS estate, ensuring scalable and secure development practices, and overseeing delivery through the full software development lifecycle. The successful candidate will work closely with Development, Business Analysis, QA, Application Support, IT Security, and Enterprise Architecture teams to deliver robust and high-performing solutions across complex banking and financial systems.
Responsibilities:
- Lead the development and enhancement of strategic banking data platforms and applications across Databricks and AWS cloud environments
- Design, build, and optimise large-scale data pipelines using Spark / PySpark, Delta Lake, and Databricks Workflows
- Own data governance and access control within the Databricks environment, including Unity Catalog design and implementation
- Manage cloud infrastructure deployments using Terraform and Infrastructure as Code best practices
- Maintain technical documentation and internal knowledge resources
- Provide technical leadership through mentoring, code reviews, and best practice guidance
- Support architectural design with a focus on scalability, performance, cost efficiency, and reliability
- Drive CI/CD improvements across cloud and on-premise environments
- Promote clean coding standards, automated testing, and effective use of AI-assisted development tools
Requirements
- Enterprise SDLC experience
- Financial services experience, including banking exposure
- Strong hands-on Databricks experience, including Spark / PySpark, Delta Lake, Databricks SQL, and Workflows, with proficiency in Python and / or Scala
- Experience of Unity Catalog and data governance within a regulated environment
- Strong AWS experience (EC2, Lambda, ECS, RDS, S3, IAM)
- Hands-on Terraform / Infrastructure as Code experience
- CI/CD experience using Jenkins
- Degree in Computer Science or related discipline (or equivalent experience)
- IBM MQ or similar messaging systems
Benefits
Length: Permanent
Location: Cork, Dublin, or Amsterdam
Data Engineering work from LinkedIn, X, Reddit and Upwork, in one list.
Each morning you get everything that fits, strongest first.
Data Engineering
Find me workBy the team behind dataroles.