Senior Data Engineer (Azure, Databricks)
At a glance
Senior Data Engineering role at OPTIVEUM sp. z o.o. Wrocław · full-time.
Pay not stated Data Engineer salary
dataroles summary, based on the employer's posting.
What you'll do
- Move and reshape data from source systems, including legacy platforms, into clean datasets ready for analysis
- Use Databricks notebooks and ingestion tables to build shared file outputs and load staging and Data Lake Core data
- Create analysis-ready SQL Server tables and views, then tune SQL queries and monitor pipeline performance
- Build batch and real-time data flows, automate integration work, and improve data testing and quality
- Work with data modellers, analysts and governance teams on mappings, catalogue upkeep and delivery estimates
What you bring
- At least five years in data engineering or a related area, with substantial ETL and cloud data work
- A bachelor's degree in computer science, engineering or a related discipline
- Strong SQL and relational database experience, plus hands-on use of the named Azure, Databricks and data tools
- English proficiency at C1 level
Who this fits
This suits a senior engineer comfortable building data pipelines and collaborating in agile teams. The role is full-time under a B2B contract and requires working fully on-site in Wrocław. Microsoft Azure Data Engineer and Databricks Data Engineer Pro certifications are listed; a master's degree is preferred.
From the employer
Senior Data Engineer (Azure, Databricks)
About the OfferWe are currently looking for a Senior Data Engineer to join an innovative data team at our client, the financial services (captive finance) arm of a global automotive company. For this role, Optiveum is the recruitment and contracting party, which means you will sign the cooperation agreement directly with us.
You will build and optimise ETL pipelines in the Azure and Databricks ecosystem, migrate data from legacy systems to next-generation platforms, ensure data quality and work with cross-functional teams to deliver actionable insights.
Key Details:Rate: up to 165 PLN/h net + VAT
Work Model: B2B contract, full-time (40 h/week), 100% onsite
Location: Wrocław
Language: English (C1)
Responsibilities:
Extract, combine, transform, load and cleanse data from various sources to deliver high-quality datasets for analysis, including migration from legacy systems
Work with data modellers and business analysts to understand the data model and source-to-staging mapping
Create analysis-ready data structures, including DDLs for MS Cloud SQL Server tables and views in the Pond database (a subset of the Data Lake)
Design and develop Databricks notebooks that extract data from input files and join related entities into Shared File Formats (SFFs)
Configure Ingestion Framework tables to load staging and Data Lake Core (DLC) tables
Build large-scale batch and real-time data pipelines in cloud or on-premises environments and develop performance-efficient algorithms
Apply CI/CD best practices and introduce automation in existing and future integration flows
Track data consumption patterns and work with data governance and information stewards on the curated data catalogue
Drive improvements in data acquisition, testing and tooling to raise data quality
Monitor performance and optimise SQL queries
Prepare detailed design documents based on business and system requirement documents
Work in cross-functional agile teams and take part in requirement analysis and estimates
Requirements:
5+ years of experience in data engineering or a related field, with a strong focus on ETL and cloud data tools
Bachelor's degree in Computer Science, Engineering or a related field (Master's preferred)
Certifications: Microsoft Certified Azure Data Engineer and Databricks Certified Data Engineer
Proficiency in Python, Java or Scala
Hands-on experience with MS Cloud SQL Server, Azure Data Factory, Azure Databricks, PySpark, Spark SQL, ADLS, Power BI, SSIS and SSRS
Strong SQL skills and experience with relational databases
Familiarity with big data technologies and data processing frameworks
Experience with Agile/Scrum
Strong problem-solving and communication skills and a collaborative mindset
English at C1 level
Nice to have:
Experience in financial services, ideally in a captive finance company, including customer, dealer and supplier data
Experience delivering global data marts used across regions
Java
Data Engineering work from LinkedIn, X, Reddit and Upwork, in one list.
Each morning you get everything that fits, strongest first.
Data Engineering
Find me workBy the team behind dataroles.