Tech Lead Data Engineer
At a glance
Senior Data Engineering role at GFT Technologies. Kraków.
Pay not stated Lead Data Engineer salary
dataroles summary, based on the employer's posting.
What you'll do
- Build ETL and data-processing solutions in Python and PySpark, covering ingestion through reporting
- Develop cloud data platforms and pipelines with Azure services, including ADLS, Key Vault and Databricks
- Turn business needs into technical designs and implementation plans, then deliver them with stakeholders in Agile
- Create GitLab CI/CD pipelines, Shell scripts and scheduling solutions, and troubleshoot data on Unix
- Keep data solutions reliable and scalable while supporting risk-management processes
What you bring
- At least ten years in professional software engineering
- Recent, continuous hands-on Python and PySpark work over the past two to three years
- Practical experience designing Python ETL and data solutions, plus Shell scripting and Autosys
- Strong Azure knowledge, including ADLS, Azure Key Vault and Databricks
- Unix, Oracle, GitLab CI/CD and Agile experience, with Java or C# also required
Who this fits
This senior role suits an experienced data engineer who can translate business requirements into implementable technical work. The contract is an employment contract, with hybrid work in the client’s Kraków office three days a week.
From the employer
Type of contract: Employment contract
Salary range: 17400 - 26700 PLN gross
What will you do?
You will join a team responsible for building a cloud-based strategic data platform supporting risk management processes within investment banking. The project focuses on data integration, process automation, digital transformation, and modernization of large-scale financial services platforms, enabling more effective risk management and data processing capabilities.
Your tasks
- Design and develop ETL and data processing solutions using Python and PySpark
- Build and maintain cloud-based data platforms and pipelines
- Analyze business requirements and translate them into technical solutions and implementation plans
- Develop data ingestion, cleansing, transformation, loading, and reporting processes
- Work with Azure services including ADLS, Azure Key Vault, and Databricks
- Create and maintain CI/CD pipelines using GitLab
- Develop and maintain Shell scripts and scheduling solutions
- Collaborate with stakeholders in an Agile delivery environment
- Support data analysis and troubleshooting on Unix platforms
- Ensure high quality, scalability, and reliability of data solutions
Your skills
- 10+ years of professional software engineering experience
- Recent hands-on experience with Python and PySpark used continuously over the last 2-3 years
- Experience with Java or C#
- Strong experience working on Unix platforms including file operations, permissions, environments, and data analysis
- Hands-on experience designing and developing ETL and data solutions using Python
- Experience with data ingestion, transformation, cleansing, loading, and reporting processes
- Experience with Shell scripting
- Experience with Autosys
- Experience working with Oracle databases
- Ability to gather business requirements and break them down into implementable technical tasks
- Experience with CI/CD pipelines and GitLab
- Good understanding of software development lifecycle within Agile environments
- Strong knowledge of Azure platform
- Experience with ADLS
- Experience with Azure Key Vault
- Experience with Databricks
Nice to have
- Experience with AI-powered development tools such as GitHub Copilot
- Experience creating automation agents and AI-based productivity solutions
We offer
- Hybrid work in our client's office (Kraków) 3 days a week
- Working in a highly experienced and dedicated team
- Benefit package tailored to your needs (medical, sport, lunch subsidy, life insurance, etc.)
- Online training and certifications
- Access to e-learning platform
- Social events