Senior Data Engineer (Hadoop, Spark)
At a glance
Senior Data Engineering role at GFT Technologies. Kraków.
Pay not stated Data Engineer salary
dataroles summary, based on the employer's posting.
What you'll do
- Build and maintain scalable data solutions with PySpark, contributing to their software design
- Automate tests for new and existing components, and review code to reinforce development standards
- Troubleshoot production issues and put monitoring and performance processes in place
- Turn business analyst requirements into implementation, while contributing to architecture and sprint activities
- Mentor colleagues and support planning, reviews and retrospectives in the Agile development process
What you bring
- You have development and design experience with PySpark or Scala
- You know the Hadoop stack, including Spark, Hive and YARN, and have built data pipelines with its components
- You bring strong SQL and REST knowledge, plus experience on Unix or Linux
- You have used scheduling tools such as Airflow and worked with Git, Jenkins or another listed tool
Who this fits
This senior role suits an engineer who can build data pipelines and contribute to design, production support and code reviews. It is hybrid in Kraków, with two office days each week.
From the employer
Type of contract: Employment contract
Salary range: 15800-24300 PLN gross/month
What will you do?
You will work as a key member of a technical team alongside Engineers, Data Analysts and Business Analysts, contributing to a collaborative Agile development process while designing, developing and maintaining scalable data solutions in a dynamic DevOps environment.
Your tasks
- Define and contribute to software design and development using Pyspark
- Automate testing of new and existing components
- Promote development standards through code reviews and mentoring
- Provide production support and troubleshooting
- Implement tools and processes ensuring performance, scalability and monitoring
- Collaborate with Business Analysts to interpret and implement requirements
- Participate in planning, sprint reviews and retrospectives
- Contribute to system architecture and design
Your skills
- Experience with Pyspark or Scala development and design
- Experience using scheduling tools such as Airflow
- Knowledge of Hadoop ecosystem including Spark, Hive, YARN and ETL frameworks
- Strong SQL and RESTful services knowledge
- Experience working on Unix or Linux platforms
- Hands-on experience building data pipelines using Hadoop components
- Experience with Git, GitHub, Jenkins, Ansible and JIRA
- Understanding of big data modelling using relational and non-relational techniques
- Experience debugging code and communicating findings to development teams
Nice to have
- Experience with Elasticsearch
- Experience developing Java APIs
- Experience in data ingestion processes
- Understanding of cloud design patterns
- Exposure to DevOps and Agile methodologies such as Scrum and Kanban
- Experience with Spark streaming
- Experience with Apache Airflow in production
- Experience with Hadoop ecosystem in enterprise environments
- Knowledge of Python backend services
- Experience with Scala for high performance systems
- Experience in data integration and ETL processes
- Knowledge of PL/SQL
- Experience with Linux and Unix system operations
We offer
- Hybrid work in Krakow (2 office days per week)
- Working in a highly experienced and dedicated team
- Benefit package tailored to your needs (medical, sport, lunch subsidy, life insurance, etc.)
- Online training and certifications
- Access to e‑learning platform
- Social events
Data Engineering work from LinkedIn, X, Reddit and Upwork, in one list.
Each morning you get everything that fits, strongest first.
Data Engineering
Find me workBy the team behind dataroles.