Senior Data Engineer - Chennai/Banglore/Hyderabad/Trivandrum, India
At a glance
Senior Data Engineering role at Fa Ertb Saasfaprod1. Chennai.
Pay not stated Data Engineer salary
dataroles summary, based on the employer's posting.
What you'll do
- Build ELT pipelines with Python scripts and Airflow DAGs
- Tune Spark resource settings to improve pipeline performance
- Trace existing Microsoft BI ETLs, learn their business rules, and rebuild them as Airflow pipelines
- Clarify needs with business partners and turn them into technical approaches
- Take an active part in Agile team work and scrum ceremonies
What you bring
- You have three to five years implementing big data solutions in cloud environments
- You have hands-on experience with Airflow DAGs, Spark, Python, Hive, Trino, S3 or another listed tool
Who this fits
This suits a senior data engineer comfortable building and debugging cloud data pipelines and working directly with business partners. The role is offshore and requires overlap with the onsite team until ten to eleven a.m. Pacific time for scrum ceremonies or onsite interaction.
From the employer
Who are we?
For the past 20 years, we have powered many Digital Experiences for the Fortune 500. Since 1999, we have grown from a few people to more than 4000 team members across the globe that are engaged in various Digital Modernization. For a brief 1 minute video about us, you can check https://youtu.be/uJWBWQZEA6o.
What will you do? What are we looking for?
Technical Skill set:
Having 3-5 years of experience in implementing Big Data solution in Cloud environments.
Hands-on in implenting Big data solution using Airflow DAG,Spark,Python,Hive,Trino,S3 Bucket,etc
Having experience Cloud Data platform like SnowFlake , Databricks is a plus.
Knowledge of Financial domain-Credit Card industry is a plus.
Responsibilites:
Creating an ELT Data pipelines using python script and Airflow DAG.
Optimizing the Data pipelines by configuring the Spark system resources
Debug an existing Microsoft BI ETLs and understand business logic and convert in to big data pipeline using Airflow DAG.
Able to interact with business partners to understand the requirements and provide technical solutions.
Proficient with Agile Methodology and active team participation is required.
Need to have overlap with Onsite team till 10-11 am Pacific time , for attending scrum ceremonies or to have onsite interaction .
Location : Offshore
Data Engineering work from LinkedIn, X, Reddit and Upwork, in one list.
Each morning you get everything that fits, strongest first.
Data Engineering
Find me workBy the team behind dataroles.