Data Engineer(Azure) - Chennai/Banglore/Hyderabad/Trivandrum
At a glance
Mid-level Data Engineering role at Fa Ertb Saasfaprod1. Chennai.
Pay not stated Data Engineer salary
dataroles summary, based on the employer's posting.
What you'll do
- Shape Azure data models and architectures around stakeholder needs, then build ETL flows that bring in data from multiple sources
- Create and maintain automated data pipelines with Azure Data Factory, Databricks or comparable tools
- Tune storage and retrieval so data stays available, queries run efficiently and pipelines can recover from faults
- Track pipeline health, resolve performance and data-quality issues, and provide analysts and data scientists with dependable datasets
- Apply data security and governance controls, and coordinate with DevOps on deployment automation and infrastructure as code
What you bring
- You have a bachelor's or master's degree in computer science, engineering or a related discipline
- You have proven data engineering experience centered on Azure and its data services
- You can design scalable data models, warehouses and lakes, and build ETL and data integration workflows
- You use Python, SQL or PowerShell for data work, scripting and automation
- You bring experience with cloud platforms and distributed computing, such as Spark or Databricks
Who this fits
This mid-level role suits a data engineer who can build and troubleshoot Azure pipelines and work with stakeholders, analysts and data scientists. The position is based in Chennai, Bangalore, Hyderabad or Trivandrum and follows PST timing.
From the employer
Who are we?
For the past 20 years, we have powered many Digital Experiences for the Fortune 500. Since 1999, we have grown from a few people to more than 4000 team members across the globe that are engaged in various Digital Modernization. For a brief 1 minute video about us, you can check https://youtu.be/uJWBWQZEA6o.
What will you do? What are we looking for?
Position: Data Engineer
Location: Chennai/Banglore/Hyderabad/Trivandrum, PST Timing
Job Summary
We are seeking a Data Engineer to work on a Generative AI initiative to join our team. The ideal candidate will have a deep understanding of data modeling, data schemas and has developed ETLs from various sources eensuring high data availability, fault tolerance and security and governance.
Responsibilities:
- Collaborate with stakeholders to understand data requirements and design scalable and efficient data models, schemas, and architectures on the Azure platform.
- Develop and implement data integration and ETL (Extract, Transform, Load) processes to ingest, transform, and load data from various sources into Azure data storage systems.
- Build and maintain scalable and reliable data pipelines using Azure Data Factory, Azure Databricks, or similar tools to automate the movement and transformation of data.
- Optimize data storage and retrieval mechanisms, ensuring high data availability, fault tolerance, and efficient query performance.
- Hands-on experience with cloud platforms (MS Azure, AWS or Google Cloud Services)
- Hands-on experience with distributed computing (preferably using Apache Spark or Databricks)
- Monitor and troubleshoot data pipelines, identifying and resolving performance issues, data quality problems, and data integration challenges.
- Collaborate with data scientists and analysts to provide them with access to reliable and well-structured data sets for analysis and reporting purposes.
- Implement data governance and security measures to protect sensitive data, ensure compliance with regulatory standards, and adhere to data privacy policies.
- Work closely with the DevOps team to automate deployment processes, ensure continuous integration and delivery of data solutions, and maintain infrastructure as code.
- Stay updated with the latest advancements in Azure data services, evaluate and implement new tools and features to enhance data engineering processes.
Requirements
- Bachelor's or master’s degree in computer science, Engineering, or a related field.
- Proven experience as a Data Engineer, with a strong focus on Azure cloud platform.
- In-depth knowledge of Azure data services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure SQL Database, Azure Data Lake Storage, and Azure Cosmos DB.
- Proficiency in designing and implementing scalable data models, data warehouses, and data lakes.
- Strong understanding of ETL processes, data integration patterns, and data transformation techniques.
- Experience with programming languages such as Python, SQL, and PowerShell for data manipulation, scripting, and automation.
- Familiarity with big data technologies and frameworks like Hadoop, Spark, and NoSQL databases is a plus.
- Strong analytical and problem-solving skills, with the ability to troubleshoot and optimize data pipelines.
- Excellent communication and collaboration skills to work effectively in a team environment and interact with stakeholders from various disciplines.
Preferred Qualifications:
- Bachelor's or master's degree in computer science, Data Science, Statistics, Math, Physics, or other Science related discipline with course work in AI/ML.
- Cloud certifications preferred.
- Contribute to the design and implementation of new data-driven solutions, using cutting-edge machine learning and artificial intelligence techniques.
- Self-motivated with a strong desire to learn and stay up to date with new technologies in the field.
- Ability to work collaboratively in a team environment and communicate complex technical concepts to non-technical stakeholders.
Data Engineering work from LinkedIn, X, Reddit and Upwork, in one list.
Each morning you get everything that fits, strongest first.
Data Engineering
Find me workBy the team behind dataroles.