Sr. Software Engineer - Azure Databricks Job
At a glance
Senior Data Engineering role at Yash Technologies. Hyderabad.
Pay not stated Data Engineering salary
dataroles summary, based on the employer's posting.
What you'll do
- Build and maintain Azure data pipelines, including ETL/ELT workflows for structured and unstructured information
- Use Data Factory, Databricks and Synapse to ingest data and support lakes, warehouses and analytics
- Connect Azure AI and machine-learning services, including Azure OpenAI, to applications and data workflows
- Create data models and reusable processing frameworks, while applying governance, quality, security and compliance controls
- Improve platform performance and cost, support deployments through Azure DevOps and IaC, and troubleshoot production issues
What you bring
- Three to six years working in data engineering and Azure cloud environments
- Hands-on skill with Data Factory, Databricks, Synapse, data lakes, Python, SQL and Spark
- A bachelor's or master's degree in computer science, IT, data science or a related discipline
- Experience with large structured and semi-structured datasets, plus Azure AI/ML integration and generative AI
Who this fits
This role suits a senior data engineer who has built Azure data platforms and can work across pipelines, analytics and AI integration. You’ll collaborate with data scientists, AI engineers, analysts and application teams, while also providing production support.
From the employer
YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.
At YASH, we’re a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth – bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.
We are looking forward to hire Azure Databricks Professionals in the following areas :
Experience
3-6 Years
Job Description
-
We are seeking an experienced Azure AI Data Engineer with 3 to 6 years of hands-on experience in designing, developing, and maintaining scalable data and AI solutions on Microsoft Azure. The ideal candidate should possess strong expertise in data engineering, Azure cloud services, AI/ML integration, data pipelines, and modern analytics platforms to support business intelligence and AI-driven applications.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Azure services.
- Build and optimize ETL/ELT workflows for structured and unstructured data.
- Implement data ingestion solutions using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
- Develop and manage data lakes and data warehouse solutions on Azure.
- Integrate AI and Machine Learning services such as Azure AI Services, Azure OpenAI, Azure Machine Learning, and Cognitive Services into enterprise applications.
- Create and maintain data models, transformations, and processing frameworks.
- Implement data governance, data quality, security, and compliance controls.
- Monitor and optimize data platform performance, scalability, and cost.
- Collaborate with Data Scientists, AI Engineers, Business Analysts, and Application Development teams.
- Develop reusable frameworks and automation for data orchestration and deployment.
- Support CI/CD implementation using Azure DevOps and Infrastructure as Code (IaC).
- Troubleshoot data-related issues and provide production support.
Azure AI & Machine Learning
- Azure AI Services
- Azure OpenAI Service
- Azure Machine Learning
- Azure Cognitive Services
- Generative AI concepts and implementation
Required Qualifications
- Bachelor's or Master's degree in Computer Science, Information Technology, Data Science, or related field.
- 3 to 6 years of experience in Data Engineering and Azure Cloud technologies.
- Strong experience with Azure Data Factory, Databricks, Synapse Analytics, and Data Lake.
- Experience working with large-scale structured and semi-structured datasets.
- Knowledge of AI/ML integration and Generative AI solutions on Azure.
- Hands-on experience with Python, SQL, and Spark.
- Strong understanding of cloud architecture, security, and performance optimization.
- Experience with Agile development methodologies.
Preferred Qualifications
- Microsoft Azure Certifications such as:
- DP-203: Azure Data Engineer Associate
- AI-102: Azure AI Engineer Associate
- AZ-305: Azure Solutions Architect Expert
- Experience with Microsoft Fabric.
- Experience in Retrieval-Augmented Generation (RAG) architectures.
- Knowledge of Vector Databases and Semantic Search.
- Experience integrating Azure OpenAI with enterprise applications.
At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment. We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.
Our Hyperlearning workplace is grounded upon four principles
- Flexible work arrangements, Free spirit, and emotional positivity
- Agile self-determination, trust, transparency, and open collaboration
- All Support needed for the realization of business goals,
- Stable employment with a great atmosphere and ethical corporate culture
Data Engineering work from LinkedIn, X, Reddit and Upwork, in one list.
Each morning you get everything that fits, strongest first.
Data Engineering
Find me workBy the team behind dataroles.