Senior Data Engineer
At a glance
Senior Data Engineering role at K MART Australia. Bangalore.
Pay not stated Data Engineer salary
dataroles summary, based on the employer's posting.
What you'll do
- Build dependable data platforms that can scale and support production workloads
- Design data pipelines for ETL/ELT and connect data sources reliably at scale
- Process large datasets and streaming workloads with Spark and Kafka
- Prepare structured and unstructured data for AI workloads, including ingestion, chunking, embeddings and quality controls
- Integrate LLMs and AI agents with enterprise data and APIs, including retrieval and multi-step workflows
What you bring
- You bring five to seven years of data engineering experience building production-ready platforms
- You have at least three years using AWS services such as IAM, API Gateway, EC2 and S3
- You have two or more years with Docker and Kubernetes, CI/CD pipelines, and Snowflake
- You bring five to seven years working with ETL/ELT and large-scale data processing using Spark and Kafka
- You program in Python and have working knowledge of Java or Scala
Who this fits
This senior role suits a data engineer with substantial platform, pipeline and big-data experience, plus exposure to GenAI and agentic workflows. The stated experience ranges call for five to seven years in data engineering and ETL/ELT, alongside specific experience with AWS, containers, CI/CD and Snowflake.
From the employer
Brighter Futures Start Here
At Anko you’ll be joining a diverse team who come together to collaborate globally around tech. We are an innovation hub which power and support our retail brands. You’ll feel the impacts of the work you’ll do for our millions of customers and team members every day. Our brands are focused on being customer-led, digitally enabled retailers, providing you with challenging and rewarding work that you will be proud of.Join our team, choose your own path and work on projects that excite you.
Job Description:
- 5–7 years of overall experience in Data Engineering, building scalable and production-grade data platforms.
- 3+ years of hands-on experience with AWS services, including IAM, API Gateway, EC2, S3, and related cloud services.
- 2+ years of experience in containerization and orchestration, including creating, deploying, and managing containers using Docker and Kubernetes.
- 2+ years of experience building and managing CI/CD pipelines using tools such as Jenkins, GitHub Actions, or equivalent.
- 2+ years of hands-on experience with Snowflake, including data warehousing, data modelling, performance optimization, and integration with ETL/ELT pipelines.
- 5–7 years of strong experience with ETL/ELT frameworks and data integration, including designing reliable and scalable data pipelines.
- 5–7 years of experience with Big Data technologies such as Apache Spark and Kafka, including large-scale data processing and streaming workloads.
- Strong programming experience in Python, with working knowledge of Java or Scala for data engineering applications.
- AI / Generative AI experience: Exposure to integrating LLMs into enterprise applications and data platforms, including prompt engineering, embeddings, RAG (Retrieval-Augmented Generation), vector databases, and LLM APIs.
- Agentic AI: Understanding or hands-on experience building AI agents and agentic workflows, including tool/function calling, multi-step reasoning workflows, orchestration, and integration of agents with enterprise data sources and APIs.
- AI Data Engineering: Experience preparing and managing structured/unstructured datasets for AI/ML and GenAI workloads, including data ingestion, transformation, chunking, metadata management, embeddings, and data quality/governance.
- Good to have: Exposure to frameworks and platforms such as LangChain, LangGraph, LlamaIndex, Amazon Bedrock, or Azure OpenAI for developing enterprise GenAI or Agentic AI solutions.
A place you can belong:
We celebrate the rich diversity of the communities in which we operate and are committed to creating inclusive and safe environments where all our team members can contribute and succeed. We believe that all team members should feel valued, respected, and safe irrespective of your gender, ethnicity, indigeneity, religious beliefs, education, age, disability, family responsibilities, sexual orientation and gender identity and we encourage applications from all candidates.