Data Engineer (GCP, Azure)
Artefact Open At a glance
Mid-level Data Engineering role at Artefact. Pune · full-time.
Pay not stated Data Engineer salary
dataroles summary, based on the employer's posting.
What you'll do
- Build and tune data pipelines that move information between systems, using Python and SQL for ETL work
- Keep databases reliable and create ways to store and retrieve data
- Use Azure, GCP or AWS to design and deploy data solutions that can scale
- Work with teams to add machine-learning models to pipelines and process data with Spark and Kafka
What you bring
- You are proficient in Python, SQL and database management
- You have experience with ETL pipelines, cloud services, machine-learning modeling, Spark and Kafka
- You bring strong problem-solving ability and communicate well with teammates and stakeholders
- You have business acumen and an interest in roles that face business teams
Who this fits
This role suits a mid-level data engineer who can work across pipeline development, cloud platforms and real-time processing. You’ll collaborate with teams and stakeholders in a business-facing setting. The role is based in Pune, India.
From the employer
Artefact is a new generation of data service providers specialising in data consulting and data-driven digital marketing. It is dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we’re enjoying skyrocketing growth.
The backbone of our consulting missions, today our Data consulting team has more than 400 consultants covering all Artefact's offers (and more): data marketing, data governance, strategy consulting, product owner…
What you will be doing?
As a Data Engineer, your role involves crafting and maintaining robust data pipelines, utilising Python and SQL, to ensure efficient extraction, transformation, and loading (ETL) of data.
Your responsibilities will include:
- Data Pipeline Development: Building and optimising data pipelines to facilitate seamless data flow across systems and platforms.
- Database Management: Managing databases, ensuring their integrity, and implementing data storage and retrieval solutions.
- Cloud Services Integration: Leveraging cloud services such as MS Azure, GCP, and AWS to architect and deploy scalable data solutions.
- Machine Learning Integration: Collaborating with teams to integrate machine learning models into data pipelines for enhanced data processing.
- Utilising Spark & Kafka: Implementing and working with Spark and Kafka for real-time data processing and analytics.
What we are looking for?
- Proficiency in Python, SQL, and database management.
- Experience with Data Pipelines ETL, Cloud Services (MS Azure, GCP preferred), ML Modeling, Spark & Kafka.
- Proven problem-solving skills and a solution-oriented mindset.
- Excellent communication skills to collaborate effectively within teams and with stakeholders.
- Strong business acumen with an interest in business-facing roles.
- Adaptability and a start-up mentality to thrive in a dynamic environment.
- Candidates with similar skill sets and experiences have excelled in technology firms or consultancy firms.
- Successful candidates often possess Computer Science, Electronics, and Communication Engineering degrees.
Data Engineering work from LinkedIn, X, Reddit and Upwork, in one list.
Each morning you get everything that fits, strongest first.
Data Engineering
Find me workBy the team behind dataroles.