Big Data Engineer
At a glance
Mid-level Data Engineering role at Müller`s Solutions. Dubai.
Pay not stated Data Engineering salary
dataroles summary, based on the employer's posting.
What you'll do
- Build and look after data pipelines with Spark, Hadoop and Kafka to process large datasets reliably
- Work with data scientists, analysts and IT teams to pin down data needs and deliver suitable solutions
- Add validation and testing checks to protect data quality, then tune storage across cloud and on-premises systems
- Track processing workflows, resolve failures that delay delivery, and document architectures and operating processes
What you bring
- A relevant bachelor's degree and at least three years in big data or a comparable data engineering role
- Hands-on ability with Spark, Hadoop and Kafka, plus strong coding in Java, Scala or Python
- Experience with data processing and ETL tools, cloud platforms and storage such as HDFS, S3 or BigQuery
Who this fits
This mid-level role suits an engineer comfortable building and supporting data pipelines while working with both technical and non-technical teams. The position is on-site in Dubai.
From the employer
Müller’s Solutions is looking for an experienced Big Data Engineer to join our innovative team. In this role, you will be responsible for designing and developing scalable big data solutions that enable advanced analytics and insights across the organization. You will work with large data sets and utilize cutting-edge technologies to ensure data processing is efficient and reliable.
Key Responsibilities:
- Design, build, and maintain scalable data pipelines using big data technologies such as Apache Spark, Hadoop, and Kafka.
- Collaborate with data scientists, analysts, and IT teams to identify data requirements and deliver solutions that meet business needs.
- Ensure high data quality and integrity by implementing robust data validation and testing processes.
- Optimize data storage solutions for performance and cost-efficiency across cloud and on-premises environments.
- Monitor and troubleshoot data processing workflows to ensure timely data delivery.
- Document data architectures, processes, and workflows for knowledge sharing and compliance.
- Stay ahead of industry trends and best practices in big data technologies and methodologies.
Requirements
Requirements:
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 3+ years of experience as a Big Data Engineer or in a similar data engineering role.
- Proficiency in big data technologies such as Apache Spark, Hadoop, and Apache Kafka.
- Strong coding skills in programming languages like Java, Scala, or Python.
- Familiarity with data processing frameworks and ETL tools.
- Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and data storage solutions (e.g., HDFS, S3, BigQuery).
- Analytical mindset and excellent problem-solving abilities.
- Strong communication skills to collaborate effectively with technical and non-technical stakeholders.
- A self-motivated and proactive approach to work, with the ability to manage multiple tasks and deadlines.
Preferred Qualifications:
- Experience with machine learning frameworks and algorithms is a plus.
- Knowledge of data governance and security best practices.
- Familiarity with containerization technologies and orchestration tools like Docker and Kubernetes.
Benefits
1- Attractive Package.
2- Family Benefits.
3- Visa.
4-Air Tickets.