Big Data Engineer
At a glance
Mid-level Data Engineering role at Inetum. Lisbon · full-time.
Pay not stated Data Engineering salary
dataroles summary, based on the employer's posting.
What you'll do
- Run and monitor Hadoop data lakes, responding to advanced incidents and tuning components when performance issues arise
- Protect HDFS data through replication checks and capacity planning, while automating health and node alerts
- Bring new workloads onto the platform with data and platform teams, choosing suitable resource allocations
- Apply platform patches and configuration updates, and manage Kerberos, access policies and TLS protection
- Coordinate with storage, network and security teams to improve throughput and access controls, while maintaining cluster documentation
What you bring
- A bachelor’s degree in computer science or an equivalent qualification
- At least five years in a comparable big data engineering role
- Strong practical command of Hadoop operations, data lake services, query engines, platform monitoring and distributed-system security
- You can investigate and fix difficult issues in big data environments, and communicate effectively across teams
- English proficiency at B2 to C1 level
Who this fits
This mid-level, full-time role suits an experienced engineer focused on Hadoop platform operations, reliability and security. It is based on-site in Lisbon.
From the employer
Inetum is a European leader in digital services. Inetum’s team of 28,000 consultants and specialists strive every day to make a digital impact for businesses, public sector entities and society. Inetum’s solutions aim at contributing to its clients’ performance and innovation as well as the common good.
Present in 19 countries with a dense network of sites, Inetum partners with major software publishers to meet the challenges of digital transformation with proximity and flexibility.
Driven by its ambition for growth and scale, Inetum generated sales of 2.5 billion euros in 2023.
Inetum is seeking a seasoned Big Data Engineer to join our team and support the operations of our Hadoop-based data lake environments. This is a critical role for ensuring the performance, reliability, and security of our big data infrastructure.
Key Responsibilities
- Operate, monitor, and support Hadoop-based data lake platforms.
- Provide L3 incident response, deep troubleshooting, and performance tuning for big data components.
- Ensure data integrity, replication, and capacity management within HDFS clusters.
- Develop and automate monitoring and alerting for service health and node performance.
- Collaborate with platform and data teams to onboard new workloads with optimal resource allocation.
- Apply patches, upgrades, and configuration changes to maintain platform security and stability.
- Manage Kerberos authentication, Ranger/Sentry policies, and TLS encryption.
- Work with storage, network, and security teams to optimize throughput and access controls.
- Maintain cluster documentation and share knowledge across teams.
- Bachelor’s degree in Computer Science or equivalent.
- Minimum 5 years of experience in a similar role.
- Strong expertise in:
- Hadoop Ecosystem & Data Lake Operations
- Big Data Services & Query Engines
- Security & Access Control in Distributed Environments
- Monitoring, Automation & Platform Lifecycle Management
- Proven ability to diagnose and resolve complex issues in Big Data environments.
- Strong communication skills to collaborate with cross-functional teams.
- English proficiency: B2-C1 level
Nice to Have:
- Big Data certifications (e.g., Cloudera).
- Familiarity with Kafka, NiFi, or Flume for ingestion pipelines.
- Knowledge of ITIL processes for incident and change management.