Opportunity Data Engineering work from LinkedIn, X, Reddit and Upwork, in one list. Find me work
dataroles

#111 - Data Engineer

Lifted, an Upwork Company™ Open
Remote Hyderabad Contract Mid-level Data Engineering

At a glance

Mid-level Data Engineering role at Lifted, an Upwork Company™. Remote, India · contract.

Pay not stated Data Engineering salary

RoleData Engineering
SeniorityMid-level
LocationHyderabad
WorkplaceRemote
EmploymentContract
PostedOct 8, 2026
Role brief

dataroles summary, based on the employer's posting.

What you'll do

  • Move pipelines from Airflow 2 to Airflow 3, and shift Confluent connections across cloud regions
  • Convert Hive pipelines to Iceberg with Snowpark Connect, then adapt existing workflows for Snowflake
  • Keep data quality and reliability intact as you migrate datasets and update pipelines
  • Schedule and monitor Airflow workflows while coordinating time-sensitive migration work with the team

What you bring

  • At least two years working with large-scale datasets, including Airflow and Spark
  • You bring hands-on Python skills, advanced SQL, and experience building and testing Airflow pipelines
  • You have worked with Snowflake data models, Kafka, Spark and PySpark, plus Iceberg and Parquet
  • You can use AWS S3 for data lakes, partitioning and lifecycle policies, and debug and test code directly

Who this fits

This suits a hands-on engineer who can work independently and communicate clearly while delivering implementation-focused migrations. It is a remote contract role for forty hours per week, expected to run through March 31, 2027. Candidates must be in an eligible EMEA or APAC location and provide coverage through noon Pacific Time.

From the employer

We are seeking a hands-on Data Engineer to support a large-scale data platform modernization initiative. You will migrate approximately 1,000 datasets to Snowflake, adapt existing pipelines, and help deliver reliable orchestration with Apache Airflow 3. The architecture and technical approach are already defined, with the role focused on implementation and migration delivery through March 2027.

Enterprise experience strongly preferred.

Key Responsibilities

- Migrate pipelines from Apache Airflow 2 to Apache Airflow 3.

- Migrate Confluent connections between cloud regions.

- Migrate pipelines from Hive to Iceberg using Snowpark Connect.

- Adapt existing data pipelines to Snowflake while maintaining data quality and reliability.

- Support workflow scheduling and monitoring in Apache Airflow.

- Partner with the team to execute time-sensitive data migrations.

Must-Have Skills

- 2+ years of experience.

- Strong software engineering fundamentals.

- Hands-on Python development experience.

- Advanced SQL, including complex joins, CTEs, window functions, and performance tuning.

- Snowflake data modeling.

- Apache Airflow experience developing and testing pipelines in Airflow and Python.

- Apache Kafka experience.

- Apache Spark experience, including hands-on PySpark.

- Experience with Iceberg and Parquet data formats.

- AWS experience, particularly S3 data lakes, partitioning, and lifecycle policies.

- Testing strategy experience and the ability to debug and test code hands-on.

- At least 2 years of industry experience working with large-scale datasets, including Airflow and Spark.

- Strong communication skills.

- Ability to work independently.

Nice-to-Have Skills

- Hands-on Snowflake migration experience, including data warehouse modernization and performance and cost optimization.

- Apache Airflow migration experience, including version upgrades, executor changes, or platform migrations.

- Experience using AI tools for development.

Required Tools & Platforms

- Python and SQL.

- Snowflake, Apache Airflow, Apache Kafka, and Apache Spark/PySpark.

- Iceberg and Parquet.

- AWS S3.

- The migration environment also includes Confluent, Hive, and Snowpark Connect.

Location, Time & Engagement

- Open to candidates in eligible EMEA and APAC locations.

- Coverage until 12:00 PM Pacific Time is required.

- Remote contract engagement for 40 hours per week.

- Expected engagement through March 31, 2027; start date to be confirmed.

- Two openings are available.

- This is not currently a contract-to-hire opportunity.

Opportunity

Data Engineering work from LinkedIn, X, Reddit and Upwork, in one list.

Each morning you get everything that fits, strongest first.

Data EngineeringRemote

Find me work

By the team behind dataroles.

Find me work
Opportunity

Data Engineering work from LinkedIn, X, Reddit and Upwork, in one list.

Each morning you get everything that fits, strongest first.

Find me work

By the team behind dataroles.