Data Engineer - Egypt
Remote Worldwide Mid-level Data Engineering
At a glance
Mid-level Data Engineering role at Protagona. Remote.
Pay not stated Data Engineer salary
RoleData Engineering
SeniorityMid-level
LocationWorldwide
WorkplaceRemote
Role brief
dataroles summary, based on the employer's posting.
What you'll do
- Turn business needs into technical plans for data applications, components and enhancements
- Plan project milestones, outputs and resources, then keep track of tasks as they progress
- Create design and test plans, functional documents, interface designs and process flow charts
- Build batch and real-time data pipelines or APIs with Python, SQL and cloud platforms
- Move data from on-premises systems to cloud environments and handle cloud data conversions
What you bring
- You have data engineering experience focused on analytics and reporting
- You have worked with AWS and can use SQL for transformations and database troubleshooting
- You have built custom pipelines for extracting, transforming and loading data
- You can script in Python or another scripting language
Who this fits
This remote role suits a mid-level data engineer who can adapt across client data needs and use an analytical approach to changing business requirements. The work spans pipeline development, cloud systems and project planning.
From the employer
As a Data Engineer, you will be part of a talented team of engineers responsible for the deployment and configuration of cloud resources to meet individual client business needs in AWS. Client engagements cover a wide variety of business requirements and require our engineers to adapt quickly and stay on top of recent cloud technology trends. Candidates should be able to identify and remediate issues within cloud-based systems, based on their knowledge of industry standards and best practices.
Data Engineer Responsibilities
Desired Skills & Experience
Data Engineer Responsibilities
- Work with the team to evaluate business needs and priorities, liaise with key business partners and address team needs related to data systems and management
- Translate business requirements into technical specifications; establish and define details, definitions, and requirements of applications, components and enhancements
- Participate in project planning; identifying milestones, deliverables and resource requirements; tracks activities and task execution
- Generate design, development, test plans, detailed functional specifications documents, user interface design, and process flow charts for execution of programming
- Develop data pipelines / APIs using Python, SQL, potentially Spark and AWS, Azure or GCP Methods
- Use an analytical, data-driven approach to drive a deep understanding of fast changing business
- Build large-scale batch and real-time data pipelines with data processing frameworks in AWS, Azure or GCP cloud platform
- Moving data from on-prem to cloud and cloud data conversions
Desired Skills & Experience
- Experience in data engineering with an emphasis on data analytics and reporting
- Exposure to the AWS Cloud Platform
- Experience in SQL, data transformations, and troubleshooting across at least one database Platform (Redshift, Amazon RDS, Cassandra, Snowflake, PostgreSQL, Databricks, etc.)
- Experience in the design and build of data extraction, transformation, and loading processes by writing custom data pipelines
- Experience in a scripting language such as Python
- Experience designing and building solutions utilizing various Cloud services such as EC2, S3, EMR, Kinesis, RDS, Redshift/Spectrum, Lambda, Glue, Athena, API gateway, etc.
Data Engineering work from LinkedIn, X, Reddit and Upwork, in one list.
Each morning you get everything that fits, strongest first.
Data EngineeringRemote
Find me workBy the team behind dataroles.