Data Engineer - GCP, SQL,BiqQuery, Dataflow, Pub/Sub, Logging, IAM
At a glance
Mid-level Data Engineering role at Hcmportal. IN - TDC 1 (IN110) · full-time.
Pay not stated Data Engineer salary
dataroles summary, based on the employer's posting.
What you'll do
- Build pipelines that bring data from varied sources into warehouses and knowledge graphs, then refine their speed and scale
- Set up data solutions with GCP services such as BigQuery, Dataflow, Pub/Sub, Cloud Storage and Composer
- Develop knowledge graph models, load their data and write queries in Neo4j or Stardog
- Apply checks and governance practices to keep data accurate, consistent and dependable
- Monitor pipeline and query performance, resolve slowdowns, and document pipelines, models and graph schemas
What you bring
- A bachelor's degree in computer science, engineering or another related quantitative field
- At least five years working as a data engineer or in a comparable role
- Practical experience with GCP data services, plus Python, SQL and data warehousing
- Experience with relational data modeling, Git or another version control system, and Terraform or other IaC tools
Who this fits
This mid-level role suits a data engineer who can build cloud data pipelines and work with knowledge graphs. You’ll collaborate with data scientists, analysts and engineering teams to turn data needs into working solutions.
From the employer
Before you apply to a job, select your language preference from the options available at the top right of this page.
Explore your next opportunity at a Fortune Global 500 organization. Envision innovative possibilities, experience our rewarding culture, and work with talented teams that help you become better every day. We know what it takes to lead UPS into tomorrow—people with a unique combination of skill + passion. If you have the qualities and drive to lead yourself or teams, there are roles ready to cultivate your skills and take you to the next level.
Job Description:
Job Description
We're seeking a talented Data Engineer with hands-on experience in the Google Cloud data ecosystem and a proven track record. You'll be instrumental in designing, building, and maintaining our data infrastructure and pipelines, enabling critical insights and supporting data-driven initiatives across the organization.
Responsibilities
Data Pipeline Development: Design, build, and optimize robust and scalable data pipelines to ingest, transform, and load data from various sources into our data warehouse and knowledge graphs.
Cloud Data Stack Expertise: Implement and manage data solutions using Google Cloud Platform (GCP) services such as BigQuery, Dataflow, Pub/Sub, Cloud Storage, Spanner and Dataproc and Azure Cloud Services
Knowledge Graph Engineering: Develop and maintain data models, ingest data, and create efficient queries within Neo4j and/or Stardog. Leverage your expertise to build and expand our enterprise knowledge graph.
Data Quality & Governance: Implement best practices for data quality, data validation, and data governance, ensuring data accuracy, consistency, and reliability.
Performance Optimization: Continuously monitor and optimize the performance of data pipelines and database queries, identifying and resolving bottlenecks.
Collaboration: Work closely with data scientists, analysts, and other engineering teams to understand data requirements and deliver effective data solutions.
Documentation: Create and maintain comprehensive documentation for data pipelines, data models, and knowledge graph schemas.
Required Qualifications
Education:
Bachelor’s degree in computer science, Engineering, or a related quantitative field.
Experience:
5+ years of professional experience as a Data Engineer or in a similar role.
Strong hands-on experience with Google Cloud Platform (GCP) data services, including BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Composer (Apache Airflow).
Proficiency in Python for data manipulation and pipeline orchestration.
Experience with SQL and data warehousing concepts.
Familiarity with data modeling techniques relational database
Experience with version control systems (e.g., Git).
Application Support
Terraform or any other IaC tools
Preferred Qualifications
Experience with other GCP services
Knowledge of streaming data technologies (e.g., Kafka, Google Cloud Dataflow streaming).
Familiarity with data governance tools and principles.
Certifications in Google Cloud Platform data engineering.
Employee Type:
UPS is committed to providing a workplace free of discrimination, harassment, and retaliation.
Data Engineering work from LinkedIn, X, Reddit and Upwork, in one list.
Each morning you get everything that fits, strongest first.
Data Engineering
Find me workBy the team behind dataroles.