Senior Data Engineer
At a glance
Senior Data Engineering role at PTTEP. Bangkok.
Pay not stated Data Engineer salary
dataroles summary, based on the employer's posting.
What you'll do
- Design and build scalable systems for storing, moving and transforming data, with connections to analytics platforms
- Set data flows for digital products and guide IT teams on architecture, data models and metadata practices
- Gather business insight needs, turn them into data structures, and make sure development teams can access relevant data
- Test data models and establish practices for profiling, quality, transformation, mining and protection
- Review analytics outcomes and project efficiency, then recommend improvements
What you bring
- A bachelor’s degree in computer science, statistics or another related technical discipline
- At least five years working with advanced data management systems and master data management
- Experience building high-volume data staging and ETL applications, with advanced SQL and Python skills
- Familiarity with pandas, scikit-learn, matplotlib, numpy, dash and data analytics tools such as BigQuery, Kafka or Airflow
Who this fits
This senior data engineering role suits someone who can connect data architecture and engineering work with business insight needs. You’ll work with IT, database teams, initiative leaders and development teams.
From the employer
Job Purpose
Data Engineer is responsible for handling the design and construction of scalable data management system including data storage, data piping, ETL and interfacing with analytics platforms. The jobholder needs to manage all data aspects related to public cloud solution, data lake, data warehouse, reporting, etc. The job holder is also required to participate in gathering data requirements, modelling, and testing as well as define flow of data in a project from input through to storage including interfaces with analytics tools or end user software.
Key Accountabilities
- Providing technical guidance related to data architecture, data models and meta data management to IT function and imitative leaders
- Define and implement data flows through/ and around digital products
- Participate in data modeling and testing to ensure smooth operations
- Extract relevant data to solve analytical problems, and ensure development teams have the required data
- Interact with the initiative leaders to understand all data requirements used for business insights development, and translates into data structures and data model requirements to IT function
- Develop set processes for data profiling, data quality, data transformation, data mining and data protection.
- Work closely with database teams on topics related to data requirements, cleanliness, accuracy, and etc.,
- Track analytics impact on business, and provide recommendation for better result
- Monitor market watch, and provide recommendation to improve efficiency of current projects
Professional Knowledge & Experiences
- Bachelor’s Degree in computer science, statistics, or related technical discipline
- 5+ years’ experience with advanced data management system and master data management
- Experience in developing applications in high volume data staging/ ETL environments and proficient in advanced SQL skills, Python programming and familiar with pandas scikit-learn, matplotlib, numpy, dash library.
- Experience in using Data Analytics products such as BigQuery, Apache Kafka, Apache Airflow, Cloud Storage, etc.
- Clear understanding in different data domains of operations, customers, etc.
- Ability to quickly learn new technologies