Data & Analytics Principal Consultant
At a glance
Senior Data Analysis & BI role at NTT DATA. Bangalore.
Pay not stated Data Analysis & BI salary
dataroles summary, based on the employer's posting.
What you'll do
- Convert Informatica sessions, mappings and parameters into Python EL scripts and dbt models with matching behavior
- Load billion-row tables into the warehouse through Python EL pipelines and the named database and bulk-export tools
- Build layered dbt models with macros, incremental processing and snapshots, then test them with dbt and Python
- Use Airflow to run the Python EL and dbt work, and help maintain GitLab CI/CD checks and NAS deployment
- Review code, troubleshoot performance and row-count differences during SIT and UAT, and write runbooks and handover notes
What you bring
- You bring hands-on skill assessing Informatica sessions, mappings and parameter settings for migration
- You can build Python EL pipelines and dbt transformations, including tests for correctness and data quality
Who this fits
This senior consulting role suits someone focused on migrating Informatica workflows and validating data pipelines. The role is based in Bangalore, India.
From the employer
Key Responsibilities
• Assess complex Informatica workflows including sessions, mappings, and parameterizations and translate them into equivalent Python EL scripts and dbt transformation models.
• Develop and maintain Python EL pipelines to land high-volume data, including billion-row tables, into the target warehouse using SQLAlchemy, cx_Oracle, pyodbc, and bulk export tools such as Oracle Data Pump and SQL Server BCP.• Design and develop dbt transformation models based on Informatica mapping logic, incorporating dbt best practices including model layering, macros, incremental strategies, and snapshot patterns.
• Develop dbt-native tests as well as custom Python unit tests to validate transformation correctness and data quality.
• Develop Airflow DAGs to orchestrate Python EL and dbt scripts end-to-end, producing output that is functionally equivalent to the source Informatica workflows.
• Contribute to GitLab CI/CD pipeline for dbt and Airflow code, including lint gates, automated testing, and deployment to shared NAS.
• Perform peer code reviews and provide constructive technical feedback to fellow engineers.
• Troubleshoot performance issues and data discrepancies during SIT and UAT, including row-count reconciliation between source Oracle/SQL Server systems and the target warehouse.
• Contribute to technical documentation, runbooks, and handover materials.