QA Automation Engineer with Databricks
At a glance
Mid-level Data Engineering role at Vizient. Chicago · full-time · $88,900–$155,500 base.
dataroles summary, based on the employer's posting.
What you'll do
- Build and maintain automated checks for Databricks jobs, Delta tables, views, transformations and ETL pipelines
- Check metric calculations, business rules and source-to-target transformations, including data quality across systems
- Cover full and incremental loads, updates, deletes, retries, exceptions and recovery with automated tests
- Create test data, SQL checks and reusable reconciliation tools, then connect data tests to CI/CD pipelines
- Investigate test failures, document defects and work with data engineering and platform teams on fixes
What you bring
- You can develop and maintain automated tests for Databricks data jobs and pipelines
- You can validate data transformations, business rules and data quality across systems
- You can build SQL validation queries, test data and reusable automation or reconciliation tools
Who this fits
This role suits a mid-level QA automation engineer focused on testing large-scale data solutions. It includes functional, integration, regression and end-to-end testing, with preferred work involving Stardog and knowledge graph data.
From the employer
When you’re the best, we’re the best. We instill an environment where employees feel engaged, satisfied and able to contribute their unique skills and talents while living and working as their authentic selves. We provide extensive opportunities for personal and professional development, building both employee competence and organizational capability to fuel exceptional performance through an inclusive environment both now and in the future.
Responsibilities:
Required Responsibilities
- Develop and maintain automated test suites for Databricks jobs, Delta tables, views, data transformations, and ETL pipelines.
- Validate metric calculations, business rules, aggregations, derived values, and source-to-target data transformations within Databricks.
- Perform source-to-target reconciliation and validate data completeness, accuracy, consistency, timeliness, and referential integrity across systems.
- Develop automated tests for full and incremental loads, updates, deletes, retries, exception handling, and recovery scenarios.
- Create test data, SQL validation queries, reusable utilities, and reconciliation frameworks to improve testing efficiency and coverage.
- Integrate automated data tests into CI/CD pipelines and enhance test automation frameworks and processes.
- Perform functional, integration, regression, and end-to-end testing across large-scale data solutions.
- Analyze test failures, conduct root cause analysis, document defects, and collaborate with data engineering and platform teams to resolve issues.
Preferred Responsibilities
- Validate data and integrations involving Stardog, knowledge graph platforms, and other data technologies.
- Test knowledge graph structures, ontologies, relationships, mappings, SPARQL queries, data lineage, and provenance.
Estimated Hiring Range:
At Vizient, we consider skills, experience, and organizational needs in our compensation approach. Geographic factors may adjust the range estimate and hires typically fall below the top range. Compensation decisions are tailored to individual circumstances. The current salary range for this role is $88,900.00 to $155,500.00.This position is also incentive eligible.
Vizient has a comprehensive benefits plan! Please view our benefits here:
http://www.vizientinc.com/about-us/careers
Equal Opportunity Employer: Females/Minorities/Veterans/Individuals with Disabilities
The Company is committed to equal employment opportunity to all employees and applicants without regard to race, religion, color, gender identity, ethnicity, age, national origin, sexual orientation, disability status, veteran status or any other category protected by applicable law.
Data Engineering work from LinkedIn, X, Reddit and Upwork, in one list.
Each morning you get everything that fits, strongest first.
Data Engineering$80k+
Find me workBy the team behind dataroles.