Quick overview
Job description
Data Quality Engineer – Azure Data Platform Testing
Overview
Seeking a seasoned Azure Data Engineer Tester to drive test strategy and ensure data quality across a large-scale Azure data platform modernization initiative. Data is a critical enterprise asset, and this role ensures accurate ingestion, transformation, storage, and reporting across cloud-based data solutions. The ideal candidate has test lead experience, strong automation skills, Agile exposure, and familiarity with P&C insurance domains.
Key Responsibilities
Test Strategy & Leadership
- Drive overall test strategy and create effective test cases and scenarios based on business and user requirements
- Define and implement test automation strategy, ensuring the right balance of manual and automated testing
- Participate in architecture, design, requirements, and code reviews; provide feedback to stakeholders
Azure Data Pipeline Testing
- Test Azure data pipelines built using services such as Microsoft Azure, Azure Data Factory, and Azure Synapse Analytics
- Validate end-to-end data movement from source to destination across batch and streaming workflows
Ensure Data Quality & Accuracy
- Validate ETL/ELT transformations across Medallion architecture layers
- Identify missing, duplicate, or incorrect data and ensure business rules are applied accurately
- Validate analytical outputs such as dashboards, reports, and data visualizations
Database & Storage Validation
- Test data stored in Azure SQL Database and Azure Data Lake Storage for integrity, reliability, and performance
- Validate schema, source-to-target mappings, and data models
Automation & Performance Testing
- Develop automated test scripts using SQL, Python, and PySpark
- Perform performance, scalability, and load testing of pipelines and data platforms
- Track defects and test cycles using Jira
Desired Skills & Competencies
Data & Technical Acumen
- Strong understanding of data warehousing concepts, star schemas, data marts, and Medallion architecture
- Ability to read data models and update source-to-target mapping documents
- Hands-on experience with Snowflake, Azure, DBT, Python, and PySpark
Industry & Methodology
- Experience working in Agile environments
- Knowledge of Property & Casualty (P&C) and Specialty Insurance is preferred
Key Responsibilities
Test Strategy & Leadership
- Drive overall test strategy and create effective test cases and scenarios based on business and user requirements
- Define and implement test automation strategy, ensuring the right balance of manual and automated testing
- Participate in architecture, design, requirements, and code reviews; provide feedback to stakeholders
Azure Data Pipeline Testing
- Test Azure data pipelines built using services such as Microsoft Azure, Azure Data Factory, and Azure Synapse Analytics
- Validate end-to-end data movement from source to destination across batch and streaming workflows
Ensure Data Quality & Accuracy
- Validate ETL/ELT transformations across Medallion architecture layers
- Identify missing, duplicate, or incorrect data and ensure business rules are applied accurately
- Validate analytical outputs such as dashboards, reports, and data visualizations
Database & Storage Validation
- Test data stored in Azure SQL Database and Azure Data Lake Storage for integrity, reliability, and performance
- Validate schema, source-to-target mappings, and data models
Automation & Performance Testing
- Develop automated test scripts using SQL, Python, and PySpark
- Perform performance, scalability, and load testing of pipelines and data platforms
- Track defects and test cycles using Jira
Bachelors Degree
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
