Back to Jobs
Recently postedTechnology

SDET / Data Test Automation Engineer

Code Beacons IncCharlotte, NC🇺🇸United States

Quick overview

SeniorityMid Senior
Work modeHybrid
LocationCharlotte, NC, United States
SQLGitApache SparkAWSETLScrumSnowflakeDatabricksGitHub ActionsHadoopHiveJenkinsPostmanPythonpytestRESTAzureJiraAgileCI/CDAzure DevOpsAzure Data Factory

Job description

Title: SDET / Data Test Automation Engineer

Location: Charlotte, NC (Hybrid)

Duration: Long-term Contract

Job Description:

  • SDET and Test Automation Engineer, focused on data engineering and data warehouse testing in enterprise and financial-services environments.
  • Strong hands-on experience validating ETL and ELT pipelines end-to-end. This covers source-to-target mapping checks, data completeness, accuracy, and transformation rules, duplicate and null checks, schema validation, and reconciliation between source systems, staging, and target layers.
  • Builds PySpark-based test automation frameworks that validate large datasets in distributed environments, using DataFrame comparisons, row-count and checksum reconciliation, and rule-based data quality checks at scale.
  • Skilled in Python and SQL for writing test scripts, complex validation queries, and reusable utilities. Uses PyTest for test organization, fixtures, parameterization, and reporting.
  • Has tested data pipelines built on Spark, Hive, Hadoop/HDFS, Databricks, and Snowflake.
  • Familiar with ELT patterns on cloud data platforms (AWS S3/Glue/EMR, Azure Data Factory/ADLS).
  • Applies data quality frameworks such as Great Expectations or custom PySpark rule engines, covering threshold checks, referential integrity, SCD Type 1/2 validation, and incremental/CDC load testing.
  • Integrates automated data tests into CI/CD pipelines (Jenkins, GitHub Actions, Azure DevOps) so data releases get shift-left validation and regression coverage.
  • Experienced with API testing (REST Assured, Postman, Python requests) for data ingestion services. Does performance and volume testing of batch jobs.
  • Works in Agile/Scrum teams with data engineers, BAs, and product owners. Writes test strategies and test plans and maintains RTMs. Tracks defects in JIRA, and test cases in Zephyr/qTest/ALM.
  • Strong analytical and communication skills. Can find the root cause of data issues across pipeline layers and explain the impact to both technical and business stakeholders.

Will your resume get past this employer's screening? Check your resume against this job, free

Similar jobs