Haystack
← Back to Jobs
Remote
Technology

Quality Engineer – AI & Test Automation

ITBMS Inc.United States🇺🇸United StatesPosted 17 Aug 2026

Why This Role Stands Out

This remote Quality Engineer role offers an exciting opportunity to leverage AI and GenAI to build cutting-edge test automation solutions, significantly impacting software quality and delivery speed. If you thrive in a hands-on development environment and are eager to expand your skills in AI-driven testing and modern automation frameworks, this position is an excellent next step in your career. Apply today to join a forward-thinking team and shape the future of quality engineering.

Quick Overview

Work Type
Remote
Level
Mid Senior

Job Description

Job Title: Quality Engineer – AI & Test Automation

Location: Remote

Duration: Long-term

 
Role Summary

The AI Automation Quality Engineer is responsible for developing intelligent and scalable test automation solutions using AI/GenAI, modern automation frameworks, and engineering practices to improve software quality, test coverage, and delivery speed.

This is a hands-on Quality Engineering and automation development role, not a primarily manual QA/testing position.

 

Key Responsibilities

  • Develop and maintain automated testing frameworks for UI, API, integration, regression, and end-to-end testing.
  • Build AI-assisted test automation using GenAI tools to generate test cases, test data, automation scripts, and validation scenarios.
  • Use AI to identify test coverage gaps, regression risks, defects, and potential failure scenarios.
  • Automate API testing for REST/SOAP services and validate integrations across enterprise applications.
  • Develop automated regression suites and integrate them into CI/CD pipelines.
  • Use AI to accelerate test-script generation, test maintenance, defect analysis, root-cause analysis, and test documentation.
  • Analyze test results, application logs, API responses, and observability data to identify root causes and troubleshoot complex issues.
  • Integrate automation with tools such as GitHub Actions, Azure DevOps, Jenkins, Datadog, and other CI/CD or observability platforms.
  • Participate in story refinement and design discussions to identify acceptance-criteria gaps, testability concerns, dependencies, and test scenarios before development begins.
  • Work closely with developers to implement shift-left testing and build automation within the sprint.
  • Design reusable automation components and maintainable test frameworks.
  • Develop and manage test data required for automated testing.
  • Provide automated quality metrics and test results to support release-readiness decisions.

Pega Testing Experience

Experience with Pega application testing is highly preferred, including:

  • Pega case-management and workflow testing
  • Pega Constellation UI
  • Case Types, Stages, Assignments, SLAs and business rules
  • Role/persona-based workflow validation
  • Pega REST/API integrations
  • End-to-end testing across Pega and downstream enterprise applications
  • PegaUnit or other Pega testing capabilities

AI / GenAI Quality Engineering

Experience or working knowledge of:

  • AI-assisted test-case generation
  • AI-assisted automation-code generation with github copilot
  • Automated test-data generation
  • AI-assisted identification of test-coverage gaps
  • AI-assisted defect/root-cause analysis
  • Using GenAI development tools to improve QE productivity
  • Testing AI/GenAI-enabled application capabilities
  • Understanding the challenges of validating non-deterministic AI-generated outputs

Must-Have Technical Skills

Programming & Automation

  • Java
  • Object-Oriented Programming
  • Selenium WebDriver/Karate
  • TestNG / JUnit
  • Page Object Model (POM)
  • XPath / CSS Selectors
  • Data-driven, Hybrid and BDD automation frameworks
  • Gherkin
  • Maven or Gradle

API & Integration Testing

  • REST Assured
  • Postman
  • SOAP UI
  • REST / SOAP
  • JSON / XML
  • HTTP methods, status codes, headers, authentication and error handling

Database

  • SQL
  • Backend/database validation
  • SQL Developer or equivalent database tools

Source Control & CI/CD

  • Git / GitHub
  • GitHub Actions
  • Jenkins and/or Azure DevOps
  • Ability to create and maintain automated test jobs/pipelines

Preferred Technical Skills

  • Playwright/Selenium/Karate
  • Groovy
  • YAML
  • VS code
  • JDK 8/17/21
  • Sauce Labs or equivalent cross-browser/cloud testing platform
  • Allure / Extent Reports / ReportNG
  • Log4j / SLF4J
  • JIRA
  • AWS or Azure
  • Observability platforms such as Datadog
  • Performance and accessibility testing

Framework / Design Knowledge

Strong understanding of automation design patterns and reusable framework development, including:

  • Page Object Model
  • Data-driven frameworks
  • Hybrid frameworks
  • BDD
  • Reusable automation components
  • Appropriate software design patterns for automation frameworks

Preferred Domain Experience

  • Pega-based enterprise applications
  • Healthcare, dental, insurance, claims, clinical, enrollment, provider, or contact-center applications
  • Java/Spring Boot APIs and microservices
  • Large-scale enterprise modernization programs

Skills

Microservices
SOAP
SQL
Spring
Spring Boot
AWS
Selenium
Azure
BDD
CSS
Datadog
Git
GitHub Actions
Groovy
HTTP
JUnit
Java
Jenkins
Jira
Playwright
Postman
REST
TestNG

Similar jobs