Quality Engineer – AI & Test Automation

Position: Quality Engineer – AI & Test Automation

Duration: Long Term

Location: Atlanta or San Francisco (Preferred)

Remote: Candidates can work remotely but must work in the PST time zone. 

Skill Matrix to be filled by Candidates 

Role Summary

The AI Automation Quality Engineer is responsible for developing intelligent and scalable test automation solutions using AI/GenAI, modern automation frameworks, and engineering practices to improve software quality, test coverage, and delivery speed.

This is a hands-on Quality Engineering and automation development role, not a primarily manual QA/testing position.

Key Responsibilities

·       Develop and maintain automated testing frameworks for UI, API, integration, regression, and end-to-end testing.

·       Build AI-assisted test automation using GenAI tools to generate test cases, test data, automation scripts, and validation scenarios.

·       Use AI to identify test coverage gaps, regression risks, defects, and potential failure scenarios.

·       Automate API testing for REST/SOAP services and validate integrations across enterprise applications.

·       Develop automated regression suites and integrate them into CI/CD pipelines.

·       Use AI to accelerate test-script generation, test maintenance, defect analysis, root-cause analysis, and test documentation.

·       Analyze test results, application logs, API responses, and observability data to identify root causes and troubleshoot complex issues.

·       Integrate automation with tools such as GitHub Actions, Azure DevOps, Jenkins, Datadog, and other CI/CD or observability platforms.

·       Participate in story refinement and design discussions to identify acceptance-criteria gaps, testability concerns, dependencies, and test scenarios before development begins.

·       Work closely with developers to implement shift-left testing and build automation within the sprint.

·       Design reusable automation components and maintainable test frameworks.

·       Develop and manage test data required for automated testing.

·       Provide automated quality metrics and test results to support release-readiness decisions. 

Pega Testing Experience

Experience with Pega application testing is highly preferred, including:

·       Pega case-management and workflow testing

·       Pega Constellation UI

·       Case Types, Stages, Assignments, SLAs and business rules

·       Role/persona-based workflow validation

·       Pega REST/API integrations

·       End-to-end testing across Pega and downstream enterprise applications

·       PegaUnit or other Pega testing capabilities 

AI / GenAI Quality Engineering

Experience or working knowledge of:

·       AI-assisted test-case generation

·       AI-assisted automation-code generation with github copilot

·       Automated test-data generation

·       AI-assisted identification of test-coverage gaps

·       AI-assisted defect/root-cause analysis

·       Using GenAI development tools to improve QE productivity

·       Testing AI/GenAI-enabled application capabilities

·       Understanding the challenges of validating non-deterministic AI-generated outputs 

Must-Have Technical Skills

Programming & Automation

·       Java

·       Object-Oriented Programming

·       Selenium WebDriver/Karate

·       TestNG / JUnit

·       Page Object Model (POM)

·       XPath / CSS Selectors

·       Data-driven, Hybrid and BDD automation frameworks

·       Gherkin

·       Maven or Gradle

API & Integration Testing

·       REST Assured

·       Postman

·       SOAP UI

·       REST / SOAP

·       JSON / XML

·       HTTP methods, status codes, headers, authentication and error handling

Database

·       SQL

·       Backend/database validation

·       SQL Developer or equivalent database tools

Source Control & CI/CD

·       Git / GitHub

·       GitHub Actions

·       Jenkins and/or Azure DevOps

·       Ability to create and maintain automated test jobs/pipelines

Preferred Technical Skills

·       Playwright/Selenium/Karate

·       Groovy

·       YAML

·       VS code

·       JDK 8/17/21

·       Sauce Labs or equivalent cross-browser/cloud testing platform

·       Allure / Extent Reports / ReportNG

·       Log4j / SLF4J

·       JIRA

·       AWS or Azure

·       Observability platforms such as Datadog

·       Performance and accessibility testing

Framework / Design Knowledge

Strong understanding of automation design patterns and reusable framework development, including:

·       Page Object Model

·       Data-driven frameworks

·       Hybrid frameworks

·       BDD

·       Reusable automation components

·       Appropriate software design patterns for automation frameworks

Preferred Domain Experience

·       Pega-based enterprise applications

·       Healthcare, dental, insurance, claims, clinical, enrollment, provider, or contact-center applications

·       Java/Spring Boot APIs and microservices

·       Large-scale enterprise modernization programs

Alchemy: Transforming Your Professional Vision into Reality

Since our inception in 2013, Alchemy has been dedicated to reshaping organizational performance through innovative IT services. With a vision to empower businesses seeking a transformative edge, we’ve positioned ourselves at the forefront of digitization and software modernization.

Our name reflects our mission: to transmute technology into gold-standard solutions for our esteemed clients. We proudly serve a diverse range of sectors, including IT and ITES, BFSI, Telecom and Media, Automotive, Manufacturing, Energy, Oil and Gas, Real Estate, Retail, Healthcare, and more.

With a global footprint spanning the USA, India, Europe, Canada, Singapore, Japan, and parts of Central and West Africa, we harness a unique blend of competencies, frameworks, and cutting-edge technologies. Together, we drive growth and innovation across industries, helping organizations turn their visions into reality.

Alchemy – Connecting Talent with Opportunities (Diversity, Equity and Inclusion)