Haystack
← Back to Jobs
Remote
Technology
VI

QA Automation Engineer (Exp-10 Years) with AI, Cypress, BDD/Gherkin)- Full time-Remote

Visionary Innovative Technology SolutionsUnited States🇺🇸United StatesPosted 1 Sept 2026

Quick Overview

Seniority
Mid Senior
Work mode
Remote
Location
United States
Posted
Yesterday
SQLAWSScrumAgileAzureBDDCucumberCypressGitGitHub ActionsHTTPJWTJavaScriptJenkinsLLMPostmanRESTTypeScript

Job Description

We are looking for a highly experienced Senior QA Automation Engineer with 10+ years of experience in software quality assurance, test automation, and framework development. The ideal candidate will have strong hands-on expertise with Cypress, JavaScript/TypeScript, BDD, Gherkin, API automation, CI/CD, and modern AI/GenAI testing technologies.

The candidate will be responsible for designing and implementing scalable automation frameworks, developing end-to-end test strategies, integrating automated tests into CI/CD pipelines, and validating applications that leverage AI/LLMs, APIs, and intelligent automation.

Mandatory Skills

  • 10+ years of experience in QA Automation / Software Testing
  • Strong hands-on experience with Cypress
  • Strong knowledge of JavaScript and/or TypeScript
  • Strong experience with BDD and Gherkin
  • Experience with Cucumber or Cucumber-style BDD frameworks
  • Expertise in UI and API automation testing
  • Experience designing and maintaining automation frameworks
  • Strong knowledge of REST APIs
  • Experience with Postman, REST Assured, or similar API testing tools
  • Strong experience with SQL/database testing
  • Experience with Git and CI/CD
  • Hands-on experience with Jenkins, GitHub Actions, Azure DevOps, or similar
  • Experience testing AI/GenAI/LLM-based applications
  • Strong understanding of Agile/Scrum methodologies

Key Responsibilities

  • Design, develop, and maintain robust Cypress-based automation frameworks for web applications.
  • Create reusable automation components using JavaScript/TypeScript.
  • Develop BDD scenarios using Gherkin syntax and maintain feature files, step definitions, hooks, and reusable test components.
  • Collaborate with developers, product owners, business analysts, and other QA engineers to define test scenarios and acceptance criteria.
  • Implement comprehensive UI, API, integration, regression, smoke, and end-to-end automation.
  • Develop automated tests for RESTful APIs and validate request/response payloads, status codes, headers, authentication, and error handling.
  • Integrate automated test suites into CI/CD pipelines for continuous quality validation.
  • Analyze test failures, perform root-cause analysis, and work with development teams to resolve defects.
  • Establish automation standards, coding guidelines, reusable utilities, and framework best practices.
  • Perform cross-browser and end-to-end testing across modern web applications.
  • Develop test data strategies and validate application data using SQL/database queries.
  • Participate in sprint planning, backlog refinement, daily stand-ups, retrospectives, and defect triage.
  • Mentor junior QA engineers and provide technical guidance on automation best practices.

AI / GenAI Testing Responsibilities

  • Design and execute automated testing strategies for AI/GenAI/LLM-powered applications.
  • Validate AI-driven features including chatbots, virtual assistants, AI agents, RAG applications, and intelligent automation workflows.
  • Test LLM responses for accuracy, consistency, relevance, completeness, and hallucination.
  • Develop test scenarios for different prompts, contexts, edge cases, and adversarial inputs.
  • Validate AI application behavior across different prompts and datasets.
  • Automate regression testing for AI/LLM-based features.
  • Validate prompt engineering workflows, response formatting, structured JSON outputs, and API integrations.
  • Test RAG-based applications by validating retrieval accuracy, context relevance, and generated responses.
  • Work with development teams to establish AI quality metrics and evaluation criteria.
  • Support testing of integrations with AI platforms such as OpenAI, Azure OpenAI, AWS Bedrock, Anthropic Claude, or Google Gemini.
  • Explore and utilize AI-assisted testing and coding tools such as GitHub Copilot, Claude, ChatGPT/OpenAI, and other GenAI tools.
  • Identify opportunities to leverage AI for test-case generation, test-data generation, defect analysis, automation code generation, and test optimization.

Cypress Automation

  • Build scalable automation frameworks using Cypress.
  • Develop reusable custom commands, fixtures, utilities, assertions, and page/component abstractions.
  • Implement data-driven and parameterized testing.
  • Configure Cypress for multiple environments.
  • Execute parallel and headless test runs.
  • Integrate Cypress execution with CI/CD pipelines.
  • Generate test reports and analyze automation results.
  • Maintain stable and reliable automated regression suites.

BDD / Gherkin

  • Develop business-readable scenarios using Given / When / Then syntax.
  • Convert business requirements and acceptance criteria into executable test scenarios.
  • Maintain feature files and reusable step definitions.
  • Implement scenario outlines, examples, tags, hooks, and background sections.
  • Collaborate with business and development teams using Behavior-Driven Development (BDD) practices.
  • Ensure traceability between requirements, BDD scenarios, automated tests, and defects.

API Testing

  • Automate REST and HTTP-based APIs.
  • Validate JSON/XML request and response payloads.
  • Perform positive, negative, boundary, and error-condition testing.
  • Validate authentication mechanisms including OAuth2, JWT, and API keys.
  • Perform API integration and contract testing.
  • Use tools such as Postman, REST Assured, Cypress API testing, or similar frameworks.

Similar jobs