Haystack
← Back to Jobs
Other
AP

Automation Test Lead

ApolisAustin, TX🇺🇸United StatesPosted Oct 19, 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
Austin, TX, United States
Posted
21 hours ago
AWSScrumSeleniumAgileConfluenceGenerative AIGitHub ActionsJiraLLMPlaywrightPythonRESTTypeScript

Job Description

Automation Test Lead

Location: Austin, TX / San Diego, CA
Duration: 12 Months
Experience: 8+ Years

Job Summary

We are seeking an experienced Automation Test Lead to drive test automation strategy, lead hands-on automation development, and support release management for enterprise applications. The ideal candidate will have strong expertise in Playwright, Selenium, TypeScript, API testing, Python programming, and CI/CD pipelines, along with experience migrating automation frameworks from Selenium to Playwright.

The candidate should also have hands-on experience incorporating Generative AI (GenAI) tools into testing, validating LLM-powered applications, and coordinating releases with onshore and offshore teams.

Roles & Responsibilities

  • Define and implement test automation strategies for enterprise applications.

  • Write, enhance, maintain, and execute automated test scripts using Playwright.

  • Develop and maintain UI automation frameworks using Playwright, Selenium, and TypeScript.

  • Lead the migration of existing automation frameworks from Selenium to Playwright.

  • Perform API testing using REST Assured and other relevant testing tools.

  • Develop and maintain automated test scripts using Python and TypeScript.

  • Design and maintain CI/CD pipelines using GitHub Actions and other DevOps tools.

  • Integrate automated test suites into build and deployment pipelines.

  • Use Jira and Confluence for defect tracking, test documentation, and team collaboration.

  • Leverage GitHub Copilot and other GenAI tools to improve test automation productivity.

  • Test Generative AI applications powered by LLMs, including OpenAI, Claude, and Amazon Bedrock.

  • Perform prompt validation, model evaluation, response validation, and AI application testing.

  • Utilize AWS services to support testing and validation of AI-powered applications.

  • Coordinate release planning, release execution, validation, and post-release testing.

  • Collaborate with development, QA, DevOps, product, and offshore teams to ensure quality delivery.

  • Identify automation gaps, troubleshoot failures, and drive continuous improvements in test coverage and release quality.

  • Provide technical guidance and support to team members on automation frameworks and testing best practices.

Required Skills & Qualifications

  • 8+ years of experience in software testing and test automation.

  • Strong hands-on experience with UI automation using Playwright and Selenium.

  • Proficiency in TypeScript for developing and maintaining automation scripts.

  • Experience migrating automation frameworks from Selenium to Playwright.

  • Experience with API testing and REST Assured.

  • Proficiency in Python programming for testing and automation.

  • Hands-on experience with CI/CD pipelines, GitHub Actions, and DevOps practices.

  • Experience with GitHub, Jira, and Confluence.

  • Experience using GitHub Copilot or similar AI-assisted development tools.

  • Hands-on experience testing Generative AI applications and LLM-powered solutions.

  • Knowledge of prompt validation, model evaluation, and AI application testing.

  • Experience with OpenAI, Claude, Amazon Bedrock, and AWS services.

  • Strong analytical, troubleshooting, communication, and problem-solving skills.

  • Ability to manage releases while remaining hands-on with automation development.

  • Experience collaborating with offshore teams and distributed delivery groups.

Preferred Qualifications

  • Experience designing scalable and reusable automation frameworks.

  • Exposure to AI-assisted test generation and intelligent testing solutions.

  • Experience testing enterprise applications in cloud-based environments.

  • Knowledge of advanced API testing, test reporting, and automation performance optimization.

  • Experience leading automation initiatives and mentoring QA engineers.

  • Familiarity with Agile/Scrum methodologies and continuous delivery practices.

Key Skills

  • UI Automation: Playwright, Selenium

  • Programming: TypeScript, Python

  • API Testing: REST Assured

  • Framework Migration: Selenium to Playwright

  • Generative AI Testing: OpenAI, Claude, Amazon Bedrock

  • AI Testing: Prompt Validation, Model Evaluation, LLM Application Testing

  • CI/CD: GitHub Actions, DevOps

  • AI Coding Tools: GitHub Copilot

  • Collaboration Tools: Jira, Confluence, GitHub

  • Cloud: AWS

  • Release Management and Coordination

  • Test Strategy and Automation Framework Development

  • Offshore Team Coordination

Top 3 Required Skills

  1. UI Automation: Playwright and Selenium.

  2. GenAI Testing: Experience incorporating Generative AI tools into testing and validating LLM-powered applications.

  3. Programming and API Testing: Strong TypeScript, API testing, and Python programming skills.

Additional Requirements

  • Must be comfortable handling release activities alongside hands-on automation development.

  • Must be able to collaborate effectively with offshore teams.

  • Must be available to work in Austin, TX, or San Diego, CA, as required by the project.

Similar jobs