Quick overview
Job description
Job at a Glance
- Title: Senior QA Automation Engineer
- Location: Orlando, FL | Glendale, CA | Anaheim, CA
- Contract: Through March 2027, likelihood of extension of up to 22 months
- Pay: $70.00/hour + optional medical, dental, vision, 401(k) match
Our Client is seeking a Senior QA Tester to support a product team building AI-powered conversational experiences that help guests discover and plan theme park vacations. This role will be a primary contributor to the UI automation suite, with a strong emphasis on Playwright, TypeScript, end-to-end testing, and strategies for validating non-deterministic AI/LLM responses.
The ideal candidate has built and maintained production automation suites and is comfortable working directly with product managers, engineers, and content owners to translate Gherkin stories, acceptance criteria, and business rules into reliable automated tests.
Key Responsibilities
- Become deeply familiar with product features, guest journeys, and business rules and serve as a knowledgeable voice on expected product behavior.
- Translate Gherkin user stories, acceptance criteria, and business rules into automated Playwright and TypeScript tests.
- Identify gaps and ambiguity in requirements before functionality is built.
- Build and maintain end-to-end automated tests covering complete guest journeys.
- Design rule-based, semantic, and evaluation-dataset approaches for testing non-deterministic AI/agent responses rather than relying on exact-string matching.
- Develop reusable fixtures, authentication setup, helpers, and test data.
- Validate UI experiences against API responses and use request interception and mocking where appropriate.
- Execute automated test suites through Jenkins and Harness CI/CD pipelines.
- Triage failures to determine whether root causes originate from the application, automation, environment, or test data.
- Document clear, reproducible defects.
- Use AI coding and agent tools to accelerate test creation, refactoring, and maintenance, and share effective approaches with the team.
- Strong hands-on Playwright and TypeScript skills, including experience building and maintaining a production end-to-end automation suite.
- Experience testing AI- or LLM-powered products and designing tests for non-deterministic output.
- Demonstrable hands-on use of AI coding tools such as Claude, Copilot, or Cursor to accelerate test authoring and maintenance.
- Fluency with Gherkin, acceptance criteria, and business rules.
- Ability to quickly understand complex product domains and guest journeys.
- API testing experience, including request interception and mocking.
- Experience integrating or running automated test suites within Jenkins and/or Harness CI/CD.
- Strong written communication and ability to work directly with product stakeholders in addition to engineering.
- Bachelor's degree required
- Experience with LLM evaluation or observability tools such as Arize, Phoenix, LangSmith, or Promptfoo.
- Experience testing travel, hospitality, e-commerce, or booking workflows.
- Accessibility testing experience.
- Visual regression testing experience.
- Experience building agent- or MCP-driven test tooling.
Why Should I Apply?
This role offers the opportunity to work at the intersection of modern QA automation and generative AI. You will own meaningful portions of a Playwright/TypeScript automation suite while solving a newer testing challenge: determining how to reliably validate conversational AI experiences whose responses can legitimately vary between runs. The position also offers direct collaboration with product, engineering, and content stakeholders and encourages practical use of AI development tools.
About CEI
As a trusted technology partner, CEI delivers solutions that help our customers transform their business and achieve meaningful results. From strategy and custom application development through application management - our technology and digital experience services are tailored to meet each unique need of our customers. Our staffing solutions bring specialized skills to complement our customers' workforce and project requirements.
#ZR
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- BC
Software Test EngineerRecently posted
Boeing Company · Berkeley, MO · Hybrid · Posted 19 Nov 2026 🇺🇸
FiberMicrosoft OfficeGit+4Technology$136.8k - $185.2k/yr - GL

QA Automation Engineer - HBITS-08-15121Recently posted
GreyCell Labs, Inc · Albany, NY · On-site · Posted 19 Nov 2026 🇺🇸
SQLSeleniumC#+8TechnologySalary not listed - TE

Data Networking-QA (Testing & Automation) (ONLY W2)Recently posted
Tekfortune Inc. · San Jose, CA · Hybrid · Posted 19 Nov 2026 🇺🇸
ShellBashGo+4Salary not listed - EW

Upcoming Opportunity - Senior Staff Software Engineer - Test (SDET) - PazeRecently posted
Early Warning Services, LLC · Scottsdale, AZ · Hybrid · Posted 20 Nov 2026 🇺🇸
RubySQLSwift+17Technology$144k - $180k/yr - AG

Test EngineerRecently posted
ApTask Global Workforce · Redmond, WA · Hybrid · Posted 20 Nov 2026 🇺🇸
Technology$77/hr - HA

Sr. Specialist, Integration/Test EngineeringRecently posted
Harris Corporation · Palm Bay, FL · Hybrid · Posted 19 Nov 2026 🇺🇸
Background ChecksTechnologySalary not listed - GE

Quality Engineer - OnsiteRecently posted
Genesis10 · Portage, MI · On-site · Posted 19 Nov 2026 🇺🇸
GD&TEngineering$30 - $40/hr - LE

Software Quality Assurance Manager - Information TechnologyRecently posted
Leidos · Huntsville, Alabama · Hybrid · Posted 20 Nov 2026 🇺🇸
Project ManagementTechnologySalary not listed - CH

QA/Expeditor - Deptford Chili'sRecently posted Auto Apply
Chili's · Deptford · Hybrid · Posted 20 Nov 2026 🇺🇸
Salary not listed - TP
SDET/QA Automation EngineerRecently posted
Tech Pundits · CA · Hybrid · Posted 19 Nov 2026 🇺🇸
AWSSeleniumAngular+9TechnologySalary not listed - TH

Contract Test EngineerRecently posted
The Hollister Group · Boston, Massachusetts · Hybrid · Posted 20 Nov 2026 🇺🇸
AgileTechnology$65 - $70/hr - PS

Mid-Level Test Engineer, TS/SCI w/MD poly required with Security ClearanceRecently posted
Power3 Solutions · Hanover, MD · Hybrid · Posted 19 Nov 2026 🇺🇸
GitSeleniumConfluence+5Technology$150k - $200k/yr
