Quick overview
Job description
Location:Orlando,FL
The DX US Parks Agentic Experiences team builds AI-powered conversational experiences that help guests discover and plan Disney parks vacations. You will be the primary contributor to our UI automation suite and help us test a product whose answers change from run to run. You will work within the Product team, collaborating daily with product managers, engineers, and content owners.
What You Will Do- Learn the product deeply (features, guest journeys, business rules) and become a go-to voice on how it should behave.
- Turn Gherkin user stories, acceptance criteria, and business rules into Playwright + TypeScript tests.
- Flag gaps or ambiguity in stories before they are built.
- Build and maintain end-to-end tests across full guest journeys.
- Design checks for non-deterministic agent responses (rule-based and semantic assertions, eval datasets) instead of exact-string matching.
- Build reusable fixtures, authentication setup, helpers, and test data.
- Validate what guests see against API responses, using request interception and mocks where appropriate.
- Run automated suites in Jenkins and Harness CI/CD pipelines.
- Triage failures to root cause (application, automation, environment, or test data) and file clear, reproducible defects.
- Use AI coding and agent tools every day to write, refactor, and maintain tests faster, and share what works with the team.
- Strong Playwright and TypeScript skills, with an end-to-end suite you built and maintained in production.
- Experience testing AI or LLM-powered products, including strategies for non-deterministic output.
- Hands-on, demonstrable use of AI tools (e.g., Claude, Copilot, Cursor) to speed up test authoring and maintenance. Be ready to show examples.
- Fluency with Gherkin, acceptance criteria, and business rules, and the ability to pick up a complex business domain quickly.
- API testing experience, including request interception and mocking.
- Experience integrating test suites into Jenkins and/or Harness CI/CD.
- Clear written communication and comfort working directly with product, not only engineering.
- LLM evaluation or observability tools (e.g., Arize, Phoenix, LangSmith, Promptfoo).
- Travel, hospitality, or e-commerce booking flows.
- Accessibility or visual regression testing.
- Building agent- or MCP-driven test tooling.
Similar jobs
- SE

Manager, Quality Assurance - Analytical and Client ServicesRecently posted Auto Apply
Seranbio · Bend · On-site · Posted 15 Nov 2026 🇺🇸
Microsoft OfficeComplianceContinuous Improvement+4Salary not listed - CH

QA/Expeditor - Muskogee Chili'sRecently posted Auto Apply
Chili's · Muskogee · Hybrid · Posted 15 Nov 2026 🇺🇸
Salary not listed - DE
QA EngineerRecently posted
DTEL Engineering & Consultants Inc · Buffalo, NY · Hybrid · Posted 15 Nov 2026 🇺🇸
SQLAWSSelenium+8TechnologySalary not listed - HG

Quality Assurance AnalystRecently posted
HTC Global Services Inc · Columbia, South Carolina · Hybrid · Posted 27 Oct 2026 🇺🇸
Project ManagementTechnologySalary not listed - BF
Senior QA Engineer - Digital Asset PlatformRecently posted
BC Forward · New York · On-site · Posted 16 Nov 2026 🇺🇸
MicroservicesSmart ContractsGenerative AI+2Technology$58/hr - 4C
Software Quality Assurance Analysts and TestersRecently posted
4Ci · Plano, Texas · Remote · Posted 16 Nov 2026 🇺🇸
SQLAzureJira+2TechnologySalary not listed - NG

Senior Principal Test & Evaluation Engineer with Security ClearanceRecently posted
Northrop Grumman · Melbourne, FL · Hybrid · Posted 15 Nov 2026 🇺🇸
5GEngineering$111.7k - $167.5k/yr - NA

Manager Quality Assurance and Regulatory AffairsRecently posted Auto Apply
Natera · US Remote · Remote · Posted 13 Nov 2026 🇺🇸
CompliancePharmacyRegulatory Compliance+2$112.1k - $150k/yr - CH

QA/Expeditor - Justin Road Chili'sRecently posted Auto Apply
Chili's · Flower Mound · Hybrid · Posted 14 Nov 2026 🇺🇸
Salary not listed - EN

Test Engineer with Security ClearanceRecently posted
Encode · Saint Louis, MO · Hybrid · Posted 13 Nov 2026 🇺🇸
ConfluenceJiraAgileTechnologySalary not listed - TH
Software Tester/QA Analyst 3Recently posted Auto Apply
TOMORROW HIRE · Glen Allen, Virginia · Hybrid · Posted 15 Nov 2026 🇺🇸
Case ManagementPlaywrightProcess Improvement+1Technology$34 - $54/hr - IT
Software Tester/QA AnalystRecently posted
isolve technology inc · Richmond, VA · Hybrid · Posted 13 Nov 2026 🇺🇸
JiraTechnologySalary not listed
