Test Automation Specialist | 100% Remote

Test Automation Specialist
Remote

Job Summary

We are seeking a Test Automation Specialist to design, build, and support AI-driven test automation solutions. This role combines deep Playwright automation expertise with AI Agent development, LLM evaluation, and automation framework architecture to support enterprise-wide QA modernization initiatives.

Key Responsibilities

• Design and maintain Playwright automation frameworks.
• Create UI, API, Database, and End-to-End automated tests.
• Build AI agents and orchestration workflows for automation assets.
• Define coding standards and framework best practices.
• Integrate automation into CI/CD pipelines.
• Establish AI evaluation frameworks and quality metrics.
• Package and distribute reusable automation solutions.
• Provide technical leadership and mentoring.
• Ensure AI governance, security, and compliance standards.

Mandatory Skills

• 9+ years of Software Testing experience
• 6+ years of Test Automation Framework Design
• AI Agents / LLM-based Tools Development
• GitHub Copilot Custom Agents & Instructions
• Playwright (TypeScript Preferred)
• TypeScript, Python, and Java
• Prompt Engineering & LLM Concepts
  • Context Management
  • Tool Calling
  • Retrieval/Grounding
  • LLM Failure Analysis
• AI/LLM Evaluation Frameworks
• CI/CD (Jenkins, Azure DevOps)
• Git, GitHub, Bitbucket
• Framework Architecture & Shared Tool Development
• SDLC, STLC & Agile Methodologies
• Strong Communication & Technical Leadership