Test Automation Architect – Change Agent

Job Description: Test Automation Architect – Change Agent

Location: Philadelphia, PA
Experience: 10+ Years
Role Type: Individual Contributor plus Technical Lead or Specialist. Need AI experience on this.

Role Summary

We are seeking a Test Automation Architect to define, design, and govern enterprise-scale automation solutions. The role requires strong hands-on expertise in Java, Playwright, Python, React JS, and Helenium, along with Prompt Engineering capabilities to leverage AI-driven testing and productivity use cases. The candidate must also demonstrate excellent stakeholder communication skills to drive automation strategy and quality outcomes.

Key Responsibilities

Automation Architecture & Strategy

• Own and define end-to-end test automation architecture across web and desktop applications.
• Design scalable, reusable, and maintainable automation frameworks using Java, Playwright, and Python.
• Define automation standards, best practices, coding guidelines, and governance models.
• Evaluate applications and recommend tools, frameworks, and AI-assisted automation approaches.

Hands-on Automation Development

• Develop and enhance Java- and Python-based automation frameworks with strong OOP and design principles.
• Build and maintain Playwright automation frameworks for modern web applications.
• Automate React JS applications, handling dynamic UI components and asynchronous behavior.
• Create reusable automation components, utilities, and libraries.
• Enable parallel and distributed execution to optimize execution cycles.

AI & Prompt Engineering

• Apply Prompt Engineering techniques to improve test design, test data generation, defect analysis, and automation productivity.
• Leverage AI-assisted tools for test case generation, exploratory testing support, and automation optimization.
• Collaborate with teams to integrate AI-driven testing approaches into existing automation frameworks.

CI/CD & Tool Integration

• Integrate automation frameworks with CI/CD pipelines (Jenkins / Azure DevOps or equivalent).
• Enable automated execution, reporting, and defect traceability.
• Track automation metrics, execution stability, and ROI.

Stakeholder Communication & Leadership

• Act as the automation subject matter expert (SME) for internal and external stakeholders.
• Collaborate with product owners, architects, developers, and business teams.
• Clearly communicate automation strategy, progress, risks, and value to senior leadership.
• Support estimation, planning, and proposal preparation for automation initiatives.

Mentoring & Governance

• Mentor automation engineers and guide teams on framework usage and best practices.
• Conduct code reviews and enforce quality standards.
• Govern automation execution across projects to ensure consistency and quality.

Mandatory Skills (Must Have)

• Java (Core & Advanced) – strong OOP and framework design experience
• Python development – automation framework development and scripting
• Playwright (Mandatory) – hands-on experience building and maintaining Playwright frameworks
• Prompt Engineering – applying AI prompts for testing, automation, and quality use cases
• Test Automation Framework Design (custom / hybrid frameworks)
• React JS automation
• Helenium
• CI/CD integration (Jenkins / Azure DevOps or similar)
• Test strategy, test planning, and automation estimation
• Strong stakeholder communication and presentation skills

Nice to Have

• API automation (REST)
• Performance or non-functional testing exposure
• Agile / DevOps delivery experience
• Enterprise-scale or multi-application automation experience

Soft Skills

• Excellent verbal and written communication
• Strong stakeholder management and influencing skills
• Ability to communicate with technical and non-technical audiences
• Ownership mindset and strong problem-solving ability

Education

• Bachelor’s degree in Engineering / Computer Science or equivalent