Automation Testing Engineer

Senior Automation Testing Engineer

Overview 

We are seeking a Senior Automation Testing Leader / Senior Automation Testing Engineer to own and build the quality engineering and test automation function for an AI-powered healthcare technology platform. 

In this role, quality directly impacts patient access to healthcare. A broken call flow can prevent a patient from reaching their physician, making quality assurance an important part of the overall patient experience. 

This is not a traditional manual QA position. The role is focused on test automation, framework design, automation strategy, scalable QA processes, AI-assisted testing techniques, and building a future QA organization. 

 

What You''ll Do 

Automation Strategy & Leadership 

• Own the overall quality engineering vision and automation strategy for an AI-powered voice platform. 

• Design, build, and maintain scalable automated testing infrastructure from the ground up. 

• Establish testing standards, best practices, and quality metrics across engineering teams. 

• Recruit, mentor, and eventually lead future QA and automation testing team members. 

• Help drive a culture of quality throughout the organization. 

Testing Architecture & Framework Development 

• Design and implement automated testing frameworks covering unit testing, integration testing, end-to-end testing, regression testing, and load/performance testing. 

• Build reusable test harnesses and tooling that enable engineers to efficiently create and execute tests. 

• Develop simulation frameworks for real-time voice and conversational AI workflows. 

• Create testing methodologies that can scale with rapid product growth. 

AI & Voice Platform Testing 

• Build simulation and regression frameworks for conversational AI scenarios. 

• Develop testing approaches for real-time voice interactions and telephony workflows. 

• Leverage AI-assisted testing techniques to improve coverage and efficiency. 

• Validate agent behaviors, routing logic, integrations, and patient call flows before production deployment. 

Platform & Integration Quality 

• Partner with platform, provisioning, and integrations teams to ensure comprehensive coverage across system boundaries. 

• Test APIs, backend services, event-driven systems, and third-party integrations. 

• Own test environments and CI/CD integration for automated execution. 

• Investigate production issues and lead root cause analysis efforts. 

Compliance & Reliability 

• Develop testing approaches that support HIPAA and healthcare compliance requirements. 

• Help ensure platform reliability, scalability, and quality standards are consistently maintained. 

• Drive preventative quality initiatives that reduce production defects and customer-impacting issues. 

Required Qualifications 

• 10+ years of experience in software quality engineering with a strong emphasis on automation. 

• Proven track record designing and owning automation frameworks from the ground up. 

• Expertise in automated testing architecture and test harness design. 

• Strong experience building scalable QA processes and automation strategies. 

• Experience leveraging AI-assisted testing methodologies. 

• Proficiency with Python, TypeScript, or similar programming languages. 

• Strong scripting, tooling, and automation development skills. 

• Experience integrating automated testing into CI/CD pipelines. 

• Hands-on experience with GitHub Actions, Jenkins, or similar tools. 

• Deep understanding of unit testing, integration testing, end-to-end testing, regression testing, and performance testing. 

• Experience testing APIs, backend services, and distributed/event-driven architectures. 

• Strong debugging and analytical skills. 

• Demonstrated ability to elevate quality standards across engineering organizations. 

• Startup mentality with a willingness to build processes, frameworks, and teams from scratch. 

• Ability to operate as both an individual contributor and future people leader. 

Preferred Qualifications 

• Experience testing real-time systems. 

• Experience with telephony platforms, call routing systems, or voice technologies. 

• Experience testing conversational AI or AI-powered applications. 

• Load and performance testing experience in high-throughput environments. 

• HIPAA-regulated healthcare experience. 

• Experience in compliance-heavy environments. 

• Contract testing experience. 

• Service virtualization experience. 

• Previous experience building or leading QA organizations. 

Ideal Candidate 

• Can design testing frameworks from the ground up. 

• Can build and execute an automation-first quality strategy. 

• Understands how to leverage AI to improve testing effectiveness and efficiency. 

• Can create scalable quality processes that grow with the business. 

• Can build sophisticated test harnesses and simulation environments. 

• Thrives in a fast-paced startup-style environment. 

• Operates as a strategic quality leader rather than a traditional manual tester. 

Determining compensation for this role (and others) at Vaco/Highspring depends upon a wide array of factors including but not limited to the individual’s skill sets, experience and training, licensure and certifications, office location and other geographic considerations, as well as other business and organizational needs. With that said, as required by local law in geographies that require salary range disclosure, Vaco/Highspring notes the salary range for the role is noted in this job posting. The individual may also be eligible for discretionary bonuses, and can participate in medical, dental, and vision benefits as well as the company’s 401(k) retirement plan. Additional disclaimer: Unless otherwise noted in the job description, the position Vaco/Highspring is filing for is occupied. Please note, however, that Vaco/Highspring is regularly asked to provide talent to other organizations. By submitting to this position, you are agreeing to be included in our talent pool for future hiring for similarly qualified positions. Submissions to this position are subject to the use of AI to perform preliminary candidate screenings, focused on ensuring minimum job requirements noted in the position are satisfied. Further assessment of candidates beyond this initial phase within Vaco/Highspring will be otherwise assessed by recruiters and hiring managers. Vaco/Highspring does not have knowledge of the tools used by its clients in making final hiring decisions and cannot opine on their use of AI products.