Quick overview
Job description
Job Title: Automation AI Tester
Project Location: Plano, TX (Onsite)
interview Mode- F2F interview
Job Description:
Looking for experienced Automation, Performance & AI Testing Lead to define and drive quality engineering across our products and services. You'll lead test automation and performance engineering while helping teams apply AI and build agentic workflows that improve software delivery and quality. This role combines hands-on technical leadership with coaching, planning, and collaboration across engineering, product, and delivery teams.
Key responsibilities
- Define and evolve Avertack's automation, performance, and AI-enabled quality engineering strategy.
- Design and develop maintainable automated test frameworks for UI, API, integration, and end-to-end testing.
- Establish performance engineering practices, including load, stress, endurance, and scalability testing.
- Identify performance bottlenecks and work with engineering teams to diagnose and resolve them.
- Design, build, and implement agentic workflows that automate testing, triage, test-data preparation, defect analysis, or other quality engineering processes.
- Evaluate AI agents, large language models, and orchestration approaches; apply them responsibly with appropriate validation, human oversight, and security controls.
- Integrate automated tests and AI-enabled workflows into CI/CD pipelines and advise on quality gates and release readiness.
- Define quality metrics and reporting for test coverage, reliability, defects, performance, and AI workflow effectiveness.
- Guide test planning, risk assessment, test data management, and environment strategy.
- Collaborate with architects, developers, product managers, and operations teams throughout the software lifecycle.
- Mentor engineers and promote shared ownership of quality.
Required qualifications
- 10+ years of experience in software testing, quality engineering, and test automation, including substantial technical leadership.
- Proven experience building and scaling automation frameworks for APIs and web applications.
- Strong programming or scripting skills in one or more languages such as Java, Python, JavaScript/TypeScript, or C#.
- Practical experience with tools such as Playwright, Selenium, Cypress, REST Assured, Postman, JMeter, Gatling, or equivalent.
- Experience designing performance tests, interpreting results, and driving remediation.
- Hands-on knowledge of AI/LLM applications and the ability to build agentic workflows, including tool use, workflow orchestration, and integrating agents with APIs or enterprise systems.
- Ability to evaluate AI-generated results and account for reliability, privacy, security, and human review in AI-enabled workflows.
- Experience with CI/CD systems and integrating automated testing into delivery pipelines.
- Strong understanding of test strategy, software development lifecycle, defect management, and quality metrics.
- Experience leading teams, mentoring engineers, and influencing quality practices across teams.
Preferred qualifications
- Experience with agent frameworks, AI orchestration platforms, retrieval-augmented generation (RAG), or evaluation frameworks.
- Experience with cloud-native, distributed, microservices, or event-driven systems.
- Familiarity with observability tools, application monitoring, containers, Kubernetes, and infrastructure-as-code.
- Knowledge of security and accessibility testing principles.
- Experience in Agile or DevOps delivery environments
About AgreeYa:
AgreeYa is a global systems integrator delivering competitive advantage for its customers through software, solutions, and services. Established in 1999, AgreeYa is headquartered in Folsom, California, with a global footprint and a team of more than 2,200 staff across offices. AgreeYa works with 500+ organizations ranging from Fortune 100 firms to small and large businesses across industries such as Telecom, Banking, Financial Services & Insurance, Healthcare, Utility & Energy, Technology, Public Sector, Pharma & Biotech, and others.
Please visit us at for more information.
AgreeYa is an equal opportunity employer. We evaluate qualified applicants without regard to race, color, religion, gender identity, sexual orientation, national origin, disability, veteran status, or other protected characteristics. Visit our website to learn about our Career & Culture.
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- BW

QA / Test Automation Engineer with Security ClearanceRecently posted
Bow Wave LLC · Washington, DC · Hybrid · Posted 19 Nov 2026 🇺🇸
GitAWSSelenium+10TechnologySalary not listed - IS

Quality Assurance Manager, Commercial Services with Security ClearanceRecently posted
Iridium Satellite Communications · Tempe, AZ · Hybrid · Posted 18 Nov 2026 🇺🇸
Sales$105k - $140k/yr - DE

QA/Test Automation Engineer (Journeyman) with Security ClearanceRecently posted
DecisionPoint Corporation · Chicago, IL · Hybrid · Posted 18 Nov 2026 🇺🇸
SeleniumC#Confluence+14TechnologySalary not listed - DE

Data Quality & Test Automation Engineer (Senior) with Security ClearanceRecently posted
DecisionPoint Corporation · Chicago, IL · Hybrid · Posted 18 Nov 2026 🇺🇸
SQLETLPython+4TechnologySalary not listed - GO

Bilingual Quality Assurance Manager - Recruiting ServicesRecently posted
GoodwinRecruiting · Bohemia, New York · Hybrid · Posted 19 Nov 2026 🇺🇸
RecruitingData AnalysisHuman ResourcesSalary not listed - LE
Production Test EngineerRecently posted
Leonardo Electronics US Inc · Tucson, Arizona · On-site · Posted 21 Oct 2026 🇺🇸
Microsoft ExcelLean Six SigmaProcess Improvement+1ManufacturingSalary not listed - CS

Senior QA/QE EngineerRecently posted
CYNET SYSTEMS · Oakland, California · On-site · Posted 19 Nov 2026 🇺🇸
ScrumJiraAgileEngineering$45 - $50/hr - AA
Quality Assurance Compliance Officer and TrainerRecently posted
Alliance Adult Care Services (AACS) · Murrysville, Pennsylvania · Hybrid · Posted 19 Nov 2026 🇺🇸
ComplianceRegulatory ComplianceLegalSalary not listed - CS

Senior Healthcare Payer E2E QA Test LeadRecently posted
CYNET SYSTEMS · Seattle, Washington · On-site · Posted 19 Nov 2026 🇺🇸
SOC 2Customer SuccessJenkins+9$47 - $52/hr - GT

Software Test Engineer with Security ClearanceRecently posted
Geon Technologies · Columbia, MD · Hybrid · Posted 18 Nov 2026 🇺🇸
DockerGitAWS+12Technology$145k - $165k/yr - II
Mid-Level Test Engineer/Analyst with Security ClearanceRecently posted
Integration Innovation, Inc. (i3) · Huntsville, AL · Hybrid · Posted 18 Nov 2026 🇺🇸
MATLABMicrosoft OfficeC+++1TechnologySalary not listed - LH

Specialist, Integration and Test Engineering
L3 Harris · Malabar, FL · Hybrid 🇺🇸
FiberProject ManagementLinuxTechnologySalary not listed