Quick Overview
Seniority
Mid Senior
Work mode
Hybrid
Location
Charlotte, NC, United States
Posted
17 hours ago
Machine LearningData PipelineGenerative AIPythonpytest
Job Description
Primary Skill: Test AI applications, RAG systems, agents, APIs and Data Pipeline using automated development framework
Experience: Minimum 8 years
Roles & Responsibilities
Bachelor s or master s degree in computer science or related field.
Key Responsibilities
- Lead Strategy: Design end-to-end test plans for generative AI, LLMs, and machine learning models.
- Model Validation: Test models for accuracy, drift, latency, robustness, and security vulnerabilities.
- Automation: Build advanced test automation frameworks using Python, PyTest, and specialized AI testing tools.
- Data Quality: Validate training, validation, and test datasets for bias, leakage, and data integrity.
- Performance Testing: Evaluate system scalability and response times under heavy concurrent loads.
- Team Leadership: Mentor junior engineers and collaborate with data scientists and software developers.
- Certifications in Automation
Similar jobs
- II
Senior Test Engineer with Security Clearance
Integration Innovation, Inc. (i3)
Huntsville, AL🇺🇸On-site7 weeks agoTCP/IPTechnology - ES
QA Manual Tester -W2 contract
NeweSolutionsFirst, LLC
Southfield, MI🇺🇸On-site17 hours agoSQLScrumAgile+1 - CT
SDET
NewCivilSoft Technolgies Inc
New York, NY🇺🇸On-site17 hours agoMicroservicesSeleniumCucumber+5Technology - OE
Software Development Engineer in Test (SDET)
NewOSI Engineering, Inc.
Cupertino, CA🇺🇸$50 - $65/hrOn-site17 hours agoShellEmbedded SystemsPythonTechnology - ET
QA + AI/ML Engineer
NewePace Technologies, Inc
Harrisburg, PA🇺🇸On-site17 hours agoMicroservicesSQLSelenium+11Technology - TE
Quality Assurance Engineer - Chicago, IL, Minneapolis, MN, Detroit, MI, Madison, WI, Columbus, OH.
TechniPros, LLC
Chicago, IL🇺🇸Hybrid5 days agoDockerSQLScrum+9Technology