QA Analyst with AI/ML at Bunker Hill, OH, - ONSITE

Job Description: Job Summary:
We are looking for a QA Analyst with AI/ML expertise to ensure the quality, reliability, and performance of AI/ML-driven applications. This role involves validating machine learning models, testing data pipelines, and ensuring end-to-end quality for AI-based systems including LLM-based applications, data processing pipelines, and predictive models.

 

Key Responsibilities:
Design and execute test strategies for AI/ML applications and data pipelines
Validate ML model outputs, accuracy, and performance metrics
Perform functional, integration, and regression testing for AI solutions
Test data pipelines, data quality, and preprocessing workflows used in ML systems
Conduct API testing for model inference and integration endpoints
Collaborate with Data Scientists, ML Engineers, and DevOps teams to understand model behavior and testing requirements
Perform model validation testing including drift, bias, and edge case scenarios
Participate in release validation, UAT support, and defect management
Develop automation scripts for testing AI/ML workflows (where applicable)
Prepare test plans, test cases, and QA documentation
 

Required Skills:
Strong experience in QA / Software Testing (functional & API testing)
Hands-on experience with testing tools such as JIRA, Rally, QTP, or similar
Experience in API testing tools (Postman/REST APIs)
Good understanding of SQL and database testing
Exposure to AI/ML fundamentals (model training, evaluation, prediction workflows)
Understanding of data validation, data quality, and ETL testing
Basic scripting knowledge (Python, Java script preferred)
 

Role Descriptions: Required Skills:Strong experience in QA / Software Testing (functional & API testing) Hands-on experience with testing tools such as JIRA| Rally| QTP| or similarExperience in API testing tools (Postman/REST APIs) Good understanding of SQL and database testingExposure to AI/ML fundamentals (model training| evaluation| prediction workflows) Understanding of data validation| data quality| and ETL testingBasic scripting knowledge (Python preferred)
Essential Skills: Design and execute test strategies for AI/ML applications and data pipelinesValidate ML model outputs| accuracy| and performance metricsPerform functional| integration| and regression testing for AI solutionsTest data pipelines| data quality| and preprocessing workflows used in ML systemsConduct API testing for model inference and integration endpointsCollaborate with Data Scientists| ML Engineers| and DevOps teams to understand model behavior and testing requirements Perform model validation testing including drift| bias| and edge case scenariosParticipate in release validation| UAT support| and defect managementDevelop automation scripts for testing AI/ML workflows (where applicable)Prepare test plans| test cases| and QA documentationRequired Skills:Strong experience in QA / Software Testing (functional & API testing) Hands-on experience with testing tools such as JIRA| Rally| QTP| or similarExperience in API testing tools (Postman/REST APIs) Good understanding of SQL and database testingExposure to AI/ML fundamentals (model training| evaluation| prediction workflows) Understanding of data validation| data quality| and ETL testingBasic scripting knowledge (Python preferred)
Desirable Skills: 
Keyword: 
Skills: AI and Automation~Playwright~Generative AI - Quality Engineering~Selenium
Experience Required: 8-10