AI/ML & Gen AI Testing -- W2 ONLY

BEFORE APPLYING FOR THE JOB. KINDLY READ THE COMPLETE JOB DESCRIPTION PROPERLY(EVEN THE TERMS OF EMPLOYMENT ALSO), NO 1099, C2C , H1 TRANSFER

Title: AI/ML & Gen AI Testing

Location: Hybrid (1 day/week on-site in Merriweather, MD; occasional travel to Northern VA / DC offices)

Terms of Employment:

W2 Contract, 6-Months (possibile of extension)

Location: Hybrid (1 day/week on-site in Merriweather, MD; occasional travel to Northern VA / DC offices)

Candidate must reside in DMV area only

Role Overview

This role sits at the intersection of software/QA testing and AI/ML it is not a hands-on model-building or deployment position. The engineer will work closely with the lead systems engineer and lead developer supporting two active workstreams:

1. Machine Learning Models supporting existing and new ML initiatives, evaluating fine-tuned and agentic model outputs, and providing iterative feedback to improve model efficiency and accuracy in collaboration with the business team.

2. Generative AI Chatbots (Bridge Console) testing chatbot responses for accuracy and hallucination, crafting and refining prompts, and working with the development team to fine-tune outputs based on findings.

Day-to-day work includes testing across multiple pipeline stages (evaluating intermediate outputs at each processing step, not just final results), analyzing model/chatbot outputs, and partnering with both engineering and business stakeholders to validate results.

Required Qualifications (Mandatory)

3+ years of software engineering / QA testing experience

1 2 years of hands-on experience with Generative AI concepts

3+ years of cloud platform experience (AWS, Azure, or Google Cloud Platform)

Working knowledge of system/software testing methodology

~1 year of experience with BDD, Selenium, and test automation

Understanding of relational and non-relational databases, with experience working with data pipelines (e.g., Oracle, Snowflake)

Hands-on exposure to prompt engineering

Strong analytical skills comfortable interpreting model outputs and providing structured feedback

Experience with Jira and Confluence

Preferred Qualifications

Familiarity with AWS Bedrock and/or SageMaker

Background in healthcare or insurance industry

Exposure to newer AI/ML testing frameworks

Salesforce experience (nice to have, not required)

Interview Process

1. Initial video screen (~30 minutes)

2. In-person interview (typically at Merriweather, location may vary)