Haystack
← Back to Jobs
Technology
LS

Software Engineer AI/ML QA Engineer

Lumen Solutions Group Inc.Columbia, MD🇺🇸United StatesPosted 3 Sept 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
Columbia, MD, United States
Posted
Yesterday
GCPOracleSQLAWSSeleniumAgileBDDConfluenceGenerative AIJiraLLM

Job Description

Company Description
Lumen SolutionsGroupInc. is a technology consulting Services company based inFlorida. Weprovidea wide array of experienced business and IT professionals supporting clients from solution design to implementation and support.We specialize in professional IT consulting services, IT Staffing, Business/IT Strategy, Business Process Blueprints, Enterprise Architecture, and EnterpriseTransformation.

Role: Software Engineer AI/ML QA Engineer
Location: Columbia, MD / Washington, DC (Hybrid Required once in a Week)
Job Type: 6 Months Contract (Possible Extension)

Job Summary:
We are seeking a Software Engineer / AI/ML QA Engineer with strong experience in QA automation, Salesforce, AI/ML, and Generative AI testing. The ideal candidate will have hands-on experience testing LLMs, RAG applications, prompts, ML models, APIs, chatbots, and AI-powered workflows, along with strong Selenium/BDD automation, SQL, and Oracle skills.


Key Responsibilities:
  • Test and validate AI/ML and Generative AI applications, including LLM responses, prompts, model predictions, and end-to-end workflows.
  • Develop test strategies for AI-powered applications and non-deterministic GenAI outputs.
  • Perform manual, exploratory, API, UI, and automated testing for Salesforce and AI/ML applications.
  • Develop and maintain automated test suites using Selenium, BDD, and related automation frameworks.
  • Test Salesforce Einstein and integrations with external LLM/AI platforms.
  • Validate RAG pipelines, embeddings, vector databases, ML pipelines, and intermediate data outputs.
  • Evaluate AI applications for accuracy, relevance, hallucinations, bias, model drift, and safety.
  • Write and execute complex SQL queries across multiple databases, with strong Oracle experience.
  • Collaborate with Product Owners, Developers, Data Scientists, and Business stakeholders to define requirements and testing strategies.
  • Participate in Agile ceremonies and maintain project documentation using Jira and Confluence.

Required Qualifications
  • 3+ years of Software Engineering experience.
  • 12 years of hands-on AI/ML/Generative AI project experience.
  • 3+ years of Cloud experience with AWS, GCP, or another major cloud platform.
  • Strong QA/Software Testing experience, including AI/ML outputs and chatbot responses.
  • Strong hands-on experience with Selenium, BDD, and test automation.
  • Experience with API, UI, manual, and automation testing.
  • Strong SQL skills and experience with Oracle.
  • Understanding of relational and non-relational databases.
  • Understanding of data pipelines and ability to validate intermediate pipeline outputs.
  • Experience working with Jira and Confluence.
  • Bachelor's degree required; technical degree preferred.

Nice to Have
  • Experience with AWS Bedrock and/or SageMaker.
  • Experience with AI/ML testing frameworks.

Lumen SolutionsGroup Inc is an equal opportunity employer. All qualified applicants will be considered for employment without regard to any legally protected status.

Similar jobs

Browse related jobs

Apply now