Haystack
← Back to Jobs
Technology
VC

Ai Engineer Mid level

Vega Consulting SolutionsBaltimore, MD🇺🇸United StatesPosted 4 Sept 2026

Quick Overview

Seniority
Mid Senior
Work mode
On Site
Location
Baltimore, MD, United States
Posted
17 hours ago
AWSSeleniumAgileBDDConfluenceGenerative AIJiraLLM

Job Description

Ai Engineer Mid Level

Please, no agencies or recruiters, only W2 applicants.

Vega Consulting Solutions is hiring a Mid-level Ai Engineer with automation testing experience for our client located in Baltimore, MD. This position will require candidates to work onsite once a week.

Job Description:

Mid Level Ai Engineer to Conduct deep technical analysis and testing of AI/ML and Generative AI systems, including validation and verification of model outputs, prompt behavior, and end-to-end application workflows.

Job Requirements:

  • ML concepts and GEN AI concepts
  • 3+ years of relevant testing experience with a strong background in Software QA with cloud technologies, including 3+ years of experience with hands-on exposure to AI/ML application testing.
  • 2+ years of relational database experience including generating complex queries, setting up database connections, and automating query processing, with familiarity in querying ML feature stores or data pipelines.
  • Experience in automated and manual testing in cloud environments, particularly for AI/ML and Gen AI applications, including validation of model outputs, embeddings, and LLM-generated responses.
  • Experience designing test strategies for non-deterministic systems, including techniques for evaluating accuracy, relevance, and safety of Gen AI outputs.
  • 1+ years of experience with BDD/Selenium and automation tools, with a plus for experience in AI testing frameworks.
  • Experience using Agile team collaboration and requirements management tools (Jira, Confluence).
  • Excellent written and oral communication skills and problem-solving abilities, with the ability to clearly articulate AI/ML testing findings to both technical and non-technical stakeholders.
  • Strong aptitude to learn and adapt to emerging AI/ML technologies and evolving Gen AI tooling.
  • Familiarity with AWS AI/ML services (SageMaker, Bedrock) or equivalent cloud AI platforms is a plus.
  • Bachelor's degree required; technical degree preferred.

If you are looking for the next step in your career - Select Apply Now and a Vega Staffing specialist will reach out to you.

Similar jobs