Haystack
← Back to Jobs
Remote
Technology
KT

AI/ML Engineer (Gen AI, LLM, RAG)

Karwell Technologies IncUnited States🇺🇸United StatesPosted Oct 2, 2026

Quick Overview

Seniority
Mid Senior
Work mode
Remote
Location
United States
Posted
Yesterday
AWSMachine LearningAzureGenerative AILLMPython

Job Description

#W2 Reqirement
Job Title:
AI/ML Engineer (Gen AI, LLM, RAG)
Location: Remote
Job Description

Responsibilities

  • Architect and develop production-grade Generative AI and LLM-powered solutions.
  • Design and implement Retrieval-Augmented Generation (RAG) systems, vector search, and knowledge retrieval platforms.
  • Build scalable APIs, AI services, and cloud-native ML/LLM infrastructure.
  • Establish evaluation frameworks to measure model quality, accuracy, groundedness, and safety.
  • Lead Responsible AI practices, including bias mitigation, hallucination reduction, security, privacy, and compliance controls.
  • Partner with product, business, and engineering teams to identify and deliver high-value AI use cases.
  • Evaluate emerging AI technologies and recommend innovative solutions that drive business value.

Required Skills

  • Bachelor's degree in Computer Science, Engineering, Data Science, or related field.
  • 10+ years of software engineering, machine learning, or AI engineering experience.
  • 5+ years of experience building and deploying LLM or Generative AI solutions.
  • Strong proficiency in Python and modern software engineering practices.
  • Experience with cloud platforms (Azure or AWS).
  • Hands-on experience with RAG, vector databases, prompt engineering, and AI application development.
  • Proven ability to lead complex technical initiatives and influence cross-functional teams.

Preferred Skills

  • Hands-on AI engineering leadership experience.
  • Successfully delivered production-scale LLM and Generative AI solutions.
  • Strong understanding of Responsible AI and governance.
  • Experience operating effectively in regulated environments.
  • Strong understanding of privacy and security.
  • Technical depth and leadership skills to build platforms and mentor teams.
  • Ability to drive enterprise AI strategy.

Similar jobs