Haystack
โ† Back to Jobs
Full time
Technology
WA

Staff ML Engineer

Weekday AIBengaluru, Karnataka๐Ÿ‡ฎ๐Ÿ‡ณIndiaPosted 29 Sept 2026

Quick Overview

Seniority
Mid Senior
Employment type
Full Time
Work mode
On Site
Location
Bengaluru, Karnataka, India
Posted
Yesterday
GPTGenerative AILLM

Job Description

๐—ง๐—ต๐—ถ๐˜€ ๐—ฟ๐—ผ๐—น๐—ฒ ๐—ถ๐˜€ ๐—ณ๐—ผ๐—ฟ ๐—ผ๐—ป๐—ฒ ๐—ผ๐—ณ ๐˜๐—ต๐—ฒ ๐—ช๐—ฒ๐—ฒ๐—ธ๐—ฑ๐—ฎ๐˜†'๐˜€ ๐—ฐ๐—น๐—ถ๐—ฒ๐—ป๐˜๐˜€

๐—ฆ๐—ฎ๐—น๐—ฎ๐—ฟ๐˜† ๐—ฟ๐—ฎ๐—ป๐—ด๐—ฒ: ๐—ฅ๐˜€ ๐Ÿฒ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ - ๐—ฅ๐˜€ ๐Ÿญ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ (๐—ถ๐—ฒ ๐—œ๐—ก๐—ฅ ๐Ÿฒ๐Ÿฌ-๐Ÿญ๐Ÿฌ๐Ÿฌ ๐—Ÿ๐—ฃ๐—”)

Experience: 13+ yrs

Location: Bengaluru

Job Type: Full-time

We are looking for an experiencedย Staff ML Engineer โ€“ Generative AIย to design, build, and scale production-gradeย GenAI applications and intelligent software systems. The role combines hands-on engineering, AI architecture, technical leadership, and end-to-end ownership of enterprise AI solutions.

The ideal candidate will have strong experience taking GenAI applications beyond prototypes into production, with a focus onย reliability, evaluation, observability, security, cost optimisation, user trust, adoption, and measurable business impact.

Key Responsibilities

  • Design, develop, and launch production-gradeย GenAI applicationsย including assistants, copilots, document intelligence, workflow automation, and decision-support solutions.
  • Identify high-impact opportunities where AI can improve productivity, service quality, operational efficiency, customer experience, or business outcomes.
  • Take GenAI applications from concept and experimentation through production deployment and ongoing optimisation.
  • Lead hands-on technical execution across application architecture, model selection, prompting, retrieval, orchestration, APIs, data pipelines, and user experiences.
  • Architect scalable LLM applications usingย RAG, agentic workflows, tool use, structured outputs, grounding, and orchestration.
  • Evaluate and select appropriate frontier models, open-source models, smaller task-specific models, fine-tuned models, or deterministic approaches based on business requirements.
  • Establish practical evaluation frameworks coveringย accuracy, relevance, groundedness, safety, latency, cost, user trust, adoption, and business impact.
  • Build production capabilities for observability, monitoring, versioning, fallback mechanisms, privacy, security, reliability, and operational ownership.
  • Analyse production feedback and continuously improve AI application quality, performance, reliability, and user experience.
  • Work with cross-functional stakeholders to define requirements, establish success criteria, and measure real-world impact.
  • Stay current with emerging GenAI technologies and pragmatically evaluate techniques that improve quality, speed, scalability, or cost efficiency.
  • Contribute to engineering standards, technical architecture decisions, AI development practices, and responsible AI implementation.
  • Mentor engineers and provide technical leadership across complex AI application initiatives.

What Makes You a Great Fit

  • 13+ years of experienceย building applied AI/ML-based intelligent software systems, with strong hands-on engineering expertise.
  • 3+ years of practical GenAI application experience, including production applications used by real users at meaningful scale.
  • Proven experience taking GenAI solutions fromย PoC/prototype to production, with ownership of reliability, launch quality, cost, user feedback, adoption, and measurable impact.
  • Strong understanding of modern LLM application architectures includingย RAG, agents, tool use, structured outputs, retrieval, grounding, and orchestration.
  • Experience withย LangGraph, LangChain, LlamaIndex, and LLM APIs such as GPT, Claude, or Gemini.
  • Strong programming and software engineering capabilities, with the ability to build production-ready AI applications rather than only prototypes.
  • Experience implementing evaluation and observability frameworks using tools such asย Langfuse, Arize, or similar platforms.
  • Strong understanding of enterprise AI requirements including security, privacy, reliability, monitoring, cost management, and user trust.
  • Experience with AI-native development tools such asย Cursor, Claude Code, or similar toolsย is preferred.
  • Strong architectural judgement with the ability to balance model capabilities, application complexity, performance, cost, and reliability.
  • Experience with advanced AI techniques such asย GraphRAG, long-context architectures, model routing, caching, cascades, PEFT/LoRA/QLoRA, knowledge distillation, or open-source model deploymentย is an advantage.
  • Strong analytical, problem-solving, communication, and cross-functional collaboration skills.
  • Ability to operate effectively in ambiguous, fast-moving environments and take end-to-end ownership of complex technical initiatives.
  • Strong interest in buildingย trustworthy, scalable, measurable, and production-ready AI systems.

Similar jobs