Haystack
โ† Back to Jobs
Full time
Technology
WA

Senior AI Engineer

Weekday AIBengaluru, Karnataka๐Ÿ‡ฎ๐Ÿ‡ณIndiaPosted 12 Oct 2026

Why This Role Stands Out

Advance your career as a Senior AI Engineer by designing and deploying cutting-edge LLM-powered applications and AI agents with a competitive compensation package of INR 25-40 LPA. You'll thrive in this role if you have a passion for solving complex problems and hands-on experience with Python, agentic AI, and RAG frameworks, making this an excellent opportunity to contribute to impactful AI solutions.

Quick Overview

Seniority
Mid Senior
Employment type
Full Time
Work mode
On Site
Location
Bengaluru, Karnataka, India
Posted
15 hours ago
MLOpsMachine LearningDeep LearningGenerative AILLMPythonReact

Job Description

๐—ง๐—ต๐—ถ๐˜€ ๐—ฟ๐—ผ๐—น๐—ฒ ๐—ถ๐˜€ ๐—ณ๐—ผ๐—ฟ ๐—ผ๐—ป๐—ฒ ๐—ผ๐—ณ ๐˜๐—ต๐—ฒ ๐—ช๐—ฒ๐—ฒ๐—ธ๐—ฑ๐—ฎ๐˜†'๐˜€ ๐—ฐ๐—น๐—ถ๐—ฒ๐—ป๐˜๐˜€

๐—ฆ๐—ฎ๐—น๐—ฎ๐—ฟ๐˜† ๐—ฟ๐—ฎ๐—ป๐—ด๐—ฒ: ๐—ฅ๐˜€ ๐Ÿฎ๐Ÿฑ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ - ๐—ฅ๐˜€ ๐Ÿฐ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ (๐—ถ๐—ฒ ๐—œ๐—ก๐—ฅ ๐Ÿฎ๐Ÿฑ-๐Ÿฐ๐Ÿฌ ๐—Ÿ๐—ฃ๐—”)

Experience: 2+ yrs

Location: Bengaluru

Job Type: Full-time

We are looking for a technically strongย Generative AI / Machine Learning Engineerย to design, develop, and deploy intelligent applications powered by Large Language Models (LLMs), AI agents, and machine learning systems. The ideal candidate will have hands-on experience inย Python, agentic AI, Retrieval-Augmented Generation (RAG), LLM frameworks, and production-ready AI engineering.

This role is suited for an engineer who enjoys solving complex problems, experimenting with emerging AI technologies, and transforming research concepts into scalable, reliable, and high-performing applications.

Key Responsibilities

1. Generative AI and Agent Development

  • Design and develop LLM-powered applications and autonomous or semi-autonomous AI agents.
  • Build agentic workflows usingย LangChain, LangGraph, LlamaIndex, or similar frameworks.
  • Implement function calling, tool integration, and multi-step reasoning workflows using approaches such as ReAct.
  • Develop end-to-end AI systems that can plan, execute tasks, and interact with external tools and APIs.

2. Retrieval-Augmented Generation (RAG)

  • Design and implement scalable RAG pipelines for document-based knowledge retrieval and contextual response generation.
  • Work with vector databases such asย Pinecone, FAISS, and Milvus.
  • Optimise document chunking, embedding generation, indexing, and retrieval strategies.
  • Evaluate retrieval quality, improve response relevance, and implement techniques to minimise LLM hallucinations.

3. LLM Optimisation and Fine-Tuning

  • Experiment with prompt engineering, context management, and response-quality optimisation.
  • Fine-tune models usingย LoRA, PEFT, and related parameter-efficient techniques where appropriate.
  • Apply quantisation techniques, including 8-bit and 4-bit quantisation, to improve inference efficiency.
  • Develop an understanding of model alignment approaches, including RLHF.

4. Machine Learning and Deep Learning

  • Apply machine learning techniques to structured and unstructured datasets.
  • Demonstrate an understanding of neural networks, backpropagation, regularisation, and model evaluation.
  • Work with algorithms such asย XGBoost and Random Forestย for tabular prediction tasks.
  • Understand foundational architectures such as RNNs, LSTMs, and CNNs where relevant.
  • Train and optimise models using GPU/TPU-based environments when required.

5. Deployment and MLOps

  • Build production-ready AI and ML pipelines with appropriate testing, deployment, and monitoring.
  • Track model performance and identify data drift, concept drift, and quality degradation.
  • Collaborate with engineering teams to integrate AI capabilities into applications and services.
  • Improve reliability, scalability, latency, and resource utilisation across deployed AI systems.

What Makes You a Great Fit

  • 2โ€“5 years of experienceย in AI/ML engineering, Generative AI, or a related software engineering field.
  • Strong programming skills inย Pythonย and hands-on experience with LLM frameworks.
  • Proven experience buildingย RAG pipelines, AI agents, and tool-using systems.
  • Good understanding of vector databases, embeddings, retrieval optimisation, and prompt engineering.
  • Knowledge of practical techniques for evaluating LLM outputs and mitigating hallucinations.
  • Solid fundamentals in machine learning, deep learning, model training, and evaluation metrics such as precision and recall.
  • Familiarity with class imbalance, model validation, and performance optimisation.
  • Experience withย LoRA/PEFT, quantisation, GPU-based training, or LLM inference optimisationย is an advantage.
  • Exposure to MLOps, model deployment, monitoring, and real-time AI applications is desirable.
  • Strong analytical, debugging, and problem-solving skills.
  • Ability to translate complex requirements into practical AI solutions and collaborate effectively with cross-functional teams.
  • A proactive learning mindset and genuine interest in emerging AI technologies and production-grade AI systems.

Similar jobs