Quick overview
Job description
Key Responsibilities
Architecture & Solution Leadership
- Lead the design of enterprise-grade GenAI and agentic architectures (single-agent, multi-agent, tool-driven systems).
- Define reference architectures, reusable frameworks, and best practices for LLM applications across the organisation.
- Architect and oversee implementation of end-to-end RAG pipelines:
- Data ingestion → chunking → embeddings → vector search → orchestration → response synthesis.
- Drive scalability, reliability, cost optimisation, and performance across GenAI platforms.
Agentic & LLM Engineering (Hands-on + Oversight)
- Provide technical leadership in prompt engineering, prompt orchestration, and agent workflows (LangChain, LangGraph, etc.).
- Guide teams on tool-calling, function-calling, memory handling, and multi-agent system design.
- Lead efforts in hallucination reduction, guardrails, safety mechanisms, and output evaluation frameworks.
Platform & Engineering Excellence
- Architect production-grade APIs and services (FastAPI/Flask/enterprise microservices) for LLM solutions.
- Define MLOps / LLMOps pipelines including CI/CD, monitoring, observability, and evaluation.
- Partner with Data Engineering teams to ensure:
- Data quality, lineage, governance, and compliance
- Seamless integration with enterprise data platforms
Organisation-Level Responsibilities (Critical)
Capability Building & CoE Development
- Build and scale GenAI / Agentic AI Centre of Excellence (CoE).
- Define standardised frameworks, accelerators, and reusable components to improve delivery velocity.
- Drive organisation-wide adoption of GenAI best practices and tooling standards.
Strategic & Stakeholder Leadership
- Engage with CXOs, business stakeholders, and clients to translate business problems into AI-led solutions.
- Lead solutioning, pre-sales, RFP responses, and client workshops for GenAI opportunities.
- Influence AI strategy, roadmap, and investment decisions at organisational level.
Governance, Risk & Compliance
- Establish enterprise governance frameworks for GenAI:
- Responsible AI, security, privacy, ethical usage, and compliance
- Define policies for:
- Data access, redaction, model usage, auditability, and explainability
Mentorship & Team Leadership
- Mentor and guide architects, engineers, and data scientists.
- Drive technical upskilling, hiring strategy, and capability maturity.
- Review solution designs and enforce architecture quality standards.
Experience & Must-Have Skills
Experience
- 15+ years of total experience in Data Engineering / Data Science / AI
- 3+ years of hands-on experience in LLM / GenAI solutions at scale
- Proven experience in architecture, solution design, and enterprise delivery
LLM / GenAI & Agentic Engineering
- Strong hands-on experience with:
- LLMs (Claude, OpenAI, etc.)
- RAG pipelines and retrieval optimisation
- GPT + Agentic AI implementation experience
- Experience with:
- LangChain, LangGraph, or similar frameworks
- Agent orchestration and tool-calling architectures
- Deep understanding of:
- LLM limitations, evaluation, and optimisation strategies
Core Engineering
- Strong Python/Pyspark engineering expertise (production-grade development) with proven API integration experience
- Deep data analysis experience and handling large volume of data
- Fabric/Azure Databricks/Snowflake data engineering integration skills
- Good exposure to:
- Cloud platforms (Azure/AWS/GCP)
- SQL
- Containers, CI/CD, monitoring
Data / AI Foundations (Mandatory)
Prior experience in one or more:
- Data Engineering (ETL/ELT, pipelines, orchestration)
- Data Science / ML lifecycle (especially NLP)
Analytics engineering / data products
Good-to-Have / Preferred
- Fine-tuning techniques (LoRA, PEFT, prompt tuning, few-shot learning)
- Experience with enterprise GenAI deployments (security, privacy, governance)
- Experience with Azure ecosystem (Azure OpenAI, AI Search, Fabric, etc.)
- Exposure to industry use cases (Insurance, BFSI, Healthcare, Retail, etc.)
Key Responsibilities
Architecture & Solution Leadership
- Lead the design of enterprise-grade GenAI and agentic architectures (single-agent, multi-agent, tool-driven systems).
- Define reference architectures, reusable frameworks, and best practices for LLM applications across the organisation.
- Architect and oversee implementation of end-to-end RAG pipelines:
- Data ingestion → chunking → embeddings → vector search → orchestration → response synthesis.
- Drive scalability, reliability, cost optimisation, and performance across GenAI platforms.
Agentic & LLM Engineering (Hands-on + Oversight)
- Provide technical leadership in prompt engineering, prompt orchestration, and agent workflows (LangChain, LangGraph, etc.).
- Guide teams on tool-calling, function-calling, memory handling, and multi-agent system design.
- Lead efforts in hallucination reduction, guardrails, safety mechanisms, and output evaluation frameworks.
Platform & Engineering Excellence
- Architect production-grade APIs and services (FastAPI/Flask/enterprise microservices) for LLM solutions.
- Define MLOps / LLMOps pipelines including CI/CD, monitoring, observability, and evaluation.
- Partner with Data Engineering teams to ensure:
- Data quality, lineage, governance, and compliance
- Seamless integration with enterprise data platforms
Organisation-Level Responsibilities (Critical)
Capability Building & CoE Development
- Build and scale GenAI / Agentic AI Centre of Excellence (CoE).
- Define standardised frameworks, accelerators, and reusable components to improve delivery velocity.
- Drive organisation-wide adoption of GenAI best practices and tooling standards.
Strategic & Stakeholder Leadership
- Engage with CXOs, business stakeholders, and clients to translate business problems into AI-led solutions.
- Lead solutioning, pre-sales, RFP responses, and client workshops for GenAI opportunities.
- Influence AI strategy, roadmap, and investment decisions at organisational level.
Governance, Risk & Compliance
- Establish enterprise governance frameworks for GenAI:
- Responsible AI, security, privacy, ethical usage, and compliance
- Define policies for:
- Data access, redaction, model usage, auditability, and explainability
Mentorship & Team Leadership
- Mentor and guide architects, engineers, and data scientists.
- Drive technical upskilling, hiring strategy, and capability maturity.
- Review solution designs and enforce architecture quality standards.
Experience & Must-Have Skills
Experience
- 15+ years of total experience in Data Engineering / Data Science / AI
- 3+ years of hands-on experience in LLM / GenAI solutions at scale
- Proven experience in architecture, solution design, and enterprise delivery
LLM / GenAI & Agentic Engineering
- Strong hands-on experience with:
- LLMs (Claude, OpenAI, etc.)
- RAG pipelines and retrieval optimisation
- GPT + Agentic AI implementation experience
- Experience with:
- LangChain, LangGraph, or similar frameworks
- Agent orchestration and tool-calling architectures
- Deep understanding of:
- LLM limitations, evaluation, and optimisation strategies
Core Engineering
- Strong Python/Pyspark engineering expertise (production-grade development) with proven API integration experience
- Deep data analysis experience and handling large volume of data
- Fabric/Azure Databricks/Snowflake data engineering integration skills
- Good exposure to:
- Cloud platforms (Azure/AWS/GCP)
- SQL
- Containers, CI/CD, monitoring
Data / AI Foundations (Mandatory)
Prior experience in one or more:
- Data Engineering (ETL/ELT, pipelines, orchestration)
- Data Science / ML lifecycle (especially NLP)
Analytics engineering / data products
Good-to-Have / Preferred
- Fine-tuning techniques (LoRA, PEFT, prompt tuning, few-shot learning)
- Experience with enterprise GenAI deployments (security, privacy, governance)
- Experience with Azure ecosystem (Azure OpenAI, AI Search, Fabric, etc.)
- Exposure to industry use cases (Insurance, BFSI, Healthcare, Retail, etc.)
Key Responsibilities
Architecture & Solution Leadership
- Lead the design of enterprise-grade GenAI and agentic architectures (single-agent, multi-agent, tool-driven systems).
- Define reference architectures, reusable frameworks, and best practices for LLM applications across the organisation.
- Architect and oversee implementation of end-to-end RAG pipelines:
- Data ingestion → chunking → embeddings → vector search → orchestration → response synthesis.
- Drive scalability, reliability, cost optimisation, and performance across GenAI platforms.
Agentic & LLM Engineering (Hands-on + Oversight)
- Provide technical leadership in prompt engineering, prompt orchestration, and agent workflows (LangChain, LangGraph, etc.).
- Guide teams on tool-calling, function-calling, memory handling, and multi-agent system design.
- Lead efforts in hallucination reduction, guardrails, safety mechanisms, and output evaluation frameworks.
Platform & Engineering Excellence
- Architect production-grade APIs and services (FastAPI/Flask/enterprise microservices) for LLM solutions.
- Define MLOps / LLMOps pipelines including CI/CD, monitoring, observability, and evaluation.
- Partner with Data Engineering teams to ensure:
- Data quality, lineage, governance, and compliance
- Seamless integration with enterprise data platforms
Organisation-Level Responsibilities (Critical)
Capability Building & CoE Development
- Build and scale GenAI / Agentic AI Centre of Excellence (CoE).
- Define standardised frameworks, accelerators, and reusable components to improve delivery velocity.
- Drive organisation-wide adoption of GenAI best practices and tooling standards.
Strategic & Stakeholder Leadership
- Engage with CXOs, business stakeholders, and clients to translate business problems into AI-led solutions.
- Lead solutioning, pre-sales, RFP responses, and client workshops for GenAI opportunities.
- Influence AI strategy, roadmap, and investment decisions at organisational level.
Governance, Risk & Compliance
- Establish enterprise governance frameworks for GenAI:
- Responsible AI, security, privacy, ethical usage, and compliance
- Define policies for:
- Data access, redaction, model usage, auditability, and explainability
Mentorship & Team Leadership
- Mentor and guide architects, engineers, and data scientists.
- Drive technical upskilling, hiring strategy, and capability maturity.
- Review solution designs and enforce architecture quality standards.
Experience & Must-Have Skills
Experience
- 15+ years of total experience in Data Engineering / Data Science / AI
- 3+ years of hands-on experience in LLM / GenAI solutions at scale
- Proven experience in architecture, solution design, and enterprise delivery
LLM / GenAI & Agentic Engineering
- Strong hands-on experience with:
- LLMs (Claude, OpenAI, etc.)
- RAG pipelines and retrieval optimisation
- GPT + Agentic AI implementation experience
- Experience with:
- LangChain, LangGraph, or similar frameworks
- Agent orchestration and tool-calling architectures
- Deep understanding of:
- LLM limitations, evaluation, and optimisation strategies
Core Engineering
- Strong Python/Pyspark engineering expertise (production-grade development) with proven API integration experience
- Deep data analysis experience and handling large volume of data
- Fabric/Azure Databricks/Snowflake data engineering integration skills
- Good exposure to:
- Cloud platforms (Azure/AWS/GCP)
- SQL
- Containers, CI/CD, monitoring
Data / AI Foundations (Mandatory)
Prior experience in one or more:
- Data Engineering (ETL/ELT, pipelines, orchestration)
- Data Science / ML lifecycle (especially NLP)
Analytics engineering / data products
Good-to-Have / Preferred
- Fine-tuning techniques (LoRA, PEFT, prompt tuning, few-shot learning)
- Experience with enterprise GenAI deployments (security, privacy, governance)
- Experience with Azure ecosystem (Azure OpenAI, AI Search, Fabric, etc.)
- Exposure to industry use cases (Insurance, BFSI, Healthcare, Retail, etc.)
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- WP

Data EngineerRecently posted Auto Apply
WPP · Chennai · Hybrid · Posted 18 Nov 2026 🇮🇳
SQLApache SparkDatabricks+9TechnologySalary not listed - JU

Data Engineer - II (Biometrics)Recently posted Auto Apply
Jumio · Bengaluru · Hybrid · Posted 18 Nov 2026 🇮🇳
SQLAWSETL+5TechnologySalary not listed - CH

Senior Data EngineerRecently posted Auto Apply
Cohere Health · Hyderabad · Hybrid · Posted 17 Nov 2026 🇮🇳
SQLApache SparkAWS+6TechnologySalary not listed - B2
Senior Fabric Lead Data Engineer - R01572945 Auto Apply
Brillio 2 · Bengaluru · Hybrid · Posted 22 Oct 2026 🇮🇳
SQLGitApache Spark+6TechnologySalary not listed - WE
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekdayworks · Bengaluru · On-site · Posted 16 Nov 2026 🇮🇳
Technology₹1400k - ₹2000k/yr - V1
Senior Oracle Fusion Data Migration ConsultantRecently posted Auto Apply
Version 1 · Bengaluru, KA · Hybrid · Posted 16 Nov 2026 🇮🇳
OraclePL/SQLSQL+6TechnologySalary not listed - WA
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekday AI · Chennai, Tamil Nadu · On-site · Posted 16 Nov 2026 🇮🇳
GCPSQLAirflow+6TechnologySalary not listed - WA
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekday AI · Hyderabad, Telangana · On-site · Posted 16 Nov 2026 🇮🇳
GCPSQLAirflow+6TechnologySalary not listed - WA
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekday AI · Pune, Maharashtra · On-site · Posted 16 Nov 2026 🇮🇳
GCPSQLAirflow+6TechnologySalary not listed - WA
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekday AI · Bengaluru, Karnataka · On-site · Posted 16 Nov 2026 🇮🇳
GCPSQLAirflow+6TechnologySalary not listed - EX
Technical Data managerRecently posted Auto Apply
Excelya · Bengaluru, Karnataka · Hybrid · Posted 16 Nov 2026 🇮🇳
GCPOracleMicrosoft Excel+2TechnologySalary not listed - BG
KNIME SpecialistRecently posted Auto Apply
Bosch Group · bengaluru · On-site · Posted 13 Nov 2026 🇮🇳
SQLAWSETL+5TechnologySalary not listed
