Quick overview
Job description
Key Responsibilities
1. Solution Architecture & Strategy
- Define and lead end-to-end architecture for enterprise GenAI platforms and use cases
- Design scalable agentic systems (single-agent, multi-agent, orchestration frameworks)
- Establish reference architectures, design patterns, and reusable frameworks
- Lead architecture decisions on RAG vs fine-tuning vs hybrid approaches
- Conduct technology evaluations (LLMs, vector DBs, orchestration frameworks) and recommend best-fit solutions
2. Agentic AI & LLM Engineering Leadership
- Design and implement complex agentic workflows with tool calling, function orchestration, and memory strategies
- Build enterprise-grade RAG pipelines with strong focus on retrieval accuracy and evaluation
- Drive prompt architecture standards (prompt libraries, chaining, orchestration governance)
- Optimise solutions for latency, cost, scalability, and reliability
3. Platform & Engineering Excellence
- Lead development of GenAI platforms, APIs, and microservices (FastAPI, Flask, etc.)
- Define engineering best practices: coding standards, testing, packaging, observability
- Ensure seamless integration with enterprise data platforms, APIs, and business applications
- Collaborate with MLOps teams for CI/CD, deployment pipelines, versioning, and monitoring
4. Governance, Risk & Responsible AI
- Define and enforce LLM guardrails (hallucination control, safety filters, policy enforcement)
- Implement evaluation frameworks (RAG evaluation, prompt testing, benchmarking)
- Ensure compliance with data security, privacy, and enterprise governance standards
- Drive adoption of Responsible AI practices (bias mitigation, explainability, auditability)
5. Data & Ecosystem Collaboration
- Partner with Data Engineering teams on:
- Data ingestion, pipelines, and quality controls
- Metadata management and knowledge graph strategies
- Work with business stakeholders to:
- Identify high-value GenAI use cases
- Translate business problems into AI-driven solutions
6. Leadership & Stakeholder Management
- Provide technical leadership and mentorship to engineering teams
- Act as a solution advisor to clients/stakeholders (including pre-sales, PoCs, solutioning)
- Present architecture and design decisions to senior leadership and CXOs
- Drive COE initiatives, knowledge sharing, and internal capability building
Must-Have Skills & Experience
Experience
- 12–15 years total experience, with 3+ years in GenAI / LLM-based systems
- Proven experience in leading architecture and delivery of enterprise solutions
LLM / GenAI & Agentic Engineering
- Strong hands-on experience with:
- LLMs (Claude, OpenAI, etc.)
- RAG pipelines and retrieval optimisation
- GPT + Agentic AI implementation experience
- Experience with:
- LangChain, LangGraph, or similar frameworks
- Agent orchestration and tool-calling architectures
- Deep understanding of:
- LLM limitations, evaluation, and optimisation strategies
Core Engineering
- Strong Python/Pyspark engineering expertise (production-grade development) with proven API integration experience
- Deep data analysis experience and handling large volume of data
- Fabric/Azure Databricks/Snowflake data engineering integration skills
- Good exposure to:
- Cloud platforms (Azure/AWS/GCP)
- SQL
- Containers, CI/CD, monitoring
Cloud & Platform
- Hands-on experience with Azure / AWS / GCP
- Familiarity with:
- Containers (Docker/Kubernetes)
- CI/CD pipelines
- Monitoring & observability
Data / AI Foundations (Mandatory)
Prior experience in one or more:
- Data Engineering (ETL/ELT, pipelines, orchestration)
- Data Science / ML lifecycle (especially NLP)
- Analytics engineering / data products
Good-to-Have / Preferred
- Fine-tuning techniques (LoRA, PEFT, prompt tuning)
- Experience with Azure AI stack (Azure OpenAI, Cognitive Search)
- Knowledge of knowledge graphs, semantic layers, or enterprise search
- Experience in domain-specific GenAI solutions (Insurance, BFSI, Healthcare)
Key Responsibilities
1. Solution Architecture & Strategy
- Define and lead end-to-end architecture for enterprise GenAI platforms and use cases
- Design scalable agentic systems (single-agent, multi-agent, orchestration frameworks)
- Establish reference architectures, design patterns, and reusable frameworks
- Lead architecture decisions on RAG vs fine-tuning vs hybrid approaches
- Conduct technology evaluations (LLMs, vector DBs, orchestration frameworks) and recommend best-fit solutions
2. Agentic AI & LLM Engineering Leadership
- Design and implement complex agentic workflows with tool calling, function orchestration, and memory strategies
- Build enterprise-grade RAG pipelines with strong focus on retrieval accuracy and evaluation
- Drive prompt architecture standards (prompt libraries, chaining, orchestration governance)
- Optimise solutions for latency, cost, scalability, and reliability
3. Platform & Engineering Excellence
- Lead development of GenAI platforms, APIs, and microservices (FastAPI, Flask, etc.)
- Define engineering best practices: coding standards, testing, packaging, observability
- Ensure seamless integration with enterprise data platforms, APIs, and business applications
- Collaborate with MLOps teams for CI/CD, deployment pipelines, versioning, and monitoring
4. Governance, Risk & Responsible AI
- Define and enforce LLM guardrails (hallucination control, safety filters, policy enforcement)
- Implement evaluation frameworks (RAG evaluation, prompt testing, benchmarking)
- Ensure compliance with data security, privacy, and enterprise governance standards
- Drive adoption of Responsible AI practices (bias mitigation, explainability, auditability)
5. Data & Ecosystem Collaboration
- Partner with Data Engineering teams on:
- Data ingestion, pipelines, and quality controls
- Metadata management and knowledge graph strategies
- Work with business stakeholders to:
- Identify high-value GenAI use cases
- Translate business problems into AI-driven solutions
6. Leadership & Stakeholder Management
- Provide technical leadership and mentorship to engineering teams
- Act as a solution advisor to clients/stakeholders (including pre-sales, PoCs, solutioning)
- Present architecture and design decisions to senior leadership and CXOs
- Drive COE initiatives, knowledge sharing, and internal capability building
Must-Have Skills & Experience
Experience
- 12–15 years total experience, with 3+ years in GenAI / LLM-based systems
- Proven experience in leading architecture and delivery of enterprise solutions
LLM / GenAI & Agentic Engineering
- Strong hands-on experience with:
- LLMs (Claude, OpenAI, etc.)
- RAG pipelines and retrieval optimisation
- GPT + Agentic AI implementation experience
- Experience with:
- LangChain, LangGraph, or similar frameworks
- Agent orchestration and tool-calling architectures
- Deep understanding of:
- LLM limitations, evaluation, and optimisation strategies
Core Engineering
- Strong Python/Pyspark engineering expertise (production-grade development) with proven API integration experience
- Deep data analysis experience and handling large volume of data
- Fabric/Azure Databricks/Snowflake data engineering integration skills
- Good exposure to:
- Cloud platforms (Azure/AWS/GCP)
- SQL
- Containers, CI/CD, monitoring
Cloud & Platform
- Hands-on experience with Azure / AWS / GCP
- Familiarity with:
- Containers (Docker/Kubernetes)
- CI/CD pipelines
- Monitoring & observability
Data / AI Foundations (Mandatory)
Prior experience in one or more:
- Data Engineering (ETL/ELT, pipelines, orchestration)
- Data Science / ML lifecycle (especially NLP)
- Analytics engineering / data products
Good-to-Have / Preferred
- Fine-tuning techniques (LoRA, PEFT, prompt tuning)
- Experience with Azure AI stack (Azure OpenAI, Cognitive Search)
- Knowledge of knowledge graphs, semantic layers, or enterprise search
- Experience in domain-specific GenAI solutions (Insurance, BFSI, Healthcare)
Key Responsibilities
1. Solution Architecture & Strategy
- Define and lead end-to-end architecture for enterprise GenAI platforms and use cases
- Design scalable agentic systems (single-agent, multi-agent, orchestration frameworks)
- Establish reference architectures, design patterns, and reusable frameworks
- Lead architecture decisions on RAG vs fine-tuning vs hybrid approaches
- Conduct technology evaluations (LLMs, vector DBs, orchestration frameworks) and recommend best-fit solutions
2. Agentic AI & LLM Engineering Leadership
- Design and implement complex agentic workflows with tool calling, function orchestration, and memory strategies
- Build enterprise-grade RAG pipelines with strong focus on retrieval accuracy and evaluation
- Drive prompt architecture standards (prompt libraries, chaining, orchestration governance)
- Optimise solutions for latency, cost, scalability, and reliability
3. Platform & Engineering Excellence
- Lead development of GenAI platforms, APIs, and microservices (FastAPI, Flask, etc.)
- Define engineering best practices: coding standards, testing, packaging, observability
- Ensure seamless integration with enterprise data platforms, APIs, and business applications
- Collaborate with MLOps teams for CI/CD, deployment pipelines, versioning, and monitoring
4. Governance, Risk & Responsible AI
- Define and enforce LLM guardrails (hallucination control, safety filters, policy enforcement)
- Implement evaluation frameworks (RAG evaluation, prompt testing, benchmarking)
- Ensure compliance with data security, privacy, and enterprise governance standards
- Drive adoption of Responsible AI practices (bias mitigation, explainability, auditability)
5. Data & Ecosystem Collaboration
- Partner with Data Engineering teams on:
- Data ingestion, pipelines, and quality controls
- Metadata management and knowledge graph strategies
- Work with business stakeholders to:
- Identify high-value GenAI use cases
- Translate business problems into AI-driven solutions
6. Leadership & Stakeholder Management
- Provide technical leadership and mentorship to engineering teams
- Act as a solution advisor to clients/stakeholders (including pre-sales, PoCs, solutioning)
- Present architecture and design decisions to senior leadership and CXOs
- Drive COE initiatives, knowledge sharing, and internal capability building
Must-Have Skills & Experience
Experience
- 12–15 years total experience, with 3+ years in GenAI / LLM-based systems
- Proven experience in leading architecture and delivery of enterprise solutions
LLM / GenAI & Agentic Engineering
- Strong hands-on experience with:
- LLMs (Claude, OpenAI, etc.)
- RAG pipelines and retrieval optimisation
- GPT + Agentic AI implementation experience
- Experience with:
- LangChain, LangGraph, or similar frameworks
- Agent orchestration and tool-calling architectures
- Deep understanding of:
- LLM limitations, evaluation, and optimisation strategies
Core Engineering
- Strong Python/Pyspark engineering expertise (production-grade development) with proven API integration experience
- Deep data analysis experience and handling large volume of data
- Fabric/Azure Databricks/Snowflake data engineering integration skills
- Good exposure to:
- Cloud platforms (Azure/AWS/GCP)
- SQL
- Containers, CI/CD, monitoring
Cloud & Platform
- Hands-on experience with Azure / AWS / GCP
- Familiarity with:
- Containers (Docker/Kubernetes)
- CI/CD pipelines
- Monitoring & observability
Data / AI Foundations (Mandatory)
Prior experience in one or more:
- Data Engineering (ETL/ELT, pipelines, orchestration)
- Data Science / ML lifecycle (especially NLP)
- Analytics engineering / data products
Good-to-Have / Preferred
- Fine-tuning techniques (LoRA, PEFT, prompt tuning)
- Experience with Azure AI stack (Azure OpenAI, Cognitive Search)
- Knowledge of knowledge graphs, semantic layers, or enterprise search
- Experience in domain-specific GenAI solutions (Insurance, BFSI, Healthcare)
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- WP

Data EngineerRecently posted Auto Apply
WPP · Chennai · Hybrid · Posted 18 Nov 2026 🇮🇳
SQLApache SparkDatabricks+9TechnologySalary not listed - JU

Data Engineer - II (Biometrics)Recently posted Auto Apply
Jumio · Bengaluru · Hybrid · Posted 18 Nov 2026 🇮🇳
SQLAWSETL+5TechnologySalary not listed - CH

Senior Data EngineerRecently posted Auto Apply
Cohere Health · Hyderabad · Hybrid · Posted 17 Nov 2026 🇮🇳
SQLApache SparkAWS+6TechnologySalary not listed - B2
Senior Fabric Lead Data Engineer - R01572945 Auto Apply
Brillio 2 · Bengaluru · Hybrid · Posted 22 Oct 2026 🇮🇳
SQLGitApache Spark+6TechnologySalary not listed - WE
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekdayworks · Bengaluru · On-site · Posted 16 Nov 2026 🇮🇳
Technology₹1400k - ₹2000k/yr - V1
Senior Oracle Fusion Data Migration ConsultantRecently posted Auto Apply
Version 1 · Bengaluru, KA · Hybrid · Posted 16 Nov 2026 🇮🇳
OraclePL/SQLSQL+6TechnologySalary not listed - WA
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekday AI · Chennai, Tamil Nadu · On-site · Posted 16 Nov 2026 🇮🇳
GCPSQLAirflow+6TechnologySalary not listed - WA
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekday AI · Hyderabad, Telangana · On-site · Posted 16 Nov 2026 🇮🇳
GCPSQLAirflow+6TechnologySalary not listed - WA
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekday AI · Pune, Maharashtra · On-site · Posted 16 Nov 2026 🇮🇳
GCPSQLAirflow+6TechnologySalary not listed - WA
GCP(Big query + SQL) Data EngineerRecently posted Auto Apply
Weekday AI · Bengaluru, Karnataka · On-site · Posted 16 Nov 2026 🇮🇳
GCPSQLAirflow+6TechnologySalary not listed - EX
Technical Data managerRecently posted Auto Apply
Excelya · Bengaluru, Karnataka · Hybrid · Posted 16 Nov 2026 🇮🇳
GCPOracleMicrosoft Excel+2TechnologySalary not listed - BG
KNIME SpecialistRecently posted Auto Apply
Bosch Group · bengaluru · On-site · Posted 13 Nov 2026 🇮🇳
SQLAWSETL+5TechnologySalary not listed
