Quick overview
Job description
You'll collaborate with teams around the world, mentor rising talent, and participate in global forums. SAP's growth culture gives you the autonomy to explore new methods and the support to scale your impact internationally.
What You Bring
- Bachelor’s or Master’s degree (or pursuing one) in Computer Science, Data Science, AI, or a related field.
- 7+ years of experience delivering ML and generative AI solutions in production.
- Deep working knowledge of SAP data models, metadata structures, and core business processes end-to-end. (SAP knowledge is a strong accelerator)
- Hands-on experience with the SAP data and AI platform stack SAP Datasphere, SAP HANA Cloud Knowledge Graph Engine, SAP Business Data Cloud, SAP One Domain Model, SAP Graph API, and SAP Business Accelerator Hub.
- Deep expertise across the W3C stack (OWL, RDF/RDFS, SKOS, SHACL) and/or property graph query languages (Cypher, GQL).
- Strong expertise in agentic AI systems, including orchestration, planning, memory, and tool usage.
- Hands-on experience with LLM frameworks (e.g., LangChain, LlamaIndex, Semantic Kernel).
- Solid understanding of LLM techniques, including fine-tuning, prompt engineering, and RAG.
- Strong Python skills with ML frameworks (e.g., PyTorch, TensorFlow, Hugging Face).
- Experience building scalable, reliable AI systems with a focus on performance and maintainability.
- Familiarity with MLOps/LLMOps practices and cloud platforms (AWS, Azure, GCP).
- Strong analytical thinking, problem-solving, and clear communication skills.
- Hands-on experience with SAP BTP AI stack — SAP AI Core, Gen AI Hub, HANA Cloud, UCL registry for provisioning, and CAP/BTP services.
- Familiarity with AI governance, Data Integrity, Handling DPP/PII, and audit/traceability.
- Experience with CI/CD tooling (GitHub Actions, Jenkins, Piper) and containerization (Docker, Cloud Foundry/Kyma).
- Understanding of security practices- SaaS based Security Standards, IAS (OAuth2, XSUAA), customer-managed keys, Malware scanning.
What You Build
- Design and scale agentic AI systems, including multi-agent orchestration, tool integration, memory, and human-in-the-loop workflows.
- Design and maintain enterprise ontologies and semantic models that give AI agents accurate, grounded understanding of SAP and connected business landscapes, harmonizing data from SAP and external providers into unified semantic layers.
- Build LLM-powered applications using prompt engineering, RAG, tool calling, and reasoning pipelines.
- Build AI capabilities including RAG pipelines, embeddings, vector databases, and enterprise knowledge grounding that make SAP's agents accurate and reliable in production.
- Work with cloud and data platforms, including Databricks, SAP Datasphere, SAP HANA Cloud, AWS, Azure, and GCP to support reliable, scalable AI workflows.
- Fine-tune and adapt LLMs for domain-specific use cases such as code generation, transformation, and automation.
- Translate business requirements into end-to-end AI solutions, defining data, modelling, and evaluation strategies.
- Apply machine learning, deep learning, and statistical modeling to develop and evaluate AI solutions using real-world enterprise datasets.
- Develop and maintain high-quality data pipelines for training, validation, and continuous improvement.
- Lead experimentation and optimization using prompt tuning, PEFT, and model selection techniques.
- Ensure production readiness through evaluation, monitoring, observability, and cost-performance trade-offs.
- Collaborate with cross-functional teams and mentor junior engineers’/data scientists.
- Continuously evaluate emerging trends in generative AI and agentic systems.
- Productize Agentic SaaS based solutions on SAP BTP with proper multi-tenancy and lifecycle management.
- Implement CI/CD pipelines for agents (automated build, test, evaluation gates, deployment, rollback).
- Embed security and compliance by design - secure secrets/credential handling and AI guardrails.
Where You Belong:
SAP Private Cloud Cross Technology and Architecture unit that is driving technology-empowering innovations in business and people. It is part of the global organization Private Cloud, dedicated to delivering innovative solutions to meet our customers’ unique business process needs in Private Cloud.
- You will be joining a dynamic and passionate team dedicated to leveraging Agentic AI and Enterprise Ontologies to facilitate seamless interactions between individuals and information.
- We foster a culture of collaboration, learning, and growth, encouraging all team members to contribute ideas and perspectives.
- Enjoy the benefits of working within a diverse and international environment, with opportunities to collaborate with colleagues from around the globe.
Our vision is to become the premier strategic RISE with SAP enabler, driving accelerated innovation and technology adoption leveraging the SAP Business Technology Platform, focusing on a clean core approach.
Architectural thinking and hands-on coding skills. You design secure, scalable systems, reason about data structures and APIs, and use observability, 7+ years of experience delivering ML and generative AI solutions in production. Hands-on experience with the SAP data and AI platform stack SAP Datasphere, SAP HANA Cloud Knowledge Graph Engine, SAP Business Data Cloud, SAP One Domain Model, SAP Graph API, and SAP Business Accelerator Hub. Strong expertise in agentic AI systems, including orchestration, planning, memory, and tool usage.
About SAP
With a global network of customers, partners, employees, and thought leaders, SAP helps the world run better and improves people’s lives.
As a leader in enterprise applications and business AI, SAP stands at the nexus of business and technology. For over 50 years, organizations have trusted SAP to bring out their best by uniting business-critical operations spanning finance, procurement, HR, supply chain, and customer experience.
We win with inclusion
SAP’s culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone, regardless of background, feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.
SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or complete your application, please send an email with your request to the Recruiting Operations Team: Careers@sap.com.
For SAP employees: Only permanent roles are eligible for the SAP Employee Referral Program, according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training.
Qualified applicants will receive consideration for employment without regard to age, race, religion, national origin, ethnicity, gender (including pregnancy and childbirth), sexual orientation, gender identity or expression, protected veteran status, or disability, in compliance with applicable federal, state, and local legal requirements.
Successful candidates might be required to undergo a background verification with an external vendor.
AI Usage in the Recruitment Process
For information on the responsible use of AI in our recruitment process, please refer to our Guidelines for Ethical Usage of AI in the Recruiting Process.
Please note that any violation of these guidelines may result in disqualification from the hiring process.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- SI
AI Development ExpertRecently posted Auto Apply
SAP IT Business Systeme · Bengaluru, KA · Hybrid · Posted 19 Nov 2026 🇮🇳
Generative AIAgilePrompt EngineeringEngineeringSalary not listed - TE
SCADA EngineerRecently posted Auto Apply
Terabase Energy · India · Remote · Posted 18 Nov 2026 🇮🇳
Continuous ImprovementPLC ProgrammingSCADA+3EngineeringSalary not listed - CA
Senior FAST Engineer (Contract)Recently posted Auto Apply
Careers at KKR · Gurugram · Hybrid · Posted 18 Nov 2026 🇮🇳
SQLScrumCompliance+6EngineeringSalary not listed - OP

Associate Implementation Engineer Auto Apply
Opengov · Pune · On-site · Posted 29 Oct 2026 🇮🇳
SQLMicrosoft ExcelETL+7EngineeringSalary not listed - FL

Senior ABAP EngineerRecently posted Auto Apply
Floqast · Pune · Hybrid · Posted 18 Nov 2026 🇮🇳
SQLCPAPython+5EngineeringSalary not listed - ET

CSV Validation EngineerRecently posted Auto Apply
E Tech Group · Pune · Hybrid · Posted 18 Nov 2026 🇮🇳
ERPComplianceSCADA+2EngineeringSalary not listed - CL

Quality Engineer Auto Apply
Clinisys · Bengaluru · Hybrid · Posted 6 Nov 2026 🇮🇳
RecruitingSQLSelenium+9EngineeringSalary not listed - ON

Solution EngineerRecently posted Auto Apply
Onit · Pune · On-site · Posted 18 Nov 2026 🇮🇳
RubyMicrosoft OfficeArticulate+5EngineeringSalary not listed - SI
Senior Consultant - Python, MLops, Agentic AIRecently posted Auto Apply
SAP IT Business Systeme · Bengaluru · Hybrid · Posted 18 Nov 2026 🇮🇳
EngineeringSalary not listed - AC
Knowledge EngineerRecently posted Auto Apply
AccorCorpo · Gurugram, HR · Hybrid · Posted 18 Nov 2026 🇮🇳
SQLGoogle CloudLLM+2EngineeringSalary not listed - DR
Team Member - Engineering (Utility)Recently posted Auto Apply
Dr Reddy's Laboratories Limited · Baddi, HP · On-site · Posted 18 Nov 2026 🇮🇳
5SComplianceContinuous Improvement+6EngineeringSalary not listed - DR
Specialist - Process Engineering MSAT PeptidesRecently posted Auto Apply
Dr Reddy's Laboratories Limited · Visakhapatnam · On-site · Posted 18 Nov 2026 🇮🇳
ComplianceCorporate GovernanceSAP+2EngineeringSalary not listed