Quick overview
Job description
The Role
You will own the technical side of our largest and most complex inference deals, from first discovery call to go-live. You're the trusted technical counterpart for our customers' CTOs and ML leads, you design the setups that run their models, and you work hand in hand with our commercial team to get deals closed.
You'll be one of two senior technical owners of our inference deals. Together with our Inference Sales Engineering lead, you'll also turn what we learn in the field into a repeatable playbook and product.
What You'll Do
Own the technical side of our largest and most complex inference deals end to end, from discovery to go-live
Be the senior technical counterpart for customers' CTOs and ML leads on architecture, sizing, SLAs, latency/throughput trade-offs and cost
Design dedicated inference setups: model choice, GPU type and count, parallelism, quantization, inference engine and configuration
Lead benchmarks and proofs of concept, and turn the results into clear recommendations
Scope customer customizations with our engineering team and decide what becomes product
Build the playbook and tooling for matching workloads to GPUs, and feed our roadmap with what you learn in the field
Work in tandem with our commercial team on pricing, proposals and the technical parts of contracts
What We're Looking For
A degree in computer science, data science or a closely related field
4+ years in a customer-facing technical role, e.g. solutions or sales engineer, forward deployed engineer, ML engineer working closely with customers, or technical consultant
Hands-on experience with LLM inference and model serving (e.g. vLLM, SGLang, TensorRT-LLM, Triton) and GPU sizing
A track record of owning the technical side of complex B2B deals, ideally with enterprise customers
You're credible with customer CTOs and engineers alike, and you explain trade-offs clearly
Entrepreneurial mindset: give you an outcome, and you find a way without getting blocked
Fluent English
Bonus Points
Experience at an inference provider, GPU cloud or AI infrastructure company
Benchmarking and performance optimization: throughput, latency, cost per token
Experience with quantization, parallelism strategies, KV-cache and batching
Startup experience
German
Why us?
Outstanding team: Work with some of the best engineers in the world, coming from hedge funds, big tech, AI startups and top universities
Once in a lifetime opportunity: Early-stage company in the fastest-growing market in the world
Ownership: Shape how European AI companies access GPU compute
European mission: Build sovereign, GDPR-compliant AI infrastructure for the next generation of deep-tech
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- SS
AI Requirements Engineer Public Sector (m/w/d)Recently posted Auto Apply
Sopra Steria · bundesweit · Hybrid · Posted 12 Nov 2026 🇩🇪
DockerPythonGenerative AITechnologySalary not listed - SS
Senior Consultant AI (m/w/d)Recently posted Auto Apply
Sopra Steria · bundesweit · On-site · Posted 12 Nov 2026 🇩🇪
PythonGenerative AITechnologySalary not listed - SS
AI Architect - Public Sector (m/w/d)Recently posted Auto Apply
Sopra Steria · bundesweit · On-site · Posted 12 Nov 2026 🇩🇪
MicroservicesHelmJenkins+6TechnologySalary not listed - SS
AI Consultant – GenAI & NLP Public Sector (m/w/d)Recently posted Auto Apply
Sopra Steria · bundesweit · On-site · Posted 12 Nov 2026 🇩🇪
MLOpsNLPJava+8TechnologySalary not listed - RP
Senior Forward Deployed AI Engineer (m/f/d)Recently posted Auto Apply
Redcare Pharmacy · Berlin, BE · Hybrid · Posted 14 Nov 2026 🇩🇪
GitMLOpsMental Health+4TechnologySalary not listed - RP
Senior Forward Deployed AI Engineer (m/f/d)Recently posted Auto Apply
Redcare Pharmacy · München, BY · Hybrid · Posted 14 Nov 2026 🇩🇪
GitMLOpsMental Health+4TechnologySalary not listed - RP
Senior Forward Deployed AI Engineer (m/f/d)Recently posted Auto Apply
Redcare Pharmacy · Cologne · Hybrid · Posted 14 Nov 2026 🇩🇪
GitMLOpsMental Health+4TechnologySalary not listed - HS
Senior AI Consultant (w/m/d) – Hands‑on | Microsoft Data & AI | NürnbergRecently posted Auto Apply
Hitachi Solutions · Nuremberg, BY · Hybrid · Posted 13 Nov 2026 🇩🇪
Generative AIOperations & Project ManagementSalary not listed - MI

Senior AI Deployment StrategistRecently posted Auto Apply
Mistral.ai · Munich · Hybrid · Posted 13 Nov 2026 🇩🇪
Talent AcquisitionStrategic PlanningSalary not listed - EW

AI Infrastructure Co-Founder / CEO (100 % remote) (m/f/d)Recently posted Auto Apply
EWOR GmbH · Berlin · Remote · Posted 13 Nov 2026 🇩🇪
Salary not listed - EW

AI Infrastructure Co-Founder / CEO (100 % remote) (m/f/d)Recently posted Auto Apply
EWOR GmbH · Leipzig · Remote · Posted 13 Nov 2026 🇩🇪
Salary not listed - EW

AI Infrastructure Co-Founder / CEO (100 % remote) (m/f/d)Recently posted Auto Apply
EWOR GmbH · Vallendar · Remote · Posted 13 Nov 2026 🇩🇪
Salary not listed