Quick overview
Job description
Your Mission & Challenges
As Group Lead Edge AI, you own the team that turns cutting-edge models into production-grade, on-device intelligence. You set the technical direction, make the hard calls on hardware and architecture, and stay hands-on enough to dive into a profiler when things get tough.
Own the roadmap: Drive on-device AI from research to shipped product.
Build and lead the team: Hire, mentor, and grow a team of edge AI engineers into the best in the field.
Deploy at the edge: Take models from trained to deployed using quantization, pruning, distillation, and every trick it takes to make them fast and lean on embedded accelerator platforms (e.g. NVIDIA Jetson, Qualcomm IQ-series).
Own the toolchain end to end: Cover model export and inference optimization frameworks (e.g. ONNX, TensorRT, AIMET) and the SDKs that turn a model into a working robot behavior.
Partner across functions: Work with Hardware, Software, and Product to push the limits of what fits in the latency, power, and memory budget you're given.
Set the bar for quality: Own benchmarking, on-device evaluation, and performance regression testing across every hardware target we ship.
Get hands-on when it counts: Debug an accuracy drop after quantization, chase down a latency spike, solve the problem nobody else can.
What We Can Look Forward To
Strong academic foundation: An excellent Master's or PhD in Computer Science, Electrical Engineering, Embedded Systems, or a related field.
Proven experience: 7+ years in ML or embedded AI engineering, with 2+ years leading technically. Real production deployment on embedded accelerators, not just papers.
Hardware fluency: Hands-on experience with embedded AI hardware platforms (e.g. NVIDIA Jetson, Qualcomm IQ-series, or comparable).
Optimization mastery: Deep expertise in model optimization from the model side to the metal: quantization, pruning, distillation, and architecture search.
Toolchain expertise: Fluency with common model optimization and deployment toolchains (e.g. ONNX, TensorRT, AIMET, or equivalent vendor SDKs).
Technical depth: Strong Python and C++, PyTorch experience, and comfort with embedded Linux and low-level profiling.
The right mindset: A conviction that the only real test is the target chip, not the training cluster.
Leadership & communication: The ability to lead engineers, make calls under uncertainty, and speak fluently to researchers, hardware engineers, and product alike. Professional English required; German a strong plus (B2 to C1).
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your CV get past this employer's screening? Check your CV against this job, free
Similar jobs
- ST
AI Solutions Engineer (All genders)Recently posted Auto Apply
STARK · Munich · Hybrid · Posted 20 Nov 2026 🇩🇪
Google CloudLLMPython+3TechnologySalary not listed - ST
AI Solutions Engineer (All genders)Recently posted Auto Apply
STARK · Berlin · Hybrid · Posted 20 Nov 2026 🇩🇪
Google CloudLLMPython+3TechnologySalary not listed - CL

Lead AI EngineerRecently posted Auto Apply
Clera · Düsseldorf · On-site · Posted 21 Nov 2026 🇩🇪
ERPCustomer SuccessGDPR+3Technology€100k - €115k/yr - EV

LLM Engineer — Post-Training (Remote - Germany)Recently posted Auto Apply
Everai · Germany · Remote · Posted 20 Nov 2026 🇩🇪
Web3Generative AIEngineering€75k - €125k/yr - HR
Intern - AI Systems Research Auto Apply
Huawei Research Center Germany · Dresden · On-site 🇩🇪
Deep LearningAutonomous DrivingC+++2Salary not listed - DA

Senior Manager, AI Forward Deployed EngineeringRecently posted Auto Apply
Databricks · Munich · Hybrid · Posted 19 Nov 2026 🇩🇪
GCPMicrosoft ExcelAWS+9Salary not listed - DA

AI Forward Deployed Engineer - GermanyRecently posted Auto Apply
Databricks · Munich · Hybrid · Posted 20 Nov 2026 🇩🇪
GCPMicrosoft ExcelApache Spark+16Salary not listed - SI
Working Student SAP Engagement Cloud (f/m/d) – AI Product Builder for Product BrainRecently posted Auto Apply
SAP IT Business Systeme · Walldorf, BW · Hybrid · Posted 16 Nov 2026 🇩🇪
ConfluenceLLMPython+6TechnologySalary not listed - CE

Senior Applied AI Solution EngineerRecently posted Auto Apply
Celonis · Munich · Hybrid · Posted 19 Nov 2026 🇩🇪
Talent AcquisitionSQLScikit-learn+10Salary not listed - CE

Senior AI Transformation & Innovation ConsultantRecently posted Auto Apply
Celonis · Munich · Hybrid · Posted 19 Nov 2026 🇩🇪
Talent AcquisitionSQLScikit-learn+10Salary not listed - AL

Senior AI Researcher- Pre-training (f/m/d) Auto Apply
Alephalpha · Heidelberg · Hybrid · Posted 13 Nov 2026 🇩🇪
Mental HealthPyTorchPython+1Salary not listed - AL

AI Researcher - Pre-training (f/m/d) Auto Apply
Alephalpha · Berlin · Hybrid · Posted 9 Nov 2026 🇩🇪
LinearPyTorchPython+1Salary not listed
