Quick overview
Job description
What You’ll Do
Build low-latency inference pipelines for on-device deployment, enabling real-time next-token and diffusion-based control loops in robotics
Design and optimize distributed inference systems on GPU clusters, pushing throughput with large-batch serving and efficient resource utilization
Implement efficient low-level code (CUDA, Triton, custom kernels) and integrate it seamlessly into high-level frameworks
Optimize workloads for both throughput (batching, scheduling, quantization) and latency (caching, memory management, graph compilation)
Develop monitoring and debugging tools to guarantee reliability, determinism, and rapid diagnosis of regressions across both stacks
What You’ll Bring
Deep experience in distributed systems, ML infrastructure, or high-performance serving (8+ years)
Production-grade expertise in Python, with strong background in systems languages (C++/Rust/Go)
Low-level performance mastery: CUDA, Triton, kernel optimization, quantization, memory and compute scheduling
Proven track record scaling inference workloads in both throughput-oriented cluster environments and latency-critical on-device deployments
System-level mindset with a history of tuning hardware–software interactions for maximum efficiency, throughput, and responsiveness
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- FA

Senior Applied AI/ML Scientist - Retailer GrowthRecently posted Auto Apply
Faire · San Francisco · Hybrid · Posted 20 Nov 2026 🇺🇸
SQLDeep LearningPython+2Technology$211k - $290.5k/yr - ND

Member of Technical Staff - Applied Scientist I [Reinforcement Learning and Simulation Environments]Recently posted Auto Apply
Ntt Data Aivista · San Francisco Bay Area · Hybrid · Posted 22 Nov 2026 🇺🇸
PythonMachine Learning$300k - $400k/yr - ND

Member of Technical Staff - Machine Learning Research Engineer IRecently posted Auto Apply
Ntt Data Aivista · San Francisco Bay Area · Hybrid · Posted 22 Nov 2026 🇺🇸
Machine LearningTechnology$300k - $400k/yr - CL

Founding Engineer, Recommendation SystemsRecently posted Auto Apply
Clera · San Francisco · On-site · Posted 22 Nov 2026 🇺🇸
SupabaseLLMPrisma+6Engineering$130k - $170k/yr - TT
Staff Machine Learning Engineer, VLA TrainingRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 21 Nov 2026 🇺🇸
RoboticsDeep LearningPyTorch+2Technology$250k - $300k/yr - TT
Senior Data & Machine Learning EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 21 Nov 2026 🇺🇸
SQLdbtMachine LearningTechnology$200k - $300k/yr - TT
Founding RL EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 21 Nov 2026 🇺🇸
SwiftAWSReact Native+4Engineering$125k - $200k/yr - AN

Research Engineer, FinetuningRecently posted Auto Apply
Anthropic · San Francisco · Hybrid · Posted 21 Nov 2026 🇺🇸
ConcreteGPTPython+2Engineering$500k - $850k/yr - CO

Sr. Staff ML Infra Engineer - Offline Infra & TrainingRecently posted Auto Apply
Coupang · Mountain View · Hybrid · Posted 21 Nov 2026 🇺🇸
GCPScalaAWS+12Salary not listed - PA

Robotics Machine Learning EngineerRecently posted Auto Apply
Pantograph · San Francisco · On-site · Posted 21 Nov 2026 🇺🇸
RoboticsTechnology$150k - $260k/yr - TR

Robotics Intern, Generalist Robot Learning (GRL)Recently posted Auto Apply
Tri · Los Altos · Hybrid · Posted 18 Nov 2026 🇺🇸
RoboticsComputer VisionDeep Learning+4$45 - $65/hr - TT
Senior AI/ML EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 18 Nov 2026 🇺🇸
ScalaC++Java+4Technology$180k - $275k/yr
