Quick overview
Job description
About the Role
Join a team building the training and inference stack for image, video, and world-model workloads. You will improve performance across GPU kernels, distributed execution, and serving systems.
What You'll Do
Optimize training and inference performance for image, video, and world-model workloads.
Profile kernel, memory, system, and cluster bottlenecks using Nsight and related tools.
Implement low-level GPU optimizations with CUDA and Triton.
Design and improve distributed training and inference engines for diffusion models.
Improve communication performance across GPUs and nodes, including NCCL, RDMA, InfiniBand, RoCE, and disaggregated serving.
Build benchmarks and regression tests to sustain performance improvements in production.
Apply hardware-aware co-design across kernels, runtimes, and models.
What We're Looking For
At least 2 years of experience in deep learning training or inference systems, distributed systems, or related ML systems work.
At least 1 year of recent, hands-on experience with ML systems or GPU performance.
Experience authoring core features in an inference or training framework, rather than focusing only on deployment or integration.
Hands-on experience writing GPU kernels for NVIDIA hardware using CUDA, CUTLASS, Triton, or PTX.
Strong machine learning and computer science fundamentals, with a degree in computer science or a related quantitative field.
Experience optimizing inference or training performance, including GPU kernels, runtimes, or distributed execution.
Experience with diffusion, video, image, or other multimodal workloads is valuable.
Compensation & Benefits
Base salary: $180,000 to $260,000 annually. Visa sponsorship is available.
Location
On-site in Menlo Park, California, United States.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- TT
Founding ML Research EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 15 Nov 2026 🇺🇸
Computer VisionPyTorchPython+1$180k - $230k/yr - TT
Senior Data & Machine Learning EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York City · On-site · Posted 15 Nov 2026 🇺🇸
SQLETLdbt+1Technology$200k - $300k/yr - TI

Senior Research Engineer, Computer Vision Auto Apply
Tutor Intelligence · Watertown · Hybrid · Posted 7 Nov 2026 🇺🇸
OpenCVRoboticsC+++2TechnologySalary not listed - TI

Machine Learning Engineer, Robotics Auto Apply
Tutor Intelligence · Watertown · Hybrid · Posted 2 Nov 2026 🇺🇸
RoboticsComputer VisionDeep Learning+3TechnologySalary not listed - TI

Perception Engineer, Robot Safety Auto Apply
Tutor Intelligence · Watertown · Hybrid · Posted 2 Nov 2026 🇺🇸
RoboticsC++Lever+1EngineeringSalary not listed - PL

Sr. Applied Machine Learning Engineer Auto Apply
Plugmotors · Los Angeles · On-site · Posted 6 Nov 2026 🇺🇸
LLMPythonTelematics+4Technology$164k - $200k/yr - OV

Staff Machine Learning Engineer - Wildfire Auto Apply
Overstory · United States · Remote 🇺🇸
GCPMLOpsComputer Vision+5TechnologySalary not listed - LT
Staff ML Ops Engineer Auto Apply
Liveview Technologies · Seattle · Hybrid 🇺🇸
MLOpsComplianceComputer Vision+4$213.3k - $272k/yr - F7
Perception Engineer - Multimodal & Embodied AI (R6022)Recently posted Auto Apply
F7d8749a 72d6 407c Bf98 292ea630c73a · San Diego · Hybrid · Posted 10 Nov 2026 🇺🇸
Talent AcquisitionRoboticsCUDA+7Salary not listed - F7
Senior Staff Engineer, ML Ops (R4941)Recently posted Auto Apply
F7d8749a 72d6 407c Bf98 292ea630c73a · San Mateo · Hybrid · Posted 9 Nov 2026 🇺🇸
Talent AcquisitionMLOpsRobotics+14TechnologySalary not listed - F7
Senior Staff Engineer, ML Ops (R4941)Recently posted Auto Apply
F7d8749a 72d6 407c Bf98 292ea630c73a · San Diego · Hybrid · Posted 9 Nov 2026 🇺🇸
Talent AcquisitionMLOpsRobotics+14TechnologySalary not listed - F7
Staff Autonomy Engineer- Behavior and Motion Planning (R6007) Auto Apply
F7d8749a 72d6 407c Bf98 292ea630c73a · San Diego · Hybrid · Posted 5 Nov 2026 🇺🇸
Talent AcquisitionRoboticsC+++5EngineeringSalary not listed