Quick overview
Job description
About the Role
Join an AI team building efficient training and inference systems for image, video, and world-model workloads. You will improve performance across GPU kernels, distributed execution, and multi-node serving.
What You'll Do
Optimize system and GPU performance for training and inference across image, video, and world-model workloads.
Profile and address bottlenecks at the kernel, memory, system, and cluster levels using Nsight and related tools.
Implement low-level optimizations with CUDA and Triton.
Design and improve distributed training and inference engines for diffusion models.
Improve communication performance across GPUs and nodes using NCCL, RDMA, InfiniBand, RoCE, and disaggregated serving approaches.
Build benchmarking and regression harnesses to preserve performance gains in production.
Collaborate on hardware-aware kernel, runtime, and model design.
What We're Looking For
Two or more years of experience in deep learning training or inference systems, distributed systems, or related ML systems work.
At least one year of hands-on ML systems or GPU performance work in a current or recent role.
Experience authoring core features in a training or inference framework, rather than focusing only on deployment or integration.
Direct GPU kernel development experience with CUDA, CUTLASS, Triton, or PTX on NVIDIA GPUs.
Experience improving inference or training performance across GPU kernels, runtime systems, or distributed execution.
Strong machine learning and computer science fundamentals, with a degree in computer science or a related quantitative field.
Experience optimizing diffusion, video, image, or other multimodal workloads is relevant.
Compensation & Benefits
Base salary: $180,000 to $260,000 annually. Visa sponsorship is available.
Location
On-site in Menlo Park, California, United States.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- TT
Founding ML Research EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 14 Nov 2026 🇺🇸
Computer VisionHugging FacePyTorch+1$180k - $230k/yr - TT
Member of Technical Staff, Reinforcement LearningRecently posted Auto Apply
True Talent Solutions Partners · Remote · Remote · Posted 13 Nov 2026 🇺🇸
LLMPyTorchPython+1$250k - $400k/yr - SE
Senior Machine Learning EngineerRecently posted Auto Apply
ServiceNow · Santa Clara, California · Hybrid · Posted 13 Nov 2026 🇺🇸
Generative AITechnology$161.3k - $274.2k/yr - VT

Machine Learning EngineerRecently posted Auto Apply
Voyager Technologies, Inc. · El Segundo · Hybrid · Posted 13 Nov 2026 🇺🇸
MATLABComputer VisionDeep Learning+3Technology$120k - $280k/yr - GA

Technical Lead, ML InfrastructureRecently posted Auto Apply
Gatik AI · Santa Clara · Hybrid · Posted 13 Nov 2026 🇺🇸
SQLMLOpsRobotics+7$180k - $260k/yr - FA

Staff Applied AI/ML Scientist, AcquisitionRecently posted Auto Apply
Faire · San Francisco · Hybrid · Posted 13 Nov 2026 🇺🇸
RecruitingSEODeep Learning+2Technology$246.5k - $339k/yr - DR

Senior AI/ML EngineerRecently posted Auto Apply
Dragos · United States · Hybrid · Posted 13 Nov 2026 🇺🇸
DockerRustSQL+5Technology$190k/yr - AU

Computer Vision EngineerRecently posted Auto Apply
Augmodo · United States · Remote · Posted 13 Nov 2026 🇺🇸
OpenCVRoboticsComputer Vision+6Technology$155k - $210k/yr - BB

Senior Algorithm EngineerRecently posted Auto Apply
Beacon Biosignals · Boston · Remote · Posted 13 Nov 2026 🇺🇸
Deep LearningPyTorchRequirements Gathering+2Engineering$170k - $220k/yr - BL

Senior Machine Learning Engineer, PlatformRecently posted Auto Apply
Block · Bay Area · Hybrid · Posted 13 Nov 2026 🇺🇸
AWSMLOpsCapacity Planning+11Technology$228.7k - $343.1k/yr - RO

Senior Machine Learning Engineer, Behavioral DetectionRecently posted Auto Apply
Roblox · San Mateo · Hybrid · Posted 13 Nov 2026 🇺🇸
FlinkPyTorchPython+2TechnologySalary not listed - CO

E11 Bio - Machine Learning Scientist I/IIRecently posted Auto Apply
Convergentresearch · Alameda · On-site · Posted 13 Nov 2026 🇺🇸
GCPAWSComputer Vision+1Technology$130k - $225k/yr