Quick overview
Job description
About the Role
Join an AI team building training and inference systems for image, video, and world-model workloads. You will improve performance across the stack, from GPU kernels to distributed training and serving.
What You'll Do
Optimize training and inference performance for image, video, and world-model workloads.
Profile and resolve bottlenecks across kernels, memory, systems, and clusters using Nsight and related tools.
Implement low-level optimizations with CUDA and Triton.
Design and improve distributed training and inference engines for diffusion models.
Improve communication performance across GPUs and nodes using NCCL, RDMA, InfiniBand, and RoCE.
Build benchmarking and regression systems to maintain performance gains in production.
Co-design kernels, runtimes, and models with hardware constraints in mind.
What We're Looking For
Two or more years of experience in deep learning training or inference systems, or distributed systems.
At least one year of recent, hands-on ML systems or GPU performance work.
Experience authoring core features in an inference or training framework, such as vLLM, SGLang, TensorRT-LLM, or Megatron.
Direct GPU kernel development with CUDA, CUTLASS, Triton, or PTX on NVIDIA GPUs.
Strong machine learning and computer science fundamentals, with a degree in computer science or a related quantitative field.
Experience optimizing inference or training performance, ideally for diffusion, video, image, or other multimodal workloads.
Compensation & Benefits
Base salary is $180,000 to $260,000 annually. Visa sponsorship is available.
Location
On-site in Menlo Park, California, United States.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- TT
Member of Technical Staff, Applied MLRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 15 Nov 2026 🇺🇸
Continuous ImprovementLLMPython+1$175k - $350k/yr - TT
Senior AI/ML EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 15 Nov 2026 🇺🇸
LLMPythonRAGTechnology$180k - $275k/yr - TT
Computer Vision ML / Research EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 15 Nov 2026 🇺🇸
OpenCVRoboticsCUDA+3Technology$180k - $245k/yr - WE

Senior Staff Machine Learning Scientist, Assets Auto Apply
Webflow · United States · Remote 🇺🇸
CADComputer VisionDeep Learning+6TechnologySalary not listed - CI
AI/ML Engineer, Internal Platforms - REMOTERecently posted Auto Apply
CONFISA INTERNATIONAL GROUP · Pembroke Pines, FL · Remote · Posted 15 Nov 2026 🇺🇸
FastAPIGCPAWS+10TechnologySalary not listed - BF

Machine Learning Engineer - ModerationRecently posted Auto Apply
Black Forest Labs · San Francisco (United States) · On-site · Posted 15 Nov 2026 🇺🇸
CopyrightGenerative AIRAGTechnology$220k - $280k/yr - TT
Founding ML Research EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 15 Nov 2026 🇺🇸
Computer VisionPyTorchPython+1$180k - $230k/yr - TT
Senior Data & Machine Learning EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York City · On-site · Posted 15 Nov 2026 🇺🇸
SQLETLdbt+1Technology$200k - $300k/yr - TI

Senior Research Engineer, Computer Vision Auto Apply
Tutor Intelligence · Watertown · Hybrid · Posted 7 Nov 2026 🇺🇸
OpenCVRoboticsC+++2TechnologySalary not listed - TI

Machine Learning Engineer, Robotics Auto Apply
Tutor Intelligence · Watertown · Hybrid · Posted 2 Nov 2026 🇺🇸
RoboticsComputer VisionDeep Learning+3TechnologySalary not listed - TI

Perception Engineer, Robot Safety Auto Apply
Tutor Intelligence · Watertown · Hybrid · Posted 2 Nov 2026 🇺🇸
RoboticsC++Lever+1EngineeringSalary not listed - PL

Sr. Applied Machine Learning Engineer Auto Apply
Plugmotors · Los Angeles · On-site · Posted 6 Nov 2026 🇺🇸
LLMPythonTelematics+4Technology$164k - $200k/yr