Quick overview
Job description
About the Role
Join a team building high-performance training and inference systems for image, video, and world-model workloads. You will improve speed and efficiency across GPU kernels, distributed execution, and multi-node serving.
What You'll Do
Optimize training and inference performance for image, video, and world-model workloads.
Profile and remove bottlenecks at the kernel, memory, system, and cluster levels using Nsight and related tools.
Implement low-level optimizations with CUDA and Triton.
Design and improve distributed training and inference engines for diffusion models.
Improve communication performance across GPUs and nodes using NCCL, RDMA, InfiniBand, RoCE, and disaggregated serving approaches.
Build benchmarks and regression tests to sustain performance improvements in production.
Co-design kernels, runtimes, and models with hardware capabilities in mind.
What We're Looking For
Two or more years of experience in deep learning training or inference systems, distributed systems, or related ML systems work.
At least one year of recent, hands-on experience with ML systems or GPU performance.
Experience authoring core features in a training or inference framework, rather than deployment or integration work alone.
Hands-on GPU kernel development for NVIDIA hardware using CUDA, CUTLASS, Triton, or PTX, including writing kernels directly.
Experience improving inference or training performance across kernels, runtimes, or distributed execution.
Strong machine learning and computer science fundamentals, with a degree in computer science or a related quantitative field.
Experience optimizing diffusion, video, image, or other multimodal workloads is valuable.
Compensation & Benefits
Annual base salary: $180,000 to $260,000. Visa sponsorship is available.
Location
On-site in Menlo Park, California, United States.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- CO

E11 Bio - Machine Learning Scientist I/IIRecently posted Auto Apply
Convergentresearch · Alameda · On-site · Posted 13 Nov 2026 🇺🇸
GCPAWSComputer Vision+1Technology$130k - $225k/yr - TT
Member of Technical Staff, Applied MLRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 13 Nov 2026 🇺🇸
Continuous ImprovementLLMPython+1$175k - $350k/yr - TT
Member of Technical Staff, Reinforcement LearningRecently posted Auto Apply
True Talent Solutions Partners · Remote · Remote · Posted 12 Nov 2026 🇺🇸
LLMPyTorchPython+1$250k - $400k/yr - LL
Physics-Informed Machine Learning - Postdoctoral ResearcherRecently posted Auto Apply
LLNL · Livermore, CA · Hybrid · Posted 11 Nov 2026 🇺🇸
Deep LearningPyTorchPython+2Healthcare$123.0k/yr - BH
Applied ML Engineer, Agents & AutomationRecently posted Auto Apply
Bask Health · United States · Remote · Posted 12 Nov 2026 🇺🇸
GitAWSContinuous Improvement+11TechnologySalary not listed - BH
Machine Learning Engineering InternRecently posted Auto Apply
Bask Health · United States · Remote · Posted 12 Nov 2026 🇺🇸
SQLGitAWS+16TechnologySalary not listed - BH
Machine Learning Engineer, PersonalizationRecently posted Auto Apply
Bask Health · United States · Remote · Posted 12 Nov 2026 🇺🇸
Next.jsSQLGit+15TechnologySalary not listed - BH
Applied ML Engineer, Care ExperienceRecently posted Auto Apply
Bask Health · United States · Remote · Posted 12 Nov 2026 🇺🇸
OnboardingDrizzleNext.js+18TechnologySalary not listed - BH
ML Systems EngineerRecently posted Auto Apply
Bask Health · United States · Remote · Posted 12 Nov 2026 🇺🇸
DockerGitAWS+12TechnologySalary not listed - BH
Machine Learning Engineer, Search & DiscoveryRecently posted Auto Apply
Bask Health · United States · Remote · Posted 12 Nov 2026 🇺🇸
GitAWSContinuous Improvement+8TechnologySalary not listed - BH
Machine Learning Engineer, Evaluation & ReliabilityRecently posted Auto Apply
Bask Health · United States · Remote · Posted 12 Nov 2026 🇺🇸
GitAWSCompliance+14TechnologySalary not listed - WA
ML Infrastructure and Performance Engineer, AI Expert (Remote)Recently posted Auto Apply
Weekday AI · United States · Remote · Posted 12 Nov 2026 🇺🇸
AWSCUDACompliance+3$90 - $120/hr