Quick overview
Job description
About the Role
Join an AI team building high-performance training and inference systems for image, video, and world-model workloads. You will improve efficiency across GPU kernels, distributed engines, and multi-node infrastructure.
What You'll Do
Optimize training and inference performance for image, video, and world-model workloads.
Profile bottlenecks at the kernel, memory, system, and cluster levels using Nsight and related tools.
Implement low-level optimizations with CUDA and Triton.
Design and improve distributed training and inference engines for diffusion models.
Improve communication performance across GPUs and nodes using technologies such as NCCL, RDMA, InfiniBand, and RoCE.
Build benchmarking and regression tools to maintain performance gains in production.
Co-design kernels, runtimes, and models with hardware constraints in mind.
What We're Looking For
At least 2 years of experience in deep learning training or inference systems, distributed systems, or related ML systems work.
Hands-on GPU performance experience, including at least 1 year in a full-time role focused on ML systems or GPU performance.
Experience authoring core features in a training or inference framework, rather than only deploying or integrating one.
Direct NVIDIA GPU kernel development experience with CUDA, CUTLASS, Triton, or PTX.
Strong machine learning and computer science fundamentals, with a degree in computer science or a related quantitative field.
Experience optimizing inference or training performance, including GPU kernels, runtimes, or distributed execution.
Experience with diffusion, video, image, or other multimodal workloads is relevant.
Compensation & Benefits
Base salary is $180,000 to $260,000 annually. Visa sponsorship is available.
Location
On-site in Menlo Park, California, United States.
Similar jobs
- EH

Senior ML Engineer, Agentic AIRecently posted Auto Apply
Ellipsis Health · San Francisco - Hybrid · Hybrid 🇺🇸
Background ChecksComplianceDeep Learning+5Technology$160k - $210k/yr - TT
Founding ML Research EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site 🇺🇸
Computer VisionHugging FacePyTorch+2$180k - $230k/yr - TT
Founding Research Engineer, Robot LearningRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site 🇺🇸
RoboticsPyTorchPython+1Engineering$260k - $300k/yr - TT
Machine Learning Infrastructure EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site 🇺🇸
DockerGCPAWS+8Technology$200k - $400k/yr - TT
Member of Technical Staff, Applied MLRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site 🇺🇸
PythonMachine Learning$175k - $350k/yr - WS
Senior Machine Learning EngineerRecently posted Auto Apply
Wiser Solutions · Ontario, CA · Remote 🇺🇸
CADGenerative AITechnologyC$160k - C$200k/yr - HR

ML Infra Engineer Auto Apply
Humble Robotics · San Francisco · Remote 🇺🇸
RoboticsAnsibleScheduling+3Salary not listed - PH

Senior Machine Learning Engineer Auto Apply
Paradigm Health · US-Remote · Remote 🇺🇸
SQLClinical ResearchClinical Trials+5TechnologySalary not listed - SE
Senior Staff Machine Learning Engineer_Voice AIRecently posted Auto Apply
ServiceNow · Kirkland, Washington · Hybrid 🇺🇸
Generative AIPrompt EngineeringTechnology$201.3k - $352.3k/yr - RO

Staff Research Engineer, Robot Learning SystemsRecently posted Auto Apply
RoboForce · Milpitas · Hybrid 🇺🇸
RoboticsC++Python+1Engineering$225k - $265k/yr - RE

Machine Learning EngineerRecently posted Auto Apply
Reddit · San Francisco · Hybrid 🇺🇸
RoboticsData PipelineGoogle Cloud+5Technology$216.7k - $303.4k/yr - NA

Lead Bioinformatics & Machine Learning Scientist (Epigenomics)Recently posted Auto Apply
Natera · San Carlos · Hybrid 🇺🇸
ShellGitNumPy+7Technology$172k/yr