Quick overview
Job description
About the Role
Join an AI/ML systems team building efficient training and inference infrastructure for image, video, and world-model workloads. You will improve performance across GPU kernels, distributed execution, and multi-node serving systems.
What You'll Do
Optimize training and inference performance for image, video, and world-model workloads.
Profile bottlenecks at the kernel, memory, system, and cluster levels using Nsight and related tools.
Implement low-level optimizations in CUDA and Triton.
Design and improve distributed training and inference engines for diffusion models.
Improve communication performance across GPUs and nodes using technologies such as NCCL and RDMA.
Build benchmarks and regression tests to preserve performance improvements in production.
Co-design kernels, runtimes, and models with the target hardware in mind.
What We're Looking For
At least 2 years of experience in deep learning training or inference systems, distributed systems, or related ML systems work.
Hands-on experience improving inference or training performance, including GPU kernels, runtimes, or distributed execution.
Experience authoring core features in an inference or training framework, rather than focusing only on deployment or integration.
Direct experience writing kernels for NVIDIA GPUs using CUDA, CUTLASS, Triton, or PTX.
Strong machine learning and computer science fundamentals, supported by a degree in computer science or a related quantitative field.
Experience optimizing diffusion, video, image, or other multimodal workloads is valuable.
Compensation & Benefits
Base salary: $180,000 to $260,000 annually. Visa sponsorship is available.
Location
On-site in Menlo Park, California, United States.
Similar jobs
- OK

Staff Engineer, Machine Learning & Data InfrastructureRecently posted Auto Apply
OKX · San Jose · Hybrid 🇺🇸
SQLScalaApache Spark+9Technology$214.7k - $322.0k/yr - EV

Senior Machine Learning (ML) Engineer (CCC Casualty / Claims Intelligence)Recently posted Auto Apply
EvolutionIQ · Chicago · Remote 🇺🇸
SQLLLMPython+3Technology$180k - $225k/yr - AI

Senior Machine Learning Engineer, RelevanceRecently posted Auto Apply
Airbnb · United States · Hybrid 🇺🇸
ScalaA/B TestingAirflow+11Technology$200k - $235k/yr - RO

Principal Machine Learning Engineer - MatchmakingRecently posted Auto Apply
Roblox · San Mateo · Hybrid 🇺🇸
LeverMachine LearningTechnology$295.3k/yr - BJ
AI Phone - Applied ML / Model EngineerRecently posted Auto Apply
Bjakcareer · United States · Remote 🇺🇸
NLPDeep LearningLLM+2Salary not listed - BJ
AI Phone - On-device AI / ML Systems EngineerRecently posted Auto Apply
Bjakcareer · United States · Remote 🇺🇸
C++PythonTensorFlow+1TechnologySalary not listed - TT
Founding ML Research EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site 🇺🇸
DockerComputer VisionHugging Face+3$180k - $230k/yr - TT
Founding Reinforcement Learning EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site 🇺🇸
AWSLLMPyTorch+3Engineering$125k - $200k/yr - AY
Machine Learning Architect Auto Apply
Ayosemi · Boston · On-site 🇺🇸
PyTorchPythonTensorFlow+1TechnologySalary not listed - BA

Staff Machine Learning EngineerRecently posted Auto Apply
Babylist · United States · Hybrid 🇺🇸
MySQLSwiftGit+24Technology$233.5k - $290.7k/yr - AD

Senior Machine Learning Engineer, Financial ProductsRecently posted Auto Apply
Adyen · San Francisco · Hybrid 🇺🇸
DockerSQLMLOps+12Technology$227.5k - $317k/yr - TT
Senior Data & Machine Learning EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site 🇺🇸
SQLETLdbtTechnology$200k - $300k/yr