Quick overview
Job description
In this role, you will:
-
Vision: Develop and execute a strategic vision and roadmap for ML Training and Inference Performance Optimization, ensuring scalability, reliability, and performance to support autonomous driving.
-
Technical acumen: Lead the design, implementation, and operation of a robust and efficient ML platform to enable the training, validation, serving, optimization and monitoring of ML models.
-
ML Performance Optimization: Drive end-to-end performance optimization for large-scale model training and inference, including distributed training efficiency, GPU utilization, memory and communication optimization, model compression (quantization, pruning, distillation), and low-latency on-vehicle inference that meets strict real-time and compute budgets.
-
Hiring: Attract, hire, and inspire a diverse world-class engineering team, fostering a culture of innovation, collaboration, and excellence.
-
Partnership: Collaborate closely with cross-functional teams, including ML researchers, software engineers, data engineers, and hardware engineers, to define requirements and align on architectural decisions.
-
Mentorship: Enable engineers on the team to grow their careers by providing the right opportunities and clear, timely feedback.
Qualifications
- 8+ years of relevant experience, including 3+ years of management experience managing engineers.
- Strong technical background in ML performance optimization, such as distributed training strategies (data, tensor, pipeline parallelism, FSDP/ZeRO), mixed-precision training, kernel-level optimization (CUDA, Triton), compiler stacks (torch.compile, XLA, TVM), quantization, and profiling/benchmarking across GPU and embedded accelerators.
- Experience building user-friendly ML Infrastructure that enabled large-scale model training and high-throughput, low-latency serving use cases.
- Experience with training frameworks like PyTorch, JAX, etc., leveraging GPUs for distributed model training.
- Experience with GPU-accelerated inference using TensorRT, Ray Serve, or similar frameworks.
- Proven track record of extensive cross-functional collaboration, partnering with research, product, hardware, and platform teams to align priorities, influence technical direction, and deliver measurable performance improvements across organizational boundaries.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- NO

Founding Engineering ManagerRecently posted Auto Apply
Noto · New York City · Hybrid · Posted 17 Nov 2026 🇺🇸
RecruitingSourcingNext.js+7EngineeringSalary not listed - UW
Software Development ManagerRecently posted Auto Apply
UWorld, LLC · Irving, Texas · On-site · Posted 17 Nov 2026 🇺🇸
Stakeholder ManagementOnboardingGCP+18TechnologySalary not listed - BJ
Engineering Manager - Wealth Management App Auto Apply
Bjakcareer · United States · Remote · Posted 29 Oct 2026 🇺🇸
Continuous ImprovementPerformance ManagementSystem DesignEngineeringSalary not listed - BJ
Engineering Manager - AI-Native Email App Auto Apply
Bjakcareer · United States · Remote · Posted 29 Oct 2026 🇺🇸
Continuous ImprovementPerformance ManagementSystem DesignSalary not listed - BJ
Engineering Manager - AI Payments App Auto Apply
Bjakcareer · United States · Remote · Posted 29 Oct 2026 🇺🇸
Continuous ImprovementPerformance ManagementSystem DesignSalary not listed - VU

Product & Software Engineering Manager, Network IntelligenceRecently posted Auto Apply
Vultr · Remote - United States · Remote · Posted 16 Nov 2026 🇺🇸
RecruitingNeo4jSQL+11Technology$2.5k/mo - SI

Head of Engineering (Director/VP) - VC Backed StartupsRecently posted Auto Apply
Signalfire · Remote - No Preference · Remote · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionDjangoDocker+32EngineeringSalary not listed - SI

Head of Engineering (Director/VP) - VC Backed StartupsRecently posted Auto Apply
Signalfire · NYC - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionDjangoDocker+32EngineeringSalary not listed - SI

Head of Engineering (Director/VP) - VC Backed StartupsRecently posted Auto Apply
Signalfire · Bay Area - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionDjangoDocker+32EngineeringSalary not listed - FI

Manager, Legal Solutions Engineering Auto Apply
Filevine · Salt Lake City · Hybrid · Posted 4 Nov 2026 🇺🇸
Case ManagementCustomer SuccessGong+3LegalSalary not listed - DD
Senior Manager, Engineering, Care ExpansionRecently posted Auto Apply
Deaa6ad2 D184 436b B69e 17f761da1d94 · San Francisco · Hybrid · Posted 16 Nov 2026 🇺🇸
SpringData PipelineMental HealthEngineeringSalary not listed - TT
Engineering LeadRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 17 Nov 2026 🇺🇸
PythonReactPostgreSQL+1Engineering$221k - $295k/yr
