Why this role stands out
This hybrid role offers an exciting opportunity to contribute to cutting-edge foundation model development at a leading smart technology company, XPENG, perfect for ambitious mid-senior engineers passionate about AI and autonomous systems. You'll thrive by leveraging your machine learning expertise to shape the future of intelligent mobility. Apply now to join a dynamic team and drive innovation in a rapidly evolving industry.
Quick overview
Job description
Key Responsibilities
-
Design and implement large-scale multi-modal architectures (e.g., vision–language–action transformers) for end-to-end autonomous driving.
-
Develop pretraining and fine-tuning strategies leveraging massive labeled and unlabeled fleet data (images, video, LiDAR, CAN bus, maps, human driving behaviors, etc.).
-
Research and integrate cross-modal alignment (e.g., visual grounding, temporal reasoning, policy distillation, imitation and reinforcement learning) to improve model interpretability and action quality.
-
Collaborate with infrastructure engineers to scale training across thousands of GPUs using distributed training frameworks (FSDP, DDP, etc.).
-
Conduct systematic ablation, evaluation, and visualization of model behavior across perception, reasoning, and planning tasks.
-
Contribute to model deployment optimization, including quantization, export, and latency–accuracy trade-offs for onboard execution.
Minimum Qualifications
-
Master’s degree or higher in Computer Science, Electrical/Computer Engineering, or related field, with 3+ years of experience in deep learning research or productization.
-
Strong proficiency in PyTorch and modern transformer-based model design.
-
Experience in large-scale pretraining or multi-modal modeling (vision, language, or planning).
-
Deep understanding of representation learning, temporal modeling, and self-supervised or reinforcement learning techniques.
-
Familiarity with distributed training (DDP, FSDP) and large-batch optimization.
Preferred Qualifications
-
PhD in CS/CE/EE or related field, with 1+ years of relevant industry experience.
-
Publication record in top-tier AI conferences (CVPR, ICCV, NeurIPS, ICLR, ICML, ECCV).
-
Prior experience building foundation or end-to-end driving models, or LLM/VLM architectures (e.g., ViT, Flamingo, BEVFormer, RT-2, or GRPO-style policies).
-
Familiarity with RLHF/DPO/GRPO, trajectory prediction, or policy learning for control tasks.
-
Proven ability to collaborate cross-functionally with infra, perception, and planning teams to deliver production-ready models.
-
A collaborative, research-driven environment with access to massive real-world data and industry-scale compute.
-
An opportunity to work with top-tier researchers and engineers advancing the frontier of foundation models for autonomous driving.
- Direct impact on the next generation of intelligent mobility systems.
-
Opportunity to make significant impact on the transportation revolution by the means of advancing autonomous driving.
-
Competitive compensation package.
-
Snacks, lunches, dinners, and fun activities.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- CO

Sr. Staff ML Infra Engineer - Offline Infra & TrainingRecently posted Auto Apply
Coupang · Mountain View · Hybrid · Posted 21 Nov 2026 🇺🇸
GCPScalaAWS+12Salary not listed - PA

Robotics Machine Learning EngineerRecently posted Auto Apply
Pantograph · San Francisco · On-site · Posted 21 Nov 2026 🇺🇸
RoboticsTechnology$150k - $260k/yr - TR

Robotics Intern, Generalist Robot Learning (GRL)Recently posted Auto Apply
Tri · Los Altos · Hybrid · Posted 18 Nov 2026 🇺🇸
RoboticsComputer VisionDeep Learning+4$45 - $65/hr - TT
Senior AI/ML EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 18 Nov 2026 🇺🇸
ScalaC++Java+4Technology$180k - $275k/yr - TT
Founding Research Engineer, Robot LearningRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 18 Nov 2026 🇺🇸
RoboticsEngineering$260k - $300k/yr - AB

Member of Technical Staff, Machine LearningRecently posted Auto Apply
Abridge · SF Office · Hybrid · Posted 18 Nov 2026 🇺🇸
NLPDeep LearningPyTorch+3Technology$205k - $300k/yr - AI

Machine Learning Engineer, Assistance EngineeringRecently posted Auto Apply
Airbnb · United States · Remote · Posted 18 Nov 2026 🇺🇸
MLOpsLLMReact+4Technology$162k - $186k/yr - TT
Founding ML Research EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 18 Nov 2026 🇺🇸
Computer VisionPyTorchPython+1$200k - $260k/yr - CL

Founding Machine Learning EngineerRecently posted Auto Apply
Clera · San Francisco · On-site · Posted 18 Nov 2026 🇺🇸
SQLScikit-learnPandas+2Technology$170k - $200k/yr - AT

Senior Manager, Machine Learning & AI – FinanceRecently posted Auto Apply
Atoms · San Francisco · Hybrid · Posted 18 Nov 2026 🇺🇸
DockerFastAPISQL+12Technology$220k - $250k/yr - 1A

Senior/Staff AI/ML Engineer, Plant IntelligenceRecently posted Auto Apply
1 Arc Power · Mountain View · Hybrid · Posted 18 Nov 2026 🇺🇸
SQLLinearPython+2Technology$237k - $257.5k/yr - TT
Member of Technical Staff, ML SystemsRecently posted Auto Apply
True Talent Solutions Partners · Menlo Park · On-site · Posted 18 Nov 2026 🇺🇸
CUDADeep LearningLLM+1$180k - $260k/yr
