Why this role stands out
This role offers an exceptional opportunity to push the boundaries of multimodal foundation models within the cutting-edge field of autonomous driving, fostering significant career growth and skill development. You'll thrive here if you possess a deep understanding of representation learning, a passion for scalable AI systems, and the drive to bridge research and production. Apply now to contribute to a leading company shaping the future of AI!
Quick overview
Job description
Focus
Multimodal Foundation Models · Representation Learning · Method Innovation
We are looking for strong technical builders and researchers who deeply understand foundation models and representation learning beyond simply applying existing frameworks.
Ideal candidates should have:
- Strong experimental rigor
- Solid systems and modeling intuition
- Hands-on engineering ability
- Interest in scalable multimodal AI systems for real-world autonomy
We value people who can bridge research and production, and who care about robustness, scalability, efficiency, and practical deployment in large-scale autonomous driving systems.
Responsibilities
1. Large-Scale Foundation Model Pretraining
- Develop scalable pretraining pipelines for large-scale multimodal driving data
- Design and optimize training strategies for:
- Vision-language-action models
- Video foundation models
- Long-context temporal modeling
- Multimodal representation alignment
- Improve:
- Training stability
- Data efficiency
- Scaling efficiency
- Representation robustness
- Work on distributed training systems and large-scale model optimization using frameworks such as:
- PyTorch Distributed
- DeepSpeed
- Megatron-LM
2. Representation Learning & Method Innovation
- Design and improve self-supervised and multimodal learning methods for real-world autonomous driving systems
- Conduct architecture-level research on:
- Vision Transformers (ViT)
- Video / temporal architectures
- Multimodal fusion and alignment
- Embedding and retrieval systems
- Long-context and memory-efficient architectures
- Explore and improve:
- Pretraining objectives
- Loss functions
- Training paradigms
- Generalization and robustness
- Analyze model behavior through:
- Rigorous ablation studies
- Failure case analysis
- Representation probing and evaluation
3. Efficient Foundation Models & Scalable Deployment
- Improve the efficiency, scalability, and deployability of large multimodal foundation models for real-world autonomous driving systems
- Work on areas such as:
- Model quantization
- Knowledge distillation
- Efficient attention mechanisms
- Sparse architectures and Mixture-of-Experts (MoE)
- Long-context and memory-efficient modeling
- Inference acceleration and serving optimization
- Training and inference system efficiency
- Optimize model throughput, latency, memory usage, and deployment performance for large-scale production environments
- MS or PhD in:
- Computer Vision
- Machine Learning
- Robotics
- Computer Science
- Related fields
- Strong understanding of:
- Foundation models
- Self-supervised learning
- Representation learning
- Multimodal learning
- Large-scale pretraining
- Hands-on experience with methods such as:
- CLIP
- DINO / DINOv2
- MAE
- Contrastive learning
- Masked modeling
- MoE or scalable transformer architectures
- Experience with one or more of the following is highly valued:
- Video foundation models
- Long-context modeling
- Retrieval systems
- Efficient inference
- Distributed training
- Model compression and deployment optimization
- Strong publication record in top-tier venues is preferred:
- CVPR
- ICCV
- ECCV
- NeurIPS
- ICLR
- ICML
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- TU

AI Engineer – Manufacturing & ProductionRecently posted Auto Apply
Tutorintelligence · Watertown · On-site · Posted 16 Nov 2026 🇺🇸
SQLRoboticsCAD+5Manufacturing$150k - $190k/yr - TT
Founding AI Agent EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 16 Nov 2026 🇺🇸
RecruitingClinical TrialsOutreach+2$150k - $220k/yr - TT
AI SchedulerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 16 Nov 2026 🇺🇸
BIMConstruction ManagementPrimavera P6+2$140k - $200k/yr - TT
Founding AI EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 15 Nov 2026 🇺🇸
Next.jsPlaywrightNode.js+1Technology$216k - $250k/yr - ER

Head of Applied AI Auto Apply
Eragon · San Francisco · On-site · Posted 30 Oct 2026 🇺🇸
$350k - $500k/yr - OR
Research Engineer, AIRecently posted Auto Apply
Orbis · Remote - US · Remote · Posted 13 Nov 2026 🇺🇸
LLMPythonMachine LearningEngineeringSalary not listed - OR
Research Engineer, AI (Entry-Level) Auto Apply
Orbis · Remote - US · Remote · Posted 3 Nov 2026 🇺🇸
DockerLLMPython+2Salary not listed - WI
AI Value Delivery Lead (Partner Motion) Auto Apply
Within.ai · San Francisco (HQ) · On-site 🇺🇸
Six SigmaGenerative AISlackOperations & Project ManagementSalary not listed - SI
AI Transformation ManagerRecently posted Auto Apply
Sia · Bellevue, WA · On-site · Posted 13 Nov 2026 🇺🇸
ScrumLean Six SigmaPMP+5Operations & Project Management$142.8k - $147.9k/yr - SI
AI Transformation ManagerRecently posted Auto Apply
Sia · Philadelphia, PA · On-site · Posted 13 Nov 2026 🇺🇸
ScrumLean Six SigmaPMP+5Operations & Project Management$129.5k - $134.6k/yr - CO

Senior AI Engineer - Agentic Systems - OnsiteRecently posted Auto Apply
Conifers.ai · Dallas · Hybrid · Posted 15 Nov 2026 🇺🇸
LLMPythonPrompt EngineeringTechnologySalary not listed - CL

Mid-Level AI EngineerRecently posted Auto Apply
Clera · San Francisco · On-site · Posted 15 Nov 2026 🇺🇸
GCPAWSCompliance+7Technology$150k - $180k/yr