Quick overview
Job description
About Us
Sieve is a multimodal data lab building high-quality training datasets and evaluation environments for frontier AI across audiovisual modeling, robotics, and multimodal interaction. We pair exabyte-scale data infrastructure and global data collection operations with multimodal research to help machines learn how the world looks, sounds, moves, and responds. Our work spans real and virtual environments, from large-scale video and audio to human demonstrations and evaluations of reasoning and action. We believe data creation deserves the same rigor as model development, and that a close connection between data production, model training, and evaluation is essential to building AI that can understand and interact with the world.
We partner with top AI labs and did $XXM last quarter alone, as a team of ~45 people. We also raised our Series A from Tier 1 firms such as Matrix Partners, Swift Ventures, Y Combinator, and AI Grant.
Why Now
Sieve is one of the most capital-efficient teams in AI, with roughly 30 people serving the world's leading AI labs across every major data modality. You'll join early, own problems end-to-end, and watch your work ship directly into the models defining the frontier.
About the Role
Physical AI runs on data that captures how the real world looks, moves, and fits together in 3D. As a perception-focused Machine Learning Engineer at Sieve, you'll build the systems that turn raw egocentric, robot, and sensor footage into the training data that robotics and world-model teams depend on.
You'll bring the computer vision instincts of someone who has shipped perception for robots, devices, or autonomous vehicles, and apply them to datasets at a scale few teams ever touch. One week you might recover camera pose and scene geometry across thousands of hours of first-person video. The next, you might build a hand and object tracking pipeline, or design a benchmark that tells a lab whether their data actually improves manipulation policies.
What You'll Do
Build perception pipelines for depth, pose, tracking, segmentation, and 3D reconstruction over large video and multi-sensor datasets
Apply SLAM, visual odometry, and structure-from-motion to recover camera trajectories and scene geometry at scale
Fine-tune vision and vision-language models for embodied tasks like hand-object interaction, activity understanding, and scene understanding
Develop automated QA and filtering systems that catch calibration errors, sync drift, motion blur, and other data defects before they reach customers
Create benchmarks and evaluation frameworks that measure how much a dataset improves downstream robotics and world-model performance
Work directly with frontier labs and robotics teams to turn vague data requirements into production pipelines
Ship fast, measure results, and iterate based on how the data performs in the real world
Requirements
3+ years building production perception or computer vision systems for robotics, AR/VR devices, autonomous vehicles, or similar
Hands-on experience with SLAM, visual-inertial odometry, multi-view geometry, or 3D reconstruction
Strong Python skills and fluency with PyTorch; C++ is a plus
Comfortable with multi-sensor data such as camera intrinsics and extrinsics, IMU, depth, and time synchronization
Experience training, fine-tuning, or deploying modern deep learning models for vision
Sharp intuition for evaluation, edge cases, and what makes data actually useful for training
Comfortable owning a problem from the customer conversation to a deployed pipeline
Excited about Physical AI and the data that will power it
In person at our SF HQ
Bonus
Experience with neural scene representations such as NeRFs or Gaussian splatting
Background working with egocentric or teleoperation data
Publications or open-source work in perception, 3D vision, or robotics
Benefits
401k + Full Health Insurance
Breakfast, Lunch, and Dinner covered and your choice of snacks
Ubers covered home
All roles at Sieve require you to be onsite in San Francisco 5 days per week.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- TT
Senior AI/ML EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 17 Nov 2026 🇺🇸
DockerGCPLLM+7Technology$180k - $275k/yr - RG
Machine Learning EngineerRecently posted Auto Apply
RZR Global Inc. · San Francisco · Hybrid · Posted 17 Nov 2026 🇺🇸
RustSQLFlink+10TechnologySalary not listed - SI

Principal AI/ML Engineer - VC Backed StartupsRecently posted Auto Apply
Signalfire · Remote - No Preference · Remote · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionDockerGCP+23TechnologySalary not listed - SI

Principal AI/ML Engineer - VC Backed StartupsRecently posted Auto Apply
Signalfire · NYC - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionDockerGCP+23TechnologySalary not listed - SI

Principal AI/ML Engineer - VC Backed StartupsRecently posted Auto Apply
Signalfire · Bay Area - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
Talent AcquisitionDockerGCP+23TechnologySalary not listed - SI

Head of AI/ML (Director/VP) - VC Backed StartupsRecently posted Auto Apply
Signalfire · Remote - No Preference · Remote · Posted 17 Nov 2026 🇺🇸
RecruitingTalent AcquisitionWorkforce Planning+22TechnologySalary not listed - SI

Head of AI/ML (Director/VP) - VC Backed StartupsRecently posted Auto Apply
Signalfire · NYC - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
RecruitingTalent AcquisitionWorkforce Planning+22TechnologySalary not listed - SI

Head of AI/ML (Director/VP) - VC Backed StartupsRecently posted Auto Apply
Signalfire · Bay Area - Hybrid · Hybrid · Posted 17 Nov 2026 🇺🇸
RecruitingTalent AcquisitionWorkforce Planning+22TechnologySalary not listed - PH

ML Infra Engineer, ComputeRecently posted Auto Apply
Physicalintelligence · San Francisco · On-site · Posted 16 Nov 2026 🇺🇸
GCPCapacity PlanningPyTorch+4Salary not listed - TR
Automated Driving Advanced Development Intern, Machine Learning Research Auto Apply
Tri · Los Altos · Hybrid · Posted 9 Nov 2026 🇺🇸
RoboticsAutonomous DrivingPyTorch+3Technology$65/hr - TT
Member of Technical Staff, Applied MLRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 17 Nov 2026 🇺🇸
Continuous ImprovementLLMPython+1$175k - $350k/yr - TT
Senior Data & Machine Learning EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York City · On-site · Posted 16 Nov 2026 🇺🇸
SQLETLdbt+1Technology$200k - $300k/yr
