Quick overview
Job description
At XDOF, we’re at an inflection point. Frontier labs are racing to build general-purpose robots, and high-quality training data is the bottleneck. We’re building the foundation behind the foundation models – the data collection systems, operational capability, exabyte-scale data warehouse, and model evaluation platform – to help our partners drive the field forward.
We’re looking for an Embodied Capabilities researcher to figure out what frontier models can actually do in the physical world, and where they fall short. You’ll design the tasks behind our benchmarks and RL environments, prove them out on our real robots, and use our data to decide what to build next. Examples of things you might work on: designing a benchmark suite that separates today’s best VLAs, finding the tasks where LLM agents break down, and turning data insights into new tasks and targeted data collections.
What You’ll Do
Embodied Capabilities researchers own our tasks end to end: what we measure, how we grade it, and whether it’s a good measurement. Sample projects include:
designing tasks for LLMs, VLAs, and WAMs that isolate real robotics capabilities, from precise contact to long-horizon planning and recovery from mistakes
implementing tasks on our evaluation platform, including reward functions, verifiers, success criteria, and environment configs
validating tasks on real hardware with our operators to prove they’re possible, prevent reward hacking, and calibrate their difficulty
building the simulated versions of tasks for our RL environments, including measuring real-world variation, like the spread of starting positions
owning the task taxonomy that decides which capabilities each task tests and which environments it belongs in
analyzing evaluation results and our collected data to find capability gaps, unreliable tasks, and coverage gaps
publishing findings on where frontier models stand in the physical world
You might be a good fit if you have:
strong programming skills in Python
hands-on experience with robot manipulation, and an intuition for what makes a physical task hard
strong data analysis skills, including working with large episode datasets and video
a solid grasp of experimental design and statistics, and thought hard about what a score actually measures
a working knowledge of current VLAs and LLM agents, and what they can and can’t do
a creative, adversarial mindset: you enjoy designing challenges and finding ways around them
Bonus points if you have:
designed robotics competitions or benchmarks (e.g. RoboCup, BEHAVIOR, RoboArena, IROS or ICRA challenges)
experience with LLM-as-judge, reward modeling, or RL post-training
worked with simulation (MuJoCo, Isaac Sim, or similar) or real2sim pipelines
fine-tuned a VLA or run model baselines yourself
experience with CAD or 3D printing for fixtures and repeatable setups
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- AC
Electronic Document Room Supervisor – FDA Regulatory SubmissionsRecently posted Auto Apply
Akicita Cyber · Silver Spring · On-site · Posted 22 Nov 2026 🇺🇸
$78k - $90k/yr - AC
Senior Federal Records Manager (CRM Preferred) – FDARecently posted Auto Apply
Akicita Cyber · Silver Spring · On-site · Posted 22 Nov 2026 🇺🇸
$110k - $130k/yr - AO
Remote - Member Services RepresentativeRecently posted Auto Apply
Aogarciaagency · Powell · Remote · Posted 22 Nov 2026 🇺🇸
ZoomSalary not listed - AO
Remote - Family Benefits AdvisorRecently posted Auto Apply
Aogarciaagency · Rawlins · Remote · Posted 22 Nov 2026 🇺🇸
ZoomSalary not listed - AO
Work From Home - Protection Services AssociateRecently posted Auto Apply
Aogarciaagency · Jackson · Remote · Posted 22 Nov 2026 🇺🇸
ZoomSalary not listed - AO
Work From Home - Remote Client LiaisonRecently posted Auto Apply
Aogarciaagency · Green River · Remote · Posted 22 Nov 2026 🇺🇸
ZoomSalary not listed - AO
Work From Home - Client Needs AnalystRecently posted Auto Apply
Aogarciaagency · Laramie · Remote · Posted 22 Nov 2026 🇺🇸
ZoomSalary not listed - AO
Work From Home - Coverage Support SpecialistRecently posted Auto Apply
Aogarciaagency · Casper · Remote · Posted 22 Nov 2026 🇺🇸
ZoomSalary not listed - AO
Work From Home - Virtual Benefits GuideRecently posted Auto Apply
Aogarciaagency · Wauwatosa · Remote · Posted 22 Nov 2026 🇺🇸
ZoomSalary not listed - AO
Work From Home - Client Portfolio AssociateRecently posted Auto Apply
Aogarciaagency · La Crosse · Remote · Posted 22 Nov 2026 🇺🇸
ZoomSalary not listed - AO
Work From Home - Family Services RepresentativeRecently posted Auto Apply
Aogarciaagency · Janesville · Remote · Posted 22 Nov 2026 🇺🇸
ZoomSalary not listed - AO
Work From Home - Benefits Support AssociateRecently posted Auto Apply
Aogarciaagency · Waukesha · Remote · Posted 22 Nov 2026 🇺🇸
ZoomSalary not listed
