Quick overview
Job description
About the Role
Join a healthtech team developing clinical decision-support tools for use in healthcare settings. In this hands-on research role, you will build reinforcement learning environments and evaluations that help model-training teams improve clinical reasoning, with a focus on safe, measurable performance.
What You'll Do
Design and build reinforcement learning environments for complex clinical reasoning, including multi-step tasks, tool use, state transitions, and measurable outcomes.
Create and calibrate reward functions, grading rubrics, and LLM judges, and test them for reward hacking and misleading scores.
Own the workflow from task design and data creation through implementation, evaluation, and delivery to model-training teams.
Run post-training and agent-evaluation experiments, then use observed failures to improve the environments.
Collaborate with clinicians and technical leadership to validate model outputs and guide the work.
What We're Looking For
A PhD in computer science, machine learning, or a related field, or at least three years of full-time experience in reinforcement learning research or post-training.
At least three years of research or industry experience, or current final-year PhD or postdoctoral status, and a bachelor's degree or higher in a relevant technical field.
Hands-on experience building RL environments for post-training or agent evaluation, including ownership of reward functions, grading rubrics, or LLM-judge calibration.
Production-level Python, PyTorch, and Transformers ecosystem skills, with experience in LLMs, reinforcement learning, post-training, evaluation, or reward modeling.
Experience in clinical AI or clinical reasoning is useful. Familiarity with information retrieval, constraint solving, SAT/SMT, or domain-specific languages is also relevant.
Clear technical writing about failed experiments and uncertainty, sound judgment when validating model outputs, and comfort with ambiguity and cross-disciplinary work.
Authorization to work in the United States or Canada for a remote role, and willingness to attend in-person offsites several times per year.
Compensation & Benefits
Base salary: $250,000 to $400,000 USD annually. Visa sponsorship is not available.
Location
Remote, with the primary location in Canada. Candidates must be authorized to work in the United States or Canada.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- TT
Founding ML Research EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 14 Nov 2026 🇺🇸
Computer VisionHugging FacePyTorch+1$180k - $230k/yr - TT
Member of Technical Staff, ML SystemsRecently posted Auto Apply
True Talent Solutions Partners · Menlo Park · On-site · Posted 13 Nov 2026 🇺🇸
CUDADeep LearningMachine Learning$180k - $260k/yr - SE
Senior Machine Learning EngineerRecently posted Auto Apply
ServiceNow · Santa Clara, California · Hybrid · Posted 13 Nov 2026 🇺🇸
Generative AITechnology$161.3k - $274.2k/yr - VT

Machine Learning EngineerRecently posted Auto Apply
Voyager Technologies, Inc. · El Segundo · Hybrid · Posted 13 Nov 2026 🇺🇸
MATLABComputer VisionDeep Learning+3Technology$120k - $280k/yr - GA

Technical Lead, ML InfrastructureRecently posted Auto Apply
Gatik AI · Santa Clara · Hybrid · Posted 13 Nov 2026 🇺🇸
SQLMLOpsRobotics+7$180k - $260k/yr - FA

Staff Applied AI/ML Scientist, AcquisitionRecently posted Auto Apply
Faire · San Francisco · Hybrid · Posted 13 Nov 2026 🇺🇸
RecruitingSEODeep Learning+2Technology$246.5k - $339k/yr - DR

Senior AI/ML EngineerRecently posted Auto Apply
Dragos · United States · Hybrid · Posted 13 Nov 2026 🇺🇸
DockerRustSQL+5Technology$190k/yr - AU

Computer Vision EngineerRecently posted Auto Apply
Augmodo · United States · Remote · Posted 13 Nov 2026 🇺🇸
OpenCVRoboticsComputer Vision+6Technology$155k - $210k/yr - BB

Senior Algorithm EngineerRecently posted Auto Apply
Beacon Biosignals · Boston · Remote · Posted 13 Nov 2026 🇺🇸
Deep LearningPyTorchRequirements Gathering+2Engineering$170k - $220k/yr - BL

Senior Machine Learning Engineer, PlatformRecently posted Auto Apply
Block · Bay Area · Hybrid · Posted 13 Nov 2026 🇺🇸
AWSMLOpsCapacity Planning+11Technology$228.7k - $343.1k/yr - RO

Senior Machine Learning Engineer, Behavioral DetectionRecently posted Auto Apply
Roblox · San Mateo · Hybrid · Posted 13 Nov 2026 🇺🇸
FlinkPyTorchPython+2TechnologySalary not listed - CO

E11 Bio - Machine Learning Scientist I/IIRecently posted Auto Apply
Convergentresearch · Alameda · On-site · Posted 13 Nov 2026 🇺🇸
GCPAWSComputer Vision+1Technology$130k - $225k/yr