Quick overview
Job description
About the Role
Build reinforcement learning environments and evaluations for a healthtech team developing clinical decision support tools. You will own the work from task design and data creation through environment implementation and delivery to model-training teams, helping make clinical AI more reliable in practice.
What You'll Do
Build environments for complex clinical reasoning, including multi-step tasks, tool use, state transitions, and measurable success criteria.
Design and calibrate reward functions, grading rubrics, and LLM judges, and test them for reward hacking or misleading scores.
Own task design, data creation, environment implementation, evaluation, and delivery to model-training teams.
Run post-training and agent evaluation experiments, then use failures to improve environments.
Collaborate with clinicians and technical leadership to validate model outputs and evaluation quality.
What We're Looking For
A PhD in computer science, machine learning, or a related field, or at least three years of full-time reinforcement learning research or post-training experience.
At least three years of research or industry experience, or current final-year PhD or postdoctoral status, with a bachelor's degree or higher in a relevant technical field.
Hands-on experience building reinforcement learning environments for post-training or agent evaluation, ideally in a frontier AI lab or leading AI company.
Production-level Python, PyTorch, and Transformers experience, plus experience with LLMs, post-training, and evaluation.
Experience owning reward functions, grading rubrics, or LLM-judge calibration, and communicating failed experiments and uncertainty clearly in writing.
Clinical AI experience is useful, particularly in clinical reasoning, longitudinal records, or medical workflows. Knowledge of information retrieval design, constraint solving, SAT/SMT, or domain-specific languages is also useful.
Comfort working across disciplines and with ambiguity, willingness to attend in-person offsites multiple times per year, and experience validating plausible model outputs.
Compensation & Benefits
Base salary: $250,000 to $400,000 USD annually. Visa sponsorship is not available.
Location
Remote, based in Canada or the United States. The primary location is Canada.
Similar jobs
- TT
Member of Technical Staff, ML SystemsRecently posted Auto Apply
True Talent Solutions Partners · Menlo Park · On-site 🇺🇸
CUDADeep LearningLLM+2$180k - $260k/yr - MA

Reinforcement Learning for Vision-Language ModelsRecently posted Auto Apply
Microsoft AI · Mountain View · Hybrid 🇺🇸
ConcreteDeep LearningPyTorch+2$119.8k - $234.7k/yr - IT

Senior Machine Learning Engineer, Agentic Context Retrieval and Search (Nova)Recently posted Auto Apply
Iterable · REMOTE - US · Remote 🇺🇸
SQLSnowflakeA/B Testing+6TechnologySalary not listed - IT

Senior Machine Learning Engineer, Agentic Evals and Self-Improvement (Nova)Recently posted Auto Apply
Iterable · REMOTE - US · Remote 🇺🇸
SnowflakeComplianceLLM+4TechnologySalary not listed - IT

Senior Machine Learning Engineer, Nova IntelligenceRecently posted Auto Apply
Iterable · REMOTE - US · Remote 🇺🇸
ScalaAWSSnowflake+9TechnologySalary not listed - RE
Staff Defect Metrology AI/ML EngineerRecently posted Auto Apply
Renesas Electronics · Goleta, CALIFORNIA · On-site 🇺🇸
Microsoft ExcelIoTAgile+1Technology$120k - $160k/yr - IF
Senior AI/Machine Learning Engineer - Python | TheLoopsRecently posted Auto Apply
IFS · Palo Alto, California · Hybrid 🇺🇸
Generative AIPrompt EngineeringTechnology$170k - $185k/yr - SA

Staff Machine Learning Engineer - Edge AIRecently posted Auto Apply
Samsara · Remote - US · Remote 🇺🇸
RustComputer VisionCustomer Success+6Technology$178.6k/yr - CO

Staff Machine Learning Engineer, Offsite AdsRecently posted Auto Apply
Coupang · Mountain View · Hybrid 🇺🇸
MLflowScikit-learnAirflow+9Technology$164k - $282k/yr - CO

Senior Machine Learning EngineerRecently posted Auto Apply
Coinbase · Remote - USA · Remote 🇺🇸
A/B TestingArbitrationData Privacy+8Technology$213.8k/yr - WA

2027 Summer Intern, PhD, Machine Learning - Generative World Models & Controllable SimulationRecently posted Auto Apply
Waymo · Mountain View · Hybrid 🇺🇸
RoboticsComputer VisionDeep Learning+4Technology$85/hr - WA

2027 Summer Intern, Machine Learning, MS/PhD, Simulation Realism (World Model)Recently posted Auto Apply
Waymo · Mountain View · Hybrid 🇺🇸
RoboticsComputer VisionDeep Learning+4Technology$70 - $85/hr