Quick overview
Job description
About the Role
Join a healthtech team building clinical decision-support systems for use in public healthcare. You will own reinforcement learning environments and evaluations that help make model behavior more reliable in clinical settings.
What You'll Do
Build environments for complex clinical reasoning, including multi-step tasks, tool use, state transitions, and measurable outcomes.
Design and calibrate reward functions, grading rubrics, and LLM judges, and test them for reward hacking and misleading scores.
Own task design, data creation, environment implementation, evaluation, and delivery to model-training teams.
Run post-training and agent evaluation experiments, then use failures to improve environments.
Collaborate with researchers and clinicians to validate model outputs and guide the work.
What We're Looking For
A PhD in computer science, machine learning, or a related field, or at least three years of full-time reinforcement learning research or post-training experience.
At least three years of research or industry experience, or current status as a final-year PhD student or postdoctoral researcher.
Hands-on experience building reinforcement learning environments for post-training or agent evaluation.
Production-level Python, PyTorch, and Transformers experience, with familiarity in LLMs, reward modeling, and evaluation.
Experience owning reward functions, grading rubrics, or LLM-judge calibration, and communicating failed experiments and uncertainty clearly.
Clinical AI experience is helpful, especially in clinical reasoning, longitudinal records, or medical workflows. Knowledge of information retrieval design, constraint solving, SAT/SMT, or domain-specific languages is also useful.
Comfort working across disciplines, validating plausible model outputs, and attending in-person offsites multiple times per year.
Authorization to work remotely in Canada or the United States is required.
Compensation & Benefits
Base salary range: $250,000 to $400,000 USD annually. Visa sponsorship is not available.
Location
Remote, with the primary location in Canada. Candidates may also be based remotely in the United States.
Similar jobs
- UP

Sr. Manager, Software Engineering - Machine Learning SimulationsRecently posted Auto Apply
Upstart · United States | Remote · Remote 🇺🇸
AWSMLOpsDatabricks+4Technology$195.3k/yr - NE

Senior Machine Learning Engineer, Model Training and Reinforcement LearningRecently posted Auto Apply
Nebius · Palo Alto · Hybrid 🇺🇸
CUDALLMPyTorch+3Technology$195.2k - $262.2k/yr - WH

Senior Applied ML Algorithm Engineer Auto Apply
Whoop · Boston · On-site 🇺🇸
Embedded SystemsScikit-learnC+++5Salary not listed - WA

Staff / Senior Machine Learning Engineer, AV Core Auto Apply
Wayve · Sunnyvale · Hybrid 🇺🇸
RoboticsCUDAC+++3TechnologySalary not listed - WA

Principal Machine Learning Engineer, 3D Geometric Vision Auto Apply
Wayve · Sunnyvale · Hybrid 🇺🇸
LinearRoboticsComputer Vision+5TechnologySalary not listed - OR
Founding Machine Learning Engineer Auto Apply
Orbit · San Francisco · On-site 🇺🇸
Hugging FacePyTorchPython+2TechnologySalary not listed - EC
Senior Applied ML Scientist - 1086 Auto Apply
Economicmodeling · Moscow · On-site 🇺🇸
DockerAWSMLOps+6Salary not listed - EC
Associate Applied ML Scientist - 1087 Auto Apply
Economicmodeling · Moscow · On-site 🇺🇸
DockerAWSMLflow+9Salary not listed - BE
Senior Infrastructure Engineer, AI & ML, Penguin Random House (Open to Remote)Recently posted Auto Apply
Bertelsmann-Jobs · New York, New York (NY) · Remote 🇺🇸
AWSMLOpsGDPR+2Technology$185k - $210k/yr - BJ
Member of Technical Staff, Machine Learning Auto Apply
Bjakcareer · United States · Remote 🇺🇸
PyTorchPythonMachine LearningTechnologySalary not listed - BJ
Applied Machine Learning Engineer Auto Apply
Bjakcareer · United States · Remote 🇺🇸
PyTorchPythonMachine LearningTechnologySalary not listed - MA

Compiler Engineer – MLIR / PyTorch Infrastructure Auto Apply
Mythic Ai.com · Palo Alto · Remote 🇺🇸
RoboticsC++PyTorch+2Salary not listed