Quick overview
Job description
About the Role
Join a healthtech team developing validated clinical decision tools for use in healthcare settings. You will build reinforcement learning environments and evaluations that support safer, more reliable clinical AI.
What You'll Do
Build RL environments for complex clinical reasoning, including multi-step tasks, tool use, state transitions, and measurable outcomes.
Design and calibrate reward functions, grading rubrics, and LLM judges, and test them for reward hacking and misleading scores.
Own the workflow from task design and data creation through environment implementation, evaluation, and delivery to model-training teams.
Run post-training and agent evaluation experiments, then use failures to improve environments.
Collaborate with researchers and clinicians who validate model outputs.
What We're Looking For
A PhD in computer science, machine learning, or a related field, or at least three years of full-time RL research or post-training experience.
At least three years of research or industry experience, or current status as a final-year PhD student or postdoctoral researcher.
Hands-on experience building RL environments for post-training or agent evaluation, including experience in a full-time role at a leading AI lab or company.
Strong technical fundamentals, with a BS or higher in computer science, machine learning, mathematics, or a related field.
Production-level Python, PyTorch, and Transformers ecosystem experience, plus familiarity with LLMs, reinforcement learning, post-training, evaluation, and reward modeling.
Experience owning reward functions, grading rubrics, or LLM judge calibration, and clearly communicating failed experiments and uncertainty in writing.
Ability to validate plausible model outputs, collaborate across disciplines, and work comfortably with ambiguity.
Clinical AI experience is helpful, as is knowledge of information retrieval design, constraint solving, SAT/SMT, or domain-specific languages.
Authorization to work in the United States or Canada is required. Willingness to attend in-person offsites multiple times per year is also required.
Compensation & Benefits
Annual base salary: $250,000 to $400,000 USD. Visa sponsorship is not available.
Location
Remote, based in Canada.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- CO

E11 Bio - Machine Learning Scientist I/IIRecently posted Auto Apply
Convergentresearch · Alameda · On-site · Posted 13 Nov 2026 🇺🇸
GCPAWSComputer Vision+1Technology$130k - $225k/yr - TT
Member of Technical Staff, Applied MLRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 13 Nov 2026 🇺🇸
Continuous ImprovementLLMPython+1$175k - $350k/yr - TT
Member of Technical Staff, ML SystemsRecently posted Auto Apply
True Talent Solutions Partners · Menlo Park · On-site · Posted 12 Nov 2026 🇺🇸
CUDADeep LearningMachine Learning$180k - $260k/yr - LL
Physics-Informed Machine Learning - Postdoctoral ResearcherRecently posted Auto Apply
LLNL · Livermore, CA · Hybrid · Posted 11 Nov 2026 🇺🇸
Deep LearningPyTorchPython+2Healthcare$123.0k/yr - BH
Applied ML Engineer, Agents & AutomationRecently posted Auto Apply
Bask Health · United States · Remote · Posted 12 Nov 2026 🇺🇸
GitAWSContinuous Improvement+11TechnologySalary not listed - BH
Machine Learning Engineering InternRecently posted Auto Apply
Bask Health · United States · Remote · Posted 12 Nov 2026 🇺🇸
SQLGitAWS+16TechnologySalary not listed - BH
Machine Learning Engineer, PersonalizationRecently posted Auto Apply
Bask Health · United States · Remote · Posted 12 Nov 2026 🇺🇸
Next.jsSQLGit+15TechnologySalary not listed - BH
Applied ML Engineer, Care ExperienceRecently posted Auto Apply
Bask Health · United States · Remote · Posted 12 Nov 2026 🇺🇸
OnboardingDrizzleNext.js+18TechnologySalary not listed - BH
ML Systems EngineerRecently posted Auto Apply
Bask Health · United States · Remote · Posted 12 Nov 2026 🇺🇸
DockerGitAWS+12TechnologySalary not listed - BH
Machine Learning Engineer, Search & DiscoveryRecently posted Auto Apply
Bask Health · United States · Remote · Posted 12 Nov 2026 🇺🇸
GitAWSContinuous Improvement+8TechnologySalary not listed - BH
Machine Learning Engineer, Evaluation & ReliabilityRecently posted Auto Apply
Bask Health · United States · Remote · Posted 12 Nov 2026 🇺🇸
GitAWSCompliance+14TechnologySalary not listed - WA
ML Infrastructure and Performance Engineer, AI Expert (Remote)Recently posted Auto Apply
Weekday AI · United States · Remote · Posted 12 Nov 2026 🇺🇸
AWSCUDACompliance+3$90 - $120/hr