Quick overview
Job description
About the Role
Join a healthtech team building validated clinical decision artifacts for use in patient care. You will own reinforcement learning environments and evaluations that help model-training teams develop reliable systems for complex clinical reasoning.
What You'll Do
Build reinforcement learning environments for multi-step clinical reasoning, including tool use, state transitions, and measurable success criteria.
Design and calibrate reward functions, grading rubrics, and LLM judges, and test them for reward hacking and misleading scores.
Own the workflow from task design and data creation through implementation, evaluation, and delivery to model-training teams.
Run post-training and agent evaluation experiments, using failures to improve environments.
Collaborate with clinicians and research leaders to validate model outputs and evaluation methods.
What We're Looking For
At least 3 years of research or industry experience, or experience as a final-year PhD candidate or postdoctoral researcher; depth in reinforcement learning research or post-training is valued.
A bachelor's degree or higher in computer science, machine learning, mathematics, or a related technical field, with a PhD in a related field or at least 3 years of full-time RL research or post-training experience.
Hands-on experience building reinforcement learning environments for post-training or agent evaluation, plus production-level experience with Python, PyTorch, and Transformer models.
Experience owning reward functions, grading rubrics, or LLM-judge calibration, and clearly documenting failed experiments and uncertainty.
Clinical AI experience is useful, particularly in clinical reasoning, longitudinal records, or medical workflows. Knowledge of information retrieval, constraint solving, SAT/SMT, or domain-specific languages is also useful.
Comfort working across disciplines and with ambiguity, validating plausible model outputs, and attending in-person offsites several times per year.
Must be authorized to work remotely in the United States or Canada.
Compensation & Benefits
Salary range: $250,000 to $400,000. Visa sponsorship is not available.
Location
Remote, with a primary location in Montreal, Quebec, Canada. In-person offsites take place several times per year.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- SA

Staff Machine Learning Engineer - Medical DevicesRecently posted Auto Apply
Sandboxaq · Canada · Remote · Posted 16 Nov 2026 🇨🇦
SQLAWSNumPy+8TechnologySalary not listed - PF
Scientifique IA/ML | Scientist, AI/MLRecently posted Auto Apply
Power Factors · Montreal, Quebec · Hybrid · Posted 13 Nov 2026 🇨🇦
DroneSCADALLM+5TechnologySalary not listed - HE

Staff Machine Learning Engineer, AdTechRecently posted Auto Apply
HelloFresh · Toronto · Hybrid · Posted 17 Nov 2026 🇨🇦
DockerFastAPISQL+13TechnologySalary not listed - NA

Director, Machine Learning Auto Apply
Narvar · Remote - Canada · Remote · Posted 10 Nov 2026 🇨🇦
GCPAirflowCAD+4TechnologyC$240k/yr - UR
AI/ML Engineer Auto Apply
Urban Ridge Supplies · Toronto · On-site 🇨🇦
DockerAWSETL+12TechnologySalary not listed - UR
Forward Deployed Engineer (Data, ML & AI) Auto Apply
Urban Ridge Supplies · Toronto · On-site 🇨🇦
DockerRustSQL+29C$160k - C$180k/yr - UR
AI Inference Engineer Auto Apply
Urban Ridge Supplies · Toronto · On-site 🇨🇦
DockerContinuous ImprovementCustomer Success+3C$165k - C$330k/yr - UR
Lead, AI/Machine Learning Engineer Auto Apply
Urban Ridge Supplies · Toronto · On-site 🇨🇦
RecruitingWorkdayDocker+21TechnologyC$86k - C$130k/yr - UR
Machine Learning Engineer, Lyft Business & Ads Auto Apply
Urban Ridge Supplies · Toronto · On-site 🇨🇦
AWSCADLLM+7TechnologyC$148.5k/yr - UR
Machine Learning Engineer Auto Apply
Urban Ridge Supplies · Toronto · On-site 🇨🇦
GitMLOpsMLflow+6TechnologyC$210k - C$224k/yr - WS
Senior Machine Learning Engineer Auto Apply
Wiser Solutions · Toronto, ON · Remote · Posted 6 Nov 2026 🇨🇦
CADGenerative AITechnologyC$160k - C$200k/yr - SA

Staff Machine Learning Engineer - Edge AI Auto Apply
Samsara · Remote - Canada · Remote · Posted 6 Nov 2026 🇨🇦
RustCADComputer Vision+7TechnologyC$170.4k/yr