Quick overview
Job description
About the Company
Our client is a Series B AI company, valued above $1B, whose agents do real work in a high-stakes, regulated professional domain. Founded in 2023, it has raised more than $100M, has grown from about 60 to roughly 150 employees this year and expects to keep growing quickly. The team is based in New York City.
About the Role
Own end-to-end projects that bring intelligence into production. You will be responsible for systems that help agents reason, plan and evaluate themselves, with full autonomy to plan projects, define success, run experiments and decide when a system is ready to ship. This role suits engineers who want to operate like researchers and builders at once.
What You Will Do
Design and iterate multi-agent architectures, encoding autonomy boundaries, tool use and fallback behavior that make agents safe and reliable.
Build scalable offline and online evaluation pipelines that run hundreds of experiments, with golden tasks, labeling strategies and metrics.
Instrument the stack to detect regressions, track error taxonomies and drive closed-loop improvement.
Engineer context and retrieval: prompt stacks, indexing pipelines and parsing of messy documents into structured representations.
Scope projects clearly, write concise specs and communicate progress within your pod.
What We Are Looking For
Four to twelve years as a machine learning engineer, with end-to-end LLM-based agent applications including benchmarking, orchestration and evaluations.
Experience at a fast-paced startup (Series A to D), a quant or hedge fund, or a top-tier technology company.
Experience running structured ML experiments and building evaluation infrastructure.
A CS, Physics, Math or related technical degree from a top school. The role is applied rather than research-focused.
A very clear communicator who can break complex ideas down.
Currently located in the US or Canada, ideally on the East Coast.
Bonus Points
Deep Python expertise and LLM or transformer-based systems.
Interest in the impact of AI on professional services and the economy.
Compensation and Benefits
$175,000-$350,000 base salary plus highly competitive equity, depending on experience. Visa transfers and sponsorship are available.
Location and Work Model
Full-time and on-site five days a week in Flatiron, New York City.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- CO

Sr. Staff ML Infra Engineer - Offline Infra & TrainingRecently posted Auto Apply
Coupang · Mountain View · Hybrid · Posted 21 Nov 2026 🇺🇸
GCPScalaAWS+12Salary not listed - PA

Robotics Machine Learning EngineerRecently posted Auto Apply
Pantograph · San Francisco · On-site · Posted 21 Nov 2026 🇺🇸
RoboticsTechnology$150k - $260k/yr - TR

Robotics Intern, Generalist Robot Learning (GRL)Recently posted Auto Apply
Tri · Los Altos · Hybrid · Posted 18 Nov 2026 🇺🇸
RoboticsComputer VisionDeep Learning+4$45 - $65/hr - TT
Senior AI/ML EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 18 Nov 2026 🇺🇸
ScalaC++Java+4Technology$180k - $275k/yr - TT
Founding Research Engineer, Robot LearningRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 18 Nov 2026 🇺🇸
RoboticsEngineering$260k - $300k/yr - AB

Member of Technical Staff, Machine LearningRecently posted Auto Apply
Abridge · SF Office · Hybrid · Posted 18 Nov 2026 🇺🇸
NLPDeep LearningPyTorch+3Technology$205k - $300k/yr - AI

Machine Learning Engineer, Assistance EngineeringRecently posted Auto Apply
Airbnb · United States · Remote · Posted 18 Nov 2026 🇺🇸
MLOpsLLMReact+4Technology$162k - $186k/yr - TT
Founding ML Research EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 18 Nov 2026 🇺🇸
Computer VisionPyTorchPython+1$200k - $260k/yr - CL

Founding Machine Learning EngineerRecently posted Auto Apply
Clera · San Francisco · On-site · Posted 18 Nov 2026 🇺🇸
SQLScikit-learnPandas+2Technology$170k - $200k/yr - AT

Senior Manager, Machine Learning & AI – FinanceRecently posted Auto Apply
Atoms · San Francisco · Hybrid · Posted 18 Nov 2026 🇺🇸
DockerFastAPISQL+12Technology$220k - $250k/yr - 1A

Senior/Staff AI/ML Engineer, Plant IntelligenceRecently posted Auto Apply
1 Arc Power · Mountain View · Hybrid · Posted 18 Nov 2026 🇺🇸
SQLLinearPython+2Technology$237k - $257.5k/yr - TT
Member of Technical Staff, ML SystemsRecently posted Auto Apply
True Talent Solutions Partners · Menlo Park · On-site · Posted 18 Nov 2026 🇺🇸
CUDADeep LearningLLM+1$180k - $260k/yr