Quick overview
Job description
About the Role
Join an applied machine learning team building production AI agents for accounting and finance workflows. You will own projects from initial design and experimentation through deployment, helping make agent systems more capable, reliable, and measurable.
What You'll Do
Design and improve multi-agent architectures that automate complex accounting workflows.
Define agent autonomy boundaries, tool use, fallback behaviors, and measurable success criteria.
Build evaluation pipelines, golden tasks, metrics, and experiments to assess model and agent reliability.
Instrument systems to detect regressions, analyze errors, and support continuous improvement.
Route and optimize models against latency, cost, and accuracy constraints.
Develop prompt, context, memory, retrieval, and indexing systems that help agents reason across tasks.
Parse unstructured documents into useful structured representations and implement validation guardrails.
Scope projects, document technical decisions, and communicate progress and learnings to teammates.
What We're Looking For
Four to twelve years of machine learning engineering experience, including applied ML work in industry.
Experience delivering end-to-end LLM-based agent applications, including model orchestration, benchmarking, and evaluation of behavior and reliability.
Strong Python skills and deep familiarity with LLM and transformer-based systems; experience with Postgres is relevant.
Experience running structured ML experiments, building evaluation infrastructure, and iterating based on measurable results.
Background building machine learning products in a fast-paced startup or similarly rigorous environment.
Strong technical fundamentals, clear communication, and the ability to explain complex concepts simply.
Interest in AI and its impact on accounting, finance, and the broader economy.
Compensation & Benefits
Base salary: $175,000 to $350,000 annually. Visa sponsorship is available.
Location
On-site in New York, NY.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free