Haystack
← Back to Jobs
Technology

Senior Machine Learning Engineer

Quantiphi Inc.New York, NY🇺🇸United StatesPosted 14 Aug 2026

Quick Overview

Work Type
On Site
Level
Mid Senior

Job Description

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.

If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!
About Quantiphi:

Quantiphi is an award-winning, AI-First global digital engineering company that helps the world's leading Fortune 1000 organizations transform bold ideas into measurable business impact. We go beyond building innovative AI technologies-we solve the problems that matter most to our clients.

Since our founding in 2013, Quantiphi has built a proven track record of turning complex challenges into meaningful outcomes across industries.

Headquartered in Boston, with more than 4,000 professionals worldwide, we partner with global enterprises to deliver large-scale digital, cloud, and AI-driven transformation. #SolvingWhatMatters

We are an Elite and Premier partner to Google Cloud, AWS, NVIDIA, Snowflake, and other leading technology platforms, and our work has been recognized across the industry, including:
  • 21 Google Cloud Partner of the Year awards in the past 10 years
  • 3 AWS AI/ML Partner of the Year awards
  • 3 NVIDIA Partner of the Year awards
  • 3 Snowflake Partner of the Year awards
  • Rated Leaders by Gartner, Forrester, IDC, ISG, Everest Group and other leading analyst firms

Quantiphi delivers First-in-class AI solutions across Life Sciences, Healthcare, Banking, Financial Services, CPG, Manufacturing, Energy, High-Tech, Telecommunications, etc., powered by cutting-edge Generative AI and Agentic AI accelerators.

We are also proud to be certified as a Great Place to Work-reflecting our commitment to our people and our culture.

For more details, visit: Website or LinkedIn Page

Job Description:

Location: Mid-Town NYC, USA
Work Model: In-person 3 days/week

Experience Level: 5+ Years

Engagement Context & What You'll Build

You will join a focused pod building two tightly-coupled capabilities for Humana's internal users:

1. Internal Agentic Search Engine
  • Build agentic pipelines that plan, retrieve, and reason across numerous internal and enterprise data sources (structured and unstructured).
  • Design robust retrieval, grounding, and orchestration layers so agents return accurate, cited, and trustworthy answers.
  • Implement tool-use, multi-step reasoning, and evaluation loops that keep quality high as sources and scope grow.

2. Perplexity-Style Front End
  • Deliver a fast, intuitive, conversational search experience for Humana employees - answer-first, with sources, follow-ups, and streaming responses.
  • Partner across the stack to connect the agentic backend to a responsive, production-grade UI.
  • Instrument usage, feedback, and quality signals to continuously improve relevance and user trust.
Key Responsibilities
  • Build hands-on, end to end. Design, code, test, and ship agentic AI features into production - you write code every day, not just architecture diagrams.
  • Engineer agentic systems. Develop planning, retrieval, tool-use, and orchestration components for the internal agentic search engine.
  • Integrate many data sources. Connect agents reliably and securely to numerous internal and enterprise data sources.
  • Deliver on Google Cloud. Build, deploy, and operate solutions natively on Google Cloud Platform (Vertex AI, GKE, BigQuery, Cloud Run, and related services).
  • Ship the user experience. Contribute to the Perplexity-style front end so end users get fast, grounded, well-cited answers.
  • Own quality and evaluation. Establish evals, guardrails, observability, and feedback loops to keep answers accurate and safe.
  • Collaborate on-site. Work in person at the NYC Mid-Town office Tuesday through Thursday, pairing closely with the pod and Humana stakeholders.
  • Move fast. Operate with urgency in a fast-moving engagement - iterate quickly, unblock yourself, and drive outcomes.
Required Qualifications

Must-Have Skills
  • Strong, current software engineering fundamentals - clean, tested, production-quality code (Python strongly preferred).
  • Demonstrated, hands-on experience building agentic AI systems (agents, tool-use, planning, multi-step reasoning, RAG/retrieval).
  • Deep expertise with the Google Cloud technology stack - e.g., Vertex AI, GKE, BigQuery, Cloud Run, Cloud Storage, IAM.
  • Experience integrating LLM applications with numerous, heterogeneous data sources (APIs, databases, document stores, search).
  • Experience taking ML/GenAI systems to production - deployment, scaling, monitoring, and reliability.
  • Ability to work on-site in NYC Mid-Town 3 days per week (Tuesday-Thursday).

Strong Plus (Big Positives)
  • Breadth of knowledge across frontier models (e.g., Gemini, and other leading LLM families) and when to use which.
  • Hands-on experience with open-source agentic and LLM frameworks (e.g., LangChain, LangGraph, LlamaIndex, or similar).
  • Front-end / full-stack exposure to help deliver a Perplexity-style user experience.
  • Experience with evaluation frameworks, guardrails, and responsible-AI practices.
  • Prior experience in regulated or enterprise environments (healthcare a plus)

Ideal Candidate Profile

The right person for this team is a builder at heart - someone who is energized by shipping working software, thrives in ambiguity, and raises the quality bar for everyone around them.
  • Extremely hands-on: happiest in the codebase, shipping real features.
  • Bridges agentic AI and solid software engineering - not just prototypes, but production systems.
  • Pragmatic and fast - comfortable with a high-tempo, fast-moving engagement.
  • Strong communicator who collaborates well in person with a tight-knit pod and client stakeholders.
  • Curious about the frontier - keeps up with new models, frameworks, and techniques.

What's in it for YOU at Quantiphi?
  • Join one of the world's fastest-growing AI-first digital engineering companies and make a real impact at scale.
  • Lead and collaborate with a high-energy team of talented, driven individuals solving complex, meaningful challenges.
  • Work with Fortune 500 companies and disruptive innovators in a research-driven environment with 60+ patents.
  • Stay ahead of the curve by gaining hands-on experience with cutting-edge AI, ML, data, and cloud technologies while continuously upskilling.

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Skills

AWS
Snowflake
BigQuery
Generative AI
Google Cloud
LLM
Python
SAFe

Similar jobs