Quick overview
Job description
Reporting to our SVP of Engineering, you will partner with product and engineering leadership to translate technical strategy into business impact. You’ll set the direction for a unified data platform designed for an AI-first future, guiding dozens of engineering teams to bridge the gap between raw data and actionable AI.
This role blends high-level architectural influence with hands-on code contributions, building systems from conception through global scale that are both innovative and production-ready. You will tackle complex problems in data orchestration, low-latency processing, and developer velocity, delivering the foundational capabilities that will accelerate company-wide innovation and define our next chapter.
Primary Duties:
- Architect complex systems and make critical technical decisions.
- Solve challenging technical problems with innovative solutions.
- Mentor engineers and promote engineering excellence across teams.
- Align technical strategies with business goals through cross-functional collaboration.
- Contribute to technical roadmaps and strategic planning.
- Evaluate new technologies and lead innovation initiatives.
Minimum Qualifications:
- BS/BTech (or higher) in Computer Science, Engineering or a related field required
- 10+ years of production-level experience as an engineer building highly scalable systems
- 6+ years of experience acting as a trusted technical decision-maker in a team setting, solving for short-term and long-term business value
- 4+ years of experience working with SQL or other database querying languages on large multi-table data sets
- Experience architecting, developing, and deploying large-scale distributed systems at scale
- Experience with cloud technologies, e.g., AWS, Azure, GCP
- Experience building continuous integration and continuous development (CI/CD) pipelines
- Strong familiarity with server-side web technologies (eg: Java, Python, Scala, C#, C++, Go)
Preferred Knowledge, Skills and/or Abilities:
- 10+ years of production-level experience as an engineer building highly scalable and reliable infrastructure
- Strong background in architecting or implementing AI-driven features - with the ability to translate AI capabilities into scalable and performant products
- Proven track record in end-to-end architecture and delivery - guiding large teams (50+ engineers) across multiple product areas from initial conception through maturity.
- Ability to lead and mentor senior engineering talent, shaping architecture decisions and technical direction across multiple teams
- Demonstrated success evaluating and adopting emerging technologies to drive company-wide technical strategies
- Experience working with data ingestion systems and optimizing performance for handling large-scale data processing and analysis
- Deep hands-on expertise with cloud infrastructure (AWS preferred), event streaming (Kafka), data processing (Databricks and Kafka), and large-scale database systems
- Familiarity with database replication, sharding and other techniques for scalability and high availability of databases
- Experience engineering systems for scalability, high availability, and security — with a focus on sensitive or regulated data
- Experience building observability platforms, performance monitoring, and optimization frameworks for large-scale systems and infrastructure.
- Expertise in containerization/orchestration technologies (Docker, Kubernetes) and modern CI/CD pipelines
- Experience with health-tech systems (like Electronic Health Records, Clinical data, etc.) is desired
Physical Requirements:
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- NE
Staff Machine Learning ScientistRecently posted Auto Apply
Netskope · Santa Clara · Hybrid · Posted 12 Nov 2026 🇺🇸
GCPAWSNLP+8Technology$133.5k - $235k/yr - AQ
2027 PhD Summer Associate, Machine Learning Research Auto Apply
AQR · Greenwich · Hybrid 🇺🇸
MATLABSpringCornerstone+6TechnologySalary not listed - TT
Machine Learning Infrastructure EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 12 Nov 2026 🇺🇸
DockerGCPAWS+7Technology$200k - $400k/yr - TT
Machine Learning EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 12 Nov 2026 🇺🇸
Computer VisionPythonMachine Learning+1Technology$200k - $325k/yr - TT
Founding ML Research EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 11 Nov 2026 🇺🇸
DockerHugging FacePyTorch+2$180k - $230k/yr - TT
Member of Technical Staff, Reinforcement LearningRecently posted Auto Apply
True Talent Solutions Partners · Remote · Remote · Posted 11 Nov 2026 🇺🇸
LLMPyTorchPython+1$250k - $400k/yr - TT
Senior Data & Machine Learning EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York City · On-site · Posted 11 Nov 2026 🇺🇸
SQLETLdbtTechnology$200k - $300k/yr - VI
Machine Learning EngineerRecently posted Auto Apply
Vitol · Houston, TX · On-site · Posted 11 Nov 2026 🇺🇸
DockerAWSETL+15TechnologySalary not listed - FM
Machine Learning Scientist I - Generative & Agentic AI for Drug DiscoveryRecently posted Auto Apply
Frontier Medicines · South San Francisco, California · On-site · Posted 11 Nov 2026 🇺🇸
LLMPyTorchPython+2Technology$100k - $158.9k/yr - LI

ML EngineerRecently posted Auto Apply
Litellm · San Francisco · On-site · Posted 11 Nov 2026 🇺🇸
FastAPILLMPython+3TechnologySalary not listed - IM

Machine Learning EngineerRecently posted Auto Apply
IMC · New York · Hybrid · Posted 11 Nov 2026 🇺🇸
CUDADeep LearningPyTorch+4Technology$175k - $250k/yr - CL

Founding Engineer (AI/ML)Recently posted Auto Apply
Clera · San Francisco · On-site · Posted 11 Nov 2026 🇺🇸
SupabaseLLMPrisma+5Technology$130k - $170k/yr
