Haystack
← Back to Jobs
Other

FULL-TIME Role || Director Of AI Engineering

Tek PyramidsArlington, VA🇺🇸United StatesPosted 20 Jul 2026

Quick Overview

Work Type
On Site
Level
Leader

Job Description


Role

Director of AI Engineering

Location

Arlington, VA (100% Onsite)

Duration

Full-Time ROLE

Interview Note

Greenfield AI Engineering team. Will build and lead the AI Engineering function, hire the team, define AI strategy and architecture, and remain hands-on with AI/ML system design and early implementation.

Qualifications (Required)

  • 10+ years of experience in Software Engineering, Data Engineering, or Machine Learning Engineering, including 3+ years leading technical teams.
  • Hands-on experience designing, building, and deploying production AI/ML systems at enterprise scale.
  • Advanced experience with Large Language Models (LLMs) including:
    • Self-hosting open-weight models
    • Model serving
    • Quantization
    • Inference optimization
    • GPU utilization
  • Experience designing and deploying Agentic AI systems.
  • Strong experience with both Cloud and On-Prem GPU infrastructure.
  • Proven experience hiring, building, and leading high-performing engineering teams.
  • Experience with AI infrastructure procurement, capacity planning, and vendor management.
  • Ability to define AI strategy, architecture, engineering standards, and build AI platforms from the ground up.
  • Hands-on technical leadership with the ability to drive architecture and early development efforts while growing the team.

Preferred Skills

  • Databricks
  • Experience deploying AI/ML solutions in Operational Technology (OT), Industrial, or Safety-Critical environments.
  • Ontology / Semantic Modeling

Skills

Machine Learning
Capacity Planning
Databricks
Procurement
Vendor Management

Similar jobs