Quick overview
Job description
About the Role
Join a platform engineering team at a technology company in the AI sector. You will build and operate the data infrastructure behind large-scale search and retrieval systems, with end-to-end ownership of reliable production services.
What You'll Do
Design and operate data infrastructure for large-scale ingestion into object storage, with indexing in databases and vector stores for fast retrieval.
Own storage and retrieval architecture, making tradeoffs across hot and cold storage, distributed databases, and streaming systems.
Run and scale containerized services on orchestration platforms across multiple environments using declarative configuration and GitOps workflows.
Build and maintain CI/CD pipelines, infrastructure as code, and DevOps tools that support safe, frequent releases.
Help operate secure, auditable, and reliable environments subject to federal or other regulatory requirements.
Troubleshoot and tune systems across application code, storage, and networking, and mentor engineers through reviews, pairing, and technical guidance.
What We're Looking For
Five or more years of professional software engineering experience, with 5 to 10 years overall, building and maintaining production systems.
Hands-on experience building and operating large-scale data stores and pipelines, including ingestion, hot and cold storage, and retrieval.
Production experience with AWS and a strong understanding of distributed systems, including backend or distributed systems work.
Experience owning production systems end to end, including architecture, deployment, and on-call operations.
Familiarity with Docker, Kubernetes, Terraform, CI/CD, GitOps, Python, PostgreSQL, vector and distributed SQL databases, S3 or similar object storage, Kafka, ArgoCD, Helm, and observability tools.
Experience in FedRAMP, federal, or other regulated environments is helpful. Experience with performance-critical Go, Rust, or C++ is also valued.
Must be authorized to work without visa sponsorship.
Compensation & Benefits
Base salary: $175,000 to $220,000 annually. Visa sponsorship is not available.
Location
Hybrid, New York, United States.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free