Back to Jobs
Recently postedFull timeTechnology

Lead Platform Engineer

True Talent Solutions PartnersSan Francisco🇺🇸United States

Quick overview

Salary$220k - $300k/yr
SeniorityMid Senior
Employment typeFull Time
Work modeOn Site
LocationSan Francisco, United States
FastAPIMicroservicesGitEncryptionSOC 2AnsibleComplianceGitHub ActionsPrometheusPythonTerraformKubernetesCI/CD

Job description

About the Role

Lead the platform engineering work for a data and infrastructure company serving scientific and AI workloads. You will own the architecture, security, and scaling of a foundational platform that turns diverse laboratory data into a unified, queryable knowledge base.

What You'll Do

  • Define and deliver the architecture, security posture, and scaling strategy for the data and execution platform.

  • Build and operate ingestion pipelines, APIs, microservices, and storage layers that harmonize diverse scientific data while preserving provenance.

  • Manage knowledge graph and vector search systems to support hybrid symbolic and semantic retrieval.

  • Develop high-concurrency services in Go and Python, with controlled agent write boundaries and isolated execution environments.

  • Design service authentication, tenant isolation, secrets management, encryption, and other zero-trust security controls.

  • Own cloud infrastructure and delivery systems using Kubernetes, Terraform, Ansible, and GitHub Actions, and implement observability, SLOs, and developer workflows.

  • Set engineering standards through architecture reviews, code reviews, mentorship, and team building.

What We're Looking For

  • At least 5 years of platform or infrastructure engineering experience, including dedicated infrastructure work.

  • Experience building and operating production backend infrastructure, data platforms, or distributed systems.

  • Strong proficiency with Kubernetes, Terraform, Ansible, and modern CI/CD systems.

  • Experience architecting ingestion for messy, multi-source data, including schema harmonization and entity resolution.

  • Experience owning the architecture, security, and scaling of a foundational data platform and improving early-stage infrastructure.

  • Familiarity with Go, Python or FastAPI, knowledge graphs such as TypeDB, vector search such as Qdrant, and observability tools such as OpenTelemetry or Prometheus.

  • Computational biology, biotech data systems, or SOC 2 and similar compliance experience is beneficial.

Compensation & Benefits

Base salary: $220,000 to $300,000 annually. Visa sponsorship or transfer is not available.

Location

On-site, five days per week in San Francisco, California. Relocation assistance is available.

Haystack's AI agent can fill in and submit this application for you. How AI auto apply works

Similar jobs