Quick overview
Job description
About the Job
About the Data Platform Team
What You'll Get To Do
-
Build and own ingestion pipelines that land robot data (ROS2 bags/MCAP, LiDAR, camera, IMU, logs) in cloud storage and the lakehouse
-
Handle the realities of field data: intermittent connectivity, very large sensor payloads, edge-to-cloud sync, partial or truncated uploads, and backfill from offline deployments
-
Write and operate Airflow DAGs that process, validate and catalog every mission's data
-
Build reusable ingestion SDKs, APIs and services so teams can onboard a new data source with minimal custom code
-
Build integrations that deliver processed data to external platforms and customers (REST APIs, webhooks, cloud storage drops)
-
Own pipeline reliability end to end: schema contracts, idempotent retries, re-delivery, backfills and alerting
-
Optimize pipeline throughput and cost as the fleet grows
What You Have
-
Bachelor's or Master's degree in Computer Science, Engineering, or a related field
-
3–5+ years of experience in data engineering or backend engineering focused on pipelines
-
Strong Python and SQL
-
Production experience with an orchestrator such as Airflow or Dagster
-
Experience with cloud object storage at scale (S3 or equivalent) and event-driven processing (queues, Lambda, Kinesis, Kafka or Pub/Sub)
-
Experience building integrations with third-party APIs and designing APIs others consume
-
A habit of building for failure: retries, idempotency, monitoring and clear alerts
-
You own problems from start to finish: from "the data didn't show up" to the root cause, the fix, the backfill and the alert that catches it next time
The Extras That Set You Apart
-
Experience with ROS/ROS2, MCAP or rosbag, or other robotics or automotive telemetry
-
Experience with edge computing or intermittently connected data collection
-
Experience with large binary media: point clouds, 360° video, images
-
Experience with Iceberg, Delta or another open table format
-
Some infrastructure experience, enough to ship and debug your own pipelines: Docker, Kubernetes, Terraform, or basic AWS IAM and networking
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- SA

Senior Manager, Software Engineering - AI Developer Productivity (Dev Agents and SRE AI)Recently posted Auto Apply
Samsara · Remote - US · Remote · Posted 14 Nov 2026 🇺🇸
Customer SuccessGreenhouseIoT+3Technology$162.4k/yr - OP
Staff Site Reliability Engineer, AWS & DatabasesRecently posted Auto Apply
Openloophealth · United States - Remote · Remote · Posted 14 Nov 2026 🇺🇸
DynamoDBMySQLSQL+24TechnologySalary not listed - TT
Lead Platform EngineerRecently posted Auto Apply
True Talent Solutions Partners · South San Francisco · On-site · Posted 14 Nov 2026 🇺🇸
DjangoFastAPIAWS+4Technology$205k - $235k/yr - TT
Lead Platform EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 14 Nov 2026 🇺🇸
RecruitingFastAPIMicroservices+8Technology$220k - $300k/yr - TT
Infrastructure EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 14 Nov 2026 🇺🇸
GCPAWSCompliance+7Technology$150k - $300k/yr - TT
Senior Platform EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 13 Nov 2026 🇺🇸
DockerAWSArgoCD+7Technology$175k - $220k/yr - CA
Senior Site Reliability EngineerRecently posted Auto Apply
Canonical_managed_posts · Charlotte Amalie · Hybrid · Posted 10 Nov 2026 🇺🇸
OpenStackIoTPython+2TechnologySalary not listed - CA
Senior Site Reliability EngineerRecently posted Auto Apply
Canonical_managed_posts · New York · Hybrid · Posted 10 Nov 2026 🇺🇸
OpenStackIoTPython+2TechnologySalary not listed - CA
Senior Site Reliability / Gitops EngineerRecently posted Auto Apply
Canonical_managed_posts · Charlotte Amalie · Hybrid · Posted 10 Nov 2026 🇺🇸
Capacity PlanningGrafanaIoT+5TechnologySalary not listed - CA
Senior Site Reliability / Gitops EngineerRecently posted Auto Apply
Canonical_managed_posts · New York · Hybrid · Posted 10 Nov 2026 🇺🇸
Capacity PlanningGrafanaIoT+5TechnologySalary not listed - NB
Staff DevOps EngineerRecently posted Auto Apply
NBCUniversal · New York · Remote · Posted 13 Nov 2026 🇺🇸
DynamoDBAWSAzure+16Technology$130k - $160k/yr - AB

Salesforce Platform EngineerRecently posted Auto Apply
AbbVie · Mettawa, IL · Hybrid · Posted 13 Nov 2026 🇺🇸
OracleSQLREST+3Technology$84.5k - $162k/yr