Quick overview
Job description
Team
Our data platform team is working on accelerating autonomous driving by providing access to petabytes of data collected by our fleet of autonomous and non-autonomous vehicles. Efficient, fast and cost-effective access to data at large scale is key to tackle the hardest problems in AD/ADAS, from developing the Machine Learning (ML) models for perception and prediction of human driving patterns, to increasing the sophistication of our validation and simulation by identifying rare and interesting real-world driving situations. The data ecosystem developed by the London team is a key building block for developing and testing modern AD/ADAS products that will impact millions of customers.
Our ML and Data pipelines are built on-top of the open-source Flyte orchestration framework and are deployed to AWS. Pipeline code is written in Python. We use SQS and Kafka to automate data connections and leverage BigQuery and ElasticSearch for data storage. We believe strongly in automation and testing to ensure delivery of robust and correct systems. We are a distributed team, working in the UK and US.
Who are we looking for?
The London Data Infrastructure team is looking for engineers who are passionate about and enable the next generation of automotive software development. The right candidate will have excellent communication skills, solid coding skills, broad knowledge of software development across areas such as Data Infrastructure and Warehouses, Data Ingestion, Compute Frameworks, Observability and Build Infra.
Responsibilities:
-
Work on high-impact projects and innovate new solutions to problems in the self-driving space.
-
Work with Computer Vision and Machine Learning engineers on high-impact projects and innovate new solutions to problems in the self-driving space.
-
Understand the complex data requirements of modern ML development and tailor our data ecosystem to these needs.
-
Build efficient data pipelines for ingestion from the vehicle fleet.
-
Work on distributed systems that serve, process and transform large quantities of data in the cloud.
Minimum Qualifications:
-
Extensive experience in Python (or other Object Oriented language).
-
Experience building reliable, distributed applications for Data Processing or similar areas.
-
Working with RPC protocols such as gRPC/protobuf.
-
Hands-on experience developing cloud applications (e.g. AWS, GCP, Azure).
Preferred Qualifications:
-
Experience writing testable and modular code.
-
Experience working in a fast-paced environment, collaborating across teams and disciplines.
-
Experience designing, deploying, and maintaining distributed systems.
-
Data pipelines, data platforms, workflow orchestration, batch processing.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- PI

Automations Lead Auto Apply
Pivotal · London · On-site · Posted 7 Nov 2026 🇬🇧
£86.8k - £155.5k/yr - KA
Technical Lead Auto Apply
Kaluza · Bristol · Hybrid · Posted 30 Oct 2026 🇬🇧
AWSDatadogKafka+3Salary not listed - KA
Staff Engineer (Global Billing, Payments & API) Auto Apply
Kaluza · London · Hybrid 🇬🇧
API GatewayConcreteSystem DesignTechnology£97k - £122k/yr - F7
Staff Systems Engineer - Autonomy & Software (5652)Recently posted Auto Apply
F7d8749a 72d6 407c Bf98 292ea630c73a · London · Hybrid · Posted 11 Nov 2026 🇬🇧
RoboticsC++PythonTechnologySalary not listed - F7
Autonomy Integration Engineer (R5245) Auto Apply
F7d8749a 72d6 407c Bf98 292ea630c73a · London · Hybrid · Posted 28 Oct 2026 🇬🇧
Talent AcquisitionShellEmbedded Systems+8TechnologySalary not listed - F7
Staff Engineer, Test Integration, Modelling and Simulation (R5601) Auto Apply
F7d8749a 72d6 407c Bf98 292ea630c73a · London · Hybrid · Posted 21 Oct 2026 🇬🇧
Talent AcquisitionDockerC+++8TechnologySalary not listed - F7
Forward Deployed Engineer II (5951) Auto Apply
F7d8749a 72d6 407c Bf98 292ea630c73a · London · Hybrid 🇬🇧
Talent AcquisitionRoboticsC+++3EngineeringSalary not listed - F7
Senior Autonomy Integration Engineer Auto Apply
F7d8749a 72d6 407c Bf98 292ea630c73a · London · Hybrid 🇬🇧
Talent AcquisitionShellEmbedded Systems+8TechnologySalary not listed - F7
Senior Staff Engineer, Autonomy Software Integration & Test (R5539) Auto Apply
F7d8749a 72d6 407c Bf98 292ea630c73a · London · Hybrid 🇬🇧
Talent AcquisitionEmbedded SystemsRobotics+7TechnologySalary not listed - MA

Software Engineer, AI InfraRecently posted Auto Apply
Microsoft AI · London · Hybrid · Posted 13 Nov 2026 🇬🇧
Microsoft OfficeC#C+++5Technology£91.8k - £137.6k/yr - CA
Linux Platform Integration - Ubuntu Systems Senior EngineerRecently posted Auto Apply
Canonical_managed_posts · London · Hybrid · Posted 10 Nov 2026 🇬🇧
DockerGitTCP/IP+7Salary not listed - CA
Linux Software Engineer - Ubuntu for Next-Gen Silicon (multiple roles and seniority levels)Recently posted Auto Apply
Canonical_managed_posts · London · Hybrid · Posted 10 Nov 2026 🇬🇧
DockerEmbedded SystemsTCP/IP+9TechnologySalary not listed