Haystack
← Back to Jobs
Technology
VA

Data Integration Platform Lead

Vallum Associatessheffield, england🇬🇧United KingdomPosted 19 Sept 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
sheffield, england, United Kingdom
ETLAirflowApacheBigQueryGoogle CloudPythonTerraform

Job Description

Required experience & skills

  • Proven experience as a Technical Lead / Lead Engineer delivering data engineering or integration platforms in cloud environments.
  • Strong hands-on experience building production-grade ETL/ELT pipelines and orchestration with Apache Airflow .
  • Solid experience on Google Cloud Platform , such as:
  • Data services (e.g., BigQuery, Cloud Storage, Pub/Sub, Dataflow) and/or container platforms (e.g., GKE, Cloud Run)
  • IAM, networking, secrets management, and environment separation
  • Strong software engineering foundations: Python, APIs, configuration management, testing strategy, and performance tuning.
  • CI/CD expertise (pipeline tooling, release controls, automated quality gates) and Infrastructure-as-Code experience (e.g., Terraform).
  • Experience designing for reliability: retries, idempotency, dead-letter patterns, backpressure handling, and operational resilience.
  • Ability to translate complex technical topics for mixed audiences and drive alignment across teams.

Similar jobs