Haystack
← Back to Jobs
Temporary/Casual
Technology
LO

Senior Data Engineer

LorienCity, London🇬🇧United KingdomPosted 11 Sept 2026

Quick Overview

Seniority
Mid Senior
Employment type
Temporary/Casual
Work mode
Hybrid
Location
City, London, United Kingdom
SQLAWSMachine LearningAzureDatabricksPythonTerraform

Job Description

Senior Data Engineer - UCL

£580 per day | Inside IR35 | 6-month contract | Hybrid - London

A leading higher education organisation is looking for an experienced Senior Data Engineer to join its Digital Infrastructure team on a 6-month contract.

This is an excellent opportunity for a senior data engineering professional to work on modern data platforms and contribute to the development of scalable, cloud-based data solutions.

The Role

As a Senior Data Engineer, you will be responsible for designing, developing and supporting modern data platform solutions, working across data lakes, cloud technologies, data ingestion and CI/CD.

You will work with a range of modern technologies and will be expected to bring strong hands-on engineering experience across data platforms and cloud environments.

Key Responsibilities

  • Design, develop and maintain scalable data lake and data platform solutions.

  • Work with modern data technologies including Microsoft Fabric and/or Databricks.

  • Develop robust data processing and transformation solutions using Python, PySpark and advanced SQL.

  • Implement and maintain CI/CD pipelines using Terraform, GitHub and/or Azure DevOps.

  • Develop and support data ingestion solutions using technologies such as AWS Lambda, Azure Functions, AWS DMS and other ingestion services.

  • Build reliable, scalable and production-ready data engineering solutions.

  • Work closely with technical stakeholders and wider delivery teams to understand requirements and deliver effective data solutions.

  • Apply data engineering best practices across development, testing, deployment and support.

  • Contribute to the continuous improvement of the organisation's data platform capabilities.


Essential Skills & Experience

The successful candidate will have strong hands-on experience with:

  • Modern Data Lakes/Data Platforms

  • Microsoft Fabric and/or Databricks

  • Python

  • PySpark

  • Advanced SQL

  • CI/CD

  • Terraform

  • GitHub and/or Azure DevOps

  • Cloud-based data ingestion technologies

  • AWS Lambda, Azure Functions and/or AWS DMS

  • Developing and managing production-grade data engineering solutions


Desirable Skills

Experience with AI/ML, including building or managing machine learning models and working with data science notebooks, would be advantageous but is not essential.

Contract Details

  • Contract: 6 months

  • Rate: £580 per day

  • IR35: Inside IR35

  • Location: Bidborough House, London

  • Working pattern: Hybrid

  • Start date: October 2026, TBC

  • Notice period: 14 days

  • Interview: 1-hour interview, with interview dates expected between 21st and 25th September, TBC

This is a great opportunity for a Senior Data Engineer to work within a high-profile higher education environment, contributing to modern data platform initiatives across cloud, data engineering and DevOps technologies.

Guidant, Carbon60, Lorien & SRG - The Impellam Group Portfolio are acting as an Employment Business in relation to this vacancy.

Similar jobs