Haystack
← Back to Jobs
Full time
Technology

Senior Data Engineer

Eden James Consulting LimitedLondon, UK🇬🇧United KingdomPosted 15 Jul 2026

Why This Role Stands Out

This hybrid role offers you the chance to drive a critical cloud transformation for a reputable insurer, owning the ETL pipeline that supports crucial financial reporting and migrating to a modern data platform. If you're a data engineer eager to develop skills in Azure, Databricks, and CI/CD while making a significant impact, this is an exciting opportunity to advance your career.

Quick Overview

Work Type
Hybrid
Schedule
Full Time
Level
Mid Senior

Job Description

We are recruiting for a Data Engineer on behalf of a well-respected Lloyd’s Market Insurer.

This is a pivotal role sitting at the intersection of financial data integrity and cloud transformation. You will own the ETL pipeline that underpins monthly, quarterly and year-end close cycles, while simultaneously driving a strategic migration from legacy on-premise infrastructure to a modern, cloud-native data platform.

Key Responsibilities

  • Managing and monitoring the ETL pipeline to ensure timely and accurate financial reporting.
  • Acting as the technical point of contact during the Monthly, Quarterly and Year-end Close process.
  • Design and build scalable ETL workflows using Azure Data Factory and Databricks, replacing legacy SSIS pipelines.
  • Identifying opportunities to harden and automate manual steps within the Finance Close workflow
  • Conduct T-SQL performance tuning across on-prem and cloud environments.Conduct T-SQL performance tuning across on-prem and cloud environments.
  • Collaborate with IT and business stakeholders to fix data issues, gather requirements and produce technical documentation.
  • Establish CI/CD best practices using Azure DevOps.

Key Requirements

  • Experience of supporting the Phinsys System is highly desirable.
  • Hands-on experience of Cloud based platforms and technologies such as Synapse Analytics, Fabric, Databricks, Snowflake.
  • Azure DBA experience is advantageous.
  • Solid knowledge of ETL technologies, specifically SSIS and Azure Data Factory and pipelines.
  • Solid knowledge of core SQL Server elements including T-Sql, queries, stored procedures, functions and SSAS.
  • Comfortable working with Visual Studio IDE (VS2022 and later).
  • Comfortable working with Azure DevOps for source code control.

You will have genuine ownership of a business-critical pipeline that the finance function depends on every single month, while simultaneously shaping the cloud architecture that will underpin the organisation for years to come.

If you are an experienced Data Engineer with knowledge working in a similar London Insurer, please get in touch for more information.

We do not retain any personal information without your permission. Please refer to our data protection policy on our official website for more information.

Skills

SQL
SQL Server
T-SQL
ETL
Snowflake
Azure
Databricks

Similar jobs