Quick overview
Job description
Lead Data Engineer
Manchester (Hybrid, 2 days per week in central Manchester) | Permanent | £85,000 - £100,000 + bonus
An independent, high-profile betting and gaming business is looking for a Lead Data Engineer who's happy to stay hands-on, set the standard and still get stuck into the code.
You'll be the senior technical authority for the data platform, working as the hiring manager's technical number two. The immediate focus is the final stages of a large-scale migration from on-premises SQL Server to an AWS lakehouse, alongside designing the Real Time streaming architecture that will take report latency from around 24 hours down to minutes. You'll have real authority over architecture and standards, backed by code reviews, design guidance and leading by example. There are no direct reports, so your time goes on engineering rather than admin.
You'll work closely with data scientists, analysts and other engineering leads, and represent data engineering in architecture and planning conversations with senior stakeholders. Engineers across the business already use enterprise AI tooling, and there's room to go further.
What they're looking for:
- Previous experience as technical lead on a large-scale data platform or data warehouse migration (cutover, reconciliation, parallel running, decommissioning)
- Deep, hands-on AWS data experience: Glue, Lambda, S3, Redshift and EMR
- Advanced Python, PySpark and SQL
- Production experience with Kafka or Amazon MSK, including Spark Structured Streaming
- Hands-on experience with Apache Iceberg or Delta Lake
- Strong data modelling and lakehouse design (bronze, silver, gold)
- Terraform, CI/CD and pipeline orchestration
- A track record of setting standards and mentoring engineers through review, pairing and design sessions
- Confidence communicating with technical and non-technical stakeholders, and challenging constructively
Desirable:
- SQL Server or on-prem to cloud migration, Apache Flink, regulated industry experience
If you'd rather shape a platform than inherit a finished one, and want a seat at the table while you do it, this one's worth a conversation.
Guidant, Carbon60, Lorien & SRG - The Vertage Group Portfolio are acting as an Employment Business in relation to this vacancy.
Similar jobs
- TX
Azure Data EngineerNew
TXP · London · Hybrid 🇬🇧
SQLETLPython+2TechnologySalary not listed3 hours ago - OK

Research Data Engineer- Innovative Algo TradingNew
Oxford Knight · London · Hybrid 🇬🇧
Data PipelinePythonData AnalysisTechnologySalary not listed16 hours ago - HA

Senior Data Engineer - Security ClearedNew
Hackajob Ltd · Charing Cross, Central London · Hybrid 🇬🇧
DjangoDockerFlask+18TechnologySalary not listed16 hours ago - IR

Lead Data EngineerNew
ITSS Recruitment Ltd · Hyde Park, Leeds · Hybrid 🇬🇧
SQLGitApache Spark+4TechnologySalary not listed16 hours ago - OC
Talend/Oracle RDS Data Engineer - Telford and remote - 6 months+New
Octopus Computer Associates · Telford, Shropshire · Remote 🇬🇧
OracleSQLGit+2TechnologySalary not listed4 hours ago - MP

Data EngineerNew
Michael Page Technology · Nottingham, Nottinghamshire · On-site 🇬🇧
SQLScalaETL+6Technology£55k - £57k/yr5 hours ago - IR
SC Cleared Lead Data Engineer (AI Buildout)New
IF Recruitment Ltd · United Kingdom · Hybrid 🇬🇧
SQLAWSETL+7TechnologySalary not listed5 hours ago - LI
Data EngineerNew
LA International Computer Consultants Ltd · Telford, Shropshire · Hybrid 🇬🇧
MySQLGitGrafana+1TechnologySalary not listed5 hours ago - QU

Head of Data EngineeringNew Auto Apply
Quantum · London · Hybrid 🇬🇧
RecruitingAffiliate MarketingCompliance+1Salary not listed17 hours ago - QU

Data EngineerNew Auto Apply
Quantum · London · Hybrid 🇬🇧
SQLETLAffiliate Marketing+3TechnologySalary not listed17 hours ago - IA

Senior Data EngineersNew Auto Apply
Indicium AI · London · Hybrid 🇬🇧
GCPAWSFlink+13Salary not listed2 days ago - IA

Lead Data EngineersNew Auto Apply
Indicium AI · London · Hybrid 🇬🇧
GCPScalaAWS+14Salary not listed2 days ago