Quick overview
Job description
Contract: Contract
Location: Hybrid: London, Waterloo - 3 Days Per Week in Office + 2 Days Remote
Pay: c.700 per day PAYE
Consultant: Joe Moore
This is an exciting role for a Senior Data Engineer with strong Databricks and Delta to join a world-leading Energy Trading company.
Role Description:
We are looking for a highly skilled Senior Data Engineer with strong analytical capabilities and hands-on experience in building scalable data solutions.
The ideal candidate will have expertise in Databricks, streaming architectures, data ingestion frameworks, and dashboarding, along with experience working with SAP data sources.
You will be responsible for designing and implementing scalable data pipelines and enabling real-time and batch analytics across the organization.
Key Responsibilities:
- Design and implement scalable data pipelines using Databricks and Delta Live Tables (DLT)
- Develop and manage streaming data solutions for real-time analytics and decision-making
- Ingest data from various sourcesincluding SAP systems using Qlik Replicate and ADF to ingest data from various sources ensuring data quality and consistency
- Perform data modelling and optimize data structures for analytics and reporting
- Collaborate with cross-functional teams to understand data requirements and deliver robust solutions
- Monitor, troubleshoot, and enhance data workflows for performance and reliability
- Maintain technical documentation and contribute to data engineering best practices
Required Skills & Qualifications:
- Strong experience with Databricks- DLT, Delta Lake concepts, UC governance
- Solid understanding of streaming technologies (e.g., Spark Structured Streaming, Autoloader)
- Programming skills in Python, SQL, or Scala
- Proficiency in data modelling, ETL/ELT processes, and data architecture
- Experience in MS Copilot, AI Foundry , Databricks (MosiacAI, MLflow, Agentbricks, Genie)
- Strong analytical background with problem-solving skills
- Performance tuning concepts like watermarking, late data handling, parallelism & checkpointing
- Hands-on expertise in ADF, and Qlik Replicate for data ingestion and replication
- Experience working in Azure cloud environments
With a focus within Energy Trading, Oil & Gas, Financial Markets and Commodities, we offer a transparent Recruitment Service that has proven to be reliable and effective for over 40 years. We are ISO accredited and proud of our excellent TrustPilot Reviews. Your search for a New Contract Assignment or for a New Permanent Job will be in safe hands with Eaglecliff Recruitment. Please telephone for an immediate response or email your CV for a quick response. Eaglecliff Ltd is acting in the capacity of an employment agency for permanent recruitment and an employment business for contractor resourcing.Senior Data Engineer : Databricks & Delta
Related
Similar jobs
- LR
Lead Data EngineerRecently posted
Lorien Resourcing Limited · South East London, London · On-site · Posted 17 Nov 2026 🇬🇧
AWSMLOpsMLflow+10TechnologySalary not listed - SC

Data EngineerRecently posted
Syntax Consultancy Limited · Milford, Belper · Remote · Posted 17 Nov 2026 🇬🇧
SQLT-SQLApache Spark+8Technology£40k/yr - GG
Databricks EngineerRecently posted
Gazelle Global Consulting Ltd · Farringdon, Central London · On-site · Posted 17 Nov 2026 🇬🇧
UnityEngineeringSalary not listed - CY
PostgreSQL DBARecently posted
Cyberteam · Manchester, Greater Manchester · On-site · Posted 17 Nov 2026 🇬🇧
GCPMongoDBGit+7TechnologySalary not listed - DI
Microsoft Fabric Data EngineerRecently posted
Dns Info Ltd · Leeds, Yorkshire · Hybrid · Posted 17 Nov 2026 🇬🇧
SQLGitApache Spark+8TechnologySalary not listed - HD
Data Warehouse EngineerRecently posted
Hays DT - Midlands · Birmingham · Hybrid · Posted 17 Nov 2026 🇬🇧
SQLTeamCityGit+16Technology£63.0k/yr - A-
Data Engineer – ICT Level 5Recently posted
AFBI - Agri-Food and Biosciences Institute · Belfast, Northern Ireland · Hybrid · Posted 17 Nov 2026 🇬🇧
Technology£37.7k - £39.0k/yr - AG
Senior Data Engineer, Technology Consulting- London, Leeds, Manchester orNewcastleRecently posted
Adelphi Group · newcastle upon tyne · Hybrid · Posted 13 Nov 2026 🇬🇧
SQLGitAWS+20Technology£58k - £74k/yr - ET

Senior Data EngineerRecently posted
EDF Trading · london · Hybrid · Posted 13 Nov 2026 🇬🇧
DockerSQLTableau+9TechnologySalary not listed - MG
Python Data EngineerRecently posted Auto Apply
Man Group · London · On-site · Posted 17 Nov 2026 🇬🇧
OracleSQLGit+12TechnologySalary not listed - TA
Data EngineerRecently posted
Talent · United Kingdom · Hybrid 🇬🇧
Stakeholder ManagementSQLApache Spark+8TechnologySalary not listed - OF

Data EngineerRecently posted
Outcomes First Group · manchester · Hybrid 🇬🇧
Stakeholder ManagementSQLApache Spark+5Technology£49k/yr
