Quick overview
Job description
We're looking for an experienced Databricks Engineer to join an exciting banking and financial services programme, building and managing enterprise-scale Lakehouse platforms.
You'll play a key role in developing secure, scalable and reliable Databricks environments, supporting data engineering teams across multiple environments and cloud platforms. This is a hands-on opportunity involving platform configuration, automation, deployment and performance optimisation.
Key Responsibilities:
- Build and maintain Databricks Lakehouse platforms across development, testing and production environments.
- Develop data pipelines using PySpark, SQL and Delta Lake.
- Configure Unity Catalog, permissions, access controls and security policies.
- Implement CI/CD pipelines and automate platform deployments.
- Manage Databricks Jobs, Workflows and Declarative Pipelines.
- Integrate Databricks with AWS services and cloud infrastructure.
- Support batch and incremental data processing.
- Optimise platform performance, monitoring and operational reliability.
Key Skills:
- Strong hands-on experience with Databricks and PySpark.
- Excellent knowledge of Delta Lake and Lakehouse architecture.
- Experience with Unity Catalog, Autoloader and Structured Streaming.
- Knowledge of AWS S3, IAM, KMS, Glue and Lambda.
- Experience with Git, CI/CD and data pipeline development.
Location: London / Manchester - Hybrid, 3 days onsite.
For more information or to apply directly, please email I review applications daily and will contact shortlisted candidates as quickly as possible.
Similar jobs
- LR
Lead Data EngineerRecently posted
Lorien Resourcing Limited · South East London, London · On-site · Posted 17 Nov 2026 🇬🇧
AWSMLOpsMLflow+10TechnologySalary not listed - SC

Data EngineerRecently posted
Syntax Consultancy Limited · Milford, Belper · Remote · Posted 17 Nov 2026 🇬🇧
SQLT-SQLApache Spark+8Technology£40k/yr - CY
PostgreSQL DBARecently posted
Cyberteam · Manchester, Greater Manchester · On-site · Posted 17 Nov 2026 🇬🇧
GCPMongoDBGit+7TechnologySalary not listed - DI
Microsoft Fabric Data EngineerRecently posted
Dns Info Ltd · Leeds, Yorkshire · Hybrid · Posted 17 Nov 2026 🇬🇧
SQLGitApache Spark+8TechnologySalary not listed - HD
Data Warehouse EngineerRecently posted
Hays DT - Midlands · Birmingham · Hybrid · Posted 17 Nov 2026 🇬🇧
SQLTeamCityGit+16Technology£63.0k/yr - A-
Data Engineer – ICT Level 5Recently posted
AFBI - Agri-Food and Biosciences Institute · Belfast, Northern Ireland · Hybrid · Posted 17 Nov 2026 🇬🇧
Technology£37.7k - £39.0k/yr - AG
Senior Data Engineer, Technology Consulting- London, Leeds, Manchester orNewcastleRecently posted
Adelphi Group · newcastle upon tyne · Hybrid · Posted 13 Nov 2026 🇬🇧
SQLGitAWS+20Technology£58k - £74k/yr - ET

Senior Data EngineerRecently posted
EDF Trading · london · Hybrid · Posted 13 Nov 2026 🇬🇧
DockerSQLTableau+9TechnologySalary not listed - HS

Data Engineer - Financial ServicesRecently posted
Hays Specialist Recruitment · London · On-site · Posted 17 Nov 2026 🇬🇧
DockerSQLApache Spark+8TechnologySalary not listed - MG
Python Data EngineerRecently posted Auto Apply
Man Group · London · On-site · Posted 17 Nov 2026 🇬🇧
OracleSQLGit+12TechnologySalary not listed - TA
Data EngineerRecently posted
Talent · United Kingdom · Hybrid 🇬🇧
Stakeholder ManagementSQLApache Spark+8TechnologySalary not listed - OF

Data EngineerRecently posted
Outcomes First Group · manchester · Hybrid 🇬🇧
Stakeholder ManagementSQLApache Spark+5Technology£49k/yr