Back to Jobs
Recently postedTemporary/CasualEngineering

Databricks Engineer

Gazelle Global Consulting LtdFarringdon, Central London🇬🇧United Kingdom

Quick overview

SeniorityMid Senior
Employment typeTemporary/Casual
Work modeOn Site
LocationFarringdon, Central London, United Kingdom
Unity

Job description

We're looking for an experienced Databricks Engineer to join an exciting banking and financial services programme, building and managing enterprise-scale Lakehouse platforms.

You'll play a key role in developing secure, scalable and reliable Databricks environments, supporting data engineering teams across multiple environments and cloud platforms. This is a hands-on opportunity involving platform configuration, automation, deployment and performance optimisation.

Key Responsibilities:

  • Build and maintain Databricks Lakehouse platforms across development, testing and production environments.
  • Develop data pipelines using PySpark, SQL and Delta Lake.
  • Configure Unity Catalog, permissions, access controls and security policies.
  • Implement CI/CD pipelines and automate platform deployments.
  • Manage Databricks Jobs, Workflows and Declarative Pipelines.
  • Integrate Databricks with AWS services and cloud infrastructure.
  • Support batch and incremental data processing.
  • Optimise platform performance, monitoring and operational reliability.

Key Skills:

  • Strong hands-on experience with Databricks and PySpark.
  • Excellent knowledge of Delta Lake and Lakehouse architecture.
  • Experience with Unity Catalog, Autoloader and Structured Streaming.
  • Knowledge of AWS S3, IAM, KMS, Glue and Lambda.
  • Experience with Git, CI/CD and data pipeline development.

Location: London / Manchester - Hybrid, 3 days onsite.

For more information or to apply directly, please email I review applications daily and will contact shortlisted candidates as quickly as possible.

Similar jobs