Start searching
Back to Jobs
Recently postedFull timeTechnology

Senior Data Engineer - Databricks & Agentic AI

Primus Connectlondon, england🇬🇧United Kingdom

Quick overview

SeniorityMid Senior
Employment typeFull Time
Work modeHybrid
Locationlondon, england, United Kingdom
SQLApache SparkDatabricksPythonUnityCI/CDDelta Lake

Job description

Senior Data Engineer - Databricks & Agentic AI

London (Hybrid)

Salary - £80k - £90k DOE plus bonus and benefits

Permanent

I'm working with a global business looking for a Senior Data Engineer to help evolve its established Databricks platform. This role will have a strong focus on agentic AI, automation and the future of data engineering.

This is a hands on role where you'll work on complex transformation projects, influence technical decisions and help introduce AI-driven workflows at enterprise scale.

What you'll be doing:

  • Building agentic AI workflows to automate data engineering, code generation, testing and CI/CD.
  • Developing scalable data pipelines, data models and ingestion frameworks.
  • Working extensively with Databricks, Delta Lake, SQL, Python and PySpark.
  • Improving data quality, platform performance and production reliability.
  • Delivering solutions across master data management, client data and geospatial processing.

What they're looking for:

  • Strong Databricks expertise, including Delta Lake, Declarative Pipelines, DABs and Spark optimisation.
  • Advanced SQL and strong Python/PySpark skills.
  • Experience building scalable data solutions and troubleshooting production issues.
  • A proactive, analytical mindset and an interest in AI-driven engineering.
  • Experience with coding agents, agentic AI, Unity Catalog or geospatial data would be advantageous.

Why is this a great opportunity?

  • Work at the cutting edge of AI: Help shape how agentic AI is applied to real-world data engineering, developing skills that are still relatively rare in the market.
  • Genuine technical ownership: Influence architecture, make meaningful engineering decisions and help shape the platform's future direction.
  • Build, don't rebuild: Join a mature Databricks environment with established foundations, allowing you to focus on innovation rather than starting from scratch.
  • Invest in your development: Work alongside a technically ambitious team with dedicated learning time and the freedom to explore emerging technologies.
  • Make an impact at scale: Contribute to transformation initiatives across EMEA and APAC, tackling complex challenges across multiple business domains.

If you're a Senior Data Engineer with strong Databricks experience and want to be part of the next evolution of data engineering,

#J-18808-Ljbffr

Similar jobs

Apply