Quick overview
Job description
Our client is looking for a Principal Data Engineer to act as the bridge between complex technical architecture and strategic business value. This is a high-impact, client-facing leadership role for an expert who can tackle deep technical challenges while keeping a customer-first mindset. Ideally you hold a Databricks Champion or Databricks Professional certification.
As the primary technical authority for clients, you will make sure their Databricks data platforms are resilient, scalable and aligned with their long-term business goals.
What You'll Be Doing
- Customer excellence and stakeholder management: Act as the strategic partner to client business owners, aligning technical data solutions with corporate goals while championing reliability and clean data for every consumer.
- Solution architecture and tech strategy: Drive complex, large-scale data architectures and multi-year technology roadmaps, balancing innovation with cost efficiency and operational stability.
- Delivery and execution: Oversee “team-of-teams” delivery performance, ensuring the quality and resilience of high-impact data pipelines while managing capacity planning and team velocity.
- Incident management and resilience: Lead triage and resolution of critical platform incidents, own root-cause prevention and keep communication with clients transparent throughout recovery.
- Governance, risk and compliance: Implement robust governance frameworks and compliance controls, acting as the authoritative lead on risk mitigation and the primary technical contact for regulatory matters.
- Knowledge management and mentorship: Champion a culture of knowledge sharing, represent the firm at industry events and establish best practice across communities of practice.
- Business strategy: Influence long-term organisational health by driving platform efficiency, managing engineering budgets and leading strategic hiring and retention initiatives.
What You'll Bring
- Proven experience in a principal engineering role
- Extensive experience with cloud data platforms such as Azure or AWS, with a focus on Databricks
- Strong PySpark and SparkSQL skills
- Solid understanding of data modelling across relational and non-relational databases
- Proficiency in SQL, with experience in data integration and ETL tools
- Excellent knowledge of big data technologies and frameworks
- Strong knowledge of data governance and data security best practices
- An analytical mindset, attention to detail and a consultative approach
- Excellent communication and stakeholder management skills
Disclaimer: Any remuneration stated in this advertisement is indicative and will be dependent on the successful candidate's experience, skills and qualifications. Final remuneration will be agreed with the successful candidate and will be subject to the terms of the contract.
Similar jobs
- HA

Senior Microsoft Data EngineerRecently posted
Hackajob Ltd · Charing Cross, Central London · On-site · Posted 14 Nov 2026 🇬🇧
DatabricksGenerative AIAzure+2TechnologySalary not listed - CH

Market Data Engineer - Java - Futures & Options - RFA to RTSDKRecently posted
CBSbutler Holdings Limited · South East London, London · Hybrid · Posted 14 Nov 2026 🇬🇧
TDDJavaTechnology£80k - £115k/yr - TE

Lead GCP Data EngineerRecently posted
TEKsystems · South East London, London · Hybrid · Posted 14 Nov 2026 🇬🇧
GCPTechnology£550 - £600/day - PC
Data EngineerRecently posted
PA Consulting · belfast, down · Hybrid · Posted 14 Nov 2026 🇬🇧
DynamoDBSQLScala+6TechnologySalary not listed - RH

Data EngineerRecently posted
Robert Half · birmingham, west midlands (county) · On-site · Posted 14 Nov 2026 🇬🇧
ELKLogstashKibanaTechnologySalary not listed - IN

Data Engineer – Active SC, ETL, SQLRecently posted
Investigo · london · Hybrid · Posted 14 Nov 2026 🇬🇧
OraclePL/SQLSQL+4TechnologySalary not listed - NH

Data Migration LeadRecently posted
National Health Service · leeds, west yorkshire · Remote · Posted 14 Nov 2026 🇬🇧
Stakeholder ManagementSQLSQL Server+2TechnologySalary not listed - SM

Data EngineerRecently posted
Smarkets · london · Hybrid · Posted 14 Nov 2026 🇬🇧
DockerFastAPIFlask+25TechnologySalary not listed - KI
Principal Data EngineerRecently posted
Kingfisher · southampton, hampshire · Hybrid · Posted 14 Nov 2026 🇬🇧
DockerGCPSQL+13TechnologySalary not listed - DA

Staff BI Data Engineer | Databricks & Power BIRecently posted
Datatech Analytics · reading, berkshire · Hybrid · Posted 14 Nov 2026 🇬🇧
SQLApache SparkDatabricks+5TechnologySalary not listed - CI
Lead Data Engineer – Spark / Scala - Vice PresidentRecently posted
Citigroup · belfast, down · Hybrid · Posted 14 Nov 2026 🇬🇧
ScalaApache SparkAWS+9TechnologySalary not listed - SG
Lead Data EngineerRecently posted
Serco Group · United Kingdom · Hybrid · Posted 14 Nov 2026 🇬🇧
Stakeholder ManagementSQLApache Spark+11TechnologySalary not listed
