Why This Role Stands Out
This hybrid Databricks Engineer role offers a fantastic opportunity to build and optimize data pipelines using cutting-edge technologies like Spark Structured Streaming and Delta Lake, significantly impacting data visualization and governance. You'll thrive here if you possess strong PySpark and Databricks SQL skills and are eager to contribute to a reputable company. Embrace this chance to advance your career in a flexible and dynamic environment!
Quick Overview
Job Description
Job Title: Databricks Engineer
Location: Coventry UK (Hybrid)
Employment type: contract (Inside Ir35)
Job Description:
Role:
Configure Databricks Auto Loader or Apache Spark Structured Streaming to securely subscribe to the relevant SAP AEM topics.
Develop the PySpark/SQL data pipelines to process the incoming JSON payloads through the Delta Lake layers.
Carry out data modelling in Databricks.
Expose the Delta tables to the visualisation layer.
Ensure that the data pipelines are optimised.
Skillsets:
Expert in Apache Spark Structured Streaming and Databricks Auto Loader.
Fluent in PySpark and Databricks SQL.
Proven experience building Databricks architecture patterns.
Familiarity with Unity Catalog for data governance and access control.
Similar jobs
- QT
Data Engineer-Palantir Foundry
NewQualient Technology Solutions UK Limited
Leeds🇬🇧Hybrid1 hour agoSQLPythonTechnology - MR
Senior Data & Integrations Engineer – People & Finance
NewMcLaren Racing Ltd
Woking🇬🇧On-site18 hours agoSOAPSQLETL+8Engineering - PR
Data Engineer
NewproSapient
United Kingdom🇬🇧Remote19 hours agoDockerGCPSQL+8Technology - EG
Data Manager
NewEurocell Group PLC
Hilcote, Alfreton🇬🇧£70k/yrHybridYesterdayTechnology - LF
Data Engineer
NewLa Fosse
london🇬🇧Hybrid9 hours agoAWSSnowflakedbtTechnology - IN
Senior Data Engineer (Metadata & Lineage Integration)
NewIntellias
london🇬🇧Hybrid9 hours agoMongoDBSQLSQL Server+6Technology
