Quick overview
Job description
Job Title - AWS Data Engineer
Location: Coventry UK (Hybrid)
Employment Type: Contract.
Detailed Job Description:
Role:
Configure Databricks Auto Loader or Apache Spark Structured Streaming to securely subscribe to the relevant SAP AEM topics.
Develop the PySpark/SQL data pipelines to process the incoming JSON payloads through the Delta Lake layers.
Carry out data modelling in Databricks.
Expose the Delta tables to the visualisation layer.
Ensure that the data pipelines are optimised.
Skillsets:
Expert in Apache Spark Structured Streaming and Databricks Auto Loader.
Fluent in PySpark and Databricks SQL.
Proven experience building Databricks architecture patterns.
Familiarity with Unity Catalog for data governance and access control.
Similar jobs
- TE

Lead GCP Data EngineerRecently posted
Teksystems · South East · Hybrid · Posted 13 Nov 2026 🇬🇧
GCPTechnologySalary not listed - NC

Lead Data EngineerRecently posted
Nottingham Community Housing Association · Nottingham, Nottinghamshire · Hybrid · Posted 17 Nov 2026 🇬🇧
SQLGitETL+4Technology£45.3k - £51.9k/yr - NC

Lead Data EngineerRecently posted
Nottingham Community Housing Association · Nottingham, Nottinghamshire · Hybrid · Posted 17 Nov 2026 🇬🇧
Technology£45.3k - £51.9k/yr - SC

Data EngineerRecently posted
Syntax Consultancy Limited · Milford, Belper · Remote · Posted 17 Nov 2026 🇬🇧
SQLT-SQLApache Spark+8Technology£40k/yr - GG
Databricks EngineerRecently posted
Gazelle Global Consulting Ltd · Farringdon, Central London · On-site · Posted 17 Nov 2026 🇬🇧
UnityEngineeringSalary not listed - CY
PostgreSQL DBARecently posted
Cyberteam · Manchester, Greater Manchester · On-site · Posted 17 Nov 2026 🇬🇧
GCPMongoDBGit+7TechnologySalary not listed - HD
Data Warehouse EngineerRecently posted
Hays DT - Midlands · Birmingham · Hybrid · Posted 17 Nov 2026 🇬🇧
SQLTeamCityGit+16Technology£63.0k/yr - A-
Data Engineer – ICT Level 5Recently posted
AFBI - Agri-Food and Biosciences Institute · Belfast, Northern Ireland · Hybrid · Posted 17 Nov 2026 🇬🇧
Technology£37.7k - £39.0k/yr - MG
Python Data EngineerRecently posted Auto Apply
Man Group · London · On-site · Posted 17 Nov 2026 🇬🇧
OracleSQLGit+12TechnologySalary not listed - TA
Data EngineerRecently posted
Talent · United Kingdom · Hybrid 🇬🇧
Stakeholder ManagementSQLApache Spark+8TechnologySalary not listed - OF

Data EngineerRecently posted
Outcomes First Group · manchester · Hybrid 🇬🇧
Stakeholder ManagementSQLApache Spark+5Technology£49k/yr - BH
Hybrid Data Engineer: SQL Pipelines & QualityRecently posted
Believe Housing Limited · bishop auckland · Hybrid · Posted 17 Nov 2026 🇬🇧
SQLSQL ServerTechnologySalary not listed