Data Platform Engineer

Data Platform Engineer London (Hybrid) 6 Month Contract £(Apply online only)/day (Inside IR35) Data Platform Engineer needed with strong AWS cloud platform migration and Terraform expertise. 6 Month Rolling Contract based in London (Hybrid), with occasional travel to the Leeds office.

Hybrid Working - 3-4 days/week remote (WFH) + 1-2 days/week working from the office in London. A chance to work with a leading global IT transformation business specialising in large-scale Government projects: In-depth Data Engineering experience + AWS cloud data platform migration experience.

The role will focus on Data Engineering, cloud platform migration, infrastructure automation + supporting the delivery of large-scale data processing solutions.

Supporting a major Data platform modernisation programme including migration of data pipelines, notebooks + data workloads from legacy Databricks environment to modern AWS cloud-based data platforms. Strong Terraform + Infrastructure as Code (IaC) skills including developing + maintaining Terraform code to support data platform deployments.

Supporting deployment of data platform components, jobs, permissions + environment configurations. Analysing current Data Engineering solutions + identifying data migration requirements. Onboarding datasets, users + workloads onto target platform. Data Engineering:

Python, PySpark, SQL, Data Pipeline Development, ETL/ELT Design, Data Modelling, Data Quality, Data Validation. AWS Cloud Platform, S3, IAM, CI/CD concepts, DevOps principles, Agile Delivery. Advantageous Skills:

Databricks, Palantir Foundry, Foundry Pipeline Builder, Ontology concepts, Delta Lake, Secure Data Environment (SDE) experience, NHS / Healthcare data experience. Government / (url removed) / Public Sector domain experience strongly preferred. Must be active SC Cleared or fully eligible to undergo the full SC Security Clearance process