Quick overview
Job description
Data Engineer
London | Hybrid | Full-time
Are you a skilled Data Engineer eager to work with high-volume datasets and cutting-edge technologies? We’re looking for a data-driven professional to develop and optimise a scalable data platform that supports advanced analytics and quantitative research. You’ll play a key role in designing robust data pipelines, integrating real-time feeds, and ensuring the seamless flow of structured and unstructured data.
In this role, you'll be responsible for building and maintaining high-performance data pipelines that process complex and large-scale datasets. You'll work closely with analysts and researchers to understand their data requirements, optimising real-time data ingestion by integrating external APIs and alternative data sources. You will focus on enhancing the data architecture to improve accessibility, efficiency, and security while automating ETL workflows to streamline data modelling and analysis. You’ll also support event-driven systems by implementing technologies like Kafka and Protobuf, ensuring seamless data streaming and processing. A key aspect of your role will be implementing rigorous quality assurance measures, ensuring data integrity and consistency across all inputs and outputs. Additionally, you'll collaborate with teams to support machine learning applications, facilitating data preparation for model training and deployment.
What You’ll Need
3+ years of experience in a data engineering
Strong proficiency in Python and Rust
Hands-on experience with AWS cloud, Linux, and Docker.
Expertise in distributed computing frameworks (Ray, Dask, or Apache Arrow).
Strong analytical skills, with the ability to handle large-scale, high-frequency data
.Solid understanding of ETL pipelines, data modelling, and database optimisation.
Experience working with real-time streaming technologies
This is a fantastic opportunity to be part of a fast-moving, data-driven environment where your technical expertise will have a real impact. You'll work with cutting-edge tools, collaborate with top-tier professionals, and contribute to the efficiency and innovation of a growing data team.
If you’re ready to take your data engineering career to the next level, we’d love to hear from you!
Similar jobs
- OT

Data EngineerRecently posted
Ocado Technology · doncaster, south yorkshire · Hybrid 🇬🇧
SQLGitETL+11TechnologySalary not listed - TV
Senior Data EngineerRecently posted
The Very Group · liverpool, merseyside · Hybrid 🇬🇧
SQLScalaAWS+3TechnologySalary not listed - LI

Data EngineerRecently posted
LinuxRecruit · london · Hybrid 🇬🇧
SQLAWSPython+2TechnologySalary not listed - FC

Principal Data EngineerRecently posted
Funding Circle · london · Hybrid 🇬🇧
GitAWSSnowflake+6TechnologySalary not listed - SR

Data Engineer / AnalystRecently posted
Sanderson Recruitment · london · Hybrid 🇬🇧
Stakeholder ManagementTechnologySalary not listed - NS

Senior Data Engineer (Cloud, Data Integration & Migration)Recently posted
NEC Software Solutions · United Kingdom · Hybrid 🇬🇧
MySQLOracleSQL+7TechnologySalary not listed - DE

Consultant - Manager, Data Engineer, AI & Data, Defense & SecurityRecently posted
Deloitte · london · Hybrid 🇬🇧
Stakeholder ManagementETLEncryption+2TechnologySalary not listed - QC
Lead Data Engineer – FintechRecently posted
Quant Capital · london · Hybrid 🇬🇧
SQLPythonTechnologySalary not listed - AM

Senior Data EngineerRecently posted
Anson McCade · london · Hybrid 🇬🇧
Stakeholder ManagementSQLAWS+2TechnologySalary not listed - PE

Data Engineer IIIRecently posted
Pearson · manchester, greater manchester · Hybrid 🇬🇧
MySQLSQLGit+7TechnologySalary not listed - DC

Data EngineerRecently posted
Durham County Council · durham, county durham · Hybrid 🇬🇧
TechnologySalary not listed - RR
Data Migration Specialist / Data Engineer – SQL, ETL & LegalTech – RemoteRecently posted
Recruitment Revolution · birmingham, west midlands (county) · Remote 🇬🇧
SQLETLC#+3TechnologySalary not listed
