Quick overview
Job description
Salary: £61,000 - 101,000 per year
Requirements:
- Strong software development experience in one of Java, Scala, or Python
- Software development experience with data-processing platforms from vendors such as AWS, Azure, GCP, or Databricks
- Experience developing substantial components for large-scale data processing solutions and deploying into a production environment
- Proficient in SQL and SQL extensions for analytical queries
- Solid understanding of ETL/ELT data processing pipelines and design patterns
- Awareness of key features and pitfalls of distributed data processing frameworks, data stores, and data serialisation formats
- Ability to write quality, testable code and experience with automated testing
- Experience with Continuous Integration and Continuous Deployment techniques
- A keen interest in AI technologies
- Experience with performance tuning
- Experience with data visualisation and complex data transformations
- Experience with streaming and event-processing architectures, including technologies such as Kafka and change-data-capture products
- Expertise in continuous improvement and sharing input on data best practice
- Practical experience with AI technologies, tools, processes, and delivery
Responsibilities:
- Design and develop data processing and data persistence software components for solutions that handle data at scale
- Work in agile teams and provide strong development leadership on significant technical components of data systems
- Design and develop large-scale data processing software to meet user needs in demanding production environments
- Develop data processing software primarily for deployment in big data technologies
- Deliver the full software lifecycle, including design, code, test, and defect resolution
- Work with architects and lead engineers to ensure software supports non-functional needs
- Collaborate with colleagues to resolve implementation challenges and maintain high code quality and maintainability
- Lead by example in code quality
- Work with operations teams to ensure operational readiness
- Advise customers and managers on the estimated effort and technical implications of user stories and user journeys
- Coach and mentor team members
Technologies:
- AI
- AWS
- Azure
- Big Data
- Databricks
- ETL
- GCP
- Java
- Kafka
- Python
- SQL
- Scala
- Cloud
- Support
More:
We are partnering directly with Kainos to hire for this role. At Kainos, we are problem solvers, innovators, and collaborators driven by a shared mission to create real impact. We transform digital services for millions, deliver cutting-edge Workday solutions, and push the boundaries of technology together. We believe in a people-first culture where your ideas are valued, your growth is supported, and your contributions truly make a difference. You will join a diverse, ambitious team that celebrates creativity and collaboration. We are committed to diversity, equity, and inclusion, and we aim to create a fair and supportive recruitment process for every candidate.
last updated 38 week of 2026
#J-18808-LjbffrSimilar jobs
- IT
Data Engineer - Microsoft Fabric & AzureRecently posted
Intelligent Talent Solutions Ltd · City Of Westminster, London · Hybrid · Posted 12 Nov 2026 🇬🇧
AzureTechnology£55k - £65k/yr - ER

Azure Data EngineerRecently posted
Essential Recruitment · South East · Hybrid · Posted 12 Nov 2026 🇬🇧
SQLApache SparkAzure+3Technology£60 - £70/hr - SL

Senior Data EngineerRecently posted Auto Apply
Standard Life · Birmingham · Hybrid · Posted 12 Nov 2026 🇬🇧
SQLETLCompliance+5TechnologySalary not listed - SL

Principal Data EngineerRecently posted Auto Apply
Standard Life · Edinburgh · Hybrid · Posted 12 Nov 2026 🇬🇧
SQLScalaAWS+5TechnologySalary not listed - TR

Lead Data EngineerRecently posted
Tria Recruitment · London · Hybrid 🇬🇧
SQLAWSSnowflake+3Technology£100k/yr - FC

Data Engineer, On Prem, Stakeholder managementRecently posted
Fdo Consulting Limited · Marlow, Buckinghamshire · Hybrid · Posted 12 Nov 2026 🇬🇧
Stakeholder ManagementSQLTechnology£55k - £60k/yr - SI
Lead Data Engineer – Scalable Gaming Analytics PlatformRecently posted
Sony Interactive Entertainment Inc. (Japan) · london · Hybrid · Posted 12 Nov 2026 🇬🇧
TechnologySalary not listed - PU
Lead Data EngineerRecently posted
Prudential UK Services · london · Hybrid · Posted 12 Nov 2026 🇬🇧
EncryptionSnowflakeCI/CDTechnologySalary not listed - AU
Lead Data Engineer: Scalable Pipelines & Platform InnovationRecently posted
Aumni · glasgow · Hybrid · Posted 12 Nov 2026 🇬🇧
DatabricksPythonAgileTechnologySalary not listed - SI
Lead Data EngineerRecently posted
Sony Interactive Entertainment · london · Remote · Posted 12 Nov 2026 🇬🇧
GitAWSLooker+5TechnologySalary not listed - SI

Data Engineer - Live Support and MonitoringRecently posted
Stealth IT Consulting Limited · telford · Remote · Posted 12 Nov 2026 🇬🇧
TechnologySalary not listed - SG
Data Engineer (SC Cleared) - Core Cloud DatabricksRecently posted
Sanderson Government and Defence · london · Hybrid · Posted 12 Nov 2026 🇬🇧
DatabricksTechnologySalary not listed
