Data Engineer

Data Engineer<br />We're supporting a leading enterprise financial services organisation in the search for an experienced Data Engineer to join a high-performing data team on an initial 6-month contract.<br />Contract Details:

• Inside IR35
• Initial 6-month engagement
• Sheffield-based, 3 days per week on-site<br />Key

Requirements:

• Strong hands-on experience with PySpark and Databricks
• Deep understanding of Spark performance optimisation, including lazy evaluation, column pruning, groupBy operations, and window functions
• Proven ability to troubleshoot and resolve Spark job performance issues
• Extensive experience designing, developing, and supporting enterprise-scale data pipelines
• Strong technical depth across modern data engineering platforms, tools, and technologies
• Experience working within complex, large-scale enterprise environments<br />This is an excellent opportunity to contribute to a major data transformation programme within a leading financial services organisation.<br />Additional information available on successful application