Why This Role Stands Out
This hybrid Data Engineer role offers exciting opportunities to build and maintain robust data pipelines within the financial services sector, leveraging cutting-edge big data and DataOps technologies. You'll thrive here if you possess strong skills in Scala, Python, Spark, and Airflow, and are eager to contribute to a reputable company while enjoying a flexible work environment. Join a dynamic team and advance your career in a challenging and rewarding position.
Quick Overview
Job Description
We are hiring For Data Engineer (DataOps/Big data)
Location: Hybrid 2 to 3 Days per week in Glasgow
- Hands-on experience in building, maintaining, and troubleshooting production batch data pipelines in financial services environments.
- Orchestrating batch workflows using Apache Airflow, building reusable pipeline components, handling live production support (investigating failed DAGs, checksum failures, and delivery delays), and applying data control frameworks (reconciliation, data quality, and audit tracking).
- Should have prior Experience in Investment Banking/Financial Services Technology, focusing on large-scale finance datasets, data reconciliation, metadata processing, data lineage, and strict technology change control standards.
- Prior expertise using Scala, Python, Apache Spark (PySpark/Sharedview Spark), SQL/PostgreSQL, and Starburst/Trino and DevOps Tools Docker, GitLab CI/CD, AWS S3, and container orchestration platforms (OpenShift, Kubernetes, or Helm).
Key Skills: Data Orchestration/Apache Spark (PySpark/Sharedview Spark), Scala, Python/Data Querying & Analysis/SQL, PostgreSQL, Starburst/Trino, Metadata Processing
Similar jobs
- LI
Data Engineer (Snowflake & Kafka) - Lorien Impellam
Lorien Impellam
London🇬🇧Hybrid7 weeks agoSQLAWSETL+6Technology - SE
Data Engineer
NewSustainable Energy First
Fulwood🇬🇧£45k - £55k/yrHybrid6 hours agoSQLHTTPSPower BI+1Technology - PF
Principal Data Engineer
NewPlaces for People
United Kingdom🇬🇧Hybrid16 hours agoGCPSQLEncryption+6Technology - IA
Data Engineer - Fabric
NewIO Associates
Bristol, Somerset🇬🇧£70k - £75k/yrOn-site3 hours agoSQLETLAzure+2Technology - PF
Principal Data Engineer
NewPlaces for People
United Kingdom🇬🇧Hybrid3 hours agoGCPSQLAirflow+3Technology - FP
Lead Data Engineer
NewFlagship Pioneering, Inc.
Cambridge🇬🇧2 days agoDockerSQLAWS+12Technology