Quick overview
Job description
We are working with a leading global Financial Services business to hire a Senior Data Engineer into their growing data engineering practice. This is a hands-on technical role sitting at the centre of a major enterprise data platform build, with scope to influence architecture, drive pipeline development, and contribute to AI initiatives across a complex, high-volume financial data environment.
Responsibilities:
- Design and develop scalable data solutions on a Lakehouse architecture platform, supporting enterprise-wide data processing and analytics
- Build, optimise, and maintain ETL/ELT pipelines and structured streaming workflows for both batch and real-time data ingestion
- Configure and tune clusters and Spark jobs to deliver consistent performance at scale
- Utilise Delta Live Tables and Unity Catalog to manage data ingestion, transformation, and access governance
- Apply IAM best practices and maintain compliance with data security standards across the platform
- Support infrastructure provisioning and resource management using Terraform
- Implement monitoring frameworks covering pipeline performance, data quality, and operational health
- Contribute to code reviews, technical documentation, and team knowledge-sharing
- Work within an Agile delivery model, collaborating closely with data scientists, analysts, and business stakeholders
- Explore emerging technologies and AI tooling to enhance development productivity and platform capability
- 6+ years in data engineering, with at least 2 years hands-on experience with Databricks
- Strong Python and Spark programming skills
- Solid AWS experience across core services including S3, Glue, and Lambda
- Deep understanding of data modelling, SQL, and ETL/ELT design patterns
- Experience with Delta Lake, Lakehouse architecture, and Git-based version control
- Demonstrable use of AI tools within a professional development workflow
- Strong communication skills and the ability to work effectively across technical and non-technical teams
Desirable:
- Financial services or fund administration background
- Exposure to AI/ML implementation patterns and real-time data processing frameworks
- Multi-cloud experience beyond AWS
- API development or data governance framework experience
- Experience mentoring junior engineers
Salary: to be discussed, depending on experience
Length: Permanent contract
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your CV get past this employer's screening? Check your CV against this job, free
Similar jobs
- V1
Senior Data Engineer (Microsoft Fabric) Auto Apply
Version 1 · Dublin, County Dublin · Hybrid · Posted 9 Nov 2026 🇮🇪
Stakeholder ManagementOracleSQL+7TechnologySalary not listed - GM

Databricks Team Lead Auto Apply
G MASS · Dublin, County Dublin · Hybrid · Posted 9 Nov 2026 🇮🇪
Generative AIOperations & Project ManagementSalary not listed - DG
Junior Data Engineer Auto Apply
Designer Group · Dublin, County Dublin · Hybrid · Posted 6 Nov 2026 🇮🇪
Stakeholder ManagementSQLGit+17TechnologySalary not listed - CA

Data Engineer Auto Apply
Cartrawler · Dublin · Hybrid · Posted 6 Nov 2026 🇮🇪
SQLGitAWS+10TechnologySalary not listed - DT
Senior Business Intelligence Analyst & Data Engineer- Remote Auto Apply
DeepSource Technologies · Ireland · Remote · Posted 26 Oct 2026 🇮🇪
SQLETLLooker+19TechnologySalary not listed - CI

Data EngineerRecently posted Auto Apply
CitySwift · Galway · Hybrid · Posted 16 Nov 2026 🇮🇪
MongoDBMySQLSQL+12TechnologySalary not listed - AM

Data Engineer Auto Apply
Amach · Dublin · Hybrid · Posted 5 Nov 2026 🇮🇪
GCPAWSETL+5TechnologySalary not listed - TE
Senior Scientific Data Engineer Auto Apply
TetraScience · Dublin, County Dublin · Hybrid 🇮🇪
SQLAWSSnowflake+6TechnologySalary not listed - PG

Senior Data EngineerRecently posted Auto Apply
PlayStation Global · Ireland · Hybrid · Posted 21 Nov 2026 🇮🇪
SQLGitApache Spark+7Technology€87.8k - €131.8k/yr - 2K

Director of Data EngineeringRecently posted Auto Apply
2K · Dublin · Hybrid · Posted 18 Nov 2026 🇮🇪
RustETLSnowflake+6Salary not listed - GM

Databricks Technical Lead Auto Apply
G MASS · Dublin, County Dublin · Hybrid 🇮🇪
SQLScalaAWS+10Salary not listed - DA
Head of Data and AI Engineering Auto Apply
Davy · Dublin, County Dublin · Hybrid 🇮🇪
SourcingSQLAWS+12Salary not listed