Technical Lead - Data Engineering
Why This Role Stands Out
This Technical Lead role offers a fantastic opportunity to shape a modern data platform on Azure Databricks within a reputable organization, fostering significant career growth and skill development. You'll thrive here if you possess strong leadership abilities, a passion for data engineering best practices, and enjoy collaborating with diverse teams in a flexible hybrid environment.
Quick Overview
Job Description
Technical Lead - Data Engineering (Azure Databricks) - AIA Australia. The role reports to the Head of Data Platforms and Analytics and can be based in Sydney or Melbourne. The position is part of a large technology, data, and business transformation program focused on building a modern platform using Azure Databricks.
Responsibilities- Define detailed technical solutions and manage delivery of the data engineering team (onshore and offshore) based on business requirements and high level architecture.
- Design, build, and maintain scalable, efficient data pipelines and frameworks using Azure Databricks for ingestion, curation, and transformation of data.
- Lead data modelling, ETL automation, DevOps, data quality, security, and performance optimisation using best practices on Azure.
- Collaborate with key stakeholders across business, analytics, IT, and vendors to align engineering efforts with business priorities.
- Mentor and coach a team of data engineers and analysts, promoting best engineering practices and upskilling in the Azure Databricks toolset.
- Extensive experience in data design and engineering, preferably within insurance, banking, or financial services.
- Hands on experience developing data engineering and architecture frameworks using Databricks, data modelling, and ETL automation.
- Proficiency in programming languages and tools such as Python and SQL.
- Experience with Azure cloud services (ADF, ADLS, Azure SQL).
- Strong problem solving skills and the ability to analyse complex technical issues.
- Excellent communication skills, able to convey technical concepts to both technical and non technical audiences.
- Strong leadership skills, including mentoring and developing high performing teams.
- Databricks certification is highly regarded.
- Knowledge or experience in the insurance industry is highly regarded.
- Access to training and development programs to build on current skills.
- Career development opportunities through internal mobility.
- Work with a purpose driven company that supports well being initiatives and additional leave days.
- Flexible working arrangements.
- Inclusive and supportive working environment.
Skills
Similar jobs
Geospatial Data Engineer
IT Alliance Australia · Canberra, Australia
3 hours agoAzure Data Lakehouse DBA - Contract (Perth)
NES Global Talent · Australia
3 hours agoData Engineer
Service Stream · Melbourne, Australia
10 hours agoSenior Databricks Data Engineer - Azure Spark & Pipelines
8207 Avanade Australia Pty Ltd Company · Brisbane, Australia
12 hours agoData Engineer: End-to-End Pipelines on Fabric (Melbourne, Hybrid)
Service Stream · Melbourne, Australia
12 hours agoDatabricks Data Engineer Senior Analyst
8207 Avanade Australia Pty Ltd Company · Brisbane, Australia
12 hours ago