Quick overview
Job description
Shift provides business finance to small, established and corporate sized businesses in Australia, including Business Overdraft, Equipment Line, Asset Finance, Term Loan and Trade Account. Founded in 2014, Shift has funded more than 30,000 Australian businesses.
At Shift, our unique approach to product innovation combined with our collaborative culture means you can build your career in a supportive environment. You'll be joining a diverse team of over 300 people who are always looking to deliver better outcomes for Australian businesses.
About the role:Want to put your stamp on a data platform? You'll own our Azure Databricks platform, set its standards and roadmap, and lead the data side of a core lending system migration. You'll be the senior engineer in a small team, with two other engineers to develop and plenty of room to shape how data works at Shift.
What you'll do:Own the data platform roadmap and engineering standards, including CI/CD, separate environments, automated testing, monitoring and access governance through Unity Catalog
Design and lead the build of robust, scalable ELT pipelines on Azure Databricks
Lead the data workstream for our core lending platform migration: remap pipelines and models, and reconcile outputs before and after cutover alongside Engineering
Build and extend a curated, dimensional data model that becomes the default place the business goes for trusted, self-serve data
Lift data quality, freshness and alerting so issues are caught before the business notices them
Keep the platform cost-efficient through cluster optimisation, job orchestration and smart use of compute
Mentor and develop other data engineers through code review, pairing and clear standards
Partner with analysts, data scientists, product managers and Engineering to turn business needs into data products people trust
7+ years in data engineering, with deep hands-on experience on Azure Databricks (Spark, Delta Lake, Unity Catalog)
Strong Python and SQL, plus experience with CI/CD and deploying pipelines as code (Azure DevOps or GitHub, Databricks Asset Bundles)
A track record of lifting standards on an existing platform, not just building something new on a clean slate
Solid dimensional modelling experience (star schemas, conformed dimensions, medallion architecture)
Experience mentoring engineers and leading technical decisions through design and code review
The ability to explain technical direction clearly to non-technical stakeholders, and an instinct to work across teams rather than in a silo
Experience leading the data side of a core system migration is a strong plus
Hybrid working: we're headquartered in North Sydney with state-based workplaces and offer a hybrid work policy. Our offices have spaces for collaboration, socialising and focused work.
Parental leave: up to 26 weeks paid.
Strategy Week: twice a year the whole team comes together to hear the business strategy and product and technology roadmap first hand, with fortnightly all company business updates in between.
Flat structure: everyone can learn from each other and senior leaders across the business.
Wellbeing: benefits supporting your physical, psychological and financial wellbeing, from a day off on your birthday to end of trip facilities.
If you don't meet all the qualifications or skills but think you'd be a great fit, please apply anyway.
Learn more about working at Shift at
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- CT
Data Engineer - FivetranRecently posted
Cognizant Technology Solutions Corporation · Sydney · Hybrid · Posted 18 Nov 2026 🇦🇺
SQLGitAWS+6TechnologySalary not listed - CT
Fivetran Data Engineer: ELT Pipelines & Data QualityRecently posted
Cognizant Technology Solutions Corporation · Sydney · Hybrid · Posted 18 Nov 2026 🇦🇺
TechnologySalary not listed - SF

Lead Data Engineer, Azure Databricks Platform (Hybrid)Recently posted
Shift Financial Pty · Sydney · Hybrid · Posted 18 Nov 2026 🇦🇺
DatabricksAzureTechnologySalary not listed - MC

Data EngineerRecently posted
Mane Consulting · Melbourne · Hybrid · Posted 18 Nov 2026 🇦🇺
SQLT-SQLApache Spark+7TechnologySalary not listed - CT
Senior Azure Data Engineer - Spark, Synapse & Big DataRecently posted
Cognizant Technology Solutions Corporation · Sydney · Hybrid · Posted 18 Nov 2026 🇦🇺
SQLApache SparkPython+1TechnologySalary not listed - CT
Azure Data EngineerRecently posted
Cognizant Technology Solutions Corporation · Sydney · Hybrid · Posted 18 Nov 2026 🇦🇺
MySQLSQLGit+9TechnologyA$80k - A$90k/yr - MC

Azure Data Engineer: Scale Data Pipelines & InsightsRecently posted
Mane Consulting · Melbourne · Hybrid · Posted 18 Nov 2026 🇦🇺
DatabricksAzurePower BI+1TechnologySalary not listed - ES
GCP Data Engineer - Contract or PermRecently posted
Eighty20 Solutions · Sydney · Hybrid · Posted 29 Oct 2026 🇦🇺
GCPBigQueryGoogle Cloud+1TechnologySalary not listed - XE
Senior Data Engineer - Performance Insights & AI LayerRecently posted
Xero Limited · Sydney · Hybrid · Posted 17 Nov 2026 🇦🇺
SnowflakedbtTechnologySalary not listed - TE
Storage EngineerRecently posted
Teamified · Melbourne · Hybrid · Posted 17 Nov 2026 🇦🇺
Microsoft OfficeDNSUnity+1TechnologySalary not listed - AM

Systems Specialist Logistics and Systems Engineering DatabaseRecently posted
Amentum · Sydney · On-site · Posted 17 Nov 2026 🇦🇺
Logistics ManagementSalary not listed - UN

Technical Lead - Data Platform AdministratorRecently posted Auto Apply
UniSuper · Melbourne · Hybrid · Posted 17 Nov 2026 🇦🇺
Stakeholder ManagementSQLT-SQL+5A$1.5k/mo