Data Solution Architect - Databricks

Are you ready to be a part of a team that's redefining ultra-secure cloud solutions? Join a team that's shaping the future of cloud and cybersecurity.

At Showtime Consulting, we don't just build ultra-secure cloud solutions-we enable organisations to thrive in the most challenging high-threat environments. If you're truly passionate about innovation, security, and making a real impact, you're in the right place.

We deliver security where it matters most-protecting national infrastructure, defence, and mission critical operations. Our solutions are trusted by leading organisations, and our team is at the forefront of innovation in ultra-secure cloud and cross domain security.

Join a team that's shaping the future of cloud and cybersecurity.

At Showtime Consulting, we don't just build ultra-secure cloud solutions-we enable organisations to thrive in the most challenging high-threat environments. If you're truly passionate about innovation, security, and making a real impact, you're in the right place.

We deliver security where it matters most-protecting national infrastructure, defence, and mission critical operations. Our solutions are trusted by leading organisations, and our team is at the forefront of innovation in ultra-secure cloud and cross domain security.

Our people are specialists in secure cloud, defence technology, and insider risk mitigation. We thrive in high stakes environments, where cybersecurity isn't just a requirement-it's mission critical. If you're ready to contribute to industry leading projects and grow in a company that values trust, innovation, and resilience, explore our open roles today.

Meet THE Team Terry Hicks

Principal Cloud Consultant

Resource and Operations Manager at Showtime Consulting

George Constantine

People Operations Lead

Associate Consultant at Showtime Consulting Bachelor of Information Technology Student

CEO at Showtime Consulting Expert in Ultra Secure Cloud, Cross Domain Solutions, Insider Risk Management & Defence Grade Cybersecurity

Open Roles Data Solution Architect - Databricks

Company Description

Showtime Consulting is a leading provider of Shielded Cloud and Digital Solutions across Australia and New Zealand. We specialise in delivering secure, enterprise scale technology solutions across cloud, data, DevSecOps, platform engineering, AI, and digital transformation programs.

We partner with major organisations to design, modernise, and scale data platforms that enable advanced analytics, operational intelligence, regulatory compliance, and data driven decision making.

Our teams work at the forefront of cloud data engineering and modern analytics, helping customers transform legacy data estates into scalable, cloud native platforms built for the future.

The Role

We are seeking an experienced Senior Data Engineer / Data Architect to join a high performing data and cloud engineering team.

This is a hands on role focused on designing and delivering enterprise scale Data Lakehouse solutions using Azure Databricks, modernising legacy data platforms, and enabling cloud first analytics capabilities. You will play a key role in defining data architecture, implementing modern data engineering practices, and delivering strategic data platforms that support business critical reporting, analytics, machine learning, and operational workloads.

The ideal candidate will bring deep expertise across Azure Databricks, PySpark, Delta Lake, Azure Data Services, Data Architecture, and Data Governance, along with a proven track record delivering large scale data transformation and cloud migration initiatives.

Key Responsibilities

• Design and implement enterprise Data Lakehouse solutions using Azure Databricks.
• Lead data modernisation and cloud migration initiatives.
• Build scalable batch and real time data processing solutions.
• Develop and maintain data pipelines using PySpark and Spark SQL.
• Define data governance, security, lineage, and data quality standards.
• Design dimensional and Data Vault data models.
• Collaborate with business and technology stakeholders to deliver strategic data platforms.
• Drive data architecture standards, best practices, and technical governance.
• Implement CI/CD and DevOps practices across data engineering workloads.
• Provide technical leadership and mentor engineering teams.

What You'll Need

• Experience as a Data Engineer, Data Architect, or similar role.
• Strong hands on experience with Azure Databricks.
• Expertise with PySpark, Spark SQL, and Delta Lake.
• Experience with Azure Data Factory (ADF), ADLS, and Azure Synapse Analytics.
• Strong data modelling experience, including Dimensional Modelling and Data Vault.
• Deep understanding of data governance, data architecture, security, and data quality.
• Experience delivering real time and streaming data solutions.
• Strong Azure cloud platform experience.
• Experience with Git, CI/CD, and DevOps practices.
• Excellent stakeholder engagement and communication skills.

Desirable Skills

• 15+ years' experience in Data Engineering, Data Architecture, or Solution Architecture.
• Experience delivering large scale enterprise data transformation programs.
• Strong background in cloud migration and analytics modernisation.
• Experience with Azure Event Hubs, Kafka, or streaming technologies.
• Exposure to Microsoft Purview or enterprise data governance platforms.
• Experience supporting AI, machine learning, or advanced analytics workloads.
• Experience within Financial Services, Healthcare, Retail, Logistics, Telecommunications, or Government sectors.
• Azure and Databricks certifications.

Why Join Us?

• Work on large scale enterprise data transformation initiatives.
• Design and deliver modern Azure Data Lakehouse platforms.
• Influence enterprise data architecture and governance standards.
• Collaborate with experienced cloud, data, and analytics specialists.
• Gain exposure to leading Databricks and Azure technologies.
• Play a key role in shaping strategic data capabilities for major organisations.

At Showtime Consulting, We Hire And Develop The Best Minds In Cybersecurity. Our Values Shape Everything We Do Security

Essential for protecting sensitive information and ensuring the company's technology cannot be compromised.

Critical for building trust with stakeholders and maintaining ethical standards in all operations, especially in such sensitive sectors.

Necessary for staying ahead of technological advancements and threats, ensuring solutions are cutting edge and effective.

Demonstrates dedication to the mission, the safety and security of clients' data, and the success of their operations.

Important for providing reliable and consistent service, which is crucial for defense and intelligence operations that depend on continuity and dependability.

Fuels the drive to excel, innovate, and overcome challenges. It's the emotional investment in the mission and the work, which can inspire teams and lead to exceptional outcomes.

Essential for protecting sensitive information and ensuring the company's technology cannot be compromised.

Critical for building trust with stakeholders and maintaining ethical standards in all operations, especially in such sensitive sectors