Data Engineer (Databricks)

What you'll be doing

Atturra is looking for a highly skilled SQL Server & SSIS Database Developer for a permanent opportunity, to work within our Data & Integration Business, delivering to our Atturra clients in Federal Government for a Defence Project. This role is based in Canberra, and the successful candidate must be able to work full time on the Defence site in Russell, ACT. Additionally, holding an active AGSVA NV1 Clearance is a non negotiable requirement for this role.

Atturra is seeking candidates who have a passion for innovative technology and driving customer transformation. This person must be able to communicate with a variety of different audiences and must have strong presentation skills. The ability to work in a cohesive team (Atturra and the client team) is important for this role.

Responsibilities

• Develop and support Microsoft SQL Server 2022, T SQL, SQL Server Integration Services (SSIS), SQL database projects, and Azure DevOps repositories and deployment pipelines
• Maintain, troubleshoot, and support ETL processes, SSIS package deployments, SQL database changes, and post deployment scripts across application and reporting environments
• Develop and maintain database triggers, stored procedures, data processing workflows, audit logging, application user attribution using SESSION_CONTEXT, metadata driven database solutions, and repeatable deployment patterns
• Apply SQL database schema changes to code repositories in SQL Server Management Studio (SSMS) and maintain in Visual Studio Database Project and Repository in DevOps
• Use DevOps Build and Release pipelines to deploy database schema changes to six Application Life cycle Management (ALM) environments for Application and Reporting (Application Development, Application Test, Application Production, Reporting Development, Reporting Test, Reporting Production)
• Apply changes to Visual Studio SQL Server Integration Services (SSIS) Project and Repository in DevOps, adding or removing data mappings for schema changes to ETL data flows
• Deploy SSIS package changes to the SSIS Host in the platform and configure in the custom platform scheduler
• Create and deploy SQL post update scripts to update data in higher ALM environments, including Production, for data update requests, data fixes, and similar changes
• Maintain Apache Airflow and PySpark jobs in ETL packages that move data between Application databases and medallion zones in the Reporting platform, applying Apache Iceberg schema changes and adding or removing data mappings for schema changes
• Apply remediation for any defects reported by the Test Manager
• Support investigations into any data issues reported by users or stakeholders

Working Conditions

• Onsite
• Permanent full time
• NV1 security clearance is mandatory

What will make you successful in this role?

Key Capabilities:

• Focus on client needs and effective communication skills
• Current NV1 security clearance (mandatory)
• Based in Canberra with the ability to work on site
• Strong T SQL development skills using Microsoft SQL Server 2022, including stored procedures, triggers, post deployment scripts, data fixes, and troubleshooting database related issues
• Experience supporting SQL database projects and repeatable deployments through Azure DevOps repositories, build pipelines, release pipelines, and environment specific deployment processes
• Solid SQL skills, including writing post update scripts and data fixes
• Strong experience with SQL Server, including database schema management in SQL Server Management Studio (SSMS) - mandatory
• SQL Server Integration Services (SSIS) - strong experience developing, deploying, and maintaining SSIS packages (mandatory)
• DevOps - experience managing code repositories and Build and Release pipelines
• Ability to work independently and as part of a team
• Experience with Apache Airflow and PySpark for ETL workloads
• Experience with Apache Iceberg schemas and medallion architecture
• Experience working across multiple ALM environments and custom schedulers

Why this is an exciting opportunity

Atturra is a growing ASX-listed advisory and IT solutions company that provides a foundation for career growth within a technology driven environment. The Data & Integration unit helps clients unlock data potential through on premises, hybrid, and cloud integration solutions.

What our people say

"We are working towards a very bright future."

How to apply

All applications must be submitted online via our Careers page. Please ensure your application is complete and that you have answered all required questions before submitting.