Lead Data Engineer

# Lead Data EngineerJob Reference: Government AgencyBaseline RequiredAustralian CitizenData Operations team, Data and Systems (DaS) sectionACTContractCloses 11/11/2026PythonAWSOpen Data CubeContainerisationData Engineering OrchestrationMachine Learning WorkflowsCI/CD PipelinesGeospatial Data AnalysisETL / Data PipelinesAutomated TestingShare About the RoleRole Overview:Design, code, train, validate, maintain and optimise machine learning workflows, with orchestration, testing and documentation; support development and maintenance of data source, ingest and transformation pipelines; develop, test and maintain the Open Data Cube code base; transfer knowledge to and upskill Earth Observation scientists; advise on improvements to existing algorithms; implement, maintain and improve automated testing and deployment pipelines on AWS for various platforms; contribute to and drive a strong collaborative culture; ensure services and components are available and high performing; embed security tools and practices into systems and CI/CD pipelines; support data operations as directed by DaS leadership; other administrative tasks as required.

The role sits in the Data Operations team of the Data and Systems (DaS) section and supports Earth Analysis scientific products and infrastructure, with a focus on data management, IT system support and Earth observation product support, considering cybersecurity in planning, delivery and monitoring and aligning with branch governance frameworks.

Key Responsibilities:• Large geospatial and Earth observation datasets in a cloud environment; Open Data Cube code base development, testing and maintenance.• Data engineering orchestration, containerisation and Python - essential.• Design, code, train, validate, maintain and optimise machine learning workflows with orchestration, testing and documentation.• Data ingest and transformation pipelines; protocols for data access and editing.• Automated testing and deployment pipelines on AWS; security tools and practices embedded in systems and CI/CD; service availability and performance.• Technical leadership of software development practices, tools and standards for secure, high-quality solutions; strategic advice on use and reuse of data processes, systems and tools.• Upskill Earth Observation scientists, advise on algorithm improvements, and communicate complex concepts to technical and non-technical audiences.

About the ClientA federal government agency focused on geoscience, earth observation, and national spatial data infrastructure. RequirementsEssential CriteriaYour response must demonstrate experience against each of the following:1. Demonstrated experience working with large, geospatial datasets within a cloud environment.2. Comprehensive knowledge of protocols associated with data access and editing.3. Demonstrated experience providing strategic advice and guidance on the use and reuse of data processes, systems and tools.4.

Provide technical leadership across software development, driving the adoption of development practices, tools and standards to deliver secure, high-quality solutions.5. The ability to work effectively with technical and non-technical stakeholders, and communicate complex concepts across a range of audiences. Desirable CriteriaThe following are advantageous but not mandatory:• Build and sustain strong relationships and collaboration while fostering an inclusive, high-performing team environment. Interested in this role? Submit your application today.