Why this role stands out
This hybrid role offers an exciting opportunity to lead critical workflow orchestration and SDK modernization initiatives using cutting-edge Google Cloud technologies like Apache Airflow and FastAPI. You'll thrive here if you're a seasoned backend engineer passionate about building high-performance, cloud-native solutions and driving impactful data pipeline architecture. Apply now to leverage your expertise and contribute to a fast-growing tech company with flexible work arrangements.
Quick overview
Job description
Requirement Description
A fast-growing technology company is seeking a Senior Backend Engineer for a 3-month contract to lead workflow orchestration, SDK modernization, and microservices initiatives. Based in Melbourne with a hybrid working arrangement (home-based in Victoria, with on-site visits when project milestones demand), this role offers the opportunity to build automated workflows using Google Cloud Composer (Apache Airflow), construct high-performance services with FastAPI, and deploy cloud-native solutions across GCP (Cloud Run, Cloud Functions).
Working as the core backend specialist, the consultant will design and optimise end-to-end data pipelines, drive the modernization of application SDKs and core microservices, and integrate backend workflows with BigQuery, Cloud Dataflow and Pub/Sub to process large-scale datasets.
Key Responsibilities- Serve as the core backend specialist leading the design, implementation, and optimization of end-to-end data pipelines and workflow orchestration using Google Cloud Composer (Apache Airflow).
- Drive software engineering initiatives to facilitate the seamless transition, integration, and continuous upgrade of application SDKs and core microservices across client ecosystems.
- Architect production-grade Python applications, write complex Airflow workflows/custom plugins, and build high-performance asynchronous microservices with FastAPI.
- Build cloud-native architectures on Google Cloud Platform, with expertise in Cloud Composer, Cloud Functions, Cloud Run, and containerization via Docker.
- Interface backend microservices and orchestration workflows with BigQuery, Cloud Dataflow, and Pub/Sub to process, manage, and transform large-scale datasets.
- Maintain robust Git-based CI/CD workflows for automated pipeline deployment, zero-downtime SDK releases, and seamless backend updates.
Essential:
- 5+ years of experience in backend software engineering, data orchestration, and microservices architecture.
- Strong hands-on expertise with Google Cloud Composer / Apache Airflow, including workflow authoring, dynamic task generation, custom operators, and pipeline management.
- Mastery of Python 3.x, asynchronous programming, and modern frameworks (e.g. FastAPI, AsyncIO).
- Strong GCP foundation with hands-on experience across Cloud Composer, Cloud Run and Cloud Functions.
- Direct experience integrating microservices and orchestrated workflows with data pipelines, BigQuery, and Cloud Dataflow.
- Robust containerization skills using Docker for container creation, optimization, and deployment.
- Proven track record in SDK management, including API/SDK design, versioning, and seamless client integration.
- Proficiency in DevOps & CI/CD tools (Git, GitHub Actions, Cloud Build) for continuous deployment of code and orchestration workflows.
- Commitment to software quality through rigorous testing frameworks like pytest and automated integration tests.
Desirable:
- Advanced Airflow/Composer mastery - experience managing enterprise-grade Airflow clusters, performance tuning, and building modular workflow frameworks.
- GCP certifications - Google Cloud Certified Professional Data Engineer, Cloud Developer, or Cloud Architect.
- SDK publishing experience - practical experience publishing, versioning, and maintaining public or internal open-source SDK packages (e.g. PyPI packages).
- Enterprise modernization experience - modernizing legacy batch or monolithic systems into scalable, event-driven, orchestrated cloud microservices.
- Stream processing familiarity - Apache Beam, Pub/Sub, or Kafka for real-time and event-driven data architectures.
- Security & compliance familiarity - API and workflow security standards (OAuth2, OIDC, IAM, secret management, zero-trust frameworks).
- Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
Similar jobs
- CA

Senior Backend Engineer - .NET, AWS, HybridRecently posted
carsales.com.au · Melbourne · Hybrid 🇦🇺
TechnologySalary not listed - PA

Principal Backend Engineer - AI Observability & EvaluationRecently posted
Palo Alto Networks, Inc. · Melbourne · Remote 🇦🇺
RAGTechnologySalary not listed - XE

Senior Engineer - PlatformRecently posted Auto Apply
Xero · AU: Melbourne: (260 Burwood Rd) · Hybrid 🇦🇺
AWS.NETGo+4Salary not listed - MO
Senior Backend Engineer - AI Code Analysis (Sydney, Hybrid)Recently posted
MongoDB Inc. · Sydney · Hybrid 🇦🇺
MongoDBJavaPython+2TechnologySalary not listed - BN

Senior Back End Software Engineer (NV1) - Arlula Auto Apply
Black Nova Venture Capital Pty Ltd · Sydney · Hybrid 🇦🇺
Data PipelineGoTechnologySalary not listed - PA

Principal Backend Engineer, AI Observability & EvaluationRecently posted
Palo Alto Networks, Inc. · Australia · Remote 🇦🇺
RAGTechnologySalary not listed - PA

Senior Backend Engineer: AI Observability & Scale (Remote)Recently posted
Palo Alto Networks, Inc. · Melbourne · Remote 🇦🇺
RAGTechnologySalary not listed - GP
Java DevelopersRecently posted
GoSourcing Pty · Brisbane, Queensland · Hybrid 🇦🇺
MicroservicesMongoDBSpring+16Salary not listed - 1L

Backend Engineer Auto Apply
10x Labs · Newcastle or Sydney · Hybrid 🇦🇺
DockerGCPSQL+10TechnologySalary not listed - CA

Senior Backend Software Engineer (Java), B2B Data Infrastructure Team (Open to remote across ANZ)Recently posted
Canva · Sydney · Remote 🇦🇺
AWSSnowflakeJava+4TechnologySalary not listed - EA
Backend Engineer (Payments, AU)Recently posted
EatClub · Sydney, New South Wales · Hybrid 🇦🇺
MySQLSQLGit+6TechnologySalary not listed - CA

Senior Backend Engineer - Export Auto Apply
Canva · Sydney · Remote 🇦🇺
C++JavaTechnologySalary not listed
