Software Backend Engineer - Data Pipeline Remote (Australia) 3+ years
Quick Overview
Job Description
We are looking for a Backend Engineer focused on data pipelines to design, build, and maintain the systems that move high-volume inspection data from field devices through to analysis, storage, and reporting. Reliability and latency are the primary constraints - not feature richness.
What You Will Do- Design and operate asynchronous, event-driven pipelines for inbound inspection data (imagery, point clouds, sensor telemetry)
- Build robust ingestion services that handle intermittent connectivity, partial uploads, and field device variability
- Optimise storage strategies for large binary payloads (images, video, point cloud files) on cloud object storage
- Implement processing queues and worker architectures that scale to handle burst inspection loads
- Maintain data quality and completeness checks at every pipeline stage
- Design and document data contracts between field devices, pipelines, and downstream platform consumers
- 3+ years of backend engineering with a focus on data movement and processing at scale
- Strong proficiency in Python or Node.js for pipeline and worker service development
- Experience with message queue or streaming systems (RabbitMQ, SQS, Kafka, or similar)
- Solid understanding of cloud object storage patterns (S3, Azure Blob, or GCS)
- Experience handling large binary file processing pipelines in production
- Strong observability instincts: structured logging, metrics, alerting for pipeline health
Our head office is in Melbourne and we have a second office in Sydney. We are open to flexible and remote working arrangements anywhere in Australia for the right person, so where you are based should not stop you from applying.
You are welcome to work from either office if you would prefer to, and we will get you out to site from time to time so you can see the systems your work supports running in the field.
Similar jobs
- CS
Backend Engineer: Cloud Entitlements & Subscriptions
NewCisco Systems, Inc
Sydney🇦🇺Hybrid2 hours agoSplunkTechnology - TP
Senior Backend Engineer, Health Tech - Hybrid, Mentorship
NewTyro Payments Limited
Melbourne, Victoria🇦🇺Hybrid17 hours agoTechnology - EV
Back End Software Engineer
NewEventhash
Australian Capital Territory🇦🇺HybridYesterdayMicroservicesPHPShell+10Technology - TI
Backend Engineer for Live Platform
NewTikTok
Sydney🇦🇺HybridYesterdayC++JavaPythonTechnology - TI
Backend Software Engineer, TikTok Live Foundation (Sydney) Sydney Technology - Backend Regular
NewTikTok
Sydney🇦🇺Hybrid2 days agoExpressMySQLC+++3Technology - OU
Senior Backend Engineer
Outsized
Melbourne, Victoria🇦🇺Hybrid4 days agoDockerFastAPIGCP+10Technology - BJ
Backend Developer
Bjak
Sydney, New South Wales🇦🇺Hybrid4 days agoTechnology - NH
Senior Backend Developer - Safety and Productivity Systems
NHVR
Brisbane, Queensland🇦🇺A$152.5k/yrHybrid4 days agoExpressMicroservicesMySQL+12Technology - A2
Senior NodeJs engineer
a2b
Sydney, New South Wales🇦🇺Hybrid5 days agoNode.jsSQLTDD+5Technology - HH
Staff Backend Engineer
Heidi Health Corp.
Melbourne, Victoria🇦🇺Hybrid6 days agoDjangoFastAPITDD+7Technology - TR
Backend Developer
Tech Resources
Perth, Western Australia🇦🇺Hybrid6 days agoEmbedded SystemsC#.NET+4Technology - MB
Senior Python Backend Engineer - Vulnerability Platform
Macquarie Bank Limited
Sydney🇦🇺Hybrid1 week agoTechnology