Quick overview
Job description
ABOUT THE ROLE
WHY JOIN US
RESPONSIBILITIES
- Own the end-to-end architecture of major platform components, driving design decisions that impact scalability, reliability, and performance.
- Architect and implement next-generation distributed data storage, processing, and query optimization systems.
- Partner with product, engineering leadership, and stakeholders to define technical roadmaps and translate business requirements into scalable solutions.
- Lead contributions to Apache projects and open-source communities, establishing Acceldata's presence and technical reputation.
- Identify and resolve complex performance bottlenecks across distributed systems, optimizing for cost, latency, and throughput.
- Mentor and guide Senior Software Engineers, fostering technical excellence and a culture of continuous learning.
- Establish and enforce coding standards, perform thorough code reviews, and ensure architectural consistency across the platform.
- Evaluate and recommend emerging technologies, tools, and frameworks that align with platform goals.
- Lead root cause analysis for critical production issues and drive systemic improvements to prevent recurrence.
- Work across diverse environments: Bare Metals, VM, Kubernetes, and multi-cloud architectures.
REQUIREMENTS
- 9+ years of hands-on software development experience with at least 5 years focused on distributed systems or big data platforms.
- Expert-level proficiency in Java or Scala, with strong Python skills. Experience with systems languages is a plus.
- Deep understanding of distributed computing principles, including consensus algorithms, data partitioning, replication, fault tolerance, and consistency models.
- Extensive hands-on experience with multiple components of the big data stack (Hadoop, Spark, Hive, Trino, Kafka, Flink, NiFi or similar).
- Expert-level Linux proficiency, including kernel tuning, performance analysis, and debugging at the system level.
- Strong experience with Kubernetes, Docker, and cloud platforms (AWS, GCP, or Azure).
- Deep expertise with Maven, Gradle, or SBT; experienced in CI/CD pipelines, GitHub, and artifact management (Nexus).
- Proven ability to diagnose and resolve complex issues, including memory leaks, deadlocks, GC tuning, and distributed system failures.
- Strong understanding of architectural patterns for scalable, fault-tolerant distributed systems.
- Excellent written and verbal communication skills; ability to articulate complex technical concepts to diverse audiences, including senior leadership.
- Demonstrated ability to work effectively with cross-functional teams, external contributors, and the open-source community.
- History of significant contributions or committer status in Apache projects (e.g., Spark, Kafka, Hive, Iceberg, Flink, etc.).
- Experience with modern table formats (Apache Iceberg, Delta Lake, Hudi) and data lake architectures.
- Experience developing or optimizing query engines, query planners, or execution frameworks.
- Familiarity with data governance, security, lineage, and compliance frameworks.
- Experience leading large-scale data platform migrations or Hadoop distribution upgrades.
- Published technical blogs, papers, or conference presentations on distributed systems topics.
- Experience leading or maintaining open-source projects.
PREFERRED SKILLS
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- VE
Application Engineer - MiningRecently posted Auto Apply
Veolia Environnement SA · Oakville, ON · Hybrid · Posted 20 Nov 2026 🇨🇦
CADTechnologyC$95k/yr - FS
Unreal ProgrammerRecently posted Auto Apply
Frima Studio · Québec, Quebec · Hybrid · Posted 19 Nov 2026 🇨🇦
ScrumC++Unreal EngineTechnologySalary not listed - FS
Programmeur.euse UnrealRecently posted Auto Apply
Frima Studio · Québec, Quebec · Hybrid · Posted 19 Nov 2026 🇨🇦
ScrumC++Unreal EngineTechnologySalary not listed - FS
UI ProgrammerRecently posted Auto Apply
Frima Studio · Québec, Quebec · On-site · Posted 19 Nov 2026 🇨🇦
ScrumC++Unreal EngineTechnologySalary not listed - FS
Programmeur.euse UIRecently posted Auto Apply
Frima Studio · Québec, Quebec · Hybrid · Posted 19 Nov 2026 🇨🇦
ScrumC++Unreal EngineTechnologySalary not listed - AF

Staff Software Engineer, Backend (Resilience)Recently posted Auto Apply
Affirm · Remote Canada · Remote · Posted 21 Nov 2026 🇨🇦
AWSJavaKotlin+2TechnologyC$181k - C$241k/yr - KE

Founding Engineer Auto Apply
Keplar · Toronto (Canada) · Remote 🇨🇦
Generative AIEngineeringSalary not listed - GE
Développeur(euse) logiciel senior/ Senior Software Developer - Security PlatformRecently posted Auto Apply
Genetec · Montreal, Quebec · Hybrid · Posted 20 Nov 2026 🇨🇦
OAuthSAMLData Pipeline+3TechnologySalary not listed - GE
Développeur(euse) logiciel / Software Developer - Edge OSRecently posted Auto Apply
Genetec · Montreal, Quebec · Hybrid · Posted 19 Nov 2026 🇨🇦
DockerErlangRust+9TechnologySalary not listed - TJ
Senior Software EngineerRecently posted Auto Apply
Third-Party Job Posts · Canada · Hybrid · Posted 20 Nov 2026 🇨🇦
DockerPHPAWS+11TechnologySalary not listed - SK
Senior Software Engineer (Networking/Core Systems) | MinecraftRecently posted Auto Apply
Skyboxlabs · Burnaby · Hybrid · Posted 19 Nov 2026 🇨🇦
Continuous ImprovementDiversity & InclusionC+++6TechnologyC$125k - C$170k/yr - SK
Intermediate Software Engineer (Networking/Core Systems) | MinecraftRecently posted Auto Apply
Skyboxlabs · Burnaby · Hybrid · Posted 18 Nov 2026 🇨🇦
Continuous ImprovementDiversity & InclusionC+++6TechnologyC$83k - C$140k/yr
