Haystack
← Back to Jobs
Technology
RA

Senior Software Engineer : C++ and Distributed Systems

RapidIT, IncSan Jose, CA🇺🇸United StatesPosted Oct 1, 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
San Jose, CA, United States
Posted
21 hours ago
MicroservicesSQLLoad BalancingMachine LearningAnsibleApacheCassandraCockroachDBC++KubernetesTerraformgRPC

Job Description

Position: Senior Software Engineer : C++ and Distributed Systems

Location: San Jose, CA

6+ months

Summary: We are seeking highly skilled Software Engineers with deep expertise in high-performance C++ and distributed systems. You will focus on backend systems-level development, production infrastructure automation to optimize high-scale compute and machine learning environments. This role strictly focuses on backend infrastructure; it does not involve full-stack, product-level, or web frontend development.

Core Requirements:

High-Performance C++ Engineering: Deep proficiency in modern C++ (C++14/17/20). Proven experience optimizing low-latency/high-throughput systems, with a strong grasp of concurrency, multi-threading, memory management, and asynchronous programming.

Distributed Systems & RPC Frameworks: Extensive experience building scalable, highly available backend microservices. Strong proficiency with RPC frameworks (e.g., gRPC, Apache Thrift) and data serialization (e.g., Protocol Buffers, FlatBuffers).

Cluster Management & Orchestration: Solid understanding of containerization and cluster orchestration platforms (e.g., Kubernetes, Nomad) for managing large-scale distributed workloads.

Release & Infrastructure Automation: Hands-on experience automating deployment rollouts, capacity scaling, and environment lifecycle management without manual intervention. Proficiency with Infrastructure as Code (IaC) tools (e.g., Terraform, Ansible) and advanced CI/CD pipelines.

Systems Architecture & Isolation: Experience managing multitenancy, physical compute isolation, global traffic load balancing, and rate limiting in a production environment.

Nice-to-Have:

Familiarity with distributed SQL databases (e.g., CockroachDB, Cassandra).

Experience with Machine Learning serving infrastructure and strict compliance/data residency boundaries.

Similar jobs