Job Description

Design, deploy, administer, and optimize large-scale Apache Druid clusters supporting PB-scale datasets.
Manage and troubleshoot Druid services.
Perform cluster upgrades, patching, capacity planning, and platform modernization activities.
Monitor cluster health, ingestion performance, query latency, segment distribution, and resource utilization.
Troubleshoot ingestion failures, stuck tasks, compaction issues, retention policies, and segment management problems.
Optimize Druid queries, partitioning strategies, indexing specifications, and compaction configurations.
Configure and maintain Druid metadata stores using MySQL.
Develop operational automation using Ansible and Infrastructure-as-Code methodologies.
Create dashboards, alerts, and monitoring solutions using Grafana, Prometheus, and logging platforms.
Work with platform teams to ensure high availability, disaster recovery, backup, and security compliance.
Participate in production support, incident response, root cause analysis, and performance tuning initiatives.
Collaborate with architects and business teams to understand analytical requirements and translate them into scalable solutions.

Druid Engineer

Quick Overview