Druid Engineer

Job Description:

• Design, deploy, administer, and optimize large-scale Apache Druid clusters supporting PB-scale datasets.
• Manage and troubleshoot Druid services.
• Perform cluster upgrades, patching, capacity planning, and platform modernization activities.
• Monitor cluster health, ingestion performance, query latency, segment distribution, and resource utilization.
• Troubleshoot ingestion failures, stuck tasks, compaction issues, retention policies, and segment management problems.
• Optimize Druid queries, partitioning strategies, indexing specifications, and compaction configurations.
• Configure and maintain Druid metadata stores using MySQL.
• Develop operational automation using Ansible and Infrastructure-as-Code methodologies.
• Create dashboards, alerts, and monitoring solutions using Grafana, Prometheus, and logging platforms.
• Work with platform teams to ensure high availability, disaster recovery, backup, and security compliance.
• Participate in production support, incident response, root cause analysis, and performance tuning initiatives.
• Collaborate with architects and business teams to understand analytical requirements and translate them into scalable solutions.