Quick Overview
Job Description
Requirement:
Hands-on 7+ years of experience administering Apache Druid in production environments at scale.
Strong understanding of Druid architecture: Coordinator, Overload, Broker, Historical, MiddleManager, Router.
Proficiency in Druid ingestion specifications (Native batch, Kafka, Hadoop-based).
Experience with compaction, retention policies, and segment lifecycle management.
Expertise in query optimization and partitioning strategies for large datasets.
Responsibilities:
• Design, deploy, administer, and optimize large-scale Apache Druid clusters supporting PB-scale datasets.
• Manage and troubleshoot Druid services.
• Perform cluster upgrades, patching, capacity planning, and platform modernization activities.
• Monitor cluster health, ingestion performance, query latency, segment distribution, and resource utilization.
• Troubleshoot ingestion failures, stuck tasks, compaction issues, retention policies, and segment management problems.
• Optimize Druid queries, partitioning strategies, indexing specifications, and compaction configurations.
• Configure and maintain Druid metadata stores using MySQL.
• Develop operational automation using Ansible and Infrastructure-as-Code methodologies.
• Create dashboards, alerts, and monitoring solutions using Grafana, Prometheus, and logging platforms.
• Work with platform teams to ensure high availability, disaster recovery, backup, and security compliance.
• Participate in production support, incident response, root cause analysis, and performance tuning initiatives.
• Collaborate with architects and business teams to understand analytical requirements and translate them into scalable solutions.
Education: Bachelor’s degree in Computer Science, Engineering, or a related field; OR equivalent combination of education and relevant experience.
Similar jobs
- PR
Innovation Engineer
ProAmpac
Springdale, OH🇺🇸Hybrid1 week agoMicrosoft OfficeEngineering - BS
Senior Manager, Technical Applications Engineering
NewBollinger Shipyards
Mandeville, LA🇺🇸Hybrid21 hours agoEngineering - GD
Naval Architecture and Structural Design and Engineering - 2027 Engineering Summer Internship
NewGeneral Dynamics Electric Boat
Groton, CT🇺🇸On-site21 hours agoStructural AnalysisEngineering - MC
MEP Manager (Mechanical, Electrical, and Plumbing) - Indianapolis, IN
Messer Construction
Indianapolis, IN🇺🇸Hybrid4 weeks agoBIMEngineering - CS
Associate Director, Process Technology
NewCSL
Kankakee, IL🇺🇸$177k - $209k/yrHybrid21 hours agoEngineering - BN
SVP, Principal Business Analyst – Third Party Application Engineering
BNY
New York, NY🇺🇸Hybrid5 days agoEngineering