Other

Hadoop Admin

Dminds Solutions Inc.Tampa, FL🇺🇸United States

Why this role stands out

This hybrid Hadoop Admin role at Dminds Solutions Inc. offers a fantastic opportunity to grow your expertise in big data infrastructure and gain exposure to diverse teams. You'll thrive in this position if you are adept at managing and deploying Hadoop clusters, with a keen eye for performance and availability, and you're encouraged to apply to advance your career in this dynamic field.

Quick overview

SeniorityMid Senior

Work modeHybrid

LocationTampa, FL, United States

NagiosApacheCapacity PlanningEstimatingHadoop

Job description

Responsibilities

Deploying and maintaining the Hadoop cluster, adding and removing nodes using cluster monitoring tools like Ganglia, Nagios or Cloudera Manager, and configuring NameNode high availability.
Keeping a track of all the running Hadoop jobs.
Implementing, managing and administering the overall Hadoop infrastructure.
Taking care of the day-to-day running of Hadoop clusters.
Work closely with the database team, network team, BI team and application teams to make sure that all the big data applications are highly available and performing as expected.
Knowledge of Apache Distribution; manually set up all the configurations:

CoreSite
HDFS Site
YARN Site
MapRed Site

Aware of the configuration setup using Hadoop distributions like Hortonworks, Cloudera or MapR.
Capacity planning and estimating the requirements for lowering or increasing the capacity of the Hadoop cluster, deciding the size of the Hadoop cluster based on the data to be stored in HDFS.
Ensure that the Hadoop cluster is up and running all the time, monitoring the cluster connectivity and performance.
Manage and review Hadoop log files, backup and recovery tasks, resource and security management.
Troubleshooting application errors.