Hadoop Developer

Title: Hadoop Developer

Location: Charlotte, NC

Duration: Full Time

Client: Banking

Salary: $95,000-$115,000 a year

EAD

Video Interviews

Experience required: - 10-15 years of experience


JOB DESCRIPTION:

Must Have Technical/Functional Skills


Required Technical Skills


Strong experience with the Hadoop ecosystem:

o HDFS

o Hive

o Spark

o Ozone


Hive Metastore management and table/partition maintenance.

Hadoop data lifecycle management.

Data ingestion, ETL processes, and data validation.

Shell scripting and Python automation.

Cloudera Data Platform (CDP) or similar Hadoop distributions.

Strong SQL and data analysis skills.


Experience: Minimum10 years


Roles & Responsibilities


Monitor and resolve HDFS and Ozone related issues.

Investigate cluster performance, storage utilization, and capacity concerns.

Manage quota requests, storage allocation, and capacity planning.

Support platform maintenance and perform integration activities.

Coordinate with application teams during incident and problem management.

Create and maintain operational documentation, runbooks, and knowledge articles.


Desired / Preferred Skills

Experience supporting large-scale Hadoop environments with multi-petabyte storage.

Knowledge of distributed storage architecture and data replication.

Capacity management, storage forecasting, and quota governance.

Platform onboarding, integration, and decommissioning.

Familiarity with cloud platforms (Azure, AWS, or Google Cloud Platform).

Experience with monitoring tools such as Cloudera Manager, Grafana, Splunk, or Prometheus.

Strong analytical and problem-solving skills with root cause analysis