Hadoop / Big Data Platform Engineer SME

Hello

Job Details:

Job Title: Hadoop / Big Data Platform Engineer SME
Job Location: Chicago, IL / Charlotte, NC (3 Days onsite, 2 Days Remote) Hybrid role. - locals only
Job Type: 4+ Months contract

Job Descriptions:

Hadoop Engineer (SME) role supporting NextGen Platforms built around Big Data Technologies (Hadoop, Spark, Kafka, Impala, HBase, Docker-Container, Ansible and many more). Requires experience in cluster management of vendor-based Hadoop and Data Science (AI/ML) products like Cloudera, Databricks. Hadoop Engineer is involved in the full life cycle of an application and part of an agile development process. They require the ability to interact, develop, engineer, and communicate collaboratively at the highest technical levels with clients, development teams, vendors, and other partners. The following section is intended to serve as a general guideline for each relative dimension of project complexity, responsibility, and education/experience within this role.

• Works on complex, major or highly visible tasks in support of multiple projects that require multiple areas of expertise
• Team member will be expected to provide subject matter expertise in managing Hadoop and Data Science Platform operations with focus around Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker-Container Cluster Management and Administration
• Integrates solutions with other applications and platforms outside the framework
• He / She will be responsible for managing platform operations across all environments which includes upgrades, bug fixes, deployments, metrics / monitoring for resolution and forecasting, disaster recovery, incident / problem / capacity management
• Serves as a liaison between client partners and vendors in coordination with project managers to provide technical solutions that address user needs
• Experience on L1, L2 L3 level support in Hadoop Platform
• Experience in Yarn , Spark and Impala job debugging and troubleshooting
• Experience in addressing issues around Name node , HDFS Space , File/Folder Permission backups
• Understanding and experience in experience in query performance tuning and resource utilization tuning
• Technical knowledge on relational databases, data warehousing and SQL skills
• Hadoop, Kafka, Spark, Impala, Hive, HBase, Ozone etc.
• Strong knowledge of Hadoop Architecture, HDFS, Hadoop Cluster and Hadoop Administrator's role
• Intimate knowledge of fully integrated AD/Kerberos authentication
• Experience setting up optimum cluster configurations
• Debugging knowledge of YARN.
• Hands-on with analyzing various Hadoop log files, compression, encoding, file formats
• Expert level knowledge of Cloudera Hadoop components such as HDFS, Sentry, HBase, Kafka, Impala, SOLR, Hue, Spark, Hive, YARN, Zookeeper and Postgres
• Strong technical knowledge: Unix/Linux; Database (Sybase/SQL/Oracle), Java, Python, Perl, Shell scripting, Infrastructure.
• Experience in Monitoring Alerting, and Job Scheduling Systems
• Being comfortable with frequent, incremental code testing and deployment
• Strong grasp of automation / DevOps tools Ansible, Jenkins, SVN, Bitbucket

Tools Involved -

ETL tools: Hadoop Stack

Job Scheduling tools: Autosys

BI tools: Tableau ; Tableau dashboard building connecting Hadoop-Hive Tables is equally preferred

Shift Timings: 8AM 5PM / 12:30PM ET 9:30PM ET

Desired Qualifications:

Experience working on Big Data Technologies

Cloudera Admin / Dev Certification

Certification in Cloud, Docker-Container, OpenShift Technologies

Equal Opportunity Employer/Veterans/Disabled

Benefit offerings available for our associates include medical, dental, vision, life insurance, short-term disability, additional voluntary benefits, an EAP program, commuter benefits, and a 401K plan. Our benefit offerings provide employees with the flexibility to choose the type of coverage that meets their individual needs. In addition, our associates may be eligible for paid leave including Paid Sick Leave or any other paid leave required by Federal, State, or local law, as well as Holiday pay where applicable. Disclaimer: These benefit offerings do not apply to client-recruited jobs and jobs that are direct hires to a client.

To read our Candidate Privacy Information Statement, which explains how we will use your information, please visit .

The Company will consider qualified applicants with arrest and conviction records in accordance with federal, state, and local laws and/or security clearance requirements, including, as applicable:

The California Fair Chance Act

Los Angeles City Fair Chance Ordinance

Los Angeles County Fair Chance Ordinance for Employers

San Francisco Fair Chance Ordinance

Job Description

Please find and share qualified W2 resources for the below opportunity on a referral basis.

HADOOP / BIG DATA PLATFORM ENGINEER SME
Interview Process: 2 virtual rounds; onsite interview may also be requested

Vendor Note:
Please submit only qualified candidates who closely match the job requirements.

Note to Vendor:

What we're looking for: We're seeking a senior Hadoop / Big Data Platform Engineer with strong hands-on experience in Cloudera Hadoop administration, HDFS, YARN, Spark, Impala, Kafka, and Linux/Unix. The role focuses on Hadoop cluster management, production support, troubleshooting, performance tuning, upgrades, monitoring, and platform operations. Experience with Kerberos/AD, Ansible, Jenkins, Docker/OpenShift, and other Big Data technologies is highly preferred.

Gopal Gupta Technical Recruiter

E: D: A: 505 Knolle Court, Saint Augustine| FL 32092