Hadoop/Big Data Platform Engineer / SME

Job Title: Hadoop/Big Data Platform Engineer / SME

Location: Charlotte, NC / Chicago, IL

Duration: Contract - 4 months

Pay Range: $73.67/hr (W2)

Job ID: 408209

About BCforward

BCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients. Founded in 1998, BCforward has grown with our customers needs into a full-service business solutions provider. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.

Job Description

We are seeking a Hadoop Engineer (SME) to join our dynamic team. The ideal candidate will have strong experience in enterprise Big Data platform engineering and administration across Cloudera Hadoop, Spark, Kafka, Impala, HBase, and containerized environments and a proven ability to operate, optimize, and integrate large-scale data platforms while ensuring reliability, performance, and security.

Responsibilities:

• Provide subject matter expertise for Cloudera Hadoop and Data Science platform operations, including Jupyter, OpenShift, and Docker cluster administration.


• Manage platform operations across environments, including upgrades, patches, deployments, monitoring, capacity planning, and disaster recovery.


• Deliver L1, L2, and L3 support for Hadoop platforms, including YARN, Spark, and Impala job debugging and troubleshooting.


• Address NameNode, HDFS space, file and folder permissions, and backup issues with root-cause analysis and remediation.


• Tune query performance and optimize resource utilization across Hadoop ecosystem components.


• Integrate data platforms with adjacent applications and services and coordinate with vendors and partners to meet user needs.


• Establish monitoring, alerting, and job scheduling using enterprise tools and define operational metrics and forecasting.


• Automate builds, configurations, and deployments using DevOps toolchains and implement best practices for CI/CD.

Required Skills & Qualifications:

• Expert knowledge of Cloudera Hadoop components, including HDFS, YARN, Spark, Kafka, Impala, Hive, HBase, Sentry, SOLR, Hue, Zookeeper, Ozone, and Postgres.


• Hands-on experience with YARN troubleshooting, Hadoop log analysis, compression and encoding formats, and file formats.


• Strong Unix/Linux administration and scripting skills with Shell, Python, and Perl.


• Proficiency with relational databases and SQL, including Sybase, Oracle, and similar technologies, plus data warehousing concepts.


• Experience with AD/Kerberos authentication and secure cluster configuration.


• Background in monitoring, alerting, and job scheduling systems, including Autosys.


• Working knowledge of DevOps tools such as Ansible, Jenkins, SVN, and Bitbucket.


• Ability to operate within Agile processes and support frequent, incremental testing and deployments.

Preferred Skills:

• Experience with cloud platforms, Docker containers, and OpenShift administration.


• Cloudera Administrator or Developer certification and exposure to Databricks.


• Experience building Tableau dashboards connected to Hadoop/Hive tables.

Why BCforward?

At BCforward, we believe in advancing lives and careers. When you join our team, you gain access to:

• Competitive compensation and benefits


• Opportunities for growth with global clients


• A supportive, inclusive culture that values innovation and people


• Exposure to cutting-edge technologies and projects

About Our Commitment

BCforward is an equal opportunity employer. We value diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, or veteran status.

Interested? Apply Now!

If this sounds like the right opportunity for you, please apply with your most recent resume.

Additional Details: Shift timings may be 8:00 AM - 5:00 PM ET or 12:30 PM - 9:30 PM ET. Hours per day: 8. Labor type: Technical.