Hadoop and PySpark Data Engineer

Job Title - Hadoop and PySpark Data Engineer

Duration: Full Time
Location - Charlotte, NC, Jacksonville, FL, Jersey City, NJ, Newark, DE, Plano, TX

Job Description:

Required Skill and Experience

• Experience in data warehousing architectural approaches.
• Sound understanding and experience with Hadoop ecosystem (Cloudera).
• Experience in working with a Big Data implementation in production environment.
• Experience with Big Data technologies like Hadoop, Hive, Spark, python, etc. Experience in python and Unix shell scripting.
• Experience in orchestration tool like Autosys, Airflow.
• Sound knowledge of relational databases (SQL) and experience with large SQL based systems.
• Understanding of Agile methodologies and technologies

Preferred Skill and Experience

• Able to understand and explore the constantly evolving tools within Hadoop ecosystem and apply them appropriately to the relevant problems at hand.
• Knowledge and experience with Cloud and containerization technologies
• Experience with data visualization tools like Tableau"