Quick Overview
Seniority
Mid Senior
Work mode
Remote
Location
New York, NY, United States
Posted
6 days ago
AWSAirflowApacheEMRHadoop
Job Description
Lead Cloudera Engineer
100% remote
Needs assessment
Evaluating skills in the Cloudera Hadoop Stack, Amazon EMR, and Apache Airflow
who can not only develop code, but also manage communication, handle working with stakeholders like Infrastructure, content team and be able to understand the scope of migration.
- Design and develop scalable, maintainable software and data-processing solutions.
- Analyze existing Cloudera Hadoop architecture, workflows, and data pipelines.
- Develop and execute migration strategies from on-premises Hadoop to AWS.
- Design AWS architectures using EMR, Glue, Airflow, Lambda, and related services.
- Oversee data transfer, application re-platforming, testing, and validation.
- Ensure solutions meet performance, scalability, security, and reliability requirements.
- Troubleshoot software, platform, and data-pipeline issues.
- Create technical documentation, migration plans, and operational runbooks.
- Collaborate with engineering, DevOps, QA, product, and business stakeholders.
- Mentor team members on software engineering and AWS big data practices.
Similar jobs
- CI
AVD (Azure Virtual Desktop) Engineer
NewCACI International, Inc.
Arlington, VA🇺🇸$98.5k - $206.8k/yrHybrid12 hours agoSQLSQL ServerAzure+2 - CI
Data Engineering/Analytics Support
NewCACI International, Inc.
Norco, CA🇺🇸$69.6k - $142.7k/yrOn-site12 hours agoMATLABProcess ImprovementPython - UH
Information System Specialist - Provider Enrollment
NewUNC Health Care
Morrisville, NC🇺🇸$23 - $33/hrHybrid12 hours ago - CI
Database Specialist
NewCACI International, Inc.
Reston, VA🇺🇸$103.8k - $218.1k/yrHybrid12 hours agoMariaDBMySQLOracle+13 - AC
AI Engineering & Platform Leadership Senior Manager - Utilities
NewAccenture
Chicago, Illinois🇺🇸$132.5k - $338.3k/yrOn-site33 minutes agoAWSMLOpsAzure+1 - VE
Manager, UX & Digital Experience
NewVerisk
Jersey City, New Jersey🇺🇸Hybrid33 minutes agoContent StrategyDigital Marketing