Big Data Developer

Overview

We are seeking a skilled Big Data Developer with expertise in building scalable data pipelines and processing large datasets. The ideal candidate will have hands-on experience with big data technologies, cloud platforms, and data engineering best practices.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines.
• Process and transform large volumes of structured and unstructured data.
• Develop data ingestion, ETL, and batch/streaming solutions.
• Optimize data processing performance and reliability.
• Collaborate with data architects, analysts, and business stakeholders.
• Ensure data quality, governance, and security standards.

Required Skills

• 8-10 years of experience in Data Engineering or Big Data development.
• Strong experience with Hadoop, Spark, Hive, Kafka, and SQL.
• Hands-on experience with Python, Scala, or Java.
• Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
• Knowledge of data warehousing and distributed computing concepts.
• Strong troubleshooting and performance tuning skills.