Data Engineer

Roles & Responsibilities
Design, develop, and implement scalable data engineering solutions and data pipelines.
Build, optimize, and maintain ETL/ELT workflows using Python, PySpark, and Spark.
Develop and manage batch and real-time data pipelines using AWS services and modern data engineering tools.
Integrate data from multiple sources into enterprise data lakes and data warehouses.
Develop cloud-based data solutions using AWS services such as S3, Glue, Redshift, EMR, Lambda, and CloudWatch.
Optimize data processing performance, troubleshoot production issues, and ensure data quality, reliability, and availability.
Work with relational and NoSQL databases for efficient data storage, transformation, and retrieval.
Collaborate with cross-functional teams, including Data Scientists, Analysts, and Application Developers, to deliver scalable and secure data solutions.
Follow coding standards, AWS best practices, data governance policies, and Agile methodologies throughout the software development lifecycle.