AWS Data Engineer

Job Summary (List Format):

- Lead the design and development of scalable big data applications using Python (10+ years' experience required).
- Build and optimize efficient data processing pipelines with big data technologies such as Hadoop/EMR, Spark, and Hive.
- Develop and maintain solutions leveraging AWS services, including Lambda, EventBridge, Step Functions, Redshift, S3, and Glue (5+ years' experience required).
- Implement data transformation, manipulation, and analysis workflows, including making API calls and executing complex SQL queries.
- Analyze large datasets to extract meaningful insights and support data-driven decision-making.
- Create and maintain CI/CD pipelines using tools such as GitLab and Terraform.
- Collaborate and communicate effectively with cross-functional teams in a matrixed organization.
- Apply critical thinking and strong analytical skills to solve complex technical challenges and drive innovative solutions.
- Demonstrate strong problem-solving skills and the ability to form positive partnerships with team members.
- Ensure best practices in code quality, testing, and deployment processes for big data solutions.