Data Engineer

Role: Data Engineer

Location: Fort Mill, SC 29715 (3 days onsite per week)

Duration: 12 Months

Job description:
Responsible for designing developing and maintaining scalable data pipelines and ETL processes using AWS Glue This role involves working closely with data engineers' analysts and other IT professionals to ensure data is efficiently integrated transformed and made available for business use.

Responsibilities
Design develop and maintain data pipelines and ETL processes using Snowflake AWS services Python and DBT
Collaborate with data scientists and analysts to understand data requirements and implement solutions
Optimize data workflows for performance scalability and reliability
Troubleshoot and resolve datarelated issues in a timely manner
Stay updated on the latest technologies and best practices in data engineering
Design and implement scalable ETL solutions using AWS Glue
Collaborate with data engineers and analysts to understand data requirements
Develop and manage data extraction transformation and loading processes
Optimize and improve existing data pipelines and ETL workflows
Ensure data quality and integrity during the transformation process
Monitor and troubleshoot issues with ETL jobs
Maintain detailed documentation of data workflows and processes
Stay updated with the latest AWS services and tools

Qualifications
Bachelor's degree in Computer Science Engineering or related field
Proven experience in data engineering roles with a focus on Snowflake AWS services Python and DBT
Strong analytical and problem solving skills
Excellent communication and teamwork abilities
Technical certifications are a plus
Bachelor's degree in Computer Science Information Technology or a related field
3 years of experience working with AWS Glue and other AWS data services
Proven experience in designing and maintaining ETL processes
Strong knowledge of SQL and database management
Familiarity with data warehousing concepts and tools
Experience with Python or other scripting languages
Excellent problem solving and analytical skills
Strong communication and teamwork abilities

Must have skills:

Python, AWS, PySpark, Glue.