Quick overview
Job description
Role: Senior AWS Data Engineer
Locations: Fort Mill, SC
Key Skills: Data Engineering, AWS, Airflow, Glue HVR
Mode of Hire: Full time
Job Description:
- Design, develop, and maintain ETL processes to extract, transform, and load data from various sources into Snowflake.
- Utilize AWS services such as Airflow and Glue for orchestration and data processing tasks.
- Implement data integration solutions using HVR to ensure real-time data availability.
- Write and optimize SQL queries for data retrieval and manipulation.
- Collaborate with data analysts and other stakeholders to understand data requirements and deliver solutions that meet business needs.
- Monitor and troubleshoot data pipelines to ensure high availability and performance.
- Document data processes and maintain data quality standards.
- Stay updated with the latest industry trends and technologies related to data engineering and cloud computing.
Mandatory Skills:
- Proven experience with AWS services, particularly Airflow and Glue.
- Strong knowledge of Snowflake and its data warehousing capabilities.
- Proficiency in SQL for data manipulation and analysis.
- Experience with Python for data processing and automation tasks.
- Hands-on experience with ETL processes and tools.
- Strong understanding of cloud computing concepts and architectures.
Preferred Skills:
- Experience with HVR for data replication and integration.
- Familiarity with data modelling and database design principles.
- Knowledge of data governance and data quality best practices.
- Experience with version control systems such as Git.
- Understanding of Agile methodologies and project management practices.
Qualifications:
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 7-12 years of experience in data engineering or a related role.
- Strong analytical and problem-solving skills.
- Excellent communication and collaboration abilities.
- Ability to work independently and as part of a team in a fast-paced environment.
Similar jobs
- SS
Data EngineerRecently posted
Sahi Softtech · United States · Hybrid 🇺🇸
MicroservicesOracleSQL+10TechnologySalary not listed - AS
Cloud Data AI/Foundations ManagerRecently posted Auto Apply
Ascension · Saint Louis · Remote 🇺🇸
GCPLookerAirflow+8Salary not listed - PM

Lead Data Engineer PennDnA- PeopleRecently posted
Penn Medicine · Philadelphia, PA · Remote 🇺🇸
AWSETLDatabricks+3TechnologySalary not listed - TR

Staff Data Engineer Auto Apply
Triallibrary · San Francisco · Hybrid 🇺🇸
DrizzleSQLAWS+11Technology$168k - $230k/yr - VB
Data Engineer SnowflakeRecently posted
Vaco by Highspring · Brentwood, TN · On-site 🇺🇸
SQLGitETL+5Technology$55 - $70/hr - SC

Data Engineer (Microsoft Fabric and DatabricksRecently posted
SGS Consulting · Herndon, VA · Hybrid 🇺🇸
Stakeholder ManagementSQLGit+10TechnologySalary not listed - ST
Data Engineer & Data Architect - Google Cloud Platform / AWS / ETL / SQL / NLP / Data WarehouseRecently posted
Shiro Technologies · Plano, TX · Hybrid 🇺🇸
MongoDBSQLAWS+8TechnologySalary not listed - CG
Senior Database Administrator with Security ClearanceRecently posted
Contact Government Services, LLC · Boston, MA · Hybrid 🇺🇸
SQLAWSVMware+4Technology$89.3k - $121.2k/yr - PT

Fulltime :: Data Engineer :: Santa Monica, Burbank, or Glendale, CA (Hybrid, 4 days onsite; 1 day remote)Recently posted
Prudent Technologies and Consulting · Glendale, CA · Remote 🇺🇸
SQLGitApache Spark+9TechnologySalary not listed - AA
DATA ENGINEER
AaraTechnologies Inc · Washington, DC · Hybrid 🇺🇸
SQLAWSETL+2TechnologySalary not listed - EX

Lead Data EngineerRecently posted Auto Apply
EXL · New Hampshire · Hybrid 🇺🇸
Stakeholder ManagementMicroservicesSQL+11Technology$110k - $140k/yr - HO

Lead Data EngineerRecently posted Auto Apply
Honeywell · Atlanta · Hybrid 🇺🇸
Stakeholder ManagementDockerGCP+23TechnologySalary not listed
