Quick Overview
Job Description
Job Title: AWS Senior Data Lead - Glue, SQL, Python
Location: Washington (Onsite)
About the Role:
HCLTech is seeking an experienced AWS Data Engineer to design, build, and optimize modern cloud-based data platforms and real-time data pipelines. The ideal candidate will have strong expertise in AWS data services, Python/PySpark development, event-driven architectures, and large-scale data integration. This role will play a key part in developing scalable data solutions that support critical business and analytics initiatives.
Key Responsibilities:
Design, develop, and maintain scalable data pipelines in AWS using AWS Glue, Python, and PySpark.
Build robust data ingestion frameworks to collect and process data from multiple on-premises and cloud-based sources.
Implement Change Data Capture (CDC) solutions for near real-time data synchronization and replication.
Utilize AWS Database Migration Service (AWS DMS) to migrate and replicate data across enterprise systems with minimal downtime.
Design and implement event-driven architectures using Kafka, Amazon SNS, Amazon SQS, and EventBridge.
Develop cloud-native data processing solutions supporting high availability, scalability, and performance.
Build, optimize, and maintain enterprise Data Lake solutions.
Monitor and troubleshoot data workflows using AWS CloudWatch and AWS CloudTrail.
Develop efficient Python-based data processing applications leveraging libraries such as Pandas and NumPy.
Work with relational and NoSQL databases including SQL Server, DynamoDB, MongoDB, and Cassandra.
Support migration and modernization of legacy data pipelines into AWS-based architectures.
Collaborate with business stakeholders, application owners, and data teams to understand data architecture, business requirements, and analytics needs.
Document data models, ETL processes, data flows, and target-state architectures.
Drive continuous improvements in data quality, platform performance, security, and operational efficiency.
Qualifications:
7+ years of experience in Data Engineering and Data Integration.
Hands-on experience with AWS-based data platforms and cloud-native applications.
Strong expertise in Python and PySpark development.
Experience implementing CDC and real-time data streaming solutions.
Strong understanding of data modeling, SQL optimization, and enterprise data architecture.
Excellent communication and stakeholder management skills.
Required Skills:
AWS Glue
AWS DMS (Database Migration Service)
CDC (Change Data Capture)
Python / PySpark
Kafka or SNS/SQS
Data Lake Architecture
SQL & Database Design
AWS CloudWatch
AWS CloudTrail
Data Integration & ETL Development
Preferred Skills:
AWS IAM
Amazon EKS
EventBridge
MongoDB, Cassandra, DynamoDB
Data Migration & Modernization Projects
Real-Time Streaming Architectures
CI/CD for Data Platforms
Why Join HCLTech?
Work on enterprise-scale cloud transformation initiatives.
Opportunity to build modern real-time data platforms.
Collaborate with highly skilled cloud, data, and analytics teams.
Flexible remote work environment with exposure to cutting-edge AWS technologies.
Similar jobs
- CE
Database Engineer (Access) - Depot with Security Clearance
NewCenturum
San Diego, CA🇺🇸$55 - $64/hrHybridYesterdaySQLSQL ServerT-SQL+3Technology - RE
Mid Level Data Engineer with Security Clearance
NewRedhorse Corporation
Arlington, VA🇺🇸$145k - $165k/yrHybrid20 hours agoSQLScalaAWS+10Technology - SW
Snowflake Admin
NewSwanktek Inc
Coppell, TX🇺🇸Hybrid20 hours agoETLEncryptionMFA+5Technology - CS
Oracle DBA
NewCynet Systems
Jacksonville, FL🇺🇸Hybrid20 hours agoOracleSOC 2AgileTechnology - PS
Data Engineer with U.SMortgage and Snowflake - Independent candidates
NewPull Skill Technologies
United States🇺🇸Remote20 hours agoSQLAWSETL+12Technology - PS
Data engineer
NewPurview Services
New York, NY🇺🇸On-site20 hours agoOracleSQLSQL Server+9Technology