Why this role stands out
Leverage your extensive AWS and PySpark expertise to design and build robust data pipelines in a hybrid environment that offers excellent flexibility. This mid-senior role is perfect for a data engineer passionate about cloud technologies and eager to contribute to impactful projects within a reputable company.
Quick overview
Job description
- 6–10+ years of experience in Data Engineering / Big Data Engineering.
- Strong hands-on experience with AWS cloud services.
- Strong programming experience in Python.
- Hands-on experience with PySpark / Apache Spark.
- Strong SQL development and database skills.
- Experience developing ETL/ELT data pipelines.
- Experience with AWS Glue, S3, Lambda, EMR, RDS, Redshift, and CloudWatch.
- Experience with Apache Kafka or Confluent Kafka.
- Experience with Apache Airflow or another workflow orchestration platform.
- Strong understanding of data modeling, data warehousing, and distributed data processing.
- Experience working with Parquet, JSON, Avro, and other data formats.
- Experience with Git and CI/CD practices.
- Good understanding of AWS security, IAM, networking, and cloud architecture.
Preferred Skills
- Experience in the financial services / wealth management / banking domain.
- Experience working with Snowflake or Databricks.
- Experience with AWS OpenSearch / Elasticsearch.
- Experience with Terraform or CloudFormation.
- Experience with Docker/Kubernetes.
- Experience with AWS monitoring and observability tools.
- Knowledge of data governance, lineage, metadata management, and data quality frameworks.
- Experience working in Agile/Scrum development environments.
Education
Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field is preferred.
Ideal Candidate
The ideal candidate is a strong AWS Data Engineer with hands-on experience building scalable batch and streaming data pipelines using Python, PySpark, Spark, Kafka, AWS Glue, S3, EMR, Lambda, and SQL. Experience within financial services or wealth management and exposure to modern cloud data platforms will be highly valued.
Similar jobs
- IC

Data Engineer (Python) - Remote USA with Security ClearanceRecently posted
ICF Consulting Group, Inc. · Reston, VA · Remote 🇺🇸
SQLGitAWS+10Technology$81.5k - $167.6k/yr - PE

Microsoft SQL Server Database Administrator with Security Clearance
Peraton · Herndon, VA · Hybrid 🇺🇸
SQLEncryptionSQL Server+1Technology$112k - $179k/yr - US

Data Engineer - Senior LevelRecently posted
USAA · SAN ANTONIO, TX · Hybrid 🇺🇸
SQLGitSnowflake+6Technology$127.3k - $243.3k/yr - US

Data Engineer - Mid LevelRecently posted
USAA · PHOENIX, AZ · Hybrid 🇺🇸
TechnologySalary not listed - US

Data Engineer - Mid LevelRecently posted
USAA · SAN ANTONIO, TX · Hybrid 🇺🇸
TechnologySalary not listed - US

Data Engineer - Senior LevelRecently posted
USAA · PHOENIX, AZ · Hybrid 🇺🇸
SQLGitSnowflake+6Technology$127.3k - $243.3k/yr - SG

Senior Data Engineer - Wealth & Trust ModernizationRecently posted
Software Guidance & Assistance · Cincinnati, OH · Hybrid 🇺🇸
Stakeholder ManagementMicroservicesSQL+2TechnologySalary not listed - EP
Python/PySpark Data EngineerRecently posted
e-IT Professionals Corp. · Charlotte, NC · Hybrid 🇺🇸
OracleSQLApache Spark+6TechnologySalary not listed - SS
Lead Azure Data Engineer FULL-TIME PositionRecently posted
SKANDA SOLUTIONS LLC · United States · Hybrid 🇺🇸
SQLETLData Pipeline+2TechnologySalary not listed - US

Data Engineer - Mid LevelRecently posted
USAA · Phoenix, Arizona · Hybrid 🇺🇸
TechnologySalary not listed - US

Data Engineer - Mid LevelRecently posted
USAA · San Antonio, Texas · Hybrid 🇺🇸
TechnologySalary not listed - US

Data Engineer - Senior LevelRecently posted
USAA · San Antonio, Texas · Hybrid 🇺🇸
SQLGitSnowflake+6Technology$127.3k - $243.3k/yr
