Sr. Data Engineer

Job Title: Data Engineer
Location: McLean, VA - Hybrid
Duration: 7 months

Responsibilities:
Designing and implementing high-performance data pipelines that handle large volumes of data
Ensuring data integrity through advanced quality checks and lineage tracking

Required Skills & Qualifications:
Core Languages: Expert-level proficiency in Python and PySpark.
AWS Ecosystem: Deep hands-on experience with AWS Glue and Amazon EMR.
Big Data Architecture: Proven track record of building scalable pipelines for large-scale data (Terabyte-scale preferred).
Data Integrity: Demonstrated experience implementing frameworks for Data Lineage and Data Quality.
Database Knowledge: Strong experience working with S3-based lakes and relational databases (RDS/PostgreSQL/MySQL).

Top skills
6+ years of experience
AWS Data Engineer
PySpark
AWS Glue
Snowflake
Databricks
SQL
Monitoring dashboards
Need to understand the concept of data quality and how they implement.