Senior Big Data Engineer

Tysons Corner, VA (3 days onsite & 2 days remote per week)

In-Person Interview Required

Looking for a candidate with experience creating pipelines in a large enterprise environment. MUST HAVE EXPERIENCE DEALING WITH PETABYTES OF DATA.

Candidate will need expert level SQL skills.

Hands-on Big Data Engineer with deep Spark expertise, strong AWS platform experience, solid programming (Python)/SQL fundamentals, and a focus on performance tuning, testing, and production-grade data systems.

Role Overview

• High‑impact engineering role supporting the Market Regulation / Surveillance group
• Builds complex algorithms to ensure compliance in financial markets
• Supporting surveillance for a new exchange (details confidential)

Technical Environment

Petabyte scale big data platform

Batch processing only (Spark; no streaming)

Tech stack: Spark, SQL, Python

AWS: EC2, EMR, S3

Core Responsibilities

• Build scalable, high‑performance data pipelines
• Work with extremely large datasets in high‑volume environments
• Contribute to architectural decisions and performance optimization
• Solve complex data platform and performance challenges