Big Data Developer

Big Data Developer
Location: Rockville, MD or Tysons Corner, VA

Work Setting: Onsite

Job Description:

We are seeking an experienced Big Data Developer with strong expertise in Apache Spark, Hadoop, AWS, Python/Scala, and SQL to build and optimize large-scale data processing solutions.

Required Skills:

• 8+ years of Big Data/Data Engineering experience
• Strong hands-on experience with Apache Spark
• Hadoop Ecosystem: Hadoop, Hive, Trino
• Strong programming skills in Python or Scala
• Advanced SQL (Joins, Window Functions, Aggregations, Query Optimization)
• Experience building and supporting large-scale ETL/Data Pipelines
• AWS Services: S3, EMR, Glue, Athena, Lambda
• Experience troubleshooting Spark jobs, data skew, performance tuning, and large-volume data processing
• Knowledge of Agile/Scrum development methodologies
• Experience with AI-assisted development tools (GitHub Copilot, ChatGPT, Claude, Amazon Q)

Preferred Skills:

• EKS / Kubernetes
• CI/CD Pipelines
• Test Automation
• Production Data Pipeline Support
• AWS Certifications
• Financial Services Experience