Haystack
← Back to Jobs
Technology
TRTror logo

Only W2: Sr Data Engineer – Scala, Python, Databricks & AWS | Boston, MA (Hybrid)

TrorBoston, MA🇺🇸United StatesPosted Oct 16, 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
Boston, MA, United States
Posted
21 hours ago
SQLScalaAWSETLApacheApache SparkData PipelineDatabricksPython

Job Description

Role: Sr Data Engineer – Scala, Python, Databricks & AWS
Location: Boston, MA (Hybrid)
Experience: 12+ Years

 
Job Summary
We are looking for an experienced Data Engineer with strong hands-on skills in Scala, Python, Databricks, and AWS to join our financial services client, State Street.
The ideal candidate will have experience building and maintaining data pipelines, processing large datasets, and developing scalable data engineering solutions using cloud technologies. The candidate should be comfortable working with financial data and collaborating with technical and business teams.
Key Responsibilities
  • Design, develop, and maintain data pipelines using Scala and Python.
  • Build and optimize data processing workflows using Databricks and Apache Spark.
  • Develop data engineering solutions on AWS cloud services.
  • Process, transform, and integrate large volumes of structured and unstructured data.
  • Write efficient, reusable, and high-quality code.
  • Troubleshoot data pipeline issues and improve performance and reliability.
  • Work with databases, data lakes, and other data storage systems.
  • Collaborate with developers, architects, and business teams to deliver data solutions.
  • Follow data quality, security, and coding standards.
Required Skills
  • Strong hands-on experience with Scala and Python.
  • Experience with Databricks and Apache Spark.
  • Experience building and supporting data pipelines.
  • Hands-on experience with AWS cloud services.
  • Strong understanding of data processing, transformation, and ETL/ELT concepts.
  • Experience working with large datasets and distributed data processing.
  • Strong problem-solving and debugging skills.
Preferred Qualifications
  • Experience in banking, financial services, or capital markets.
  • Experience working with cloud-based data platforms and data lakes.
  • Knowledge of SQL and relational databases.
  • Experience with data quality, performance tuning, and production support.
Mandatory Requirements
  • Must be willing to work onsite in Boston, MA, 3 days per week.
  • Must be willing to relocate to Boston if currently based elsewhere.
  • Must be available for W2 employment only.
Note: Candidates must be comfortable with the hybrid work arrangement and relocation requirement before proceeding with the interview process.

Similar jobs