Quick overview
SeniorityMid Senior
Work modeOn Site
LocationBoston, MA, United States
Job description
Job Title: Senior Databricks Engineer
Client: State Street
Location: Boston, MA – Hybrid (Onsite)
Experience: 12 Years
Interview Process: L1 Round followed by a mandatory direct in-person interview
Required Skills and Qualifications
- 12 years of overall experience in Scala/Spark data engineering and data pipeline design.
- Strong hands-on experience with Scala and Apache Spark programming.
- Strong SQL skills, including complex queries, joins, aggregations, and query optimization.
- Hands-on experience designing and developing data ingestion pipelines, ETL pipelines, and data processing jobs.
- Experience with AWS services and cloud-based data engineering solutions.
- Strong understanding of distributed data processing, data transformations, and pipeline architecture.
- Experience troubleshooting and optimizing Spark applications and data workflows.
- Strong analytical, problem-solving, and communication skills.
- Ability to participate in technical coding assessments and explain implementation decisions.
Preferred Skills
- Hands-on experience with Databricks.
- Experience configuring and managing Databricks workspaces and clusters.
- Experience with Databricks job scheduling and workflow management.
- Experience developing and maintaining production-grade ETL and ingestion pipelines in Databricks.
- Familiarity with data quality, pipeline monitoring, and production support practices.
Similar jobs
- MA

Expert Data Engineer with Security ClearanceRecently posted
Markon · Herndon, VA · Hybrid · Posted 17 Nov 2026 🇺🇸
ShellAWSSplunk+4Technology$187k - $213k/yr - VS

SQL SERVER DATABASE DEVELOPER / DATA ENGINEER with Security Clearance
VSolvit · Norco, CA · On-site · Posted 4 Nov 2026 🇺🇸
SQLT-SQLGit+5TechnologySalary not listed - SH

Principal/Senior Principal Database Engineer (TS/SCI Clearance) with Security Clearance
Shld, Inc. · Herndon, VA · Hybrid 🇺🇸
SQLAWSHadoop+2TechnologySalary not listed - LE

Principal Database Engineer with Security ClearanceRecently posted
Leidos · San Diego, CA · Hybrid · Posted 17 Nov 2026 🇺🇸
OracleAWSLoad Balancing+6Technology$154.1k - $278.5k/yr - CO

Data Engineer 4 (Python, PySpark, AWS)Recently posted
Capital One · McLean, VA · Hybrid · Posted 16 Nov 2026 🇺🇸
DynamoDBMicroservicesMongoDB+18Technology$197.3k - $225.1k/yr - AK
Data and Knowledge EngineerRecently posted
Akshaya Inc · New York, NY · Hybrid · Posted 18 Nov 2026 🇺🇸
EngineeringSalary not listed - BI

Data Engineer, Senior with Security ClearanceRecently posted
BigBear.ai · Norfolk, VA · On-site · Posted 17 Nov 2026 🇺🇸
SQLApache SparkAWS+3TechnologySalary not listed - DT
Data Engineer (W2 only)Recently posted
Digipulse Technologies, Inc · Westlake, TX · Hybrid · Posted 17 Nov 2026 🇺🇸
DockerSQLAWS+9TechnologySalary not listed - JC
Data Architect / Lead Data Architect / Lead Data EngineerRecently posted
JC CORPORATIONS · United States · Remote · Posted 18 Nov 2026 🇺🇸
SQLScalaApache Spark+15TechnologySalary not listed - DS
Data Engineer DBARecently posted
Dew Softech Inc · Trenton, NJ · On-site · Posted 16 Nov 2026 🇺🇸
OraclePL/SQLSQL+3TechnologySalary not listed - RT

Data Engineer IIRecently posted
Russell, Tobin & Associates · Mountain View, CA · Hybrid · Posted 17 Nov 2026 🇺🇸
SQLScalaApache Spark+4Technology$60 - $65/hr - OT
Data EngineerRecently posted
Oscar Technology · San Francisco, CA · Hybrid · Posted 17 Nov 2026 🇺🇸
AWSRoboticsTerraform+2Technology$300k/yr
