Senior / Lead Software Engineer (Python & Databricks) - Only W2
Quick overview
Job description
- Structure the engine as Python packages, with the pricing logic apart from data access and orchestration.
- Rewrite step by step SQL logic as vectorised computation, on Spark or on one machine, as each workload needs.
- Build the tests: unit, integration, and comparison against the current engine's results.
- Automate deployment with CI / CD and Databricks Asset Bundles.
- Make runs observable, safe to repeat and safe to run side by side.
- Bring AI agents into the team's development process, with checks on what they produce.
- 5 or more years of production Python: object oriented design, packaging, type hints, testing.
- The numerical stack beyond Spark, such as NumPy, pandas or Polars: vectorised and parallel execution, decimal against floating point accuracy.
- Production workloads shipped on Databricks: jobs, Unity Catalog, Delta Lake, Asset Bundles, medallion design.
- How Spark runs work: query plans, shuffles, partitioning, skew, and tuning from measurements.
- CI / CD, Git workflow, infrastructure as code, logging and monitoring.
- Daily use of AI coding agents, and agentic development workflows with checks on their output.
- Takes a design to production with little guidance, and leads a team by example.
- Insurance, reinsurance or other financial risk calculations.
- Reading T-SQL, the reference for the current logic.
- Azure Data Factory and Azure SQL.
- Testing in a regulated setting.
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- NR

Software Engineer II - Query GatewayRecently posted Auto Apply
New Relic · Portland · Hybrid · Posted 19 Nov 2026 🇺🇸
DockerGCPAWS+8Technology$126k - $158k/yr - PS

Application DeveloperRecently posted
Prismagic Solutions Inc · Denver, CO · Hybrid · Posted 19 Nov 2026 🇺🇸
SQLGitETL+6TechnologySalary not listed - LT

Software EngineerRecently posted
Ledgent Technology · Greeley, CO · Hybrid · Posted 19 Nov 2026 🇺🇸
SQLGitAngular+7TechnologySalary not listed - MA

Software Developer with Security ClearanceRecently posted
MANTECH · Chantilly, VA · Hybrid · Posted 19 Nov 2026 🇺🇸
DockerGitAWS+7TechnologySalary not listed - ZT
Senior Software DeveloperRecently posted
Zolon Tech Solutions Inc · Miami, FL · Hybrid · Posted 19 Nov 2026 🇺🇸
OraclePL/SQLSQL+7TechnologySalary not listed - KT

Senior Java Software EngineerRecently posted
Kforce Technology Staffing · Maryland Heights, MO · Hybrid · Posted 19 Nov 2026 🇺🇸
MicroservicesSpringSpring Boot+7TechnologySalary not listed - AL
Senior Software Developer - Multiple OpeningsRecently posted
Altimetrik · Cincinnati, OH · Hybrid · Posted 19 Nov 2026 🇺🇸
DockerSQLSVN+7TechnologySalary not listed - SO
Senior F5 Network Engineer with Security ClearanceRecently posted
Soliel LLC · Fort George G Meade, MD · On-site · Posted 19 Nov 2026 🇺🇸
SAMLTCP/IPDNS+4TechnologySalary not listed - ST

Field Application Engineer (DC/DC Converters & Power Electronics)Recently posted
STEPS TALENT, LLC · Fremont, CA · On-site · Posted 19 Nov 2026 🇺🇸
Microsoft ExcelMicrosoft WordMicrosoft PowerPoint+1Technology$165k - $180k/yr - MT
Research Engineer – Software Developer with Security ClearanceRecently posted
Michigan Technological University · Ann Arbor, MI · On-site · Posted 19 Nov 2026 🇺🇸
MATLABC++Python+4TechnologySalary not listed - TS

TTG-149 - Software Engineer - $254,200 Total Compensation with Security ClearanceRecently posted
TTG Solutions Inc. · Chantilly, VA · Hybrid · Posted 19 Nov 2026 🇺🇸
ScrumAnsibleJenkins+7Technology$152k - $184k/yr - MU

Software Engineer - FircosoftRecently posted
MphasiS Corporation USA · Tampa, FL · Hybrid · Posted 19 Nov 2026 🇺🇸
MicroservicesPL/SQLSQL+3TechnologySalary not listed