Quick overview
Job description
Lead Data Engineer (Azure Databricks)
Location: Charlotte, NC/ New York
Durattion: 12 Months Contract
Contract: W2
Required Skills:
Experience using Python, PySpark and its frameworks.
Well versed with Azure Databricks
Proven experience as a Data Engineer with experience in Azure cloud.
Experience implementing solutions using -
Azure cloud services
Azure Data Factory
Azure Lake Gen 2
Azure Databases
Azure Data Fabric
API Gateway management
Azure Functions
Strong SQL skills with RDMS or noSQL databases
Experience with developing API’s using FastAPI or similar frameworks in Python
Familiarity with the DevOps lifecycle (git, Jenkins, etc.), CI/CD processes
Good understanding of ETL/ELT processes
Experience in financial services industry, financial instruments, asset classes and market data are a plus.
Similar jobs
- CI
Lead Data EngineerRecently posted
CitiusTech · United States · Hybrid 🇺🇸
SQLShellApache Spark+11TechnologySalary not listed - KT
Senior Data EngineerRecently posted
Kforce Technology Staffing · PA · Hybrid 🇺🇸
SQLGitAWS+9TechnologySalary not listed - TL
Consultant, Data Engineer- AtlantaRecently posted
Thought Logic Consulting · Atlanta, Georgia · Hybrid 🇺🇸
SQLAWSETL+12TechnologySalary not listed - IC
Healthcare EDI Data Engineer- 7+ yrs- New York, United States- OnsiteRecently posted
iMedhas Consulting Services · New York, NY · Hybrid 🇺🇸
DatabricksHIPAAPython+1TechnologySalary not listed - IS
SAP data engineer HANA data modelerRecently posted
ISOFT · United States · Remote 🇺🇸
SQLETLTechnologySalary not listed - JC
Data engineer / Architect / Python / PySpark / SQLRecently posted
JC CORPORATIONS · United States · Hybrid 🇺🇸
SQLApache SparkAWS+3TechnologySalary not listed - PT
Data Engineer with Private Credit / Investment Domain experienceRecently posted
Pyramid Technology Solutions, Inc. · Boston, MA · Hybrid 🇺🇸
SQLAWSSnowflakeTechnologySalary not listed - JC
Big Data Engineer
JC CORPORATIONS · Irving, TX · Hybrid 🇺🇸
SQLApache SparkETL+3TechnologySalary not listed - NG
Data Engineer with Security ClearanceRecently posted
National Geospatial-Intelligence Agency · Springfield, VA · Hybrid 🇺🇸
MicroservicesMongoDBMySQL+12Technology$85.4k - $158.3k/yr - DS
Data EngineerRecently posted
Drunix Solution Inc · United States · Hybrid 🇺🇸
SQLGitAWS+6TechnologySalary not listed - SM
Data Engineer (5626)Recently posted Auto Apply
SMX · United States · Hybrid 🇺🇸
SQLAWSETL+2TechnologySalary not listed - ET
TERADATA DBARecently posted
Envision Technology Solutions · MN · On-site 🇺🇸
SQLShellETL+1TechnologySalary not listed