Quick overview
Job description
Position: Supply Chain Data Engineer-Databricks (lead/Architect)
Location: San Francisco Bay Area, CA (Onsite)
a. Databricks hands-on, including curated or Gold-layer data models [Databricks, Delta Lake, lakehouse, medallion, Gold layer].
b. Data quality ownership: DQ checks, anomaly or abnormality detection, alerting, SLAs, root-cause analysis [data quality, DQ, data observability, anomaly detection].
c. Metric governance: metric definitions and certification, semantic layer or metric views, data lineage, data governance [metric definitions, semantic layer, metric views, data lineage, data catalog].
d. Solutioning and transformation: has architected or led a data platform build, migration or modernization, not only operated pipelines [architect, solution design, transformation, migration, modernization].
- Own data quality alerting and issue management in Databricks: alert coverage, triage, routing, SLAs, root-cause analysis and closure; keep DQ and abnormality checks current as pipelines change; report DQ health to stakeholders.
- Own metric definitions, calculations and measurement standards across functions; set certification standards and the governance gate metrics must pass before official reporting; mentor analysts, data engineers and BI developers.
- Work with analytics engineers to architect and govern the Databricks Gold layer: certified data models with embedded DQ and abnormality checks, metric views and data lineage.
- Drive data readiness for AI: tiered assessments scoring datasets on completeness, accuracy and automation readiness, and turn certified metrics into natural-language queryable experiences.
Similar jobs
- SC

Senior Director, Enterprise Data & AnalyticsRecently posted Auto Apply
Scholarrock · Cambridge · Hybrid 🇺🇸
ETLCRMERP+2$245k - $325k/yr - NG

Databricks ArchitectRecently posted
Newt Global · Irving, TX · Hybrid 🇺🇸
DockerSQLApache Spark+20Salary not listed - C&

Director of eDiscovery and Data SolutionsRecently posted Auto Apply
Crowell & Moring · Boston · Remote 🇺🇸
SourcingStakeholder ManagementArbitration+14$195k - $290k/yr - XP
Enterprise AI and Data ArchitectRecently posted Auto Apply
Xplor · Atlanta, GA · Remote 🇺🇸
DatadogSnowflakeLLMTechnology$173k - $193k/yr - PA
Senior Data Architect & SME-Healthcare (Medicaid)- Remote-6 MonthsRecently posted
Palni Inc · United States · Remote 🇺🇸
OracleSQLGit+11TechnologySalary not listed - IC
Application Data ArchitectRecently posted
Innovee Consulting LLC · New York, NY · Hybrid 🇺🇸
SQLAWSETL+9TechnologySalary not listed - GR

Senior Manager / Director, Data & Business SystemsRecently posted Auto Apply
Graza · New York · On-site 🇺🇸
SQLSnowflakeERP+8Salary not listed - TE
Scientific Data Architect - Central USRecently posted Auto Apply
TetraScience · Chicago, Illinois · Hybrid 🇺🇸
SnowflakeContinuous ImprovementDatabricks+3TechnologySalary not listed - TE
Scientific Data Architect - Central USRecently posted Auto Apply
TetraScience · St. Louis, Missouri · Hybrid 🇺🇸
SnowflakeContinuous ImprovementDatabricks+3TechnologySalary not listed - SI

Snowflake ArchitectRecently posted
Spar Information Systems · United States · Remote 🇺🇸
SnowflakeTechnologySalary not listed - SS

Data Migration ArchitectRecently posted
Sriven Systems Inc. · United States · Remote 🇺🇸
ETLCADCompliance+1Salary not listed - OR

Enterprise Architect- Data Infrastructure ETL/HL7
Oracle Corporation · United States · Hybrid 🇺🇸
OracleETLData Pipeline+1Technology$95k - $209.5k/yr
