Quick Overview
Seniority
Mid Senior
Work mode
Hybrid
Location
Greensboro, NC, United States
Posted
3 days ago
SQLDatabricksUnity
Job Description
Collibra DQ to Databricks Migration
Accountable for migrating Collibra DQ estate onto Databricks end to end. Owns the technical design decisions, the working-level client relationship, and the gates that control whether the programme advances.
KEY RESPONSIBILITIES
- Own delivery of the migration end to end, from framework design through to Collibra DQ decommission.
- Make and defend the native-monitoring versus generated-SQL routing decision with VF, and revise it as pilot evidence lands.
- Own the pilot gate go/no-go — scale does not begin until every exit criterion is demonstrably met, including measured effort per dataset.
- Chair the weekly working gate with VF's DQ lead, and report progress, risk and defect trend to programme sponsors.
- Direct alias-to-table mapping, retirement validation of candidate jobs, and scope adjudication with the VF DQ team.
- Own the parity sign-off process so that no dataset is cut over without written steward approval.
REQUIRED QUALIFICATIONS
- 10+ years in data quality, data engineering or data platform architecture, including experience leading a migration to a client-facing gate.
- Hands-on Databricks — Unity Catalog, Delta Lake and Workflows — sufficient to review generated code and challenge design decisions credibly.
- Working knowledge of Collibra DQ or an equivalent enterprise DQ platform such as Informatica DQ, Ataccama, Soda or Monte Carlo.
- Proven ownership of a decommission programme where the legacy system could not be switched off without documented evidence.
- Able to hold a client conversation in which the honest answer is “not yet”, and keep both the schedule and the relationship intact.
PREFERRED
- Retail, apparel or CPG data domain exposure.
- Experience defining test strategy for a data migration, even where not personally executing it.
Similar jobs
- CT
Market Data Risk Applications Analyst / Third-Party Risk
NewCERNER TECHNOLOGIES LLC
NJ🇺🇸HybridYesterdayComplianceOnboardingProcurement+1 - TE
Lead Hygienist
NewTend
New York, NY🇺🇸$82/hrOn-site20 hours agoBLSComplianceContinuous Improvement+3 - AR
Patient Dining Manager
NewAramark
Alamosa, CO🇺🇸$58k - $65k/yrHybrid20 hours agoComplianceContinuous ImprovementFinancial Reporting+1 - XO
Manager, Data Analytics, Pricing & Yield Management
NewXometry
Denver🇺🇸4 hours agoSQLLookerMachine Learning+7 - XO
Senior Principal, ML/AI
NewXometry
Denver🇺🇸5 hours agoGCPAWSMLOps+9 - VI
Global Workplace and Facilities Coordinator
NewVIA
Somerville🇺🇸3 hours agoForecastingGoogle WorkspaceInventory Management+3