Databricks Solutions Architect / Data Platform Architect

Databricks Solutions Architect / Data Platform Architect
Location: Remote – US (PST Hours)
Duration: 6+ Months Contract (Possible Extension / FTE Conversion)
Interview: Virtual
LinkedIn Profile: Mandatory

Job Description

We are seeking an experienced Databricks Solutions Architect / Data Platform Architect to lead the design and delivery of enterprise-scale data platform solutions for a leading organization in the Healthcare & Hospital domain.

The ideal candidate will have extensive recent, hands-on experience designing and implementing Databricks-based data architectures, modernizing enterprise data platforms, and leading large-scale data warehouse migrations.

We are particularly interested in candidates with deep Databricks platform expertise who can make sound architectural decisions, optimize data processing workloads, and communicate effectively with technical and non-technical stakeholders.

Key Responsibilities

• Design and architect enterprise-scale data platforms using Databricks.

• Lead implementation of Lakehouse and Medallion architectures (Bronze, Silver, and Gold layers).

• Design and implement data pipelines using Delta Lake, Databricks Workflows, Delta Live Tables (DLT) / Lakeflow.

• Implement enterprise data governance, security, and access management using Unity Catalog.

• Develop and optimize PySpark and SQL workloads for performance, scalability, and cost efficiency.

• Architect dimensional data models and Gold-layer datasets for enterprise analytics and reporting.

• Lead legacy Enterprise Data Warehouse (EDW) migration initiatives, preferably from Teradata.

• Design cloud-based data solutions using Microsoft Azure (preferred) or AWS.

• Collaborate with business stakeholders to gather requirements and translate business needs into technical solutions.

• Establish data engineering best practices, architectural standards, and platform optimization strategies.

Required Qualifications

• Strong, recent, hands-on Databricks architecture and implementation experience.

• Deep expertise in Delta Lake, Unity Catalog, Databricks SQL, Workflows, and DLT/Lakeflow.

• Strong proficiency in PySpark and SQL.

• Experience designing enterprise Medallion architectures and dimensional data models.

• Proven experience optimizing Spark workloads for performance and cost.

• Experience with legacy EDW migrations (Teradata strongly preferred; Netezza, Oracle, or SQL Server also considered).

• Experience with Microsoft Azure (preferred) or AWS.

• Strong understanding of enterprise data governance, security, and sensitive data management.

• Excellent communication and stakeholder management skills.

• Bachelor's degree in Computer Science, Information Systems, or related discipline, or equivalent practical experience.

• Required Certification: Databricks Certified Data Engineer Professional or Databricks Certified Solutions Architect / Platform Architect credential.

Preferred Qualifications

• Healthcare and hospital industry experience.

• Experience with Epic Clarity, Epic Caboodle, healthcare claims, revenue cycle, HL7, or FHIR.

• Experience implementing self-service BI and citizen development programs.

• Familiarity with Databricks AI/BI Genie, Mosaic AI, or ML feature engineering.

• Experience designing Power BI semantic models.

• Infrastructure as Code using Terraform or Databricks Asset Bundles.

• CI/CD experience using Azure DevOps or GitHub.

• Previous consulting or Databricks partner experience.

• Azure Data Engineer Associate or Azure Solutions Architect Expert certification.

Contract Details

• Initial contract: 6+ months.

• Possible contract extension or FTE conversion depending on client requirements and candidate preference.

• Remote engagement.

• Virtual interview process.

We prioritize recent, hands-on Databricks architecture expertise, enterprise implementation experience, and strong technical decision-making over total years of IT experience.