Data Architect

Hiring: Data Architect (Azure + Databricks)

Location: Milpitas, CA (Hybrid 4 Days Onsite)

Employment Type: W2

Local Bay Area Candidates Only

We are seeking a hands-on Data Architect with deep expertise in Azure and Databricks to design, build, and optimize enterprise data platforms and products.

Key Responsibilities:

Design scalable, secure, and cost-effective data architectures on Azure and Databricks

Build data lakehouse solutions using Delta Lake and Medallion Architecture

Develop production-grade Spark applications using PySpark, Scala, and SQL

Design and implement batch and streaming data pipelines

Configure and optimize Databricks environments and Azure services

Implement data governance using Unity Catalog and Azure Purview

Lead architecture reviews, code reviews, and mentor engineering teams

Partner with business and technical stakeholders to deliver modern data solutions

Required Skills:

8+ years of Data Engineering/Data Architecture experience

Expert-level Databricks (Delta Lake, Unity Catalog, Cluster Optimization)

Strong Azure experience (ADLS, Data Factory, Synapse, Event Hubs, Purview)

Advanced Apache Spark and performance tuning experience

Production coding experience in PySpark, Scala, and/or Python

Strong SQL and query optimization skills

Experience with Lakehouse, Data Mesh, and modern data architectures

Knowledge of Kafka, Event Hubs, and Structured Streaming

Experience with Terraform, ARM Templates, and CI/CD practices

Preferred:

Azure Solutions Architect Expert Certification

Databricks Certified Data Engineer Professional

MLOps and Machine Learning platform experience

Cloud migration and modernization experience

Multi-cloud experience (AWS/Google Cloud Platform)