Data & Cloud Solutions Architect (Azure)

Data & Cloud Solutions Architect (Azure)
San Jose, CA (100% Onsite – 5 Days/Week)

Contract

UST Global // Adobe

23291-1

Job Summary

We are seeking an experienced Data & Cloud Solutions Architect to design, implement, and optimize enterprise-scale cloud data platforms on Microsoft Azure. The ideal candidate will have strong expertise in cloud data architecture, Azure data services, Databricks, metadata management, and data governance. This is a hands-on architecture role focused on building scalable, secure, and high-performance data solutions that support analytics, AI/ML, and enterprise reporting.

The architect will collaborate with engineering teams, business stakeholders, DevOps, and platform teams to develop modern cloud data architectures, establish governance standards, and drive cloud transformation initiatives.

Key Responsibilities

Cloud Data Architecture

• Design and implement scalable cloud-based data lakehouse and data warehouse solutions.
• Build end-to-end data architectures covering ingestion, transformation, storage, and data consumption.
• Define reusable architecture frameworks and enterprise data standards.
• Evaluate and integrate Azure cloud services to improve performance, scalability, and cost optimization.
• Lead architecture reviews, technical solution design, and proof-of-concepts.

Azure Data Platform

• Design solutions using:
• Azure Data Lake Storage Gen2
• Azure Data Factory
• Azure Synapse Analytics
• Azure Databricks
• Azure Event Hubs
• Develop distributed data processing pipelines using Apache Spark and Databricks.
• Optimize large-scale ETL/ELT workloads.

Data Governance & Metadata

• Design metadata-driven architectures for enterprise data platforms.
• Implement data governance standards and metadata management strategies.
• Work with tools such as:
• Unity Catalog
• Microsoft Purview
• Collibra
• Enable automated lineage, data cataloging, and schema management.

Data Modeling & Design

• Create logical and physical data models.
• Design scalable schemas for analytics and reporting.
• Implement data quality and data lineage solutions.
• Standardize enterprise data models and architecture documentation.

Documentation & Architecture

• Prepare architecture diagrams, system blueprints, and data flow documentation.
• Use tools such as:
• Visio
• Lucidchart
• Draw.io
• Maintain architecture standards and technical documentation.

Performance & Optimization

• Optimize cloud storage and compute resources.
• Improve Spark and Databricks performance.
• Implement CI/CD for data pipelines.
• Support monitoring, observability, troubleshooting, and schema evolution.

Collaboration

• Partner with Data Engineers, Product Teams, Analysts, and DevOps teams.
• Provide architecture guidance and technical leadership.
• Participate in solution reviews and enterprise architecture discussions.

Required Qualifications

• Bachelor''s Degree in Computer Science or a related technical field (Mandatory).
• 7+ years of experience in Data Engineering, Data Architecture, or Enterprise Analytics.
• Minimum 3+ years of experience designing Azure cloud data architectures.
• Strong experience with:
• Azure Data Factory
• Azure Data Lake Storage Gen2
• Azure Synapse Analytics
• Azure Databricks
• Hands-on experience with Apache Spark.
• Strong understanding of:
• Data Modeling
• Schema Design
• Metadata Management
• Data Governance
• Experience building enterprise Data Lake and Data Warehouse solutions.
• Strong SQL skills.
• Experience with Python or Java.
• Knowledge of CI/CD and DevOps practices.
• Excellent communication and documentation skills.

Preferred Skills

• Unity Catalog
• Microsoft Purview
• Collibra
• Delta Lake
• Lakehouse Architecture
• Azure Event Hubs
• Cloud Data Warehousing
• Data Lineage
• Data Quality Frameworks
• AI/ML Data Platform Architecture
• Enterprise Data Governance
• Power BI or Tableau
• Azure Certification (Solutions Architect/Data Engineer) is a plus.

Mandatory Skills

• Azure Data Lake Storage Gen2
• Azure Data Factory
• Azure Databricks
• Azure Synapse Analytics
• Apache Spark
• Cloud Data Warehousing
• Data Modeling
• Metadata Management
• Data Governance
• SQL
• Python or Java