DataOps Architect/Lead

Role: DataOps Solution Architect — Azure Data Platform (Fabric & Databricks)

Owns end-to-end architecture of the Azure data platform (Fabric, Databricks, Azure services) and sets the governance, security, and DataOps standards engineering teams implement. Design authority and primary architecture advisor to the client, not the day-to-day builder.

---

Experience Required

• 8-10+ years overall in data engineering / cloud architecture, including 3+ years as a Solution Architect or in a comparable design-authority role.
• Microsoft Fabric: 2+ years hands-on.
• Azure Databricks: 4+ years hands-on.
• Proven track record designing and delivering enterprise-scale Azure data platforms end-to-end.
• Azure is mandatory; experience across multiple client engagements or a consulting/SI background is a plus.

---

Core Technical Expertise

Azure Platform

• Fabric & Databricks architecture.
• ADF.
• ADLS.
• Entra ID.
• Key Vault.
• Monitor/Log Analytics.

Microsoft Fabric

• Workspace & environment strategy.
• Lakehouse/Warehouse.
• OneLake.
• Pipelines/Notebooks.
• REST APIs/CLI.
• Governance.

Azure Databricks

• Workspace strategy.
• Unity Catalog.
• RBAC.
• Jobs/Workflows.
• Delta Lake.
• Asset Bundles.
• ML platform integration.

DevOps & IaC

• Azure DevOps/GitHub CI/CD.
• Terraform & Bicep.
• Branching/release strategy.
• Reusable IaC modules.

Security & Networking

• Entra ID.
• RBAC architecture.
• Private Endpoints/DNS.
• Key Vault integration.

DataOps Standards

• CI/CD & test gates for pipelines.
• Data-quality frameworks.
• Observability/alerting architecture.
• SLAs/SLOs.
• Incident-management practices.
• FinOps guardrails.

---

Key Responsibilities

• Own end-to-end architecture; translate requirements into scalable, secure, cost-effective designs.
• Design enterprise-scale Fabric/Databricks architecture including workspace, networking, security, and governance.
• Set standards for CI/CD, IaC, DataOps, and environment management; ensure enterprise security and regulatory compliance.
• Evaluate technology options; identify architectural risks and define mitigation strategies.
• Act as the primary architecture point of contact for the client; lead workshops and present trade-offs and roadmaps to senior stakeholders.
• Provide technical oversight across implementation teams; conduct architecture and design reviews.
• Mentor Leads and Architects; establish reusable reference architectures and engineering standards.

---

Competencies, Certifications & Education

Must-have

• Azure Solution Architecture.
• Fabric Architecture.
• Databricks Architecture.
• Enterprise Data Architecture.
• Security & Governance.
• Client Advisory & Consulting.

Good-to-have

• Cost & performance optimization.
• Data-mesh/data-product exposure.
• Client-industry experience.
• Multi-cloud (AWS/GCP) exposure.