Senior Databricks Architect...(NJ, 6+Months)...Locals Or Nearby only

Job Title:             Senior Databricks Architect

Location:             Jersey City, NJ (Local candidates only)

Duration:             6 Months

Interview:           Onsite (5 days per week)

LinkedIn with pic





Process:  10 minutes with CAPCO HR video, and either an onsite or Teams interview with the client.   

Skills Needed:

• 10+ years of experience in cloud and data platform engineering or architecture.
• 5+ years of hands-on experience with Databricks on AWS.
• Strong experience with AWS services, including S3, IAM, VPC, and PrivateLink.
• Experience designing and supporting both front-end and back-end cloud data platform solutions.
• Hands-on experience with Terraform for infrastructure as code (IaC).
• Strong knowledge of Databricks platform security, governance, and best practices.

Role Description

Seeking a Senior Databricks Platform Architect to lead secure, scalable Databricks deployments on AWS. This role requires hands-on infrastructure expertise combined with the ability to independently lead architecture and enablement sessions with large customer teams.

Key Responsibilities

• Design and deploy Databricks classic and serverless workspaces on AWS, including networking, storage, and identity integration
• Author and maintain Terraform modules to provision and manage AWS and Databricks resources in a repeatable, secure manner
• Define and implement platform security architecture, including workspace isolation, cluster access controls, secrets management, and network security patterns
• Lead architecture enablement sessions and workshops with large, cross-functional customer teams
• Guide customer teams through Databricks security accreditation and compliance processes
• Partner with customer cloud, security, network, and platform teams to validate architecture decisions and troubleshoot deployment issues
• Produce clear architecture documentation, diagrams, and runbooks for platform configurations

Required Qualifications

• 10+ years of overall experience in cloud/data platform engineering or architecture
• 3–5 years of hands-on relavent experience with Databricks on AWS (classic and serverless workspace deployments)
• Strong working knowledge of AWS infrastructure: S3, IAM, VPC design, and PrivateLink (both front-end and back-end connectivity)
• Hands-on Terraform experience provisioning both AWS and Databricks resources
• Solid understanding of Databricks platform security: workspace isolation, identity/SSO integration, cluster access controls, secret scopes, and network security patterns (e.g., private endpoints, security groups, network ACLs)
• Excellent verbal and written communication skills, with demonstrated ability to independently lead technical sessions with large customer/stakeholder groups