AWS Databricks Architect

HMG America LLC is the best Business Solutions focused Information Technology Company with IT consulting and services, software and web development, staff augmentation and other professional services. One of our direct clients is looking for AWS Databricks Architect in Remote. Below is the detailed job description.

Job Title: AWS Databricks Architect

Location: 100% Remote

Employment Type: Full-Time

Job Summary

We are seeking a senior AWS Databricks Architect with a strong background in IT consulting and professional services to lead end-to-end cloud data enterprise initiatives. In this role, you will act as a trusted technical advisor to client stakeholders while leading the architecture, design, and execution of scalable Lakehouse platforms on AWS using Databricks.

The ideal candidate possesses exceptional client engagement abilities, deep hands-on expertise with the Databricks Medallion Architecture and Unity Catalog, and proven experience migrating legacy data warehouses to modern AWS data ecosystems.

Key Responsibilities

1. Solution Architecture & Technical Delivery

• Architect, design, and implement scalable, enterprise-grade data platforms on AWS using Databricks Lakehouse.
• Establish data architecture patterns using the Medallion Architecture (Bronze, Silver, Gold layers) for real-time and batch data pipelines.
• Implement robust governance, security, and access control models across datasets using Databricks Unity Catalog, AWS IAM, and KMS.
• Optimize workspace configurations, cluster sizing, auto-scaling, and Delta Lake optimizations (Z-Ordering, Liquid Clustering) for high performance and cost efficiency.
• Integrate AWS-native services (S3, Glue, Lambda, EventBridge, Redshift, Athena, Secrets Manager) seamlessly with Databricks.

2. Client Engagement & Advisory (Consulting)

• Lead discovery workshops, technical assessments, and architecture reviews with C-level executives, VPs of Data, and Enterprise Architects.
• Translate complex business requirements into high-level architecture diagrams, technical roadmaps, and Statements of Work (SOWs).
• Educate clients on cloud data best practices, cost-optimization strategies, and modern Lakehouse paradigms.
• Drive client migration strategy from legacy data warehouses (e.g., Teradata, Netezza, Snowflake, On-Prem Hadoop) to AWS Databricks.

3. Leadership & DevOps

• Mentor and lead cross-functional delivery teams of Data Engineers, Analytics Engineers, and DevOps Engineers.
• Enforce Infrastructure-as-Code (IaC) practices using Terraform or CloudFormation for enterprise workspace deployments.
• Build CI/CD automation pipelines for Databricks notebooks, Delta Live Tables (DLT), and Spark jobs.