Job for Data Bricks Architect at Atlanta, GA

Role : Data Bricks Architect

Location: Atlanta, GA

Type: Contract

Job Summary

We are seeking a Senior Databricks Specialist with 10+ years of experience to architect, optimize, and support scalable data platforms and solutions.

Job Description

• Design and implement scalable, resilient data architectures using the Databricks Lakehouse Platform.
• Develop and optimize data pipelines with Databricks and Spark to enable efficient, reliable data processing.
• Collaborate with cross-functional teams to translate business requirements into effective technical solutions within the Databricks ecosystem.
• Maintain data quality and consistency while ensuring SLA adherence across ingestion, transformation, and storage processes.
• Apply best practices for data modelling, governance, and security within the Databricks environment.
• Monitor platform performance and implement improvements that optimize cost and resource utilization.
• Integrate Databricks with relevant cloud services, orchestration tools, and data-management platforms.
• Maintain comprehensive documentation and support automation initiatives that improve operational efficiency.

Roles and Responsibilities

• Architect end-to-end Databricks solutions covering data ingestion, transformation, and storage.
• Monitor and troubleshoot Databricks workloads, clusters, and data pipelines to ensure reliable execution.
• Perform root-cause analysis and implement corrective actions for pipeline failures and performance issues.
• Partner with data engineers, database administrators, and business stakeholders to support production environments and deployments.
• Lead production-support activities, including incident management, service requests, and change management.
• Develop and maintain operational runbooks, monitoring dashboards, and automation scripts.
• Drive continuous-improvement initiatives focused on platform reliability, performance, and cost optimization.
• Stay current with advances in Databricks architecture and recommend the adoption of relevant features and best practices.

Required Skills

• Data architecture
• Databricks