Haystack
โ† Back to Jobs
Remote
Full time
Technology
WA

Resident Solution Architect (RSA) - Data & Databricks

Weekday AIIndia๐Ÿ‡ฎ๐Ÿ‡ณIndiaPosted 7 Oct 2026

Quick Overview

Seniority
Mid Senior
Employment type
Full Time
Work mode
Remote
Location
India
Posted
15 hours ago
GCPSQLAWSETLMLOpsMLflowSnowflakeApacheApache SparkAzureDatabricksKafkaLLMPythonTerraformUnitydbt

Job Description

๐—ง๐—ต๐—ถ๐˜€ ๐—ฟ๐—ผ๐—น๐—ฒ ๐—ถ๐˜€ ๐—ณ๐—ผ๐—ฟ ๐—ผ๐—ป๐—ฒ ๐—ผ๐—ณ ๐˜๐—ต๐—ฒ ๐—ช๐—ฒ๐—ฒ๐—ธ๐—ฑ๐—ฎ๐˜†'๐˜€ ๐—ฐ๐—น๐—ถ๐—ฒ๐—ป๐˜๐˜€

๐—ฆ๐—ฎ๐—น๐—ฎ๐—ฟ๐˜† ๐—ฟ๐—ฎ๐—ป๐—ด๐—ฒ: ๐—ฅ๐˜€ ๐Ÿฐ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ - ๐—ฅ๐˜€ ๐Ÿณ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ๐Ÿฌ (๐—ถ๐—ฒ ๐—œ๐—ก๐—ฅ ๐Ÿฐ๐Ÿฌ-๐Ÿณ๐Ÿฌ ๐—Ÿ๐—ฃ๐—”)

Experience: 8+ yrs

Location: Remote (India)

Job Type: Full-time

We are looking for an experiencedย Resident Solution Architect (RSA) โ€“ Data & Databricksย to lead the design and delivery of scalable, cloud-based data and analytics solutions for enterprise customers. The role requires strong expertise inย Databricks, Data Engineering, PySpark, Python, SQL, Lakehouse Architecture, and Cloud platforms.

The ideal candidate will combine deep technical expertise with strong customer-facing and consulting capabilities. You will work closely with enterprise stakeholders to understand complex business and technology requirements, design effective data solutions, lead architecture discussions and POCs, and provide technical direction to engineering teams.

Key Responsibilities

  • Design end-to-endย Data, Analytics, and Lakehouse solutionsย using Databricks.
  • Develop and review scalable ETL/ELT pipelines and enterprise data platforms.
  • Work hands-on withย Databricks, Apache Spark, PySpark, Python, and SQL.
  • Design solutions usingย Delta Lake, Unity Catalog, Databricks SQL, and Databricks Workflows.
  • Develop scalable data architectures acrossย Azure, AWS, and GCPย environments.
  • Conduct technical discovery sessions, architecture workshops, and solution discussions with enterprise customers.
  • Understand business and technical requirements and translate them into scalable architecture and implementation approaches.
  • Prepareย High-Level Designs (HLD), Low-Level Designs (LLD), architecture diagrams, technical proposals, and solution documentation.
  • Lead POCs, technical demonstrations, solution validations, and architecture assessments.
  • Provide technical guidance, mentoring, and architectural direction to Data Engineering teams.
  • Review data pipelines, architecture designs, code, and implementation approaches for scalability and maintainability.
  • Troubleshoot and optimiseย Databricks and Spark workloadsย for performance, scalability, reliability, and cost efficiency.
  • Support data platform modernisation, migration, and transformation initiatives.
  • Collaborate with Sales, Pre-Sales, Delivery, Product, and Engineering teams on technical solutioning.
  • Engage with senior customer stakeholders to communicate architecture decisions, technical recommendations, risks, and trade-offs.
  • Identify opportunities to improve data platform architecture, engineering practices, automation, and operational efficiency.
  • Stay current with developments across Databricks, cloud data platforms, distributed computing, and modern data engineering technologies.

What Makes You a Great Fit

  • 8+ years of experienceย in Data Engineering, Data Architecture, Solution Architecture, Big Data, or a closely related field.
  • Strong hands-on expertise inย Databricksย and enterprise data platforms.
  • Strong knowledge ofย Apache Spark and PySpark.
  • Advanced programming skills inย Python and SQL.
  • Strong understanding ofย Lakehouse Architecture, Delta Lake, Unity Catalog, Databricks SQL, and Databricks Workflows.
  • Proven experience designing scalableย ETL/ELT pipelines, data platforms, data models, and data warehouses.
  • Experience working with at least one major cloud platform:ย Azure, AWS, or GCP.
  • Strong understanding of distributed data processing, scalability, reliability, and data platform architecture.
  • Hands-on experience withย performance tuning and optimisationย of Databricks and Spark workloads.
  • Proven experience in technical solution design, architecture workshops, POCs, technical demonstrations, and solution validation.
  • Strong customer-facing consulting experience with the ability to engageย Architects, CTOs, CDOs, Engineering Managers, and senior technology stakeholders.
  • Excellent communication, presentation, stakeholder-management, and technical storytelling skills.
  • Ability to provide technical leadership and mentorship to Data Engineering teams.
  • Strong analytical and problem-solving skills with a structured approach to complex technical challenges.
  • Experience withย Databricks certificationย would be an advantage.
  • Exposure toย Snowflake, Kafka, Spark Streaming, dbt, Terraform, CI/CD, MLflow, MLOps, GenAI, LLM/RAG, or data migrationย is desirable.
  • Strong ownership mindset with the ability to work independently in a remote, customer-facing environment.

Similar jobs