Haystack
← Back to Jobs
Technology
TE

Data Scientist – Databricks Architect

TechVirtue LLCUnited States🇺🇸United StatesPosted Sep 17, 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
United States
Posted
16 hours ago
DockerSQLAWSMLOpsMLflowMachine LearningNLPApacheApache SparkAzureDatabricksDeep LearningGenerative AIGoogle CloudKubernetesPythonUnity

Job Description

Data Scientist – Databricks Architect

Location: Remote
Duration: 12 Months

Job Description

We are seeking an experienced Data Scientist / Data Science Architect with strong expertise in Databricks, advanced analytics, machine learning, and cloud-based data platforms. The ideal candidate will have hands-on experience designing scalable data science solutions and architecting end-to-end machine learning and analytics platforms using Databricks.

The candidate will work closely with data engineering, analytics, and business teams to develop and implement enterprise-grade data science solutions.

Key Responsibilities

  • Design and architect scalable Data Science and Machine Learning solutions using Databricks.

  • Develop and implement advanced analytics, predictive modeling, and machine learning solutions.

  • Provide technical leadership for Databricks-based data science and ML platforms.

  • Build and optimize data pipelines, feature engineering workflows, and ML workflows.

  • Work with Apache Spark, PySpark, Python, SQL, and Databricks for large-scale data processing and analytics.

  • Design end-to-end ML solutions including data preparation, model development, training, validation, deployment, and monitoring.

  • Collaborate with Data Engineers, Data Architects, ML Engineers, and business stakeholders.

  • Apply best practices for data governance, security, scalability, performance, and cost optimization.

  • Work with MLflow and MLOps practices for model lifecycle management.

  • Evaluate new technologies and recommend appropriate data science and analytics architectures.

  • Provide technical guidance and mentorship to data science and engineering teams.

Required Skills

  • 12+ years of experience in Data Science, Machine Learning, Advanced Analytics, or related fields.

  • Strong experience with Databricks and cloud-based data platforms.

  • Architect-level experience designing data science / machine learning solutions.

  • Strong hands-on experience with Python, PySpark, SQL, and Apache Spark.

  • Strong understanding of machine learning algorithms, statistical modeling, and predictive analytics.

  • Experience with MLflow, MLOps, model deployment, and model lifecycle management.

  • Experience working with large-scale structured and unstructured datasets.

  • Strong understanding of data engineering and modern data architecture concepts.

  • Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.

  • Strong communication, problem-solving, and technical leadership skills.

Preferred Skills

  • Databricks certifications.

  • Experience with Delta Lake, Unity Catalog, Delta Live Tables (DLT), and Databricks Workflows.

  • Experience designing enterprise-level AI/ML platforms.

  • Knowledge of Generative AI, LLMs, NLP, or deep learning.

  • Experience with CI/CD, Docker, Kubernetes, and automated ML deployment.

  • Experience with data governance, security, access control, and compliance.

Education

Bachelor’s or Master’s degree in Computer Science, Data Science, Statistics, Mathematics, Engineering, or a related field preferred.

Similar jobs