Haystack
← Back to Jobs
Other

AI Data Engineering Lead/ Manager

Sharpedge SolutionsUnited States🇺🇸United StatesPosted 5 Aug 2026

Why This Role Stands Out

Lead the design and implementation of a cutting-edge AI data platform that will power all future initiatives at Sharpedge Solutions, offering significant career growth and the chance to shape the future of AI within the company. If you are a visionary AI Data Architect with extensive experience looking for a hybrid role with substantial impact and opportunities for skill development, this is an exciting opportunity to apply.

Quick Overview

Work Type
Hybrid
Level
Mid Senior

Job Description

Responsibilities:-

  • Looking for AI Data Architect to design, build, govern, and evolve the single source of truth that powers every AI initiative in our organization.
  • This platform will serve as the foundational nervous system for conversational AI assistants, dashboard intelligence, autonomous AI agents, RAG-powered applications, predictive ML models, and any AI product we build today or in the future.
  • The resource will architect the system, drive implementation, own the data contracts that agents and AI applications depend on, enforce security and access governance for both human and agent consumers, and continuously monitor and improve the accuracy and reliability of AI outputs that flow from this platform.

Must-Have Experience

  • 10+ years of hands-on data engineering and architecture experience, with 3–5+ years building production AI/ML and LLM-era data infrastructure.
  • Proven experience designing enterprise-scale AI data platforms that serve multiple AI consumers —not just one application or pipeline.
  • Deep expertise in Lakehouse and data mesh architectures: Databricks, Delta Lake, PySpark, Kafka, Spark Structured Streaming, cloud-native data services (AWS, Azure).
  • Hands-on experience with vector stores, semantic models, knowledge graphs, and retrieval infrastructure in production environments.
  • Working knowledge of LLMOps: model serving pipelines, MLflow, CI/CD for AI, automated evaluation, and production monitoring.
  • Strong background in data governance, security, and compliance in regulated industries (financial services, payments, cybersecurity, healthcare).

 

Skills

AWS
MLflow
Azure
Compliance
Databricks
Kafka
LLM

Similar jobs