Technology

AI Data Engineer

Pebal Bright Technologies LLCNew York, NY🇺🇸United States

Why this role stands out

This hybrid role at Pebal Bright Technologies LLC offers an exciting opportunity to shape the future of AI by building robust data pipelines and managing the ML lifecycle, perfect for experienced data engineers passionate about cutting-edge AI technologies. You'll leverage your expertise in Python, Databricks, and Spark to drive innovation, and we encourage you to apply to join their dynamic team and advance your career in AI.

Quick overview

SeniorityMid Senior

Work modeHybrid

LocationNew York, NY, United States

SQLMLflowApacheApache SparkDatabricksHugging FacePython

Job description

Senior AI Data Engineer
Location: Princeton, NJ / NYC, NY – Hybrid
Type: Full-Time
We are looking for a Senior AI Data Engineer with strong expertise in Python, Databricks, Spark, AI/ML data pipelines, and ML lifecycle management.

Must Have:

10+ years of experience in Data Engineering, with strong AI/ML exposure.
Advanced Python, SQL, Databricks & Apache Spark experience.
Experience building ML/AI data pipelines, feature engineering, and data preprocessing.
Hands-on experience with MLflow, model tracking, versioning, and model registry.
Experience with AI model monitoring, data lineage, and data quality.
Experience with MCP servers / Model Context Protocol and AI data distribution.
Knowledge of vector databases, embeddings, and similarity search.
Strong understanding of AI/ML lifecycle, governance, and security.
GenAI experience with RAG, LangChain, or Hugging Face is a plus.