Quick overview
Job description
Role: Sr AI Engineer
Location:Onsite. Chicago, IL
Type: C2C
Send profiles to
Job Description:
We are seeking a Senior AI Engineer with deep, hands-on expertise in Databricks to design, build, and deploy production-grade AI and machine learning solutions at scale. You will lead the end-to-end lifecycle of data-intensive AI applications—from building resilient, large-scale data ingestion and transformation pipelines to training, fine-tuning, and operationalizing ML and Generative AI models in a unified lakehouse environment.
Key Responsibilities:
Large-Scale Data Engineering & Transformation: Architect and optimize high-throughput batch and streaming ETL/ELT pipelines using Apache Spark, PySpark, Delta Lake, and Databricks Lakehouse architectures to process multi-terabyte datasets.
AI & Machine Learning Model Development: Design, train, evaluate, and fine-tune predictive ML models, deep learning architectures, and Generative AI/LLM workflows (e.g., RAG pipelines, agentic systems) tailored to business-critical use cases.
MLOps & Production Deployment: Operationalize models at scale using MLflow, Databricks Model Serving, and CI/CD best practices, ensuring automated retraining, drift monitoring, and low-latency inference.
Data Governance & Feature Engineering: Build reusable feature pipelines using Databricks Feature Store and enforce data quality, lineage, and access controls via Unity Catalog.
Performance & Cost Optimization: Tune Spark jobs, cluster configurations, Photon engine workloads, and Delta table partitioning/Z-ordering to maximize compute efficiency and minimize cloud infrastructure costs.
Cross-Functional Technical Leadership: Partner with data scientists, software engineers, and product managers to translate complex business requirements into scalable technical architectures, while mentoring junior engineers on coding and MLOps standards.
Required Qualifications:
Experience: 5+ years of hands-on experience in AI/ML engineering, data science, or big data engineering, with at least 3+ years building production systems on Databricks.
Databricks Ecosystem Mastery: Proven expertise in PySpark, Spark SQL, Delta Lake, MLflow, Unity Catalog, and Databricks Workflows.
Programming & Software Engineering: Strong proficiency in Python and SQL, with solid software engineering fundamentals (Git, modular design, unit testing, CI/CD).
AI/ML Frameworks: Deep familiarity with modern ML and deep learning libraries (e.g., PyTorch, TensorFlow, Scikit-learn, Hugging Face, LangChain).
Cloud Infrastructure: Hands-on experience deploying data and AI workloads on major cloud platforms (AWS, Azure, or Google Cloud Platform).
Preferred Qualifications:
Experience building and deploying Generative AI / LLM applications using Databricks Mosaic AI, Vector Search, and Retrieval-Augmented Generation (RAG).
Familiarity with infrastructure-as-code tools (Terraform, Databricks Asset Bundles) for automated environment provisioning.
Experience with real-time streaming technologies (Apache Kafka, Spark Structured Streaming).
Bachelor’s or Master’s degree in Computer Science, Data Science, Engineering, or a related quantitative field.
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- Z&
Forward Deployed / Python AI Engineer, OpenAI/Claude SDK, LLM APIs , Fintech, 12+ Mths Cont NYC, NYRecently posted
Zen & Art · New York, NY · On-site · Posted 19 Nov 2026 🇺🇸
LLMPythonGenerative AI+3TechnologySalary not listed - RE
AI Engineer LeadRecently posted
Recfront Inc. · San Jose, CA · Hybrid · Posted 19 Nov 2026 🇺🇸
DockerEncryptionMLOps+14TechnologySalary not listed - JI
AI Focus Software Developer / AI DeveloperRecently posted
J-RAM IT Consulting Inc. · Palo Alto, CA · On-site · Posted 19 Nov 2026 🇺🇸
DockerSQLGit+12TechnologySalary not listed - DS
AI EngineerRecently posted
Drunix Solution Inc · Phoenix, AZ · Hybrid · Posted 18 Nov 2026 🇺🇸
DockerSQLGit+16TechnologySalary not listed - GS

Senior Generative AI Engineer (Hybrid Onsite)Recently posted
GSK Solutions Inc. · Raleigh, NC · Hybrid · Posted 19 Nov 2026 🇺🇸
SAFeDynamoDBFastAPI+20TechnologySalary not listed - GE

Staff AI Engineer
Genesis10 · Cedar Park, TX · Hybrid 🇺🇸
SQLAWSMLflow+4Technology$150k - $215k/yr - TS

Enterprise AI ArchitectRecently posted
Trigent Software, Inc. Account Number · Houston, TX · On-site · Posted 19 Nov 2026 🇺🇸
Microsoft OfficeGitAWS+4TechnologySalary not listed - SU

Senior Generative AI DeveloperRecently posted
SunTechPros, Inc. · Raleigh, NC · On-site · Posted 19 Nov 2026 🇺🇸
MicroservicesSQLEncryption+5TechnologySalary not listed - NT
Product Development AI Engineer - Software Quality Management\Recently posted
Northern Trust · Chicago, IL · Hybrid · Posted 20 Nov 2026 🇺🇸
DockerFastAPIMicroservices+12Technology$73.5k - $117.7k/yr - JG

CORP - Lead AI EngineerRecently posted
Judge Group, Inc. · Houston, TX · Hybrid · Posted 20 Nov 2026 🇺🇸
Stakeholder ManagementGitC#+7Technology$65 - $75/hr - CR
Senior AI Technical LeadRecently posted
Credence · Mc Lean, VA · Hybrid · Posted 18 Nov 2026 🇺🇸
DockerGCPGit+13Technology$185k - $215k/yr - RH

Senior AI EngineerRecently posted
Robert Half · Los Angeles, CA · Hybrid · Posted 20 Nov 2026 🇺🇸
PythonSystem DesignTechnologySalary not listed