Haystack
← Back to Jobs
Technology
OT

AI/ML Engineer

Oscar TechnologyNew York, NY🇺🇸United StatesPosted 9 Sept 2026

Why This Role Stands Out

This role offers an exciting opportunity to drive impactful AI and ML initiatives across a leading enterprise, providing significant career growth and skill development in generative AI. You'll thrive here if you're a mid-to-senior engineer eager to collaborate with stakeholders and deploy innovative solutions that automate workflows and enhance productivity. Apply now to shape the future of AI within a respected organization that offers a hybrid work model for flexibility.

Quick Overview

Seniority
Mid Senior
Work mode
On Site
Location
New York, NY, United States
Posted
8 hours ago
MLOpsMachine LearningAzureC#Databricks.NETGenerative AIPowerShell

Job Description



Title: Senior AI Engineer (Hybrid - NYC)


Location: Greater New York City Area (3 days/week on-site)


Position Type: Full-Time



About the Role


A leading enterprise organization is seeking a Mid-to-Senior AI Engineer to drive generative AI and machine learning initiatives across core corporate verticals, including Finance, Compliance, HR, and Operations. You will work directly with business stakeholders to design, deploy, and optimize high-impact AI solutions, automate workflows, and boost user productivity across the enterprise.



Key Responsibilities




  • Design, build, and deploy generative AI and machine learning models tailored to real-world corporate use cases.




  • Create and optimize prompts, embeddings, vector search, and retrieval-augmented generation (RAG) strategies.




  • Construct and maintain robust pipelines for model training, evaluation, and inference using standard MLOps best practices.




  • Collaborate with business leaders to translate complex, high-value requirements into functional, scalable AI applications.




  • Ensure responsible AI practices, focusing on data privacy, model governance, and transparency.





Required Qualifications




  • 5-7 years of hands-on experience building AI/ML solutions within enterprise environments.




  • Strong Proficiency: Deep technical expertise with C# and .NET.




  • Generative AI & RAG: Demonstrated experience in prompt engineering, embeddings, and retrieval-augmented generation architectures.




  • Cloud & Tools: Experience using Azure OpenAI, Azure Machine Learning, or equivalent platforms.




  • Data Processing: Proven track record working with both structured and unstructured, text-heavy datasets.





Preferred Qualifications




  • Hands-on experience with vector databases, semantic search platforms, and frameworks like LangChain.




  • Experience with Databricks, large-scale data processing, and cloud automation (Azure Functions, PowerShell).




  • Active Microsoft or AI-related certifications.





If you think you'd be a good fit we'd love to hear from you!



Oscar Associates Limited (US) is acting as an Employment Agency in relation to this vacancy.

Similar jobs