Haystack
← Back to Jobs
Technology
AV

AI / ML Software Engineer

Avanciers LLCMalvern, PA🇺🇸United StatesPosted Oct 8, 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
Malvern, PA, United States
Posted
17 hours ago
DockerMicroservicesAWSMLOpsMachine LearningNLPScikit-learnAzureDeep LearningGPTGenerative AIGoogle CloudKubernetesLLMPyTorchPythonTensorFlow

Job Description

AI / ML Software Engineer

Location: Malvern, PA

Job Overview

We are seeking a hands-on AI/ML Software Engineer to design, develop, deploy, and support production-grade Machine Learning, Generative AI, LLM, and NLP solutions. The ideal candidate will provide technical leadership, make architecture decisions, remain hands-on with development, and help establish scalable MLOps and engineering practices.

The role requires strong collaboration with technical and business stakeholders and the ability to communicate complex AI/ML concepts and solutions to both technical and non-technical audiences.

Key Responsibilities

  • Design, develop, deploy, and operate production-grade ML/LLM/GenAI solutions from concept through production.

  • Provide hands-on technical leadership, architecture guidance, design/code reviews, and engineering best practices.

  • Partner with product managers, data scientists, ML engineers, and business stakeholders to define and prioritize AI/ML use cases.

  • Build and enhance MLOps pipelines for model deployment, monitoring, lifecycle management, scalability, and reliability.

  • Develop and optimize generative AI models for NLP, summarization, and text-generation use cases.

  • Evaluate and improve generative models, including GPT-4.1 and other LLMs, for performance, quality, and reliability.

  • Implement model monitoring and evaluation frameworks to track performance and production reliability.

  • Mentor junior engineers through code reviews, design reviews, pairing, and technical coaching.

  • Leverage external AI/ML APIs, including OpenAI APIs, for production applications and integrations.

  • Stay current with emerging AI/ML/LLM/GenAI technologies and apply relevant techniques to business problems.

  • Communicate technical solutions, AI capabilities, and results effectively to technical and non-technical stakeholders.

Required Qualifications

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

  • 8+ years of software/engineering experience; 10+ years preferred.

  • 3–5+ years of hands-on experience building, deploying, and operating AI/ML systems in production.

  • Strong experience with Python and AI/ML development.

  • Experience with OpenAI API, prompt engineering, LLMs, and Generative AI.

  • Hands-on experience with TensorFlow, PyTorch, Scikit-learn, or similar ML frameworks.

  • Experience with AWS, Azure, or Google Cloud Platform and technologies such as Docker and Kubernetes.

  • Strong understanding of machine learning, statistics, deep learning, NLP, classification, regression, time series, and generative model architectures.

  • Experience with MLOps, model lifecycle management, monitoring, deployment, and governance.

  • Strong understanding of microservices architecture and performance optimization.

  • Demonstrated experience making architecture decisions, leading technical initiatives, conducting design/code reviews, and mentoring engineers.

  • Strong communication and collaboration skills with both technical and business teams.

  • Demonstrated experience delivering Generative AI/NLP solutions using OpenAI APIs and prompt engineering.

Preferred Qualifications

  • Experience within the financial services industry.

  • Hands-on experience designing and implementing Retrieval-Augmented Generation (RAG) pipelines.

  • Experience with advanced prompting strategies, including Chain-of-Thought, Tree-of-Thoughts, and Graph-of-Thoughts.

  • Experience with LLM evaluation, fine-tuning, optimization, and production monitoring.

  • Portfolio or demonstrated project experience implementing Generative AI/NLP solutions.

Similar jobs