Haystack
← Back to Jobs
Technology
BYByteware Inc. logo

ML Engineer

Byteware Inc.New York, NY🇺🇸United StatesPosted Oct 15, 2026

Quick Overview

Seniority
Mid Senior
Work mode
Hybrid
Location
New York, NY, United States
Posted
22 hours ago
AWSETLGPTLLMPython

Job Description

Role: ML Engineer

Location: Manhattan, NYC (Hybrid)

Contract

 

Key Responsibilities 

  • Design and maintain LLM integrations using OpenAI APIs within AWS environments.
  • Build Python-based LLM services deployed on AWS compute platforms (ECS, EKS, Lambda, or EC2).
  • Implement RAG workflows and semantic search using AWS data and storage services.
  • Develop LangChain or agentic workflows supporting reasoning and tool use.
  • Integrate LLM pipelines with ETL/ELT workflows and enterprise data systems.
  • Deploy and integrate MCP servers and emerging orchestration tools.
  • Apply AWS security best practices using IAM, KMS, and Secrets Manager.
  • Implement monitoring and observability using CloudWatch and related tools.
  • Migrate custom GPT solutions into production-grade AWS-hosted assistants.

 

Ideal Candidate Profile

  • 4-7+ years in software, ML, or applied AI engineering.
  • Strong Python proficiency.
  • Experience with RAG and semantic search.
  • Hands-on OpenAI LLM integration experience.
  • Experience deploying systems in AWS (S3, Lambda, ECS/EKS, IAM).

Similar jobs