Quick overview
Job description
An enterprise client is currently seeking experienced software engineers to contribute to improving advanced AI systems through human feedback. This work supports leading AI organizations in training large language models to better understand software development practices, debugging, and code quality.
This is part of a cutting-edge initiative focused on enhancing how AI systems write, review, and optimize code in real-world scenarios. You’ll play a key role in shaping how AI models evaluate performance, detect issues, and generate reliable outputs.
This opportunity is ideal for engineers who enjoy analyzing systems, improving code quality, and working on complex technical challenges. You will contribute to AI training projects by evaluating outputs, refining logic, and identifying potential vulnerabilities.
What You'll Do:
- Develop objective, verifiable evaluation criteria (rubrics) for system performance
- Review system logs and execution paths to improve reliability and code quality
- Refactor code and optimize system behavior toward ideal outcomes
- Test systems for vulnerabilities, including data exposure and edge-case failures
- Provide detailed, high-quality feedback on system performance and outputs
Requirements:
- 2+ years of experience in backend engineering, AI automation, or systems integration
- Strong proficiency in at least two programming languages (e.g., Python, JavaScript, Go, Java)
- Experience working with SQL databases
- Proven ability to build and maintain production-grade systems
- Experience working in live (non-mocked) environments with multi-step interactions
- Strong analytical skills and attention to detail
Nice to Haves:
- Experience with multi-stage system workflows and coordination tasks
- Familiarity with integrating tools such as APIs, databases, or external platforms
- Understanding of system vulnerabilities (e.g., privacy leaks, prompt injection, access escalation)
- Experience working with AI systems or agent-based workflows
- Comfort working with persistent state tracking or similar frameworks
- Fully remote and flexible work schedule
- Project-based engagement with no guaranteed hours
- Work on tasks based on availability and project assignment
- Payment is based on completed tasks only
- Must accept project invitations before beginning work
- Freelancers may accept or decline tasks depending on availability
- No guaranteed workload; volume may vary weekly
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- WA
AI Research EngineerRecently posted Auto Apply
Weekday AI · Bengaluru, Karnataka · On-site · Posted 21 Nov 2026 🇮🇳
DockerGitNumPy+7Salary not listed - B2
Lead AI Engineer I - R01573927Recently posted Auto Apply
Brillio 2 · Bengaluru · Hybrid · Posted 20 Nov 2026 🇮🇳
DockerMicroservicesOracle+13TechnologySalary not listed - CA

AI Engineer Auto Apply
Capco · Pune · Hybrid · Posted 12 Nov 2026 🇮🇳
MicroservicesSQLAWS+14TechnologySalary not listed - OA

Intern - Gen AIRecently posted Auto Apply
Oaknorth · Gurugram · Hybrid · Posted 18 Nov 2026 🇮🇳
Microsoft ExcelNPSNotion+4Salary not listed - TA

AI Infrastructure System EngineerRecently posted Auto Apply
Together AI · Bengaluru · Hybrid · Posted 17 Nov 2026 🇮🇳
RustAnsibleCUDA+5TechnologySalary not listed - GR
AI AssociateRecently posted Auto Apply
group.one · Ahmedabad · Hybrid · Posted 17 Nov 2026 🇮🇳
Digital MarketingGenerative AISalary not listed - SI
AI Architect (Product Architecture)Recently posted Auto Apply
Sia · Mumbai, Maharashtra · On-site · Posted 17 Nov 2026 🇮🇳
Generative AITechnologySalary not listed - BG
AI ArchitectRecently posted Auto Apply
Bosch Group · bengaluru · On-site · Posted 16 Nov 2026 🇮🇳
DockerGCPMongoDB+23TechnologySalary not listed - BA

AI EngineerRecently posted Auto Apply
Backbase · Hyderabad · Hybrid · Posted 19 Nov 2026 🇮🇳
LLMPythonGenerative AI+1TechnologySalary not listed - SH

Senior AI Product Builder (Pricing)Recently posted Auto Apply
ShipBob, Inc. · India · Remote · Posted 19 Nov 2026 🇮🇳
FigmaCustomer SuccessReconciliation+3Salary not listed - OR

AI Engineer– Microsoft FoundryRecently posted Auto Apply
Orbia · Pune · On-site · Posted 17 Nov 2026 🇮🇳
Microsoft OfficeGitApache Spark+20TechnologySalary not listed - OR

Lead Data & AI Engineer – Databricks Data Analytics & Agent BricksRecently posted Auto Apply
Orbia · Pune · Hybrid · Posted 17 Nov 2026 🇮🇳
SQLGitApache Spark+26TechnologySalary not listed