Why this role stands out
Accelerate your career by shaping the future of artificial intelligence in this high-impact, fully remote role that offers a highly competitive rate of up to $200/hour. If you are a detail-oriented engineer with a passion for code quality and algorithmic problem-solving, this is the perfect environment to refine your technical expertise and make a tangible difference in AI development. Apply now to join an innovative team and take a major step forward in your professional journey.
Quick overview
Job description
This role is for one of our clients
Pay: 150–200/hour
Role Type: Contractor
Location: Remote
We are seeking a motivated and detail-oriented Junior Software Engineer to contribute to the evaluation and improvement of advanced artificial intelligence systems. This opportunity is ideal for early-career software engineers with strong programming fundamentals, analytical thinking, and practical experience developing and reviewing software applications.
In this role, you will evaluate AI-generated code for correctness, quality, efficiency, and design. You will create challenging programming problems, develop reference solutions and test cases, and assess AI models' ability to solve real-world software engineering challenges. You will also review technical reasoning related to debugging, architecture, and system design, providing structured feedback to improve the reliability and performance of AI-generated solutions.
The ideal candidate has professional software engineering experience, a solid understanding of programming principles, and the ability to explain technical decisions clearly. Prior experience in artificial intelligence is not required.
Key Responsibilities
- AI-Generated Code Evaluation: Review AI-generated code for functional correctness, readability, maintainability, efficiency, and adherence to software engineering best practices.
- Coding Problem Development: Design challenging programming problems that assess algorithmic thinking, debugging skills, implementation quality, and practical engineering judgment.
- Reference Solution Creation: Develop accurate, well-structured reference solutions that demonstrate effective approaches to solving software engineering problems.
- Test Case Development: Create comprehensive test cases to validate functionality, identify edge cases, and detect incomplete or incorrect implementations.
- Technical Reasoning Assessment: Evaluate AI-generated explanations and decisions involving software architecture, system design, debugging, and implementation strategies.
- Code Quality Analysis: Identify bugs, inefficient algorithms, poor design choices, security concerns, and violations of established coding standards.
- Technical Feedback: Provide detailed, actionable feedback explaining errors, weaknesses, and opportunities to improve code quality and model performance.
- Documentation: Clearly document problem requirements, expected behavior, solution approaches, testing procedures, and technical evaluation findings.
- Quality Assurance: Ensure that coding tasks, reference solutions, and evaluation criteria are accurate, consistent, and reproducible.
Required Qualifications
- At least one year of professional experience as a software engineer at a well-established technology company.
- At least part of the relevant professional experience should have been gained within the past three years.
- Strong understanding of programming fundamentals, data structures, algorithms, and object-oriented programming.
- Practical experience writing, debugging, testing, and reviewing code.
- Familiarity with software development practices, including version control, code reviews, testing, and debugging.
- Ability to assess code for correctness, performance, readability, and maintainability.
- Foundational understanding of software architecture and system design principles.
- Strong analytical and problem-solving skills.
- Excellent written communication skills, with the ability to explain technical decisions and complex engineering concepts clearly.
- Ability to work independently and deliver accurate, high-quality technical assessments.
Must-Have Skills
- Software Engineering Fundamentals
- Programming and Coding
- Data Structures and Algorithms
- Code Review and Quality Assessment
- Debugging and Troubleshooting
- Automated Testing and Test Case Development
- Problem-Solving and Logical Reasoning
- Technical Documentation and Written Communication
Good-to-Have Skills
- Python, Java, C++, JavaScript, TypeScript, Go, or similar programming languages
- Object-Oriented Programming and Design Patterns
- API Development and Backend Engineering
- Software Architecture and System Design
- Performance Optimization and Profiling
- Git and Version Control
- Unit Testing and Integration Testing
- CI/CD and Software Development Workflows
- AI-Generated Code Evaluation
- Familiarity with AI coding assistants and model benchmarking
Preferred Qualifications
- Professional software engineering experience at a recognized technology company.
- Experience developing and maintaining production-quality applications, services, or APIs.
- Familiarity with reviewing complex codebases and identifying implementation weaknesses.
- Experience designing coding exercises, technical assessments, or automated evaluation tests.
- Candidates based in English-speaking countries are preferred.
- Ability to communicate technical findings in clear, structured, and concise English.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- RG

Anti-Cheat Engineering Intern (Masters/PhD) - Summer 2027Recently posted Auto Apply
Riot Games · Los Angeles · Hybrid · Posted 11 Nov 2026 🇺🇸
GitComplianceC+++1EngineeringSalary not listed - PS
Member of Technical Staff, Performance EngineeringRecently posted Auto Apply
Psi · Boston · Hybrid · Posted 11 Nov 2026 🇺🇸
CFDEngineeringSalary not listed - PC

Software Engineer – ML InfrastructureRecently posted Auto Apply
People Culture Talent · San Francisco · On-site · Posted 11 Nov 2026 🇺🇸
PyTorchSchedulingMachine LearningTechnologySalary not listed - PA

GTM EngineerRecently posted Auto Apply
Partsbase · Remote-United States · Remote · Posted 11 Nov 2026 🇺🇸
OnboardingLookerTableau+12EngineeringSalary not listed - PI

Engineering InternRecently posted Auto Apply
Parabola Io · San Francisco · On-site · Posted 11 Nov 2026 🇺🇸
LLMReconciliationEngineeringSalary not listed - IR
Software Engineer - USRecently posted Auto Apply
Irissoftwaregroup · IRIS United States · Remote · Posted 11 Nov 2026 🇺🇸
DockerDynamoDBMicroservices+27TechnologySalary not listed - CR

Lead Test Architect / Principal Software Engineer – Unit Test DevelopmentRecently posted Auto Apply
CFD Research Corporation · Huntsville · Hybrid · Posted 11 Nov 2026 🇺🇸
CFDC++TechnologySalary not listed - TT
Lead Product EngineerRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 11 Nov 2026 🇺🇸
Next.jsFigmaReact$225k - $275k/yr - TT
Product EngineerRecently posted Auto Apply
True Talent Solutions Partners · Palo Alto · On-site · Posted 11 Nov 2026 🇺🇸
SQLA/B TestingAmplitude+5$185k - $205k/yr - TT
Software Engineer, iOSRecently posted Auto Apply
True Talent Solutions Partners · New York · On-site · Posted 11 Nov 2026 🇺🇸
Objective-CSwiftXcode+2Technology$130k - $230k/yr - TT
Founding Forward Deployed EngineerRecently posted Auto Apply
True Talent Solutions Partners · California · On-site · Posted 11 Nov 2026 🇺🇸
Account ManagementPythonTypeScriptEngineering$187k - $225k/yr - TT
Senior Software Engineer, Autonomous SystemsRecently posted Auto Apply
True Talent Solutions Partners · Palo Alto · On-site · Posted 11 Nov 2026 🇺🇸
RustRoboticsC+++3Technology$145k - $275k/yr