Quick overview
Job description
About the Company
A leading AGI infrastructure company working with frontier AI labs to accelerate model development through high-quality training data, evaluations, and engineering talent.
About the Role
We're looking for a high-taste engineer with a strong eye for quality. The ideal candidate will have hands-on experience with preference data and rubric creation, understanding what separates a good example from a great one.
You'll communicate clearly and be able to synthesise complex technical work in a concise, structured, and actionable way. You'll be comfortable working in ambiguous, fast-moving environments and have a bias towards shipping over deliberating.
What Does Day-to-Day Look Like?
- Design, refine, and iterate on rubrics and evaluation criteria for preference data.
- Review and label data to a high standard, identifying subtle issues others might miss.
- Build and maintain pipelines and infrastructure supporting data generation, collection, and evaluation workflows.
- Synthesise findings from data work into clear write-ups, updates, and recommendations.
- Collaborate closely with researchers and engineers to translate qualitative judgement into scalable processes.
Required Skills
- 5+ years of proficiency in Python, particularly building and maintaining pipelines and infrastructure, or TypeScript.
- Hands-on experience with preference data collection and/or rubric creation.
- Strong written and verbal communication skills, with the ability to distil technical work into clear, actionable summaries.
- Demonstrated high-quality judgement, with the ability to articulate why something is good, not just that it is.
Perks of the Contract
- Fully remote working environment.
- Opportunity to work on cutting-edge AI projects with leading LLM companies.
Similar jobs
- SC
Programmer I - Office Information TechnologyRecently posted
Syracuse City School District · Syracuse · Hybrid 🇺🇸
Special EducationTechnologySalary not listed - SU
Senior Software DeveloperRecently posted
Sun, Inc. · Southfield, MI, Oakland County, MI; Michigan · On-site 🇺🇸
SQLAWSC#+13TechnologySalary not listed - BO
Model-Based Systems Engineer (Experienced or Lead)Recently posted
Boeing · Berkeley, Missouri · Hybrid 🇺🇸
System DesignTechnology$112.2k - $151.8k/yr - AM

C, C++ Software Engineer IIRecently posted
APPLIED MATERIALS · Santa Clara, California · Hybrid 🇺🇸
MATLABC#.NET+3Technology$124k - $171k/yr - US

Mainframe CICS Systems Programmer SeniorRecently posted
USAA · Tampa, Florida · Hybrid 🇺🇸
TCP/IPCOBOLPhoenix+2Technology$114.1k - $218.0k/yr - BO
Senior Software Engineer - Lab Provisioning & IntegrationRecently posted
Boeing · Berkeley, Missouri · On-site 🇺🇸
DockerGitAWS+18Technology$160.7k - $217.3k/yr - US

Pega Software Engineer - Intermediate levelRecently posted
USAA · San Antonio, Texas · Hybrid 🇺🇸
SQLJavaPhoenix+1Technology$77.1k - $147.4k/yr - IN

Sr. SQL DBARecently posted
InfoLogitech, Inc. · Little Rock, AR · On-site 🇺🇸
SQLSQL ServerWindows ServerTechnologySalary not listed - FN

Systems EngineerRecently posted
First National Bank · Pittsburgh, PA · On-site 🇺🇸
VMwareProject ManagementTechnologySalary not listed - CI
Embeded Software EngineerRecently posted
Citronix Inc · Arlington, TX, Tarrant County, TX; Texas · Hybrid 🇺🇸
C++Machine LearningTechnology$115k/yr - GA

Lead Software EngineerRecently posted
GE Aerospace · Evendale, OH · Hybrid 🇺🇸
MATLABAssemblyPythonTechnologySalary not listed - GE

Application Programmer
Genesis10 · Pennington, NJ · Hybrid 🇺🇸
OracleMicrosoft ExcelMicrosoft PowerPoint+7$58 - $66/hr
