Quick overview
Job description
About Collinear
Collinear builds the environments, tasks and evaluations that AI teams use to train and test their agents. Our benchmark, CWE-bench (cwe-bench.com), has 100 audit-and-patch tasks across 54 weakness types, where agents must find and fix vulnerabilities in real codebases. It is part of Artificial Analysis's Cyber Index. We work with frontier labs on their models' cyber capabilities, and we're bringing the same defensive evaluations to enterprise security teams.
About the role
As a Cybersecurity Product Engineer, you will decide what good security work looks like for the AI agents our customers train and evaluate. You'll work directly with frontier labs and enterprise security teams to find the security problems that matter most to them, and turn them into products and evaluations that reflect how security work is actually done.
This is a senior, hands-on role at the intersection of security, product, engineering and research. You'll help shape our cybersecurity roadmap, and what you build will be used by the teams training the most capable AI models.
What you'll do
Find the real problem. Talk with customers and practitioners about how they run vulnerability management and incident response today, and turn what you learn into product priorities.
Build and ship. With engineering and research, take a defensive capability such as vulnerability discovery, patch generation or alert triage from an idea to something that runs end to end for a customer.
Make evaluations hold up. Design scenarios on real codebases and infrastructure with a realistic attack surface. Define what a correct root-cause analysis or remediation looks like, and how to verify it.
Make results trustworthy. Make sure a task can only be passed by doing the real work, and that a verifier accepts a patch only when the exploit no longer works and legitimate behavior still does.
Learn from the agents. Study how agents perform on security tasks and use what you find to improve the product.
Set the bar. Review technical approaches and outputs against one question: would a security team trust this in production?
What we're looking for
10+ years of hands-on cybersecurity experience.
Depth in at least one of: application security, vulnerability research, security engineering, incident response and forensics, or cloud security.
You read code. You can review a patch and tell whether it actually fixes the vulnerability.
You've found real bugs yourself, through code review, fuzzing or exploit development.
You've built or shaped tools, products or workflows that security practitioners used, such as scanners, detection pipelines or internal AppSec tooling.
You work well with software engineers and researchers. You can explain a security problem, what it costs, and how you'd show it's solved.
You're comfortable at an early-stage company: ambiguous problems, real ownership, moving from idea to shipped.
Nice to have
Experience working with enterprise security teams or directly with customers.
CVEs, published advisories or bug bounty findings to your name.
Familiarity with security benchmarks, CWE and CVE taxonomies, SAST/DAST, or automated exploit and patch verification.
Experience with AI agents, LLM evaluations or AI-assisted security work. This isn't required; we'll teach you the AI side.
How we work
A small, technical team. You'll work directly with the founders.
In person in Sunnyvale or San Francisco.
We move fast.
Collinear is an equal opportunity employer and values diversity. We do not discriminate on the basis of race, color, religion, sex, gender identity, sexual orientation, national origin, age, disability, veteran status, or any other characteristic protected by applicable law.
The base salary range for this role in California is $150,000 to $400,000 per year, depending on experience, skills, and qualifications. This role will also be eligible for equity, benefits, and bonuses.
Collinear provides reasonable accommodations for candidates with disabilities throughout the application and hiring process. If you need an accommodation, please contact us.
Pursuant to applicable local ordinances, we will consider qualified applicants with arrest and conviction records.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- PA

Senior Application Security EngineerRecently posted Auto Apply
Paxos · Remote - United States · Remote · Posted 18 Nov 2026 🇺🇸
AWSSmart ContractsAuditing+8TechnologySalary not listed - KG

Cybersecurity Integration Architect Consultant - Mergers & AcquisitionsRecently posted Auto Apply
Kalles Group · Seattle · Hybrid · Posted 18 Nov 2026 🇺🇸
OnboardingComplianceTechnology$170k - $190k/yr - GO

Software Engineer, AI TransformationRecently posted Auto Apply
Goodleap · Austin · Remote · Posted 19 Nov 2026 🇺🇸
Microsoft OfficeAWSDatabricks+7Technology$106.1k - $145.1k/yr - FR
Senior Software Engineer - Javascript- AD TECH EXPERIENCE REQUIRED (Remote- US only)Recently posted Auto Apply
Freestar · Remote- US only · Remote · Posted 19 Nov 2026 🇺🇸
BigQueryConcreteGPT+3TechnologySalary not listed - AR

Senior Red Team Operator, NetworkRecently posted Auto Apply
Armadin · Palo Alto · On-site · Posted 18 Nov 2026 🇺🇸
GCPAWSActive Directory+9TechnologySalary not listed - TE

Senior Software Engineer, IAMRecently posted Auto Apply
Temporal · Seattle · Remote · Posted 18 Nov 2026 🇺🇸
RustGoogle WorkspaceOAuth+10TechnologySalary not listed - RE
Software Engineering Manager, ProductRecently posted Auto Apply
Rebar · New York City · On-site · Posted 19 Nov 2026 🇺🇸
DynamoDBSQLAWS+9TechnologySalary not listed - CO

Director, Information Technology K - 12Recently posted Auto Apply
Corebts · Hempstead · Remote · Posted 19 Nov 2026 🇺🇸
BudgetingData PrivacyEducational Technology+4Technology$140k - $165k/yr - BL

Senior Full Stack Software Engineer - Shared Services Auto Apply
Bluesight · United States - Remote · Remote · Posted 4 Nov 2026 🇺🇸
DynamoDBFastAPIRuby+6Technology$130k - $145k/yr - AU

Change Management Advisor - Train Automotive Sales Software to Dealership Sales & Finance teamsRecently posted Auto Apply
Autofi · Remote · Hybrid · Posted 18 Nov 2026 🇺🇸
Technology$100k - $110k/yr - TT
Senior/Staff EngineerRecently posted Auto Apply
True Talent Solutions Partners · San Francisco · On-site · Posted 19 Nov 2026 🇺🇸
SourcingAWSPython+2Technology$200k - $280k/yr - TT
Forward Deployed Software Engineer, Tactical EdgeRecently posted Auto Apply
True Talent Solutions Partners · Palo Alto · On-site · Posted 19 Nov 2026 🇺🇸
Load BalancingBashJava+4Technology$135k - $200k/yr
