Back to Jobs
Recently postedRemoteTechnology

Cybersecurity SME

JSM ConsultingUnited States🇺🇸United States

Quick overview

Salary$65 - $70/hr
SeniorityMid Senior
Work modeRemote
LocationUnited States
AWSOWASPGoogle CloudLLMPenetration TestingPythonAzure

Job description

Job description

Cybersecurity SME, AI Red Team to apply offensive security expertise to evaluating AI models and coding agents for cybersecurity risks and unsafe capabilities.

In this role, you'll test AI models and coding agents in sandboxed environments to identify vulnerabilities and assess their ability to generate harmful offensive cyber tools. You'll evaluate findings against established safety specifications, develop testing methodologies, and provide actionable recommendations to engineering and safety teams. The role will also expand into agent and harness red-teaming as evaluation capabilities evolve.

The ideal candidate has strong offensive security experience, hands-on knowledge of exploit development and malware, and an understanding of AI models and agents. They're analytical, creative, and skilled at evaluating technical risks, documenting findings, and communicating complex security issues across teams.

As a Cybersecurity SME, AI Red Team , you'll:

  • Red-team AI coding agents in sandboxed environments, using iterative testing techniques to evaluate whether models can generate offensive tools, including exploits, malware, and attack tooling.
  • Assess model outputs against safety specifications, determine violations and severity, and identify when further testing is needed.
  • Define and refine criteria for unsafe capability uplift, identifying ambiguous cases and gaps in existing safety specifications.
  • Evaluate model capabilities in vulnerability discovery, exploit development, and malware analysis, verifying whether generated tools function as intended.
  • Investigate agent-specific vulnerabilities, including prompt injection, tool misuse, and privilege escalation, as testing expands to agent and harness environments.
  • Develop realistic attack scenarios and evaluation datasets, reviewing expert-written prompts and model outputs for technical accuracy.
  • Document security findings, including severity, reproduction steps, and recommended mitigations, and communicate results to engineering and safety teams.
  • Map findings to established frameworks, including MITRE ATLAS, OWASP Top 10 for LLM Applications, and NIST AI Risk Management Framework (AI RMF).
  • Train and mentor red teamers and annotators on cybersecurity concepts while staying current on emerging AI attack techniques.

Qualification:

● Recognized certifications or proof of skill (OSCP, OSEP, GPEN, or published CVEs, CTF results, bug-bounty record).

● Prior AI/ML security, adversarial ML or model-evaluation experience.

● Experience in government, defense, intelligence or critical-infrastructure security.

● Malware reverse engineering, cloud security (AWS, Google Cloud Platform, Azure) or secure software development background.

● Conference talks, research papers or open-source security tooling.

Responsibilities

● Red-team coding agents in sandboxed environments: converse with the agent and use creative, iterative pressure to push the model into producing offensive tools such as exploits, malware and attack tooling.

● Judge each attempt against the spec: decide whether the output is a violation, whether it meets the bar, and whether to keep pushing. This judgment call is central to the role.

● Define and refine what counts as unsafe uplift, and flag gray areas and gaps in the spec for the team to resolve.

● Evaluate model capability on offensive cyber tasks such as vulnerability discovery, exploit development and malware analysis, and verify that generated tools actually work.

● Probe agent-specific weaknesses, including prompt injection, tool abuse and privilege escalation through agent actions, as our work moves toward harness and agent red teaming.

● Build realistic attack scenarios and evaluation datasets, and review expert-written prompts and model outputs for technical accuracy.

● Write clear findings with severity, reproduction steps and recommended mitigations, and brief engineering and safety teams on them.

● Map findings to frameworks such as MITRE ATLAS, OWASP Top 10 for LLM Applications and NIST AI RMF.

● Train and mentor red teamers and annotators on cybersecurity concepts, and keep the team current on new AI attack techniques.

Required skills

● 2+ years in offensive security: penetration testing, red teaming, vulnerability research or exploit development.

● Hands-on offensive tradecraft (exploit development, malware, post-exploitation, web and cloud attacks) and scripting ability (Python preferred), enough to judge whether model generated tools really work.

● Working understanding of how LLMs and agents work, and of common attack classes against them.

● Strong written communication: you can explain a technical risk to researchers and executives.

Pay: $65.00 - $70.00 per hour

Expected hours: 40.0 per week

Work Location: Remote

Will your resume get past this employer's screening? Check your resume against this job, free

Similar jobs