Quick overview
Job description
Company
Pramaana Labs is a frontier AI lab building the verification layer for AI. Founded in 2025 and headquartered in Palo Alto, we turn complex human knowledge, including tax codes, legal rules, clinical guidelines and security protocols, into a formal representation, so every AI answer can be traced, challenged, and proved. Pramaana's architecture pairs foundation models trained to formalize and reason with a symbolic world model encoded in Lean 4. Pramaana was founded by a team out of Google, DeepMind, and Glean, combining frontier AI researchers and formal methods experts.
The Role
QA/SDET (Software Development Engineer in Test) for a rules-to-proof product. You test every stage of the pipeline, from rule input through formal specs, prover output and proof artifacts to the customer-facing APIs and proof viewers. You raise clear, reproducible defects and verify fixes.
Focus areas: Corner cases and security risks, including exceptions, thresholds, conflicting rules, unsatisfiable inputs, malformed or malicious input, and access and data-handling issues.
Long-term goal: Automate these tests so problems are flagged without manual intervention.
What You'll Do
Test the different parts of the product for functionality, from rule input through formal specs, prover output and proof artifacts to the customer-facing APIs and proof viewers. Raise clear, reproducible defects and verify fixes.
Cover corner cases and potential security issues, including exceptions, thresholds, conflicting rules, unsatisfiable inputs, malformed or malicious input, and access and data-handling risks.
As time goes on, work on automating these tests so that these are flagged without manual intervention.
You Will Thrive in This Role If You Have
3+ years in QA, SDET or ML/LLM evaluation, hands-on test automation experience (Python preferred)
Experience testing non-deterministic or data-heavy systems (LLMs, ML pipelines, rules engines).
Automation and CI/CD experience (pytest or similar, GitHub Actions or Jenkins).
Logical rigor: edge cases, constraints, counterexamples.
Ability to turn dense rule-based text into precise test cases, and to write clear bug reports.
Especially Strong Candidates May Also Have
LLM eval and benchmark design.
Tax, law or compliance background.
Property-based testing and API testing.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Similar jobs
- ME

QA EngineerRecently posted Auto Apply
Metaforms · Bengaluru · On-site · Posted 16 Nov 2026 🇮🇳
SQLSeleniumMarket Research+5TechnologySalary not listed - CA

UAT TestingRecently posted Auto Apply
Capco · Mumbai · Hybrid · Posted 15 Nov 2026 🇮🇳
LLMPlaywrightRoot Cause Analysis+3Salary not listed - F7
Systems Test Engineer Auto Apply
F7d8749a 72d6 407c Bf98 292ea630c73a · Bengaluru · Hybrid · Posted 21 Oct 2026 🇮🇳
RoboticsPythonCI/CD+2TechnologySalary not listed - WA
QA EngineerRecently posted Auto Apply
Weekday AI · India · Remote · Posted 14 Nov 2026 🇮🇳
MicroservicesGitCompliance+9TechnologySalary not listed - YA

Senior SDETRecently posted Auto Apply
YipitData (Alternative) · India Remote · Remote · Posted 14 Nov 2026 🇮🇳
DockerSQLSelenium+12TechnologySalary not listed - YI

Senior SDETRecently posted Auto Apply
YipitData · India Remote · Remote · Posted 14 Nov 2026 🇮🇳
DockerSQLSelenium+12TechnologySalary not listed - CO

Principal QE Engineer/Architect - Automation Testing (10+ Years)- 11936 Auto Apply
Coupa · Pune · Hybrid 🇮🇳
Stakeholder ManagementEngineeringSalary not listed - PR
Quality Assurance EngineerRecently posted Auto Apply
Provenirinc · Bengaluru · Remote · Posted 13 Nov 2026 🇮🇳
OnboardingDockerGCP+32TechnologySalary not listed - WE

Associate Testing QA Engineer Auto Apply
Weloglobal · Gurugram · On-site 🇮🇳
PythonVBAVideo EditingTechnologySalary not listed - NI
Associate Software Test Engineer (Playwright, Typescript/ Javascript)Recently posted Auto Apply
NielsenIQ · Pune, MH · On-site · Posted 13 Nov 2026 🇮🇳
ScrumRoot Cause AnalysisGenerative AI+1TechnologySalary not listed - EN
Senior Automation Tester with AI Agent Testing experienceRecently posted Auto Apply
Endava · Bengaluru, Karnataka · Hybrid · Posted 12 Nov 2026 🇮🇳
PlaywrightTechnologySalary not listed - SC

Intern - QA Engineer - Royal Lounge CasinoRecently posted Auto Apply
Scopely · Bengaluru · Hybrid · Posted 13 Nov 2026 🇮🇳
Microsoft ExcelMicrosoft OfficeMicrosoft PowerPoint+1TechnologySalary not listed
