Start searching
Back to Jobs
Recently postedRemoteFull timeTechnology

AI QA Engineer at Innovecs

HooryaAustralia🇦🇺Australia

Quick overview

SeniorityMid Senior
Employment typeFull Time
Work modeRemote
LocationAustralia
AWSMLflowSeleniumCypressJavaLLMPlaywrightPythonAzureJavaScriptCI/CDRAG

Job description

Innovecs is a global digital services company with a presence in the US, the UK, the EU, Israel, Australia, and Ukraine. Specializing in software solutions, the Innovecs team has experience in Supply Chain, Healthtech, Collaboration Tech, and Gaming. Focus: application-layer LLM QA, and enterprise/AISDLC quality engineering.

Обов'язки
  • Design and execute quality strategies for AI-powered warehouse assistants, copilots, and autonomous agents
  • Build evaluation frameworks for LLM-based warehouse workflows and agentic systems
  • Perform hallucination, factuality, grounding, and response-quality testing
  • Validate RAG implementations and retrieval accuracy
  • Conduct adversarial testing, prompt injection testing, and jailbreak assessments
  • Create and maintain scalable automation frameworks for functional, API, integration, and end-to-end testing
  • Design CI/CD quality gates for AI and non-AI releases
  • Support compliance with EU AI Act, ISO 42001, and responsible AI principles
Вимоги
  • 5+ years of experience in Quality Assurance and Test Automation
  • 2+ years of experience testing AI-enabled applications, LLM solutions, or agentic systems
  • Strong Python/ Java/ Javascript skills
  • Experience with Playwright, Selenium, Cypress, or similar automation frameworks
  • Experience with API, integration, and database testing
  • Experience with CI/CD pipelines and DevOps practices
  • Understanding of AI-specific failure modes: hallucinations, prompt injection, jailbreak attacks, model drift, bias and fairness issues, RAG failures
  • Experience working in cloud-native environments (Azure or AWS)
  • Experience with LangSmith, Braintrust, MLflow, Arize, or Evidently AI
Буде плюсом
  • Background in Supply Chain, Logistics, WMS, TMS, OMS, or ERP platforms
  • ISTQB CT-AI certification or equivalent AI testing credentials
  • Contributions to AI testing frameworks or open-source projects
  • Leadership experience driving AI quality strategy across multiple teams
Що пропонуємо
  • Flexible hours and remote-first mode
  • Competitive compensation
  • Complete Hardware/Software setup - anything you need for work
  • Health insurance, vacation, sick leaves, holidays, paid maternity/paternity leave
  • Access to our learning & development center: workshops, webinars, training platform, and edutainment events
  • Virtual team buildings and social activities

Similar jobs

Apply