Quick overview
Job description
We are recruiting for an AI & Solution Testing Analyst in the Legal, Risk Management and Compliance (LRMC) team.
Roles & responsibilities
We are recruiting for an AI & Solution Testing Analyst in the Legal, Risk Management and Compliance (LRMC) team.
• Test Planning & Execution: Develop and execute structured test plans, scenarios and cases for AI-enabled applications, low-code agents and digital solutions.
• AI Output Evaluation: Assess agent responses for accuracy, relevance, consistency, safety, reliability and alignment with approved requirements and expected outcomes.
• Solution Testing: Perform functional, regression, integration, system, usability and edge-case testing across data engineering solutions, Power Platform applications, web applications and reporting solutions.
• Defect Management: Document defects with clear evidence, severity and reproduction steps; track remediation and verify fixes through retesting.
• Requirements Traceability: Review business and technical requirements, define acceptance criteria and maintain traceability between requirements, test coverage and results.
• Automation & Reusability: Identify opportunities for test automation and establish reusable test assets, checklists, standards, metrics and reporting templates.
• Collaboration & Quality Governance: Work with developers, product owners, data engineers and business stakeholders to support release readiness and continuous quality improvement.
• Documentation & Reporting: Maintain test evidence, defect dashboards, quality metrics, release recommendations and knowledge-transfer documentation.
Mandatory technical & functional skills
• 2-3 years of hands-on experience in software testing, quality assurance and defect management for enterprise digital solutions.
• Experience testing AI-enabled applications, copilots or low-code agents, including structured evaluation of outputs for accuracy, relevance, consistency and reliability.
• Strong knowledge of functional, regression, integration, system, usability, end-to-end and edge-case testing techniques.
• Ability to create test strategies, test plans, test scenarios, test cases, test data, acceptance criteria and requirements traceability.
• Experience documenting, prioritizing and tracking defects through resolution, retesting and closure using a test or work-management tool.
• Working knowledge of testing solutions built with Microsoft Power Platform, including Power Apps, Power Automate and Copilot Studio.
• Ability to validate data engineering pipelines and transformations using SQL, including source-to-target checks, reconciliation and data-quality testing.
• Experience testing web applications, APIs and system integrations, including browser compatibility and negative testing.
• Experience validating reports and dashboards for data accuracy, calculations, filters, refresh behavior and usability.
• Strong analytical thinking, attention to detail, documentation and stakeholder communication skills in an Agile delivery environment.
Preferred technical & functional skills
• Experience evaluating AI-enabled applications and low-code agents through prompt testing, grounded Ness checks, hallucination detection, response consistency, safety validation and human-in-the-loop testing.
• Hands-on experience testing Microsoft Power Platform solutions, including Power Apps functionality and usability, Power Automate workflow execution and exception handling, and Copilot Studio agent behavior.
• Experience validating Databricks and data engineering solutions through source-to-target checks, transformation validation, reconciliation, data-quality rules, job execution and failure scenarios.
• Experience testing web applications and REST APIs using tools such as Playwright, Selenium or Postman, including UI, browser compatibility, integration, negative and end-to-end testing.
• Experience validating Power BI reports and dashboards for data accuracy, calculations, filters, drill-through behavior, security, refresh results, performance and usability.
• Exposure to automated regression testing, CI/CD quality checks and defect tracking using Azure DevOps, GitHub or similar test and work-management tools.
• Knowledge of performance, accessibility, security and user-acceptance testing, with the ability to create reusable test packs, scorecards, quality metrics and release-readiness criteria.
Haystack's AI agent can fill in and submit this application for you. How AI auto apply works
Will your resume get past this employer's screening? Check your resume against this job, free
Similar jobs
- ZE

Senior Product Specialist - Implementation/OnboardingRecently posted Auto Apply
Zenoti · Hyderabad · Hybrid · Posted 18 Nov 2026 🇮🇳
Microsoft OfficeHTMLCRM+4Salary not listed - WI
Senior Product AnalystRecently posted Auto Apply
Wise · Hyderabad · On-site · Posted 18 Nov 2026 🇮🇳
OnboardingComplianceKYC+1Salary not listed - SS
SAP PP/QM Senior Functional AnalystRecently posted Auto Apply
Sopra Steria · Noida, Uttar Pradesh, UTTAR PRADESH · Hybrid · Posted 17 Nov 2026 🇮🇳
JiraTechnologySalary not listed - ST

Strategy and Analytics Business PartnerRecently posted Auto Apply
Stripe · Bengaluru · Hybrid · Posted 17 Nov 2026 🇮🇳
SQLCFACPA+4Salary not listed - CO
EMEA SAP Functional Analyst – Finance O2C | BangaloreRecently posted Auto Apply
Colliers · Bengaluru, KA · On-site · Posted 17 Nov 2026 🇮🇳
Stakeholder ManagementJiraAgile+1TechnologySalary not listed - SG
SAP SD Functional AnalystRecently posted Auto Apply
Syngenta Group · Pune, MH · Hybrid · Posted 17 Nov 2026 🇮🇳
Continuous ImprovementJiraAgileTechnologySalary not listed - CA

HSSE&C Systems & Performance AnalystRecently posted Auto Apply
Castrol · Pune · Hybrid · Posted 17 Nov 2026 🇮🇳
RecruitingOnboardingMicrosoft Excel+6Salary not listed - B2
Senior Business Analyst, Consulting - R01573454Recently posted Auto Apply
Brillio 2 · Pune · Hybrid · Posted 17 Nov 2026 🇮🇳
SAFeMicroservicesSQL+16Operations & Project ManagementSalary not listed - SI

Oracle Fusion Order Management Analyst | 1640Recently posted Auto Apply
SiTime Corporation · Bengaluru · Hybrid · Posted 17 Nov 2026 🇮🇳
OracleScrumAssembly+8Salary not listed - SI

Analyst, Oracle Fusion SCM & Finance | 1641Recently posted Auto Apply
SiTime Corporation · Bengaluru · Hybrid · Posted 17 Nov 2026 🇮🇳
OracleMicrosoft ExcelMicrosoft Office+9FinanceSalary not listed - IN
Business Analyst - PBRRecently posted Auto Apply
IntegriChain · Pune, MH · Hybrid · Posted 16 Nov 2026 🇮🇳
Operations & Project ManagementSalary not listed - IN
Business Analyst - Government PricingRecently posted Auto Apply
IntegriChain · Pune, MH · Hybrid · Posted 16 Nov 2026 🇮🇳
Operations & Project ManagementSalary not listed