Why Deterministic Evaluation Matters
- Ensures repeatability
- Enables auditability
- Supports regulatory compliance
- Eliminates random model behavior
- Guarantees consistent pass/fail gating
AiQT Platform Overview
Welcome to AiQT Labs
The Hands-On AI Evaluation Learning Environment
AiQT Labs is the dedicated practice environment for learners enrolled through AiVELabs Academy. Build real-world AI Quality, Governance, Evaluation, and Safety skills through guided labs, deterministic evaluations, test scenarios, and audit-ready evidence generation.
Learn. Practice. Evaluate. Prove.
Inside AiQT Labs, learners apply concepts from their courses through:
- AI evaluation scenarios
- Test execution workflows
- Legacy test import via AiQT Converter
- Policy expected-vs-actual reviews
- Frameworks, policies, and release gates
- Quality and governance checks
- Evaluation manifests and evidence packs
- Audit-ready reports
These modules unlock after subscription. AiVELabs learners arrive via SSO; direct subscribers purchase annual platform access ($199.99 for 365 days).
Quality Dashboard
Executive metrics, recent runs, and certification signals in one workspace
Applications
Register AUTs and industry catalogs your evaluations and policies attach to
Scenario Builder
Build scenarios, bind policies, run drift checks, export manifests
Test Execution Hub
Quick tests, YAML/JSON manifests, scheduling, and results history
AiQT Converter
Offline CLI: Gherkin, Xray, Zephyr, TestRail → READY_FOR_HITL JSON
Policy Scenario Viewer
NewCompare Expected (policy) vs Actual (AI) and record human oversight
Policies & Frameworks
Map NIST, ISO, and EU AI Act controls to industry transactions
Release Gate
Go / no-go decisions with sealed evidence and role-based sign-off
Data & Compliance Hub
Synthetic data tools and industry compliance workflows
AI Tools Stack
Chatbot, agentic, and LLM validators against your AUT
Audit Reports
Export PDF/CSV evidence packs for governance and release sign-off
Test Execution Hub
Run AI tests with confidence thresholds and repeatable manifests
Execute quick checks or full YAML/JSON manifest batches against your application under test. Schedule runs, review pass/fail gates, and track results from one hub — built for LLMs, chatbots, and agents.
- Quick test mode and manifest-driven batch execution
- Scheduled jobs and results history
- AUT connectors plus AI Tools Stack validators
- HITL ingest from AiQT Converter JSON
Ideal for regression before release, comparing prompt versions, and proving model behavior to governance teams.
Bring existing QA assets into AiQT without rewriting suites — convert once, upload into HITL, then evaluate and govern.
AiQT Converter
Turn legacy tests into AiQT-ready HITL JSON — offline
AiQT Converter is a standalone CLI companion (not a Cloud console module). It reads Gherkin features and test-management sources, emits READY_FOR_HITL JSON, and never calls AiQT APIs — so migration stays local until you choose to upload into Test Execution Hub / HITL.
- Gherkin
.feature→ governance test JSON - Connectors: Jira/Xray, Zephyr Scale, TestRail, qTest
- Human upload into HITL for policy binding and evaluation
Turn domain requirements into reusable test assets your whole team can run — not one-off scripts.
Scenario Builder
Design scenarios, catch prompt drift, export manifests
Scenario Forge guides you from policy context to executable test cases. Bind compliance rules, generate prompts, run drift checks, and export manifests ready for the Test Execution Hub.
- Wizard-driven scenario design with policy bindings
- Prompt drift detection before production
- Export to YAML/JSON for repeatable runs
Policy Assurance
From frameworks and policies to Expected vs Actual review
AiQT’s governance spine maps external rulebooks to your AI transactions, then proves alignment scenario-by-scenario. Policy Scenario Viewer puts Expected (policy) beside Actual (AI) so reviewers can certify outcomes with human oversight before Release Gate sign-off.
- Frameworks — NIST AI RMF, ISO/IEC 42001, EU AI Act, and related controls
- Policies — bind “what good looks like” to industry and transaction types
- Policy Scenario Viewer — Expected vs Actual compare with HITL audit trail
- Release Gate — go / no-go with sealed evidence and role-based approvals
Give governance and compliance leads a single place to answer: did this AI response meet the written policy — and who signed that judgment?
- Frameworks → Policies
- Policy Scenario Viewer
- Test Execution Hub
- Release Gate & Audit Reports
Audit Reports
Audit-ready PDF and CSV exports for release sign-off
Bundle evaluation evidence — readiness, safety, drift, and manifest summaries — into downloadable reports your compliance and engineering leads can review. Branded with the AiQT logo for stakeholder-ready delivery.
- PDF and CSV audit report bundles
- Section-level export controls
- Traceability from runs to report artifacts
Give auditors and release managers evidence they can file — not screenshots scattered across Slack.
Dashboard Metrics (Example)
Illustrative sample only — your live scores appear in the dashboard after you run tests.
What We Do
Deterministic Evaluation & Guardrails
Run tests against your AUT with threshold-based pass/fail gating, policy bindings, and AI tool validators (chatbot, agentic, LLM categories).
Policy Assurance & Release Gate
Compare Expected (policy) vs Actual (AI) in Policy Scenario Viewer, then seal go / no-go decisions with Release Gate evidence and RBAC sign-off.
Manifest‑Driven Batch Execution
YAML/JSON manifest runs, scheduled jobs, synthetic data seeding, and prompt drift checks in Scenario Builder.
Professional Services (Optional)
Need hands-on help? Our team can design evaluations, build manifests, and deliver audit-ready reports alongside the platform.
Services
Quality Engineering Services
Enterprise QA delivered by seasoned engineers with automation, performance, security, and compliance expertise.
- Web/API/Mobile Automation
- Performance & Resiliency
- Security & Privacy
- Regulatory Compliance
AI‑Specific Services
Specialized evaluation for LLMs, chatbots, and agents using AiQT guardrails and deterministic methods.
- LLM Safety & Guardrails
- Bias & Fairness Evaluation
- Prompt & Data Validation
- Agent Orchestration & Workflows
AI Quality Testing Services
Engage our global AI Engineers to plan, execute, and certify AI releases using AiQT — with KPIs, SLAs, and audit‑ready reports.
- Rapid onboarding & discovery
- Reusable test assets & manifests
- Weekly scorecards & quality gates
- Flexible models: project or managed
Industries We Serve
Specialized AI quality engineering and automation testing across critical industries
Banking & Financial Services
Payments, cards, trading algorithms, compliance validation
Healthcare & Life Sciences
HL7/FHIR interoperability, HIPAA privacy, audit-ready validation
eCommerce & Retail
Journey automation, ERP/WMS integrations, peak-season performance
SaaS & Tech Startups
CI automation, API contract testing, performance observability
Securities & Capital Markets
Trading systems, data integrity, compliance reporting
Insurance
Claims flows, risk models, policy administration with compliance
Join the AI QA & Governance Community
Subscribe for full AiQT Labs access — start a free enterprise evaluation, or sign in if you already have an account.
Enterprise Evaluation
Explore AiQT Labs with full product navigation, sample projects, compliance views, and governance workflows. Align with Guides, then upgrade for AI-powered workflows in AiQT Labs.
- Full navigation & sample projects
- Governance & audit evidence views
- Team Guides alignment path
- Upgrade anytime at learn.aiqualtest.com/access
Direct Subscription
Annual platform access via Stripe checkout. Testing hub, scenario builder, audit reports, and dashboard — with daily AI quota and optional credit top-ups.
- Full Test Execution Hub & Scenario Forge
- Audit-ready PDF/CSV report exports
- Role-based access & governance workflows
- Cancel anytime — no hidden platform fees
AiVELabs SSO
Learners on app.aivelabs.org sign in through SSO — platform access provisioned automatically. Ideal for teams building governance capability through structured learning paths and AiQT labs.
- Mastery-gated lessons & certificates
- Manifest-driven evaluation labs
- Standards-aligned curriculum
- Team progress & compliance reporting
Ready to prove AI quality with evidence?
Join QA engineers and governance teams who run deterministic evaluations, export audit-ready scorecards, and ship with confidence. New to AiQT? Start at learn.aiqualtest.com/access.
Why Choose AiQT?
Purpose-Built for AI QA
Testing hub, scenario builder, validators, and audit exports designed for LLM and agent evaluation
SaaS + Services
Use the platform self-serve from $199.99/year annual access, or add professional services when you need expert help
Manifest-First Workflow
YAML/JSON manifests, scheduling, and reusable scenarios speed up repeatable evaluation
AI Tools Stack
Run chatbot, agentic, and LLM test categories against your application under test
Transparent Pricing
$199.99/year annual access for direct subscribers; AiVELabs SSO users included with enrollment
Audit-Ready Exports
Generate PDF and CSV audit report bundles from your evaluation runs