Skip to content

AODIT

Stress-tests AI agents before they go live.

Repeatable, auditable stress tests for AI agents in customer support, financial services, insurance and healthcare triage.

Lab
Experiment
01

The challenge

Before an AI agent goes live, risk, compliance and CX teams need evidence of how it behaves under pressure, and that evidence has to be repeatable and auditable.

AODIT tests customer-support agents for unauthorised refunds, policy drift, weak identity checks, angry customers and escalation pressure. In regulated financial services, it tests payment instructions, fraud escalation and AML ambiguity. It also covers banking, insurance and claims, and healthcare triage.

02

What we built

01

Eight-turn stress tests

Each test is an adversarial conversation in eight turns: baseline, extension, contradiction, challenge, escalation, synthesis, self-assessment and recovery.

02

Clear scores

Agents are scored on Reliability, Integrity, Judgment, Resistance and Resilience, and rated from AAA to D.

03

A verdict to act on

Every test ends in a deployment verdict. A calibration gap shows how far the agent's view of itself is from the evaluator's.

04

Live runs and reports

Follow each run as it happens, then share the results as a PDF report.

05

On-premise, built for regulators

An installer runs AODIT on your own infrastructure. For financial services, testing is aligned with FINMA Guidance 08/2024, the EU AI Act, NIST and ISO 42001.

06

Any major model

Tests agents built on Claude, GPT, Gemini, Grok, DeepSeek, Kimi, Llama and Qwen, in English, German, French and Arabic.

Built with: React · Node.js · AI inference · Background jobs · Cloud storage · Payments · On-premise deployment

03

Where it stands

Mar 2026

In development.

About

About AODIT

AODIT evaluates how AI agents behave under pressure, contradiction and adversarial input, with a structured multi-turn protocol that simulates real-world failure scenarios.

More work

More from the lab.

Lab
Live

Blogz

AI-generated, SEO-ready blog posts that publish straight to WordPress and Ghost. From topic to live post without the copy-paste.

Lab
Experiment

Hopover

Paste a Squarespace store URL and, in about five minutes, get a private link to a Shopify store that looks like it. Pay only if you like it.

Lab
Experiment

Hirivo

Hirivo pre-screens, interviews and ranks every applicant automatically, with a live AI video interviewer, so your team only meets the people worth meeting.

Want something like AODIT for your team?

We build AI tools around how your team already works, then run them for you. Tell us where the hours go.

Get in touch