Skip to main content
The Agent Trust Bench vNext is an open harness for testing agents that authorise and settle payments. It goes beyond adversarial prompts into structured test modes, selectable scenario packs, and multi-dimensional scoring, and every result is a content-addressed Keystone reference (sha256: + SHA-256 of RFC 8785 JCS) so it recomputes byte for byte, offline.

Install

Test modes

Scenario packs

Seven selectable packs, not one monolith: tool-misuse, aml-edgecase, persona, long-context, multi-agent, data-protection, runtime. Together they exercise all seven of the OWASP LLM Top-10 categories the bench maps (LLM01, LLM02, LLM05, LLM06, LLM07, LLM08, LLM09).

Scores

Five per run, each content-addressed: outcome (ended safely and correctly), trace (each step justified and policy-aligned), trust (per-turn grounding and honesty), cost/latency, and severity-weighted (an unsafe success is penalised far more than a safe refusal, so “passed but dangerously” fails harder than a cautious block).

Verify it yourself

Every scored run is an atb_run_v2 object whose run_ref is the SHA-256 over its canonical JSON, Falcon-1024 signed by the bench. Recompute the ref from the object’s own fields to confirm it, and run algovoi-atb-vnext verify to check the signed corpus (positives recompute, tamper negatives diverge) against the AlgoVoi Ed25519 corpus key. No trust in the bench is required; the maths is open and the two standards (RFC 8785, SHA-256) are all you need.

Selectable, identity-bound suites

Pick a subset of tests and run them as one suite bound to your agent’s identity, so the result composes with the reputation the agent already holds:
The suite result shares the same subject as the agent’s ATB Pass Certificate and is itself a signed, recomputable reference.