Verifier crafting

A verifier is one testable check. Policies are bundles of verifiers: every string in a policy’s checks[] is surfaced in the Verifier Registry as a runtime verifier (id: policy:<policyId>:<index>), so each policy links out to the exact checks it will run.

Verifier kinds

Kind	Checks
`Outcome`	Did the agent achieve the goal state?
`Data integrity`	Are values correct, masked, un-tampered?
`Conversation`	Turn-level dialogue quality/safety.
`Tool use`	Right tool, right arguments, right order.
`Reasoning`	Justification present and grounded.
`Safety`	Prohibited content / harm avoidance.
`Runtime policy`	Policy-derived checks (from `checks[]`).

Craft a new verifier

akhara verifier new "PAN is masked before display" \
  --kind "Data integrity" \
  --policy pci-0

This scaffolds a Harbor-style bundle:

verifiers/pan-is-masked/
├── task.toml            # metadata: id, name, kind, policy binding, image
└── tests/
    └── test.sh          # the assertion: exit 0 = pass, non-zero = fail

task.toml

id     = "custom_pan_masked_9f3a"
name   = "PAN is masked before display"
kind   = "Data integrity"
policy = "pci-0"
image  = "akhara/policy-verifier:latest"

tests/test.sh

#!/usr/bin/env bash
set -euo pipefail
# The step payload is provided as JSON on stdin / env.
grep -Eq '([0-9][ -]?){13,19}' <<<"$AKHARA_STEP_OUTPUT" && exit 1  # raw PAN → fail
exit 0

Draft verifiers live client-side (localStorage: akhara.custom-verifiers.v1) until you sync them. A draft looks like { id: "custom_<slug>_<base36>", name, kind, desc, checks, custom: true }.

Sync to the decision point

Push drafts to the PDP so policies can bind them at runtime:

akhara verifier sync

How verifiers relate to everything else

At runtime each verifier emits a result under the amazon.mobile.verifier_result.v1 schema and appears on both the run trace and the enforcement feed.

Next: publish tasks

Package reproducible agent work graded by these verifiers.

Get started

How it works

Enterprise onboarding

SDK

Verifier crafting

Verifier kinds

Craft a new verifier

Sync to the decision point

How verifiers relate to everything else

Next: publish tasks

​Verifier kinds

​Craft a new verifier

​Sync to the decision point

​How verifiers relate to everything else

Next: publish tasks

Verifier kinds

Craft a new verifier

Sync to the decision point

How verifiers relate to everything else