verifyai · agent verification layer · port 8815

Every AI claim, checked against evidence.

Agents say “all tests pass” without running them. VerifyAI reads the run transcript, checks each claimed action against what actually executed, and seals the verdict to a hash-chained vault.

verifyai.app/runs/run_a1f3c9e2
Verdict wallall runs
128verified
12partial
9unverified
coder-agent-731 verified
release-bot4 partial
docs-agent2 unverified
Run run_a1f3c9e2sealed
verified
all unit tests pass
transcript shows “42 passed in 3.14s” · conf 0.95
unverified
deployed to production
no deploy step appears in this transcript · conf 0.30
audit sha256 9f2c41ab…e0d1 → vault head 4be077…a1
Evidence timeline
  • t+0.0srun queued — coder-agent-7
  • t+0.8sClaimCheckAI deep audit (kimi-k2.7-code)
  • t+1.4sfallback ready — service never raises
  • t+1.6ssha256 sealed to evidence vault
01

The problem

Agents claim. Evidence decides.

Coding agents report “all tests pass”, “file edited”, “deployed to production” — without ever running the command. Teams merge on trust, and the audit trail is a chat log nobody can verify.

  • Unverifiable claimsA transcript says the work is done. Nothing in it proves the work ran.
  • Silent failures shipA “deployed” claim with no deploy step in the log reaches production on faith.
  • No durable recordWhen a verdict is disputed later, there is no sealed artifact to point to.
$ pytest tests/ -q .............................. 42 passed in 3.14s agent: "All tests pass and the fix is deployed to production." ✗ no deploy step appears anywhere in this transcript
02

How it works

One pass over the run transcript. Every claim gets a verdict, a written reason, and a confidence score — then the whole audit is hashed into the vault.

1

Submit the run

Paste the agent transcript and its claimed actions — tests passed, file edited, deployed.

2

Deep audit

ClaimCheckAI checks every claim against execution markers — pass counts, diff --git, build success, 200 OK.

3

Per-claim verdicts

Each claim returns verified, partially_verified or unverified with a reason and confidence.

4

Seal & wall

The sha256 of the audit is chained into the evidence vault and the run lands on your verdict wall.

Agent transcript

$ pytest tests/ -q
..............................
42 passed in 3.14s
# note: no deploy step was ever run

Claimed actions

  • tests — all unit tests pass
  • deploy — deployed to production

Press Run the audit to see per-claim verdicts.

02.5

What you get

3 verdicts possible — never a score to interpret

Fixed verdict vocabulary

Every claim is verified, partially_verified or unverified, with a written reason and a confidence value. No stars, no percentages dressed up as judgment.

0 exceptions surfaced to callers

Deterministic fallback

Deep audits run via the shared Kimi proxy (kimi-k2.7-code). Any AI failure falls back to keyword heuristics — the service never raises.

64 hex chars per seal

sha256 evidence seal

Each audit is serialized and hashed into the platform vault as kind='verifyai_audit'.

50 free claim checks / month

Free tier that works

Heuristic engine, per-claim verdicts, verdict wall and sealed hashes — no card required.

2 API calls to integrate

Built for CI

POST /v1/runs submits a transcript and claim list; GET /v1/runs/{id} returns full verdict detail. Drop it in a pipeline step and fail the build on unverified deploy claims.

$ curl -X POST /v1/runs -d '{"agent_name":"ci-agent",…}' → {"summary":{"verified":1,"partial":0,"unverified":1},…}
03

Evidence & security

A verdict you can prove months later. Every audit seals its result to the platform evidence vault. Records are hash-chained: change one byte of a past verdict and every seal after it breaks.

Digest per auditsha25664-hex, sealed as verifyai_audit
Chain guarantee1→neach entry commits to the previous hash
Seal latency0 msbest-effort — sealing never blocks a verdict
Failure surface4xx/502clean errors — never a stack trace
genesis verifyai_audit · 9f2c41ab…e0d1 verifyai_audit · 4be077b2…00a1 head
04

Pricing

Start free. Upgrade when your agents start lying more often than your schedule allows.

Solo For individuals auditing one agent at a time $0 50 claim checks / month Heuristic audit engine Per-claim verdicts with reasons Verdict wall Vault-sealed audit hashes Start free
Pro For frequent filers and small teams running agents daily $29/mo Everything in Solo, plus: Unlimited claim checks AI deep audit (ClaimCheckAI) Priority audit queue Programmatic /v1/runs access for CI Go Pro

Running a platform? The API tier at $199/mo adds dedicated throughput and CI webhooks — talk to us from the app.

Stop trusting the transcript. Audit it.

Submit your first agent run in under a minute. Fifty checks a month, free — every verdict sealed.