From 6ca6b33bba22db81e1ac19c14399d3ea11839fe2 Mon Sep 17 00:00:00 2001 From: Oliver Date: Thu, 2 Jul 2026 17:32:17 -0300 Subject: [PATCH] =?UTF-8?q?Blog:=20add=20post=20'Make=20Your=20AI=20Agent?= =?UTF-8?q?=20Verify=20Its=20Own=20Work=20=E2=80=94=20No=20More=20Hallucin?= =?UTF-8?q?ated=20Done'?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- blog/index.json | 9 + ...ent-verification-completion-contracts.html | 192 ++++++++++++++++++ 2 files changed, 201 insertions(+) create mode 100644 blog/posts/ai-agent-verification-completion-contracts.html diff --git a/blog/index.json b/blog/index.json index 0b29542..7b7b682 100644 --- a/blog/index.json +++ b/blog/index.json @@ -1,5 +1,14 @@ { "posts": [ + { + "id": "ai-agent-verification-completion-contracts", + "date": "2026-07-02", + "area": "howto", + "agent": "hermes", + "headline": "Make Your AI Agent Verify Its Own Work — No More Hallucinated “Done”", + "teaser": "Stop guessing if your AI agent actually finished the job. Hermes Agent v0.18.0 introduces verification evidence and completion contracts — your agent proves it's done by running real tests, not by claiming success.", + "link": "blog/posts/ai-agent-verification-completion-contracts.html" + }, { "id": "odoo-xml-rpc-hermes-agent", "date": "2026-06-29", diff --git a/blog/posts/ai-agent-verification-completion-contracts.html b/blog/posts/ai-agent-verification-completion-contracts.html new file mode 100644 index 0000000..7c29a7c --- /dev/null +++ b/blog/posts/ai-agent-verification-completion-contracts.html @@ -0,0 +1,192 @@ + + + + + + + + Make Your AI Agent Verify Its Own Work — No More Hallucinated "Done" — derez.ai Blog + + + + + + + + + + + + + + + +
+ ← Back to Blog +

Make Your AI Agent Verify Its Own Work — No More Hallucinated "Done"

+
+ July 2, 2026 + howto + hermes + v0.18.0 + verification +
+ +

+ When I ask my agent to fix a bug or write a module, I don't want it to say "done" — I want it to prove it. That's the difference between an agent that's useful for demos and one you can trust with real work. +

+

+ Hermes Agent v0.18.0 ("The Judgment Release", July 1, 2026) introduces a verification system that changes how agents finish tasks. Instead of the model deciding "I think I fixed it," your agent now runs your actual project checks and produces evidence before claiming completion. +

+ +
+ "The tests pass. Here's proof." — Instead of "I think it works." +
+ +

The Trust Problem with AI Agents

+

+ Every business I talk to who's tried deploying an AI agent runs into the same wall: how do I know it actually did what it said? LLMs are optimised to sound confident, not to be accurate. An agent that writes code, modifies files, or runs queries and then claims "all done" without evidence — that's a liability, not a tool. +

+

+ Before v0.18.0, an agent's standard for "done" was its own internal certainty. If you asked "is the API endpoint working?" it would say yes based on what it remembered writing, not based on actually hitting the endpoint. +

+ +

What Changed: Completion Contracts

+

+ Every /goal directive can now include a completion contract — a statement of what "done" looks like, measured by real evidence. The standing-goal loop judges completion against that evidence instead of stopping when the model feels like it. +

+ +

Here's a practical example. Before:

+
+/goal Add login validation to the API
+
+# Agent writes code, says "done"
+# No proof. Maybe it works. Maybe it doesn't. +
+ +

After — with a completion contract:

+
+/goal Add login validation to the API
+done when: the test suite passes, the new endpoint
+            returns 200 for valid credentials and 401 for invalid ones,
+            and a curl smoke test confirms both cases +
+ +

+ The agent writes the code, runs the test suite, executes the curl smoke tests, collects the evidence, and only then reports completion. If any check fails, the agent tries again or reports what broke. +

+ +

How Verification Evidence Works

+

Behind the scenes, the agent now records verification evidence for every significant action:

+ +
+
+

Test Suite Runs

+

The agent executes your project's actual tests (pytest, vitest, whatever you use) and captures the output.

+
+
+

SMOKE CHECKs

+

Curl endpoints, check HTTP status codes, validate response bodies. Real network calls, not speculation.

+
+
+

File Verification

+

Stat files, check contents, run linters. The agent confirms files exist with the right content.

+
+
+

Custom Hooks

+

pre_verify hooks let you wire in any custom check. Run your deployment pipeline or integration tests.

+
+
+ +

Why This Matters for Your Business

+

+ Here's the blunt truth: you shouldn't deploy an agent that can't verify its own work. Not for customer-facing code, not for internal tooling, not for anything that costs you money if it's wrong. +

+

+ The verification system in v0.18.0 turns your agent from a "helpful intern who sounds sure" into a "senior engineer who shows receipts." You still review — but you review evidence, not promises. +

+

Three business scenarios where this matters immediately:

+ + +

Getting Started

+

If you're on Hermes Agent v0.18.0+, the verification system works out of the box with sensible defaults. No config required to start. The one-time migration tunes the defaults for your project:

+ +
+hermes upgrade # to v0.18.0 or later
+# Verification is active by default.
+# Start a goal with a "done when" clause and watch the evidence roll in. +
+ +

+ The pre_verify hook is available if you want custom pipelines. Full docs are in the release notes. +

+ +
+ Pro tip: Start with small scope — "done when the endpoint returns 200" — and expand to full test suites as you build trust. The evidence output alone is worth it: you can see exactly what the agent checked, even if you were away from the keyboard. +
+ +

What Else v0.18.0 Ships

+

This release is massive. Besides verification, it also ships:

+ +

+ But honestly? The verification system is the one I'd start with. Trust is the bottleneck to real agent deployment — and this is what unlocks it. +

+ +
+

Try It Yourself — First Month Free

+

Deploy a Hermes Agent with the new verification system. Use coupon code blog950 for your first month free — no risk, full access to v0.18.0.

+ Get Your Agent → +
+ +

+ derez.ai — Deploy your AI agent in 5 minutes. · + Setup Guide · + v0.18.0 Release Notes +

+
+ +