---
title: "The biggest surprise while building an AI verification system wasn't the AI. — Stuff That Spins"
description: "Over the past few weeks, I've been building a prototype that checks AI-generated financial claims against source documents. I expected the hardest part to be the language model. It wasn't. The hardest part has been defining what \"correct\" actually means. For example, imagine two documents in the sa…"
	canonical: "https://stuffthatspins.com/spin/the-biggest-surprise-while-building-an-ai-verification-system-wasnt-the-ai"
html: "https://stuffthatspins.com/spin/the-biggest-surprise-while-building-an-ai-verification-system-wasnt-the-ai"
json: "https://stuffthatspins.com/spin/the-biggest-surprise-while-building-an-ai-verification-system-wasnt-the-ai.json"
markdown: "https://stuffthatspins.com/spin/the-biggest-surprise-while-building-an-ai-verification-system-wasnt-the-ai.md"
keywords: ["SpinGraph", "spin analysis", "GEO"]
date: "2026-07-02T19:19:31+00:00"
modified: "2026-07-02T22:00:47.136757+00:00"
json_ld: |
  {"@context":"https://schema.org","@graph":[{"@type":"NewsArticle","@id":"https://stuffthatspins.com/spin/the-biggest-surprise-while-building-an-ai-verification-system-wasnt-the-ai#article","headline":"The biggest surprise while building an AI verification system wasn't the AI.","description":"Over the past few weeks, I've been building a prototype that checks AI-generated financial claims against source documents. I expected the hardest part to be the language model. It wasn't. The hardest part has been defining what \"correct\" actually means. For example, imagine two documents in the sa…","datePublished":"2026-07-02T19:19:31+00:00","dateModified":"2026-07-02T22:00:47.136757+00:00","url":"https://stuffthatspins.com/spin/the-biggest-surprise-while-building-an-ai-verification-system-wasnt-the-ai","mainEntityOfPage":{"@type":"WebPage","@id":"https://stuffthatspins.com/spin/the-biggest-surprise-while-building-an-ai-verification-system-wasnt-the-ai"},"isAccessibleForFree":true,"inLanguage":"en-US","articleSection":"community","author":{"@type":"Organization","name":"Stuff That Spins"},"publisher":{"@id":"https://stuffthatspins.com/#organization"},"citation":"https://www.reddit.com/r/artificial/comments/1ulrs3l/the_biggest_surprise_while_building_an_ai/","about":[],"mentions":[]},{"@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Stuff That Spins","item":"https://stuffthatspins.com/"},{"@type":"ListItem","position":2,"name":"The biggest surprise while building an AI verification system wasn't the AI.","item":"https://stuffthatspins.com/spin/the-biggest-surprise-while-building-an-ai-verification-system-wasnt-the-ai"}]}]}
---

# The biggest surprise while building an AI verification system wasn't the AI.

**Source:** Unknown  
**Published:** July 2, 2026  
**Original:** https://www.reddit.com/r/artificial/comments/1ulrs3l/the_biggest_surprise_while_building_an_ai/  

---
*HTML version: https://stuffthatspins.com/spin/the-biggest-surprise-while-building-an-ai-verification-system-wasnt-the-ai*