Beyond RAGs: Building Actually Truthful AI Harnesses
AI Summary: Retrieval-Augmented Generation (RAG) systems often incorrectly treat retrieval as an oracle of truth, providing fluent answers with links to documents rather than genuine evidence. A new objective is proposed: developing an evidence-grounded narrative system where every material proposition has inspectable support and uncertainty is represented. This requires a claims ledger with atomic claims, evidence, and controls, rather than just linking to source documents. A non-negotiable publication gate is proposed, where material claims without acceptable support must be revised, abstained from, labeled as inference, or escalated to a reviewer.