A Geometric Method to Spot Hallucinations Without an LLM Judge
AI Summary: The article introduces a novel method for detecting hallucinations in large language models (LLMs) called Displacement Consistency (DC). This approach analyzes the geometric structure of text embeddings, specifically the displacement vectors between questions and their answers, to identify inconsistencies indicative of hallucinations. The method demonstrates high accuracy across various embedding models and hallucination benchmarks, achieving near-perfect discrimination between grounded and hallucinated responses. However, the effectiveness of DC is contingent upon the domain locality of the reference question-answer pairs used for comparison.