arxiv Preprint - Chain-of-Verification Reduces Hallucination in Large Language Models

In this episode we discuss Chain-of-Verification Reduces Hallucination in Large Language Models by Shehzaad Dhuliawala, Mojtaba Komeili, Jing Xu, Roberta Raileanu, Xian Li, Asli Celikyilmaz, Jason Weston. The paper proposes the Chain-of-Verification (COVE) method to address the issue of factual hallucination in large language models. COVE involves generating an initial response, planning independent fact-checking questions, and generating a final verified response. The experiments demonstrate that COVE reduces hallucinations in various tasks and variations of the method further improve performance.