arxiv Preprint - From Sparse to Dense: GPT-4 Summarization with Chain of Density Prompting

In this episode we discuss From Sparse to Dense: GPT-4 Summarization with Chain of Density Prompting by Griffin Adams, Alexander Fabbri, Faisal Ladhak, Eric Lehman, Noémie Elhadad. The paper introduces a method called "Chain of Density" (CoD) for generating summaries with varying levels of information density. Using GPT-4, the authors generate entity-sparse summaries and then iteratively add missing salient entities without increasing the length. CoD summaries are found to be more abstractive, exhibit more fusion, and have less lead bias compared to GPT-4 summaries generated by a vanilla prompt, with human preference favoring denser GPT-4 summaries.