P

Chain of Density: Definition and Examples

An iterative summarization technique where each successive version is more information-dense while keeping the same length, developed by researchers from Columbia and Salesforce.

Full definition

Chain of Density (CoD) is a prompt engineering method designed to produce high-quality summaries through successive iterations. The principle is simple: ask the model to generate an initial summary, then rewrite it several times by integrating more key entities and information, without ever exceeding the initial length.

At each iteration, the model identifies missing entities from the source text, then merges them into the existing summary by compressing, reformulating, or removing the least important details. The result is a text that progressively becomes denser in useful information while remaining fluid and readable.

This technique is based on a 2023 research paper by researchers from Columbia University and Salesforce. Their work showed that summaries produced after 3 to 5 densification iterations achieve a quality level comparable to human-written summaries and are often preferred by readers.

Chain of Density illustrates a fundamental principle of prompt engineering: rather than asking for a perfect result in a single pass, guide the model through a structured process of progressive improvement. This iterative approach better leverages the reasoning and reformulation capabilities of large language models.

Etymology

The term "Chain of Density" refers to the sequence (chain) of summaries whose information density increases at each step. It was introduced in the article "From Sparse to Dense: GPT-4 Summarization with Chain of Density Prompting" published in 2023.

Concrete examples

Summarizing a long scientific article into a dense paragraph

Here is an article. Generate 5 successive summaries of identical length (~80 words). The first should be a general summary. At each iteration, identify 1-3 informative missing entities and rewrite the summary to include them, compressing less essential information. Article: [TEXT]

Creating a concise product sheet from technical documentation

Apply the Chain of Density method to summarize this product documentation into 100 words. Iteration 1: general summary. Iterations 2 to 4: add missing key specifications, benefits, and use cases while maintaining 100 words. Show each iteration.

Condensing a meeting report for an executive summary

Using the Chain of Density technique, produce 4 successive versions of a summary of this meeting minutes. Each version should be 60 words and be richer in key decisions and actions than the previous one.

Practical usage

To apply Chain of Density, ask the model to produce a first general summary, then rewrite it 3 to 5 times by adding missing key entities without changing the length. You can adapt the number of iterations and the target length according to your needs. This technique is particularly effective for executive summaries, briefing sheets, and any context where information density is critical.

Related concepts

Chain of ThoughtExtractive vs Abstractive SummarizationIterative PromptingText Compression

FAQ

How many iterations are needed for a good result with Chain of Density?
Research shows that 3 to 5 iterations are optimal. Beyond 5, the summary may become too dense and hard to read. In practice, 4 iterations offer the best balance between information density and readability.
What is the difference between Chain of Density and Chain of Thought?
Chain of Thought guides the model through step-by-step reasoning to solve a problem. Chain of Density is specifically designed for summarization: it guides the model through an iterative process of information densification. Both techniques share the idea of sequential processing, but their goals are different.
Does Chain of Density work with all language models?
The technique works best with large models capable of following complex instructions and reformulating accurately (GPT-4, Claude, Gemini). Smaller models may struggle to maintain coherence and quality across iterations, but can still produce notable improvements over 2-3 passes.

See also

How to use this prompt

  1. Copy the prompt with the button above.
  2. Paste it into ChatGPT, Claude or your favorite AI assistant.
  3. Replace the bracketed variables with your details, then refine the result.

About Prompt Guide

Prompt Guide is a free library of 2500+ ready-to-use prompts for ChatGPT, Claude and other AIs, with guides to learn prompting and tools to build and optimize your own prompts.

More definitions

Get new prompts every week

Join our newsletter.