Best AI for summarising documents / head-to-head

Claude Opus 4.8 vs Claude Sonnet 5for summarising documents

The verdict

Claude Opus 4.8 wins, 9993

Same 12 summarising documents tasks, marked blind by three rival labs. Claude Opus 4.8 took 4 tasks, Claude Sonnet 5 took 0, 8 tied. Tested 13 Aug 2026.

Where they differed most

The task — Extract the decision

From this thread, state in one line WHAT was decided and WHO decided it. If no decision was reached, say so. Thread: 'A: shall we move the launch to October? B: I'd rather not, the trade show is in September. A: agreed, but we can't ship without the packaging. C: packaging lands 2 Sept, confirmed by the printer this morning. A: fine, September stands then.'

Decision: The launch stays in September (not moved to October), decided by A (with input from B and C).
**Decision:** The launch date will remain in September (not moved to October).

**Decided by:** A (with agreement from B and confirmation from C on packaging timing).

Task by task

TaskClaude Opus 4.8Claude Sonnet 5
Meeting notes to actions109
Five-bullet summary1010
Do not invent1010
One-sentence gist1010
Preserve the caveat1010
Summarise a disagreement109
Extract the decision105
Long to short, no loss1010
Summary for a specific reader99
Bullet the risks only1010
Headline and standfirst109
Say when there is nothing to summarise1010

Full receipts: Claude Opus 4.8, Claude Sonnet 5 · judges gemini-3.1-pro-preview, gpt-5.6-terra, grok-4.5

Questions people ask

Which is better for summarising documents: Claude Opus 4.8 or Claude Sonnet 5?

Claude Opus 4.8 — it scored 99/100 against 93/100 on our 12-task summarising documents suite, winning 4 tasks to 0 with 8 tied. Every answer was marked blind by three judges from three rival AI labs.

How was this tested?

Both models answered the identical published summarising documents tasks. Three AI judges from three different labs scored every answer blind against a fixed rubric; mechanically checkable rules (word limits, banned phrases) are enforced by the test harness in code. The raw outputs and judge verdicts are downloadable.

More summarising documents head-to-heads: Claude Opus 4.8 vs GPT-5.5 · Claude Opus 4.8 vs GPT-5.6 Luna · Claude Opus 4.8 vs GPT-5.3-Codex · Claude Opus 4.8 vs GPT-5.6 Terra · Claude Opus 4.8 vs DeepSeek V4 Pro · Claude Opus 4.8 vs GPT-5.6 Sol

Full ranking: Best AI for summarising documents · model pages: Claude Opus 4.8, Claude Sonnet 5