Best AI for summarising documents / head-to-head

Claude Fable 5 vs DeepSeek V4 Profor summarising documents

The verdict

DeepSeek V4 Pro wins, 9593

Same 12 summarising documents tasks, marked blind by three rival labs. DeepSeek V4 Pro took 2 tasks, Claude Fable 5 took 2, 8 tied. Tested 13 Aug 2026.

Where they differed most

The task — One-sentence gist

Reduce to ONE sentence of no more than 25 words: 'After eighteen months of testing across four hospitals, the trial found that the new triage system reduced average waiting times by 22 minutes, although staff reported it added roughly ten minutes of administrative work per shift and two sites abandoned it before the trial ended.'

An eighteen-month, four-hospital trial found the new triage system cut waiting times by 22 minutes, despite added administrative work and two sites abandoning it.

(24 words)
An 18-month, four-hospital trial found new triage system cut wait times by 22 minutes, but added ten admin minutes per shift and two sites withdrew.

Task by task

TaskClaude Fable 5DeepSeek V4 Pro
Meeting notes to actions1010
Five-bullet summary1010
Do not invent1010
One-sentence gist58
Preserve the caveat1010
Summarise a disagreement1010
Extract the decision1010
Long to short, no loss810
Summary for a specific reader99
Bullet the risks only1010
Headline and standfirst108
Say when there is nothing to summarise109

Full receipts: Claude Fable 5, DeepSeek V4 Pro · judges gemini-3.1-pro-preview, gpt-5.6-terra, grok-4.5

Questions people ask

Which is better for summarising documents: Claude Fable 5 or DeepSeek V4 Pro?

DeepSeek V4 Pro — it scored 95/100 against 93/100 on our 12-task summarising documents suite, winning 2 tasks to 2 with 8 tied. Every answer was marked blind by three judges from three rival AI labs.

How was this tested?

Both models answered the identical published summarising documents tasks. Three AI judges from three different labs scored every answer blind against a fixed rubric; mechanically checkable rules (word limits, banned phrases) are enforced by the test harness in code. The raw outputs and judge verdicts are downloadable.

More summarising documents head-to-heads: Claude Opus 4.8 vs DeepSeek V4 Pro · Claude Fable 5 vs Claude Opus 4.8 · DeepSeek V4 Pro vs GPT-5.5 · Claude Fable 5 vs GPT-5.5 · DeepSeek V4 Pro vs GPT-5.6 Luna · Claude Fable 5 vs GPT-5.6 Luna

Full ranking: Best AI for summarising documents · model pages: Claude Fable 5, DeepSeek V4 Pro