GPT-5.6 Sol vs Kimi K3 for multi-step research
Effectively a dead heat: 89–88
Same 12 multi-step research tasks, marked blind by three rival labs. GPT-5.6 Sol took 6 tasks, Kimi K3 took 1, 5 tied. Tested 18 Aug 2026.
Where they differed most
Three sources on GP access in one integrated care board area. Source A — published NHS data, 2026: 'mean wait from request to appointment fell from 12 days to 9 days over the year.' Source B — a patient participation group survey of 340 local residents, 2026: '61% say it is harder to get an appointment than a year ago.' Source C — a practice manager, quoted in the local paper, 2026: 'we delivered 14% more appointments this year with one fewer full-time-equivalent GP.' Write ONLY the paragraph that goes in the report — max 110 words, nothing else. It must attribute each figure to its source, explain in plain words how all three can be true at once (what each one is actually measuring), and end by naming one thing none of them establishes.
Published NHS data for 2026 show that the mean wait from request to appointment fell from 12 to nine days, measuring average elapsed time for recorded appointments. A 2026 patient participation group survey of 340 local residents found that 61% felt access was harder than a year earlier, reflecting perceptions that may include difficulties contacting practices, finding suitable slots or seeing a preferred clinician. A practice manager told the local paper that the practice delivered 14% more appointments with one fewer full-time-equivalent GP,…
NHS data show the mean wait from request to appointment fell from 12 to 9 days during 2026 (Source A); a patient participation group survey of 340 residents found 61% felt it was harder to get an appointment than a year ago (Source B); and a practice manager reported 14% more appointments delivered with one fewer full-time-equivalent GP (Source C). All three can hold: C counts activity, not demand; A averages only appointments that occurred; and B captures the struggle to get through at all, including people who gave up, which averages conceal.…
Task by task
| Task | GPT-5.6 Sol | Kimi K3 |
|---|---|---|
| Four numbers, one high street | 10 | 9 |
| The trial that both worked and didn't | 9 | 9 |
| Break the brief into answerable steps | 10 | 9 |
| Corroboration that isn't | 9 | 9 |
| The disagreement is definitional | 9 | 8 |
| A forecast is not an outcome | 9 | 9 |
| The evidence table, as JSON | 8 | 8 |
| Funded, and still the best data | 9 | 9 |
| Write only the limits section | 9 | 8 |
| Not answerable from what you have | 10 | 9 |
| The statistic and the doorstep | 5 | 9 |
| Refuse the manufactured briefing | 10 | 9 |
Full receipts: GPT-5.6 Sol, Kimi K3 · judges claude-sonnet-5, gemini-3.1-pro-preview, grok-4.5
Questions people ask
Which is better for multi-step research: GPT-5.6 Sol or Kimi K3?
Effectively a dead heat: GPT-5.6 Sol edged it 89/100 to 88/100 on our multi-step research suite — too close to matter, so pick on price or the product you already use.
How was this tested?
Both models answered the identical published multi-step research tasks. Three AI judges from three different labs scored every answer blind against a fixed rubric; mechanically checkable rules (word limits, banned phrases) are enforced by the test harness in code. The raw outputs and judge verdicts are downloadable.
More multi-step research head-to-heads: Claude Sonnet 5 vs GPT-5.6 Sol · Claude Sonnet 5 vs Kimi K3 · GPT-5.5 vs GPT-5.6 Sol · GPT-5.5 vs Kimi K3 · GPT-5.6 Sol vs Grok 4.5 · Claude Opus 4.8 vs GPT-5.6 Sol
Full ranking: Best AI for multi-step research · model pages: GPT-5.6 Sol, Kimi K3