Gemini 3.1 Pro Preview vs GPT-5.6 Sol for multi-step research
GPT-5.6 Sol wins, 89–82
Same 12 multi-step research tasks, marked blind by three rival labs. GPT-5.6 Sol took 8 tasks, Gemini 3.1 Pro Preview took 1, 3 tied. Tested 18 Aug 2026.
Where they differed most
Three sources on GP access in one integrated care board area. Source A — published NHS data, 2026: 'mean wait from request to appointment fell from 12 days to 9 days over the year.' Source B — a patient participation group survey of 340 local residents, 2026: '61% say it is harder to get an appointment than a year ago.' Source C — a practice manager, quoted in the local paper, 2026: 'we delivered 14% more appointments this year with one fewer full-time-equivalent GP.' Write ONLY the paragraph that goes in the report — max 110 words, nothing else. It must attribute each figure to its source, explain in plain words how all three can be true at once (what each one is actually measuring), and end by naming one thing none of them establishes.
Published 2026 NHS data shows the mean wait from request to appointment fell from 12 to 9 days. A practice manager told the local paper they delivered 14% more appointments with one fewer full-time GP. Yet, a patient participation group survey of 340 residents found 61% say getting an appointment is harder than last year. All three are true because they measure different things: the manager measures total system throughput, the NHS data measures the wait time for successfully booked slots, and the survey measures the friction patients experienc…
Published NHS data for 2026 show that the mean wait from request to appointment fell from 12 to nine days, measuring average elapsed time for recorded appointments. A 2026 patient participation group survey of 340 local residents found that 61% felt access was harder than a year earlier, reflecting perceptions that may include difficulties contacting practices, finding suitable slots or seeing a preferred clinician. A practice manager told the local paper that the practice delivered 14% more appointments with one fewer full-time-equivalent GP,…
Task by task
| Task | Gemini 3.1 Pro Preview | GPT-5.6 Sol |
|---|---|---|
| Four numbers, one high street | 8 | 10 |
| The trial that both worked and didn't | 8 | 9 |
| Break the brief into answerable steps | 10 | 10 |
| Corroboration that isn't | 8 | 9 |
| The disagreement is definitional | 8 | 9 |
| A forecast is not an outcome | 8 | 9 |
| The evidence table, as JSON | 6 | 8 |
| Funded, and still the best data | 7 | 9 |
| Write only the limits section | 9 | 9 |
| Not answerable from what you have | 10 | 10 |
| The statistic and the doorstep | 8 | 5 |
| Refuse the manufactured briefing | 8 | 10 |
Full receipts: Gemini 3.1 Pro Preview, GPT-5.6 Sol · judges claude-sonnet-5, gpt-5.6-terra, grok-4.5
Questions people ask
Which is better for multi-step research: Gemini 3.1 Pro Preview or GPT-5.6 Sol?
GPT-5.6 Sol — it scored 89/100 against 82/100 on our 12-task multi-step research suite, winning 8 tasks to 1 with 3 tied. Every answer was marked blind by three judges from three rival AI labs.
How was this tested?
Both models answered the identical published multi-step research tasks. Three AI judges from three different labs scored every answer blind against a fixed rubric; mechanically checkable rules (word limits, banned phrases) are enforced by the test harness in code. The raw outputs and judge verdicts are downloadable.
More multi-step research head-to-heads: Claude Sonnet 5 vs GPT-5.6 Sol · Claude Sonnet 5 vs Gemini 3.1 Pro Preview · GPT-5.5 vs GPT-5.6 Sol · Gemini 3.1 Pro Preview vs GPT-5.5 · GPT-5.6 Sol vs Kimi K3 · GPT-5.6 Sol vs Grok 4.5
Full ranking: Best AI for multi-step research · model pages: Gemini 3.1 Pro Preview, GPT-5.6 Sol