Claude Sonnet 5 vs GPT-5.6 Sol for property and lettings admin
GPT-5.6 Sol wins, 93–85
Same 12 property and lettings admin tasks, marked blind by three rival labs. GPT-5.6 Sol took 5 tasks, Claude Sonnet 5 took 1, 6 tied. Tested 18 Aug 2026.
Where they differed most
Guidance excerpt: 'A landlord is responsible for repairs to the structure and exterior of the property and to the installations for the supply of water, gas and electricity, for sanitation, and for space heating and heating water. Repairs should be carried out within a reasonable time, and what is reasonable depends on how serious the problem is and its effect on the tenant. Loss of heating or hot water is generally treated as urgent, particularly in cold weather or where a tenant is vulnerable. Tenants should report problems in writing and landlords should keep a record of what was reported and when.' Three reports arrive on the same Tuesday in November. (a) No hot water at all in a flat let to a tenant in her eighties. (b) A dripping kitchen tap. (c) A bannister that has come loose from the wall on the stairs. Answer using only the excerpt — marked against it. Triage the three, saying for each what makes it urgent or not by reference to the excerpt, what the agent does today, and what the agent tells the tenant today. Say which of the three the excerpt does not clearly cover and what you would do about that rather than guessing.
# Triage of Three Repair Reports ## (a) No hot water — elderly tenant **Urgency:** The excerpt states loss of hot water is "generally treated as urgent, particularly in cold weather or where a tenant is vulnerable." This case has both aggravating factors named in the excerpt: it is November (cold weather) and the tenant is in her eighties (potentially a vulnerable tenant). This is the clearest urgent case under the excerpt. **What the agent does today:** Records the report (what was reported and when, as the excerpt requires), and arranges f…
| Report | Urgency under the excerpt | What the agent does today | What the agent tells the tenant today | |---|---|---|---| | **(a) No hot water in the flat of a tenant in her eighties** | **Urgent.** The landlord is responsible for hot-water installations. Complete loss of hot water is generally urgent, especially in cold weather and where the tenant is vulnerable; both are relevant in November for a tenant in her eighties. | Record what was reported and when, and arrange urgent repair action today. | Confirm that the report is being treated…
Task by task
| Task | Claude Sonnet 5 | GPT-5.6 Sol |
|---|---|---|
| Two routes, one worried tenant | 10 | 10 |
| Six weeks late and hoping | 9 | 9 |
| Write only the arrears email | 10 | 10 |
| The pre-tenancy checklist | 8 | 10 |
| Write only the renewal reply | 10 | 10 |
| Three repairs, one Tuesday | 6 | 10 |
| The nine-year-old carpet | 5 | 8 |
| The rent rise by text message | 8 | 10 |
| Every claim in the advert must be true | 8 | 8 |
| The compliance data, as JSON | 10 | 6 |
| What the agent must not promise | 8 | 10 |
| Refuse the lock change | 10 | 10 |
Full receipts: Claude Sonnet 5, GPT-5.6 Sol · judges gemini-3.1-pro-preview, gpt-5.6-terra, grok-4.5
Questions people ask
Which is better for property and lettings admin: Claude Sonnet 5 or GPT-5.6 Sol?
GPT-5.6 Sol — it scored 93/100 against 85/100 on our 12-task property and lettings admin suite, winning 5 tasks to 1 with 6 tied. Every answer was marked blind by three judges from three rival AI labs.
How was this tested?
Both models answered the identical published property and lettings admin tasks. Three AI judges from three different labs scored every answer blind against a fixed rubric; mechanically checkable rules (word limits, banned phrases) are enforced by the test harness in code. The raw outputs and judge verdicts are downloadable.
More property and lettings admin head-to-heads: GPT-5.5 vs GPT-5.6 Sol · Claude Sonnet 5 vs GPT-5.5 · GPT-5.6 Sol vs Kimi K3 · Claude Opus 4.8 vs GPT-5.6 Sol · Claude Fable 5 vs GPT-5.6 Sol · GPT-5.6 Sol vs Grok 4.5
Full ranking: Best AI for property and lettings admin · model pages: Claude Sonnet 5, GPT-5.6 Sol