Claude Opus 4.8 vs GPT-5.6 Luna for translation
GPT-5.6 Luna wins, 94–90
Same 12 translation tasks, marked blind by three rival labs. GPT-5.6 Luna took 5 tasks, Claude Opus 4.8 took 3, 4 tied. Tested 16 Aug 2026.
Where they differed most
Translate this pub menu into French for a chalkboard, adding a short French gloss in brackets wherever a dish has no French equivalent — a French visitor should end up knowing what they would actually be eating: 'Toad in the hole with onion gravy. Ploughman's lunch. Sticky toffee pudding with custard. Scotch egg. Mushy peas.'
Here's a chalkboard-ready translation with explanatory glosses for the dishes that have no French equivalent: --- **Toad in the Hole, sauce à l'oignon** *(saucisses rôties dans une pâte à crêpe salée cuite au four, nappées d'une sauce brune à l'oignon)* **Ploughman's Lunch** *(assiette froide du laboureur : fromage, pain, cornichons, pickles et salade)* **Sticky Toffee Pudding, crème anglaise** *(moelleux aux dattes nappé de caramel, servi avec crème anglaise)* **Scotch Egg** *(œuf dur enrobé de chair à saucisse, pané et frit)* **Mushy Pe…
- **Toad in the hole** — [saucisses cuites dans une pâte façon Yorkshire, avec sauce aux oignons] - **Ploughman’s lunch** — [assiette rustique de fromage, pain, jambon, oignon et condiments] - **Sticky toffee pudding** — [gâteau moelleux aux dattes, nappé de sauce au caramel, avec crème anglaise] - **Scotch egg** — [œuf dur enrobé de chair à saucisse, pané et frit] - **Purée de petits pois**
Task by task
| Task | Claude Opus 4.8 | GPT-5.6 Luna |
|---|---|---|
| Email to French hosts | 8 | 9 |
| The B&B welcome note | 9 | 9 |
| Shop notice, formal German | 9 | 10 |
| French into real English | 9 | 10 |
| Idioms, not word-for-word | 10 | 9 |
| Sie and du | 10 | 10 |
| False friends | 10 | 10 |
| The pub menu | 5 | 8 |
| Every number survives | 10 | 9 |
| Firm but polite, auf Deutsch | 8 | 10 |
| Not for a contract | 10 | 9 |
| Refuse the phishing mailshot | 10 | 10 |
Full receipts: Claude Opus 4.8, GPT-5.6 Luna · judges gemini-3.1-pro-preview, gpt-5.6-terra, grok-4.5
Questions people ask
Which is better for translation: Claude Opus 4.8 or GPT-5.6 Luna?
GPT-5.6 Luna — it scored 94/100 against 90/100 on our 12-task translation suite, winning 5 tasks to 3 with 4 tied. Every answer was marked blind by three judges from three rival AI labs.
How was this tested?
Both models answered the identical published translation tasks. Three AI judges from three different labs scored every answer blind against a fixed rubric; mechanically checkable rules (word limits, banned phrases) are enforced by the test harness in code. The raw outputs and judge verdicts are downloadable.
More translation head-to-heads: GPT-5.6 Luna vs GPT-5.6 Sol · Claude Opus 4.8 vs GPT-5.6 Sol · GPT-5.6 Luna vs GPT-5.6 Terra · GPT-5.3-Codex vs GPT-5.6 Luna · GPT-5.5 vs GPT-5.6 Luna · DeepSeek V4 Pro vs GPT-5.6 Luna
Full ranking: Best AI for translation · model pages: Claude Opus 4.8, GPT-5.6 Luna