Best AI for customer service replies / head-to-head

GPT-5.5 vs Qwen3.7 Maxfor customer service replies

The verdict

GPT-5.5 wins, 9995

Same 12 customer service replies tasks, marked blind by three rival labs. GPT-5.5 took 3 tasks, Qwen3.7 Max took 1, 8 tied. Tested 14 Aug 2026.

Where they differed most

The task — The confused customer

A customer says the product is broken, but their description shows they have not plugged in the power lead ('the light never comes on and there is no cable in the wall socket'). Write a reply that fixes it without making them feel stupid. Under 90 words.

GPT-5.510/10
Thanks for the details — that helps. The product needs mains power before the light will come on. Could you please connect the power lead firmly to the unit, then plug it into a wall socket and switch the socket on if it has a switch?

After that, check whether the light appears. If it still doesn’t turn on, let us know and we’ll help troubleshoot the next step.
Hi there, I’m sorry it isn't turning on! Since the cable isn't in the wall socket yet, let's try that first. The device requires a direct wall connection to activate the light. 

Please plug the power lead firmly into the wall socket, and the light should turn right on. 

If it’s plugged in and still not working, just let me know and I’ll send a replacement right away!

Task by task

TaskGPT-5.5Qwen3.7 Max
Refund the easy way1010
Say no without weasel words1010
Reply to a 1-star review1010
The confused customer108
De-escalate a threat1010
The feature you won't build108
Apologise for your mistake1010
Price rise notice910
Outage update mid-incident1010
The wrong customer1010
Chargeback rebuttal facts1010
Refuse the fake review request108

Full receipts: GPT-5.5, Qwen3.7 Max · judges claude-sonnet-5, gemini-3.1-pro-preview, grok-4.5

Questions people ask

Which is better for customer service replies: GPT-5.5 or Qwen3.7 Max?

GPT-5.5 — it scored 99/100 against 95/100 on our 12-task customer service replies suite, winning 3 tasks to 1 with 8 tied. Every answer was marked blind by three judges from three rival AI labs.

How was this tested?

Both models answered the identical published customer service replies tasks. Three AI judges from three different labs scored every answer blind against a fixed rubric; mechanically checkable rules (word limits, banned phrases) are enforced by the test harness in code. The raw outputs and judge verdicts are downloadable.

More customer service replies head-to-heads: GPT-5.5 vs GPT-5.6 Sol · GPT-5.6 Sol vs Qwen3.7 Max · GPT-5.3-Codex vs GPT-5.5 · GPT-5.5 vs Grok 4.5 · GPT-5.5 vs GPT-5.6 Terra · Gemini 3.1 Pro Preview vs GPT-5.5

Full ranking: Best AI for customer service replies · model pages: GPT-5.5, Qwen3.7 Max