Best AI for customer service replies / head-to-head
Gemini 3.1 Pro Preview vs Qwen3.7 Maxfor customer service replies
Gemini 3.1 Pro Preview wins, 97–95
Same 12 customer service replies tasks, marked blind by three rival labs. Gemini 3.1 Pro Preview took 3 tasks, Qwen3.7 Max took 2, 7 tied. Tested 14 Aug 2026.
Where they differed most
A paying customer asks when dark mode is coming; it is not on the roadmap. Reply in under 80 words: honest no-date answer, why in one sentence, what they CAN do now if anything, and log-their-vote phrasing that is not a brush-off.
Hi [Name], Dark mode isn't currently on our roadmap, so I don't have an ETA. Right now, our team is fully focused on improving core app performance. In the meantime, many users rely on browser extensions like Dark Reader for a great dark mode experience on our platform. I know how important this feature is, so I’ve formally added your vote to our internal tracker to help advocate for it during our next product planning cycle. Best, [Your Name]
Dark mode does not have a release date since it is not on our current roadmap. Our engineering team is entirely focused on core platform stability and new workflow features right now. For now, you can use browser extensions like Dark Reader to force a dark theme. I have personally logged your vote in our feature tracker with a detailed note, and I will email you directly if this changes.
Task by task
| Task | Gemini 3.1 Pro Preview | Qwen3.7 Max |
|---|---|---|
| Refund the easy way | 10 | 10 |
| Say no without weasel words | 10 | 10 |
| Reply to a 1-star review | 10 | 10 |
| The confused customer | 9 | 8 |
| De-escalate a threat | 10 | 10 |
| The feature you won't build | 10 | 8 |
| Apologise for your mistake | 8 | 10 |
| Price rise notice | 10 | 10 |
| Outage update mid-incident | 9 | 10 |
| The wrong customer | 10 | 10 |
| Chargeback rebuttal facts | 10 | 10 |
| Refuse the fake review request | 10 | 8 |
Full receipts: Gemini 3.1 Pro Preview, Qwen3.7 Max · judges claude-sonnet-5, gpt-5.6-terra, grok-4.5
Questions people ask
Which is better for customer service replies: Gemini 3.1 Pro Preview or Qwen3.7 Max?
Gemini 3.1 Pro Preview — it scored 97/100 against 95/100 on our 12-task customer service replies suite, winning 3 tasks to 2 with 7 tied. Every answer was marked blind by three judges from three rival AI labs.
How was this tested?
Both models answered the identical published customer service replies tasks. Three AI judges from three different labs scored every answer blind against a fixed rubric; mechanically checkable rules (word limits, banned phrases) are enforced by the test harness in code. The raw outputs and judge verdicts are downloadable.
More customer service replies head-to-heads: Gemini 3.1 Pro Preview vs GPT-5.6 Sol · GPT-5.6 Sol vs Qwen3.7 Max · Gemini 3.1 Pro Preview vs GPT-5.5 · GPT-5.5 vs Qwen3.7 Max · Gemini 3.1 Pro Preview vs GPT-5.3-Codex · GPT-5.3-Codex vs Qwen3.7 Max
Full ranking: Best AI for customer service replies · model pages: Gemini 3.1 Pro Preview, Qwen3.7 Max