Gemma 4 or Qwen: which local model writes better English?
The two open-weight families most people download, run on our own machine and judged on the same English prompts in blind duels: which one writes better, in which kinds of text, and what it costs in memory.
The verdict
Qwen3.8 27B by Alibaba (Q4_K_M, thinking xhigh) writes better English than Gemma 4 31B by Google (Q8_0, thinking on) in our blind duels: rank 51 against rank 58 on the leaderboard, score 56.7 against 51.6.
Head to head, Gemma 4 takes 45.8% of the points over 24 direct duels (10 wins, 2 ties, 12 losses). Gemma 4 leads in 4 of the 10 kinds of writing where both have been judged, Qwen in 6.
| Model | Rank | Score | Duels |
|---|---|---|---|
| Gemma 4 | 58 | 51.6 | 2,887 |
| Qwen | 51 | 56.7 | 2,524 |
Each side is its best-ranked variant in this edition: Gemma 4 31B by Google (Q8_0, thinking on) for Gemma 4, Qwen3.8 27B by Alibaba (Q4_K_M, thinking xhigh) for Qwen. When a better variant of either arrives, this page follows it.
Kind of writing by kind of writing
Score and rank recomputed on the duels of each category alone; the leader is in colour. Click a kind of writing for its full ranking.
| Kind of writing | Gemma 4 | Qwen | Direct duels |
|---|---|---|---|
| Articles, blogs and editorial | 36.6 #72 | 92.7 #12 | — |
| Dialogue and screenplay | 87.1 #26 | 15.6 #84 | — |
| Explanation and popularization | 47.2 #67 | 62.6 #42 | — |
| Fiction and narrative | 21.5 #78 | 94.3 #17 | — |
| Marketing and sales | 43.5 #63 | 21.7 #91 | — |
| Personal communication | 53.7 #52 | 54.7 #51 | 9–2–10 |
| Professional and administrative | 45.4 #69 | 64.8 #44 | 0–0–1 |
| Social media and short formats | 32.9 #74 | 82.7 #22 | 0–0–1 |
| Speech and public speaking | 80.8 #28 | 50.0 #58 | 1–0–0 |
| Structured documents and reports | 87.8 #9 | 73.4 #39 | — |
Direct duels read wins–ties–losses for the first model. A dash means the model has not yet been judged in that category.
What each side stands for
“Gemma 4” is Google’s open-weight family, “Qwen” Alibaba’s, and each side is represented by its best-ranked file in this edition: a given size and a given quantization, run in LM Studio on our Framework Desktop with reasoning on where the file supports it. The table above names the two files. The other sizes and quantizations of both families, with what each needs in memory, are on the Local AI page.
What the numbers measure
Blind duels: two anonymous texts for the same English prompt, an AI judge picking the better one without seeing the names. Local files meet cloud models in the same pool, so their scores are on the same scale as the rest of the leaderboard. The direct record counts only the duels where these two files met.
How to choose
For a local model the decision is rarely quality alone. Qwen’s best files need a reasoning pass that makes them slow; Gemma 4 comes in sizes from 2 to 31 billion parameters and its mixture-of-experts build writes fast. If the two are close on the kind of writing you do, take the file that fits your memory with room for context, then check the quantization and reasoning articles: for these two families both settings move the score by tens of points.
Writing example
Prompt
Write a very short toast (50–150 words) to be delivered by the best man, Sam, at the wedding reception of his childhood friends Priya and Leo. Include a light, affectionate memory of the three of them building a leaky raft one summer, a warm compliment about how well Priya and Leo balance each other, and a heartfelt wish for their future. End by inviting the guests to raise their glasses. Keep the tone celebratory, sincere, and suitable to say aloud.
Published verdict: Gemma 4 (judged by Claude Opus 5.5).
Gemma 4 ·
Gemma 4 31B 💡 🏠
"Hi everyone, I'm Sam. Growing up with Priya and Leo was always an adventure—usually a chaotic one. I’ll never forget the summer we spent weeks building that raft, only for it to leak immediately and sink ten feet from the shore. We spent the rest of the afternoon laughing in the mud, and that’s always been the magic of these two.
Seeing you both today, it's clear how perfectly you balance each other; Leo provides the calm to Priya’s spark, and she gives him a reason to be bold. May your life together be filled with endless laughter, deep love, and significantly fewer sinking boats.
Please join me in raising your glasses to Priya and Leo!"
Qwen ·
Qwen3.8 27B 💡 🏠
Hi everyone—Sam here. Priya and Leo have been my best friends since we were kids, so I’m honored to be here. One summer, the three of us built a raft out of whatever we could find. It was beautiful, creative, and completely leaky. We spent the afternoon bailing water while laughing like it was the greatest adventure ever. That’s kind of what their relationship feels like: joyful, a little messy sometimes, but always full of love. Priya brings warmth and wisdom; Leo brings steadiness and humor. Together they balance each other in the best way. So here’s to you two—may your future be filled with laughter, patience, adventure, and all the quiet moments that make a life together feel like home. Please raise your glasses.



