Model comparison

Gemma 4 31B IT vs Qwen3 Max

Gemma 4 31B IT and Qwen3 Max score almost the same on the Noometry Index (43.5 vs 43.7), so choose on price, context window or the category you care about most.

Last verified October 10, 2026. 24 shared benchmarks.

Gemma 4 31B IT

Google

43.5

Rank #90 Confirmed

Qwen3 Max

Alibaba (Qwen)

43.7

Rank #87 Confirmed

Summary

They share 24 benchmarks with published results for both. Gemma 4 31B IT scores higher in 5 categories and Qwen3 Max in 3 categories; 5 gaps are clear of the uncertainty.
The widest gap is in knowledge, where Qwen3 Max leads 48.1 to 37.9.
The biggest single-benchmark swing is NYT Connections (extended): 70.6% for Gemma 4 31B IT and 30.1% for Qwen3 Max.
Gemma 4 31B IT is cheaper at $0.09 / $0.34 per million input/output tokens, against $1.20 / $6 for Qwen3 Max.
Gemma 4 31B IT has downloadable open weights; the other is API-only.

Side by side

Gemma 4 31B IT and Qwen3 Max specifications
	Gemma 4 31B IT	Qwen3 Max
Provider	Google	Alibaba (Qwen)
Noometry Index	43.5	43.7
Released	2026-04-02	2025-09-23
Weights	Open	Proprietary
Context window	262K	262K
Max output	33K	66K
Input $ / M tokens	$0.09	$1.20
Output $ / M tokens	$0.34	$6
Results tracked	35	33

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Gemma 4 31B IT: 42.3 (#108), Qwen3 Max: 43.0 (#93)

Coding benchmarks
Benchmark	Gemma 4 31B IT	Qwen3 Max
LMArena Coding	1459	1456
ALE-Bench	925.5	370.45
LMArena WebDev	1366	—
SciCode	43.4%	—
WeirdML	52.3%	—

Agentic & Tool Use Not comparable

Gemma 4 31B IT: —, Qwen3 Max: —

Agentic & Tool Use benchmarks
Benchmark	Gemma 4 31B IT	Qwen3 Max
Vending-Bench 2	—	71.56

Reasoning Gemma 4 31B IT leads

Gemma 4 31B IT: 27.2 (#122), Qwen3 Max: 22.6 (#190)

Reasoning benchmarks
Benchmark	Gemma 4 31B IT	Qwen3 Max
Kagi LLM Benchmark	63.5%	72.5%
NYT Connections (extended)	70.6%	30.1%
Chess Puzzles	5%	4%
LMArena Hard Prompts	1448	1448
DTBench	82.7%	82.1%
LMCA	39.3%	28.3%
Epoch Capabilities Index	142.74	142.38
CritPt	1.4%	—
Thematic Generalization	53%	—
Mystery Game Puzzles	—	5%
Surface Evolver Bench	30.6%	—

Math Gemma 4 31B IT leads

Gemma 4 31B IT: 43.2 (#81), Qwen3 Max: 38.7 (#131)

Math benchmarks
Benchmark	Gemma 4 31B IT	Qwen3 Max
OTIS Mock AIME 2024-2025	73.3%	73.3%
LMArena Math	1465	1446
FrontierMath (Tiers 1-3)	—	18.9%
MATH Level 5	—	97.1%

Knowledge Qwen3 Max leads

Gemma 4 31B IT: 37.9 (#151), Qwen3 Max: 48.1 (#78)

Knowledge benchmarks
Benchmark	Gemma 4 31B IT	Qwen3 Max
GPQA Diamond	75.8%	72.6%
SimpleQA Verified	10.4%	48.7%
LMArena Expert	1465	1455
Vectara Hallucination Rate	7.4%	—

Multimodal Not comparable

Gemma 4 31B IT: 41.6 (#34), Qwen3 Max: —

Multimodal benchmarks
Benchmark	Gemma 4 31B IT	Qwen3 Max
LMArena Vision	1277	—
LMArena Document	1425	—

Multilingual Too close to call

Gemma 4 31B IT: 53.8 (#57), Qwen3 Max: 53.7 (#62)

Multilingual benchmarks
Benchmark	Gemma 4 31B IT	Qwen3 Max
LMArena Non-English	1431	1429
LMArena Chinese	1476	1478
LMArena French	1435	1449
LMArena Russian	1460	1428
LMArena Spanish	1444	1462
LMArena German	—	1463
LMArena Japanese	—	1397
LMArena Korean	—	1399

Instruction Following Too close to call

Gemma 4 31B IT: 75.5 (#61), Qwen3 Max: 74.8 (#87)

Instruction Following benchmarks
Benchmark	Gemma 4 31B IT	Qwen3 Max
LMArena Instruction Following	1433	1419

Long Context Gemma 4 31B IT leads

Gemma 4 31B IT: 44.2 (#71), Qwen3 Max: 41.6 (#134)

Long Context benchmarks
Benchmark	Gemma 4 31B IT	Qwen3 Max
LMArena Longer Query	1446	1438
Fiction.LiveBench	—	66.7%
CL-bench	—	14.5%

Writing & Preference Qwen3 Max leads

Gemma 4 31B IT: 60.5 (#96), Qwen3 Max: 62.4 (#76)

Writing & Preference benchmarks
Benchmark	Gemma 4 31B IT	Qwen3 Max
LMArena Text	1443	1439
LMArena Creative Writing	1415	1402
LMArena Multi-Turn	1452	1446
EQ-Bench Creative Writing	1368	—
EQ-Bench 4	1120	—

Frequently asked questions

Is Gemma 4 31B IT better than Qwen3 Max?

Gemma 4 31B IT and Qwen3 Max score almost the same on the Noometry Index (43.5 vs 43.7), so choose on price, context window or the category you care about most.

Which is cheaper, Gemma 4 31B IT or Qwen3 Max?

Gemma 4 31B IT is cheaper. It lists at $0.09 per million input tokens and $0.34 per million output tokens; Qwen3 Max lists at $1.20 and $6.

Is Gemma 4 31B IT or Qwen3 Max better for coding?

They score almost the same on coding (42.3 vs 43.0); test both on your own repository before choosing.

Which has the bigger context window?

Both accept 262K tokens.

How many benchmarks do Gemma 4 31B IT and Qwen3 Max share?

24 benchmarks have published results for both models. Gemma 4 31B IT has 35 scored results on Noometry and Qwen3 Max has 33.