Noometry

Model comparison

Grok 4 Fast vs Qwen3.8 Max

Qwen3.8 Max is the stronger model overall, scoring 56.8 to 39.4 on the Noometry Index.

Last verified . 21 shared benchmarks.

Grok 4 Fast xAI

39.4

Rank #167 Confirmed

Qwen3.8 Max Alibaba (Qwen)

56.8

Rank #22 Confirmed

Summary

  • They share 21 benchmarks with published results for both. Grok 4 Fast scores higher in 1 category and Qwen3.8 Max in 8 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where Qwen3.8 Max leads 73.2 to 38.9.
  • The biggest single-benchmark swing is τ²-bench Banking: 15.7% for Grok 4 Fast and 55.1% for Qwen3.8 Max.

Side by side

Grok 4 FastQwen3.8 Max
ProviderxAIAlibaba (Qwen)
Noometry Index39.456.8
Released2025-09-192026-08-02
WeightsProprietaryProprietary
Context window—1M
Max output—131K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked3039

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.8 Max leads

Grok 4 Fast: 32.5 (#271), Qwen3.8 Max: 53.5 (#29)

BenchmarkGrok 4 FastQwen3.8 Max
LMArena WebDev11591674
LMArena Coding14291502
DeepSWE—57.5%
FrontierSWE—17.8%
SciCode—53.2%
WeirdML42.9%—

Agentic & Tool Use Qwen3.8 Max leads

Grok 4 Fast: 29.5 (#86), Qwen3.8 Max: 45.4 (#14)

BenchmarkGrok 4 FastQwen3.8 Max
τ²-bench Banking15.7%55.1%
APEX-Agents—63.3%
Cybench30%—
GDP.pdf—23.2%
LMArena Search1171—

Reasoning Qwen3.8 Max leads

Grok 4 Fast: 22.2 (#201), Qwen3.8 Max: 54.4 (#26)

BenchmarkGrok 4 FastQwen3.8 Max
LMArena Hard Prompts14121496
DTBench82.7%92%
Epoch Capabilities Index144.2156.41
ARC-AGI-25.3%—
Kagi LLM Benchmark66.1%—
NYT Connections (extended)—88.3%
ARC-AGI-148.5%—
CritPt—20%
Chess Puzzles—40%
Mystery Game Puzzles—38%
LMCA—46.2%
ForecastBench60.5—

Math Qwen3.8 Max leads

Grok 4 Fast: 38.9 (#123), Qwen3.8 Max: 73.2 (#20)

BenchmarkGrok 4 FastQwen3.8 Max
LMArena Math14191499
FrontierMath (Tiers 1-3)—74.7%
FrontierMath Tier 4—46.3%
OTIS Mock AIME 2024-2025—100%
ProofBench—58%

Knowledge Qwen3.8 Max leads

Grok 4 Fast: 32.0 (#214), Qwen3.8 Max: 61.7 (#27)

BenchmarkGrok 4 FastQwen3.8 Max
LMArena Expert14111507
GPQA Diamond—92.7%
SimpleQA Verified—47.3%
Vectara Hallucination Rate19.7%—

Multimodal Not comparable

Grok 4 Fast: —, Qwen3.8 Max: 37.2 (#75)

BenchmarkGrok 4 FastQwen3.8 Max
LMArena Vision—1314
Furniture Assembly—20%

Multilingual Qwen3.8 Max leads

Grok 4 Fast: 51.3 (#111), Qwen3.8 Max: 56.7 (#18)

BenchmarkGrok 4 FastQwen3.8 Max
LMArena Non-English13961472
LMArena Chinese14571538
LMArena French14311503
LMArena German13831483
LMArena Japanese13521467
LMArena Korean13571461
LMArena Russian13891481
LMArena Spanish14151492

Instruction Following Qwen3.8 Max leads

Grok 4 Fast: 73.2 (#121), Qwen3.8 Max: 77.6 (#17)

BenchmarkGrok 4 FastQwen3.8 Max
LMArena Instruction Following13871479

Long Context Grok 4 Fast leads

Grok 4 Fast: 63.2 (#3), Qwen3.8 Max: 45.6 (#31)

BenchmarkGrok 4 FastQwen3.8 Max
LMArena Longer Query14151489
Fiction.LiveBench94.4%—

Writing & Preference Qwen3.8 Max leads

Grok 4 Fast: 60.0 (#102), Qwen3.8 Max: 67.1 (#30)

BenchmarkGrok 4 FastQwen3.8 Max
LMArena Text14071483
LMArena Creative Writing13871479
LMArena Multi-Turn14141489

Frequently asked questions

Is Grok 4 Fast better than Qwen3.8 Max?

Qwen3.8 Max is the stronger model overall, scoring 56.8 to 39.4 on the Noometry Index.

Is Grok 4 Fast or Qwen3.8 Max better for coding?

Qwen3.8 Max scores higher on coding benchmarks: 53.5 versus 32.5 in the Noometry coding category.

How many benchmarks do Grok 4 Fast and Qwen3.8 Max share?

21 benchmarks have published results for both models. Grok 4 Fast has 30 scored results on Noometry and Qwen3.8 Max has 39.

Related comparisons

Go deeper