Noometry

Model comparison

Grok 4.1 Fast vs Qwen3.8 Max

Qwen3.8 Max is the stronger model overall, scoring 56.8 to 41.4 on the Noometry Index. Grok 4.1 Fast costs 11× less per token, which makes it the better buy when Qwen3.8 Max's lead doesn't matter for your workload.

Last verified . 23 shared benchmarks.

Grok 4.1 Fast xAI

41.4

Rank #136 Confirmed

Qwen3.8 Max Alibaba (Qwen)

56.8

Rank #22 Confirmed

Summary

  • They share 23 benchmarks with published results for both. Grok 4.1 Fast scores higher in 0 categories and Qwen3.8 Max in 10 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where Qwen3.8 Max leads 73.2 to 31.9.
  • The biggest single-benchmark swing is ProofBench: 4% for Grok 4.1 Fast and 58% for Qwen3.8 Max.
  • Grok 4.1 Fast is cheaper at $0.20 / $0.50 per million input/output tokens, against $2 / $6 for Qwen3.8 Max.
  • Qwen3.8 Max accepts more context: 1M tokens versus 128K.

Side by side

Grok 4.1 FastQwen3.8 Max
ProviderxAIAlibaba (Qwen)
Noometry Index41.456.8
Released2025-06-272026-08-02
WeightsProprietaryProprietary
Context window128K1M
Max output30K131K
Input $ / M tokens$0.20$2
Output $ / M tokens$0.50$6
Results tracked3239

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.8 Max leads

Grok 4.1 Fast: 34.1 (#245), Qwen3.8 Max: 53.5 (#29)

BenchmarkGrok 4.1 FastQwen3.8 Max
LMArena WebDev12421674
LMArena Coding14111502
DeepSWE—57.5%
FrontierSWE—17.8%
SciCode—53.2%
ALE-Bench394.93—

Agentic & Tool Use Qwen3.8 Max leads

Grok 4.1 Fast: 36.3 (#39), Qwen3.8 Max: 45.4 (#14)

BenchmarkGrok 4.1 FastQwen3.8 Max
τ²-bench Banking13.1%55.1%
APEX-Agents—63.3%
Berkeley Function Calling Leaderboard69.6%—
GDP.pdf—23.2%
LMArena Search1171—
Vending-Bench 21,107—

Reasoning Qwen3.8 Max leads

Grok 4.1 Fast: 43.4 (#49), Qwen3.8 Max: 54.4 (#26)

BenchmarkGrok 4.1 FastQwen3.8 Max
NYT Connections (extended)87.4%88.3%
LMArena Hard Prompts14071496
DTBench87.7%92%
SimpleBench56%—
CritPt—20%
Chess Puzzles—40%
Mystery Game Puzzles—38%
LMCA—46.2%
Epoch Capabilities Index—156.41
ForecastBench61—

Math Qwen3.8 Max leads

Grok 4.1 Fast: 31.9 (#221), Qwen3.8 Max: 73.2 (#20)

BenchmarkGrok 4.1 FastQwen3.8 Max
ProofBench4%58%
LMArena Math14081499
FrontierMath (Tiers 1-3)—74.7%
FrontierMath Tier 4—46.3%
MathArena Final-Answer Competitions60.9%—
OTIS Mock AIME 2024-2025—100%

Knowledge Qwen3.8 Max leads

Grok 4.1 Fast: 33.1 (#207), Qwen3.8 Max: 61.7 (#27)

BenchmarkGrok 4.1 FastQwen3.8 Max
LMArena Expert13991507
GPQA Diamond—92.7%
SimpleQA Verified—47.3%
Vectara Hallucination Rate17.8%—

Multimodal Too close to call

Grok 4.1 Fast: 37.0 (#76), Qwen3.8 Max: 37.2 (#75)

BenchmarkGrok 4.1 FastQwen3.8 Max
LMArena Vision12011314
Furniture Assembly—20%

Multilingual Qwen3.8 Max leads

Grok 4.1 Fast: 51.0 (#114), Qwen3.8 Max: 56.7 (#18)

BenchmarkGrok 4.1 FastQwen3.8 Max
LMArena Non-English13911472
LMArena Chinese14411538
LMArena French14151503
LMArena German14041483
LMArena Japanese13491467
LMArena Korean13611461
LMArena Russian13871481
LMArena Spanish14131492

Instruction Following Qwen3.8 Max leads

Grok 4.1 Fast: 72.7 (#133), Qwen3.8 Max: 77.6 (#17)

BenchmarkGrok 4.1 FastQwen3.8 Max
LMArena Instruction Following13761479

Long Context Qwen3.8 Max leads

Grok 4.1 Fast: 42.4 (#126), Qwen3.8 Max: 45.6 (#31)

BenchmarkGrok 4.1 FastQwen3.8 Max
LMArena Longer Query13901489

Writing & Preference Qwen3.8 Max leads

Grok 4.1 Fast: 57.2 (#131), Qwen3.8 Max: 67.1 (#30)

BenchmarkGrok 4.1 FastQwen3.8 Max
LMArena Text14081483
LMArena Creative Writing13941479
LMArena Multi-Turn13891489
EQ-Bench Creative Writing1327—

Frequently asked questions

Is Grok 4.1 Fast better than Qwen3.8 Max?

Qwen3.8 Max is the stronger model overall, scoring 56.8 to 41.4 on the Noometry Index. Grok 4.1 Fast costs 11× less per token, which makes it the better buy when Qwen3.8 Max's lead doesn't matter for your workload.

Which is cheaper, Grok 4.1 Fast or Qwen3.8 Max?

Grok 4.1 Fast is cheaper. It lists at $0.20 per million input tokens and $0.50 per million output tokens; Qwen3.8 Max lists at $2 and $6.

Is Grok 4.1 Fast or Qwen3.8 Max better for coding?

Qwen3.8 Max scores higher on coding benchmarks: 53.5 versus 34.1 in the Noometry coding category.

Which has the bigger context window?

Qwen3.8 Max does, with 1M tokens against 128K.

How many benchmarks do Grok 4.1 Fast and Qwen3.8 Max share?

23 benchmarks have published results for both models. Grok 4.1 Fast has 32 scored results on Noometry and Qwen3.8 Max has 39.

Related comparisons

Go deeper