Model comparison

Grok 2 Mini 2024 08 13 vs Qwen3.5 Max Preview

Qwen3.5 Max Preview is the stronger model overall, scoring 44.7 to 37.0 on the Noometry Index.

Last verified . 17 shared benchmarks.

Grok 2 Mini 2024 08 13 xAI

37.0

Rank #196 Confirmed

Qwen3.5 Max Preview Alibaba (Qwen)

44.7

Rank #72 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Grok 2 Mini 2024 08 13 scores higher in 0 categories and Qwen3.5 Max Preview in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen3.5 Max Preview leads 66.1 to 47.5.

Side by side

Grok 2 Mini 2024 08 13 and Qwen3.5 Max Preview specifications
Grok 2 Mini 2024 08 13Qwen3.5 Max Preview
ProviderxAIAlibaba (Qwen)
Noometry Index37.044.7
Released2024-08-13—
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1717

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.5 Max Preview leads

Grok 2 Mini 2024 08 13: 36.4 (#194), Qwen3.5 Max Preview: 43.4 (#79)

Coding benchmarks
BenchmarkGrok 2 Mini 2024 08 13Qwen3.5 Max Preview
LMArena Coding12691488

Reasoning Qwen3.5 Max Preview leads

Grok 2 Mini 2024 08 13: 23.7 (#162), Qwen3.5 Max Preview: 29.6 (#81)

Reasoning benchmarks
BenchmarkGrok 2 Mini 2024 08 13Qwen3.5 Max Preview
LMArena Hard Prompts12551483

Math Qwen3.5 Max Preview leads

Grok 2 Mini 2024 08 13: 32.8 (#185), Qwen3.5 Max Preview: 37.3 (#99)

Math benchmarks
BenchmarkGrok 2 Mini 2024 08 13Qwen3.5 Max Preview
LMArena Math12651473

Knowledge Qwen3.5 Max Preview leads

Grok 2 Mini 2024 08 13: 33.4 (#195), Qwen3.5 Max Preview: 41.1 (#104)

Knowledge benchmarks
BenchmarkGrok 2 Mini 2024 08 13Qwen3.5 Max Preview
LMArena Expert12381489

Multilingual Qwen3.5 Max Preview leads

Grok 2 Mini 2024 08 13: 41.6 (#203), Qwen3.5 Max Preview: 56.4 (#21)

Multilingual benchmarks
BenchmarkGrok 2 Mini 2024 08 13Qwen3.5 Max Preview
LMArena Non-English12571465
LMArena Chinese12621534
LMArena French12851483
LMArena German12731487
LMArena Japanese12131497
LMArena Korean11951438
LMArena Russian12611472
LMArena Spanish12781470

Instruction Following Qwen3.5 Max Preview leads

Grok 2 Mini 2024 08 13: 65.7 (#215), Qwen3.5 Max Preview: 77.2 (#28)

Instruction Following benchmarks
BenchmarkGrok 2 Mini 2024 08 13Qwen3.5 Max Preview
LMArena Instruction Following12451467

Long Context Qwen3.5 Max Preview leads

Grok 2 Mini 2024 08 13: 38.4 (#191), Qwen3.5 Max Preview: 45.2 (#44)

Long Context benchmarks
BenchmarkGrok 2 Mini 2024 08 13Qwen3.5 Max Preview
LMArena Longer Query12671477

Writing & Preference Qwen3.5 Max Preview leads

Grok 2 Mini 2024 08 13: 47.5 (#207), Qwen3.5 Max Preview: 66.1 (#39)

Writing & Preference benchmarks
BenchmarkGrok 2 Mini 2024 08 13Qwen3.5 Max Preview
LMArena Text12811471
LMArena Creative Writing12421464
LMArena Multi-Turn12651478

Frequently asked questions

Is Grok 2 Mini 2024 08 13 better than Qwen3.5 Max Preview?

Qwen3.5 Max Preview is the stronger model overall, scoring 44.7 to 37.0 on the Noometry Index.

Is Grok 2 Mini 2024 08 13 or Qwen3.5 Max Preview better for coding?

Qwen3.5 Max Preview scores higher on coding benchmarks: 43.4 versus 36.4 in the Noometry coding category.

How many benchmarks do Grok 2 Mini 2024 08 13 and Qwen3.5 Max Preview share?

17 benchmarks have published results for both models. Grok 2 Mini 2024 08 13 has 17 scored results on Noometry and Qwen3.5 Max Preview has 17.

Related comparisons

Go deeper