Model comparison

Grok 4.5 vs Mistral

Grok 4.5 is the stronger model overall, scoring 55.0 to 29.9 on the Noometry Index.

Last verified . 17 shared benchmarks.

Grok 4.5 xAI

55.0

Rank #25 Confirmed

Mistral Mistral AI

29.9

Rank #303 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Grok 4.5 scores higher in 8 categories and Mistral in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Grok 4.5 leads 62.3 to 16.6.

Side by side

Grok 4.5 and Mistral specifications
Grok 4.5Mistral
ProviderxAIMistral AI
Noometry Index55.029.9
Released2026-07-08—
WeightsProprietaryProprietary
Context window500K—
Max output500K—
Input $ / M tokens$2—
Output $ / M tokens$6—
Results tracked5222

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.5 leads

Grok 4.5: 52.2 (#35), Mistral: 33.8 (#250)

Coding benchmarks
BenchmarkGrok 4.5Mistral
LMArena Coding14741162
DeepSWE53.8%—
FrontierCode42.4%—
LMArena WebDev1553—
SciCode54.1%—
WeirdML46.4%—
ALE-Bench1,309—

Agentic & Tool Use Not comparable

Grok 4.5: 44.4 (#17), Mistral: —

Agentic & Tool Use benchmarks
BenchmarkGrok 4.5Mistral
APEX-Agents56.2%—
τ²-bench Banking47.9%—
PostTrainBench23.4%—
GBAEval65.4%—
GDP.pdf14%—
LMArena Search1213—
Vending-Bench 23,887—

Reasoning Grok 4.5 leads

Grok 4.5: 56.1 (#25), Mistral: 22.2 (#200)

Reasoning benchmarks
BenchmarkGrok 4.5Mistral
LMArena Hard Prompts14621149
ARC-AGI-252.6%—
SimpleBench70%—
Kagi LLM Benchmark83.5%—
NYT Connections (extended)79.9%—
ARC-AGI-187.2%—
CritPt15.4%—
Chess Puzzles36%—
DTBench96.5%—
LMCA45.2%—
Surface Evolver Bench74.4%—
Epoch Capabilities Index153.92—

Math Grok 4.5 leads

Grok 4.5: 60.9 (#35), Mistral: 22.3 (#278)

Math benchmarks
BenchmarkGrok 4.5Mistral
LMArena Math14591180
FrontierMath (Tiers 1-3)57.2%—
FrontierMath Tier 424.4%—
OTIS Mock AIME 2024-202597.8%—
ProofBench31%—
Omni-MATH—7.2%

Knowledge Grok 4.5 leads

Grok 4.5: 62.3 (#24), Mistral: 16.6 (#288)

Knowledge benchmarks
BenchmarkGrok 4.5Mistral
LMArena Expert14661125
GPQA Diamond93.4%—
SimpleQA Verified48.3%—
MMLU-Pro—27.7%
GPQA (HELM)—30.3%

Multimodal Not comparable

Grok 4.5: 37.6 (#72), Mistral: —

Multimodal benchmarks
BenchmarkGrok 4.5Mistral
LMArena Vision1288—
Blueprint-Bench 227.3%—
Furniture Assembly22.5%—
LMArena Document1452—

Multilingual Grok 4.5 leads

Grok 4.5: 54.4 (#42), Mistral: 32.8 (#254)

Multilingual benchmarks
BenchmarkGrok 4.5Mistral
LMArena Non-English14401129
LMArena Chinese14961109
LMArena French14561180
LMArena German14461155
LMArena Japanese14281013
LMArena Korean14041032
LMArena Russian14481168
LMArena Spanish14501143

Instruction Following Grok 4.5 leads

Grok 4.5: 76.0 (#48), Mistral: 52.6 (#288)

Instruction Following benchmarks
BenchmarkGrok 4.5Mistral
LMArena Instruction Following14461152
IFEval—56.8%

Long Context Grok 4.5 leads

Grok 4.5: 44.8 (#56), Mistral: 35.0 (#245)

Long Context benchmarks
BenchmarkGrok 4.5Mistral
LMArena Longer Query14631153

Writing & Preference Grok 4.5 leads

Grok 4.5: 65.8 (#42), Mistral: 37.0 (#260)

Writing & Preference benchmarks
BenchmarkGrok 4.5Mistral
LMArena Text14481165
LMArena Creative Writing14421158
LMArena Multi-Turn14561147
EQ-Bench Creative Writing1579—
WildBench—66%

Frequently asked questions

Is Grok 4.5 better than Mistral?

Grok 4.5 is the stronger model overall, scoring 55.0 to 29.9 on the Noometry Index.

Is Grok 4.5 or Mistral better for coding?

Grok 4.5 scores higher on coding benchmarks: 52.2 versus 33.8 in the Noometry coding category.

How many benchmarks do Grok 4.5 and Mistral share?

17 benchmarks have published results for both models. Grok 4.5 has 52 scored results on Noometry and Mistral has 22.

Related comparisons

Go deeper