Noometry

Model comparison

Grok 4.1 Fast vs Mistral Large

Grok 4.1 Fast is the stronger model overall, scoring 40.9 to 31.6 on the Noometry Index.

Last verified . 24 shared benchmarks.

Grok 4.1 Fast xAI

40.9

Rank #131 Confirmed

Mistral Large Mistral AI

31.6

Rank #258 Confirmed

Summary

  • They share 24 benchmarks with published results for both. Grok 4.1 Fast scores higher in 9 categories and Mistral Large in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.1 Fast leads 42.3 to 15.4.
  • The biggest single-benchmark swing is SimpleBench: 56% for Grok 4.1 Fast and 22.5% for Mistral Large.
  • Grok 4.1 Fast is cheaper at $0.20 / $0.50 per million input/output tokens, against $2 / $6 for Mistral Large.
  • Mistral Large accepts more context: 131K tokens versus 128K.
  • Mistral Large has downloadable open weights; the other is API-only.

Side by side

Grok 4.1 FastMistral Large
ProviderxAIMistral AI
Noometry Index40.931.6
Released2025-06-272024-02-26
WeightsProprietaryOpen
Context window128K131K
Max output30K16K
Input $ / M tokens$0.20$2
Output $ / M tokens$0.50$6
Results tracked3251

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Grok 4.1 Fast: 33.8 (#236), Mistral Large: 33.8 (#240)

BenchmarkGrok 4.1 FastMistral Large
LMArena Coding14111277
ALE-Bench394.93264.7
LMArena WebDev1241—
SciCode—36.2%
BigCodeBench Instruct—30%
LiveBench Coding—47.1%
BigCodeBench Complete—38.3%
HumanEval+—62.2%
MBPP+—59.5%

Agentic & Tool Use Grok 4.1 Fast leads

Grok 4.1 Fast: 36.1 (#35), Mistral Large: 28.4 (#83)

BenchmarkGrok 4.1 FastMistral Large
Berkeley Function Calling Leaderboard69.6%38.4%
τ²-bench Banking13.1%—
LMArena Search1171—
Vending-Bench 21,107—

Reasoning Grok 4.1 Fast leads

Grok 4.1 Fast: 42.3 (#45), Mistral Large: 15.4 (#305)

BenchmarkGrok 4.1 FastMistral Large
SimpleBench56%22.5%
LMArena Hard Prompts14071257
DTBench87.7%65.1%
ForecastBench6157.1
NYT Connections (extended)87.4%—
CritPt—0%
LiveBench Reasoning—43.5%
LiveBench Data Analysis—50.1%
LMCA—16.7%
Epoch Capabilities Index—128.52
LiveBench—48.4%

Math Grok 4.1 Fast leads

Grok 4.1 Fast: 30.9 (#201), Mistral Large: 17.1 (#285)

BenchmarkGrok 4.1 FastMistral Large
LMArena Math14081262
MathArena Final-Answer Competitions60.9%—
OTIS Mock AIME 2024-2025—8.5%
ProofBench4%—
Omni-MATH—28.1%
LiveBench Math—42.5%
MATH Level 5—50.3%
FrontierMath (Feb 2025 set)—0.3%

Knowledge Grok 4.1 Fast leads

Grok 4.1 Fast: 32.6 (#203), Mistral Large: 30.0 (#224)

BenchmarkGrok 4.1 FastMistral Large
Vectara Hallucination Rate17.8%4.5%
LMArena Expert13981232
GPQA Diamond—51.3%
MMLU-Pro—59.9%
Confabulations—21.4%
GPQA (HELM)—43.5%
MMLU—80%

Multimodal Not comparable

Grok 4.1 Fast: 36.3 (#71), Mistral Large: —

BenchmarkGrok 4.1 FastMistral Large
LMArena Vision1201—

Multilingual Grok 4.1 Fast leads

Grok 4.1 Fast: 51.1 (#110), Mistral Large: 40.1 (#214)

BenchmarkGrok 4.1 FastMistral Large
LMArena Non-English13911237
LMArena Chinese14411240
LMArena French14161324
LMArena German14041254
LMArena Japanese13471187
LMArena Korean13611202
LMArena Russian13871257
LMArena Spanish14111268

Instruction Following Grok 4.1 Fast leads

Grok 4.1 Fast: 72.8 (#127), Mistral Large: 68.1 (#186)

BenchmarkGrok 4.1 FastMistral Large
LMArena Instruction Following13761249
LiveBench Instruction Following—67.9%
IFEval—87.7%

Long Context Grok 4.1 Fast leads

Grok 4.1 Fast: 42.4 (#121), Mistral Large: 38.3 (#194)

BenchmarkGrok 4.1 FastMistral Large
LMArena Longer Query13901262

Writing & Preference Grok 4.1 Fast leads

Grok 4.1 Fast: 57.4 (#126), Mistral Large: 40.9 (#237)

BenchmarkGrok 4.1 FastMistral Large
LMArena Text14081266
LMArena Creative Writing13941243
EQ-Bench Creative Writing1327985
LMArena Multi-Turn13891260
Short-Story Creative Writing—69%
WildBench—80.1%
LiveBench Language—39.4%

Frequently asked questions

Is Grok 4.1 Fast better than Mistral Large?

Grok 4.1 Fast is the stronger model overall, scoring 40.9 to 31.6 on the Noometry Index.

Which is cheaper, Grok 4.1 Fast or Mistral Large?

Grok 4.1 Fast is cheaper. It lists at $0.20 per million input tokens and $0.50 per million output tokens; Mistral Large lists at $2 and $6.

Is Grok 4.1 Fast or Mistral Large better for coding?

They score almost the same on coding (33.8 vs 33.8); test both on your own repository before choosing.

Which has the bigger context window?

Mistral Large does, with 131K tokens against 128K.

How many benchmarks do Grok 4.1 Fast and Mistral Large share?

24 benchmarks have published results for both models. Grok 4.1 Fast has 32 scored results on Noometry and Mistral Large has 51.

Related comparisons

Go deeper