Noometry

Model comparison

Grok 4.1 Fast vs Mistral Small

Grok 4.1 Fast is the stronger model overall, scoring 40.9 to 33.1 on the Noometry Index.

Last verified . 22 shared benchmarks.

Grok 4.1 Fast xAI

40.9

Rank #131 Confirmed

Mistral Small Mistral AI

33.1

Rank #238 Confirmed

Summary

  • They share 22 benchmarks with published results for both. Grok 4.1 Fast scores higher in 10 categories and Mistral Small in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.1 Fast leads 42.3 to 19.3.
  • The biggest single-benchmark swing is Berkeley Function Calling Leaderboard: 69.6% for Grok 4.1 Fast and 37.1% for Mistral Small.
  • Both cost about the same: $0.20 input and $0.50 output per million tokens.
  • Mistral Small accepts more context: 256K tokens versus 128K.
  • Mistral Small has downloadable open weights; the other is API-only.

Side by side

Grok 4.1 FastMistral Small
ProviderxAIMistral AI
Noometry Index40.933.1
Released2025-06-272024-02-26
WeightsProprietaryOpen
Context window128K256K
Max output30K256K
Input $ / M tokens$0.20$0.15
Output $ / M tokens$0.50$0.60
Results tracked3239

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Grok 4.1 Fast: 33.8 (#236), Mistral Small: 33.5 (#242)

BenchmarkGrok 4.1 FastMistral Small
LMArena Coding14111363
ALE-Bench394.93497.62
LMArena WebDev1241—
SciCode—26.5%
BigCodeBench Instruct—36.1%
LiveBench Coding—36.2%
BigCodeBench Complete—46.6%

Agentic & Tool Use Grok 4.1 Fast leads

Grok 4.1 Fast: 36.1 (#35), Mistral Small: 27.9 (#87)

BenchmarkGrok 4.1 FastMistral Small
Berkeley Function Calling Leaderboard69.6%37.1%
τ²-bench Banking13.1%—
LMArena Search1171—
Vending-Bench 21,107—

Reasoning Grok 4.1 Fast leads

Grok 4.1 Fast: 42.3 (#45), Mistral Small: 19.3 (#238)

BenchmarkGrok 4.1 FastMistral Small
LMArena Hard Prompts14071336
DTBench87.7%70.9%
SimpleBench56%—
Kagi LLM Benchmark—37.8%
NYT Connections (extended)87.4%—
CritPt—0%
LiveBench Reasoning—44.8%
LiveBench Data Analysis—53.7%
LMCA—20.6%
ForecastBench61—
LiveBench—44%

Math Grok 4.1 Fast leads

Grok 4.1 Fast: 30.9 (#201), Mistral Small: 15.4 (#287)

BenchmarkGrok 4.1 FastMistral Small
LMArena Math14081341
MathArena Final-Answer Competitions60.9%—
OTIS Mock AIME 2024-2025—5.8%
ProofBench4%—
LiveBench Math—39.9%
MATH Level 5—46.8%

Knowledge Grok 4.1 Fast leads

Grok 4.1 Fast: 32.6 (#203), Mistral Small: 30.9 (#214)

BenchmarkGrok 4.1 FastMistral Small
Vectara Hallucination Rate17.8%5.1%
LMArena Expert13981293
GPQA Diamond—47.5%
MMLU—68.7%

Multimodal Grok 4.1 Fast leads

Grok 4.1 Fast: 36.3 (#71), Mistral Small: 32.9 (#91)

BenchmarkGrok 4.1 FastMistral Small
LMArena Vision12011142

Multilingual Grok 4.1 Fast leads

Grok 4.1 Fast: 51.1 (#110), Mistral Small: 45.7 (#164)

BenchmarkGrok 4.1 FastMistral Small
LMArena Non-English13911315
LMArena Chinese14411342
LMArena French14161337
LMArena German14041341
LMArena Japanese13471275
LMArena Korean13611260
LMArena Russian13871324
LMArena Spanish14111346

Instruction Following Grok 4.1 Fast leads

Grok 4.1 Fast: 72.8 (#127), Mistral Small: 66.6 (#204)

BenchmarkGrok 4.1 FastMistral Small
LMArena Instruction Following13761310
LiveBench Instruction Following—63.7%

Long Context Grok 4.1 Fast leads

Grok 4.1 Fast: 42.4 (#121), Mistral Small: 40.4 (#151)

BenchmarkGrok 4.1 FastMistral Small
LMArena Longer Query13901327

Writing & Preference Grok 4.1 Fast leads

Grok 4.1 Fast: 57.4 (#126), Mistral Small: 52.6 (#165)

BenchmarkGrok 4.1 FastMistral Small
LMArena Text14081338
LMArena Creative Writing13941304
LMArena Multi-Turn13891344
EQ-Bench Creative Writing1327—
LiveBench Language—30.5%

Frequently asked questions

Is Grok 4.1 Fast better than Mistral Small?

Grok 4.1 Fast is the stronger model overall, scoring 40.9 to 33.1 on the Noometry Index.

Which is cheaper, Grok 4.1 Fast or Mistral Small?

Mistral Small is cheaper. It lists at $0.15 per million input tokens and $0.60 per million output tokens; Grok 4.1 Fast lists at $0.20 and $0.50.

Is Grok 4.1 Fast or Mistral Small better for coding?

They score almost the same on coding (33.8 vs 33.5); test both on your own repository before choosing.

Which has the bigger context window?

Mistral Small does, with 256K tokens against 128K.

How many benchmarks do Grok 4.1 Fast and Mistral Small share?

22 benchmarks have published results for both models. Grok 4.1 Fast has 32 scored results on Noometry and Mistral Small has 39.

Related comparisons

Go deeper