Model comparison

Codestral vs Grok 4 Fast

Grok 4 Fast is the stronger model overall, scoring 39.0 to 30.1 on the Noometry Index.

Last verified . 1 shared benchmarks.

Codestral Mistral AI

30.1

Rank #287 Reported

Grok 4 Fast xAI

39.0

Rank #164 Confirmed

Summary

  • They share 1 benchmark with published results for both. Codestral scores higher in 0 categories and Grok 4 Fast in 2 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in coding, where Grok 4 Fast leads 32.3 to 26.9.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 32.5% for Codestral and 66.1% for Grok 4 Fast.
  • Codestral has downloadable open weights; the other is API-only.

Side by side

Codestral and Grok 4 Fast specifications
CodestralGrok 4 Fast
ProviderMistral AIxAI
Noometry Index30.139.0
Released2024-05-292025-09-19
WeightsOpenProprietary
Context window256K—
Max output4K—
Input $ / M tokens$0.30—
Output $ / M tokens$0.90—
Results tracked730

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4 Fast leads

Codestral: 26.9 (#316), Grok 4 Fast: 32.3 (#264)

Coding benchmarks
BenchmarkCodestralGrok 4 Fast
Aider Polyglot11.1%—
LMArena WebDev—1160
WeirdML—42.9%
BigCodeBench Instruct41.8%—
LMArena Coding—1429
BigCodeBench Complete52.5%—
ALE-Bench137.78—
HumanEval+73.8%—
MBPP+61.9%—

Agentic & Tool Use Not comparable

Codestral: —, Grok 4 Fast: 29.3 (#80)

Agentic & Tool Use benchmarks
BenchmarkCodestralGrok 4 Fast
τ²-bench Banking—15.7%
Cybench—30%
LMArena Search—1171

Reasoning Grok 4 Fast leads

Codestral: 19.1 (#244), Grok 4 Fast: 22.5 (#179)

Reasoning benchmarks
BenchmarkCodestralGrok 4 Fast
Kagi LLM Benchmark32.5%66.1%
ARC-AGI-2—5.3%
ARC-AGI-1—48.5%
LMArena Hard Prompts—1413
DTBench—82.7%
Epoch Capabilities Index—144.21
ForecastBench—60.5

Math Not comparable

Codestral: —, Grok 4 Fast: 36.1 (#126)

Math benchmarks
BenchmarkCodestralGrok 4 Fast
LMArena Math—1419

Knowledge Not comparable

Codestral: —, Grok 4 Fast: 31.5 (#211)

Knowledge benchmarks
BenchmarkCodestralGrok 4 Fast
Vectara Hallucination Rate—19.7%
LMArena Expert—1411

Multilingual Not comparable

Codestral: —, Grok 4 Fast: 51.5 (#106)

Multilingual benchmarks
BenchmarkCodestralGrok 4 Fast
LMArena Non-English—1397
LMArena Chinese—1458
LMArena French—1433
LMArena German—1383
LMArena Japanese—1358
LMArena Korean—1359
LMArena Russian—1387
LMArena Spanish—1414

Instruction Following Not comparable

Codestral: —, Grok 4 Fast: 73.4 (#116)

Instruction Following benchmarks
BenchmarkCodestralGrok 4 Fast
LMArena Instruction Following—1388

Long Context Not comparable

Codestral: —, Grok 4 Fast: 63.2 (#3)

Long Context benchmarks
BenchmarkCodestralGrok 4 Fast
Fiction.LiveBench—94.4%
LMArena Longer Query—1415

Writing & Preference Not comparable

Codestral: —, Grok 4 Fast: 60.2 (#96)

Writing & Preference benchmarks
BenchmarkCodestralGrok 4 Fast
LMArena Text—1407
LMArena Creative Writing—1388
LMArena Multi-Turn—1414

Frequently asked questions

Is Codestral better than Grok 4 Fast?

Grok 4 Fast is the stronger model overall, scoring 39.0 to 30.1 on the Noometry Index.

Is Codestral or Grok 4 Fast better for coding?

Grok 4 Fast scores higher on coding benchmarks: 32.3 versus 26.9 in the Noometry coding category.

How many benchmarks do Codestral and Grok 4 Fast share?

1 benchmark has published results for both models. Codestral has 7 scored results on Noometry and Grok 4 Fast has 30.

Related comparisons

Go deeper