Model comparison

Claude Sonnet 5 vs Mistral Large

Claude Sonnet 5 is the stronger model overall, scoring 54.6 to 31.9 on the Noometry Index.

Last verified . 28 shared benchmarks.

Claude Sonnet 5 Anthropic

54.6

Rank #29 Confirmed

Mistral Large Mistral AI

31.9

Rank #263 Confirmed

Summary

  • They share 28 benchmarks with published results for both. Claude Sonnet 5 scores higher in 9 categories and Mistral Large in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where Claude Sonnet 5 leads 66.2 to 18.2.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 94.7% for Claude Sonnet 5 and 8.5% for Mistral Large.
  • Mistral Large is cheaper at $2 / $6 per million input/output tokens, against $2 / $10 for Claude Sonnet 5.
  • Claude Sonnet 5 accepts more context: 1M tokens versus 131K.
  • Mistral Large has downloadable open weights; the other is API-only.

Side by side

Claude Sonnet 5 and Mistral Large specifications
Claude Sonnet 5Mistral Large
ProviderAnthropicMistral AI
Noometry Index54.631.9
Released2026-06-292024-02-26
WeightsProprietaryOpen
Context window1M131K
Max output128K16K
Input $ / M tokens$2$2
Output $ / M tokens$10$6
Results tracked5151

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Sonnet 5 leads

Claude Sonnet 5: 55.5 (#26), Mistral Large: 34.3 (#240)

Coding benchmarks
BenchmarkClaude Sonnet 5Mistral Large
SciCode54.3%36.2%
LMArena Coding14831277
ALE-Bench1,463264.7
DeepSWE53.8%—
FrontierCode42.7%—
CursorBench34.1%—
LMArena WebDev1541—
GSO37.3%—
WeirdML68.8%—
BigCodeBench Instruct—30%
LiveBench Coding—47.1%
BigCodeBench Complete—38.3%
HumanEval+—62.2%
MBPP+—59.5%

Agentic & Tool Use Claude Sonnet 5 leads

Claude Sonnet 5: 42.8 (#18), Mistral Large: 28.6 (#89)

Agentic & Tool Use benchmarks
BenchmarkClaude Sonnet 5Mistral Large
APEX-Agents54.5%—
Berkeley Function Calling Leaderboard—38.4%
GBAEval65.3%—
LMArena Search1194—
Vending-Bench 26,378—

Reasoning Claude Sonnet 5 leads

Claude Sonnet 5: 49.1 (#39), Mistral Large: 15.8 (#310)

Reasoning benchmarks
BenchmarkClaude Sonnet 5Mistral Large
SimpleBench60.6%22.5%
CritPt16.9%0%
LMArena Hard Prompts14611257
DTBench92.5%65.1%
LMCA50%16.7%
Epoch Capabilities Index156.21128.52
ForecastBench61.157.1
NYT Connections (extended)75.1%—
Chess Puzzles35%—
LiveBench Reasoning—43.5%
Mystery Game Puzzles35%—
LiveBench Data Analysis—50.1%
Surface Evolver Bench60%—
Bench to the Future 30.14—
LiveBench—48.4%

Math Claude Sonnet 5 leads

Claude Sonnet 5: 66.2 (#27), Mistral Large: 18.2 (#291)

Math benchmarks
BenchmarkClaude Sonnet 5Mistral Large
OTIS Mock AIME 2024-202594.7%8.5%
LMArena Math14671262
FrontierMath (Tiers 1-3)65.6%—
FrontierMath Tier 429.3%—
ProofBench77%—
Omni-MATH—28.1%
LiveBench Math—42.5%
MATH Level 5—50.3%
FrontierMath (Feb 2025 set)—0.3%

Knowledge Claude Sonnet 5 leads

Claude Sonnet 5: 55.6 (#47), Mistral Large: 30.1 (#230)

Knowledge benchmarks
BenchmarkClaude Sonnet 5Mistral Large
GPQA Diamond90.5%51.3%
LMArena Expert14901232
SimpleQA Verified33.7%—
MMLU-Pro—59.9%
Confabulations—21.4%
Vectara Hallucination Rate—4.5%
GPQA (HELM)—43.5%
MMLU—80%

Multimodal Not comparable

Claude Sonnet 5: 42.4 (#31), Mistral Large: —

Multimodal benchmarks
BenchmarkClaude Sonnet 5Mistral Large
LMArena Vision1274—
Blueprint-Bench 224.9%—
LMArena Document1466—

Multilingual Claude Sonnet 5 leads

Claude Sonnet 5: 53.8 (#55), Mistral Large: 40.0 (#219)

Multilingual benchmarks
BenchmarkClaude Sonnet 5Mistral Large
LMArena Non-English14311237
LMArena Chinese14771240
LMArena French14601325
LMArena German14401254
LMArena Japanese14221188
LMArena Korean14111202
LMArena Russian14511257
LMArena Spanish14371268

Instruction Following Claude Sonnet 5 leads

Claude Sonnet 5: 76.3 (#41), Mistral Large: 67.9 (#191)

Instruction Following benchmarks
BenchmarkClaude Sonnet 5Mistral Large
LMArena Instruction Following14521249
LiveBench Instruction Following—67.9%
IFEval—87.7%

Long Context Claude Sonnet 5 leads

Claude Sonnet 5: 44.8 (#55), Mistral Large: 38.3 (#199)

Long Context benchmarks
BenchmarkClaude Sonnet 5Mistral Large
LMArena Longer Query14631261

Writing & Preference Claude Sonnet 5 leads

Claude Sonnet 5: 69.2 (#25), Mistral Large: 40.7 (#242)

Writing & Preference benchmarks
BenchmarkClaude Sonnet 5Mistral Large
LMArena Text14421266
LMArena Creative Writing14161243
EQ-Bench Creative Writing1794985
LMArena Multi-Turn14541260
Short-Story Creative Writing—69%
WildBench—80.1%
EQ-Bench 41236—
LiveBench Language—39.4%

Frequently asked questions

Is Claude Sonnet 5 better than Mistral Large?

Claude Sonnet 5 is the stronger model overall, scoring 54.6 to 31.9 on the Noometry Index.

Which is cheaper, Claude Sonnet 5 or Mistral Large?

Mistral Large is cheaper. It lists at $2 per million input tokens and $6 per million output tokens; Claude Sonnet 5 lists at $2 and $10.

Is Claude Sonnet 5 or Mistral Large better for coding?

Claude Sonnet 5 scores higher on coding benchmarks: 55.5 versus 34.3 in the Noometry coding category.

Which has the bigger context window?

Claude Sonnet 5 does, with 1M tokens against 131K.

How many benchmarks do Claude Sonnet 5 and Mistral Large share?

28 benchmarks have published results for both models. Claude Sonnet 5 has 51 scored results on Noometry and Mistral Large has 51.

Related comparisons

Go deeper