Noometry

Model comparison

Claude Opus 4.6 vs Mistral Medium

Claude Opus 4.6 is the stronger model overall, scoring 58.2 to 36.3 on the Noometry Index. Mistral Medium costs 3.3× less per token, which makes it the better buy when Claude Opus 4.6's lead doesn't matter for your workload.

Last verified . 30 shared benchmarks.

Claude Opus 4.6 Anthropic

58.2

Rank #20 Confirmed

Mistral Medium Mistral AI

36.3

Rank #218 Confirmed

Summary

  • They share 30 benchmarks with published results for both. Claude Opus 4.6 scores higher in 10 categories and Mistral Medium in 0 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Claude Opus 4.6 leads 61.9 to 25.0.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 94.4% for Claude Opus 4.6 and 32.2% for Mistral Medium.
  • Mistral Medium is cheaper at $1.50 / $7.50 per million input/output tokens, against $5 / $25 for Claude Opus 4.6.
  • Claude Opus 4.6 accepts more context: 1M tokens versus 262K.
  • Mistral Medium has downloadable open weights; the other is API-only.

Side by side

Claude Opus 4.6Mistral Medium
ProviderAnthropicMistral AI
Noometry Index58.236.3
Released2026-02-042023-12-11
WeightsProprietaryOpen
Context window1M262K
Max output128K262K
Input $ / M tokens$5$1.50
Output $ / M tokens$25$7.50
Results tracked6836

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Opus 4.6 leads

Claude Opus 4.6: 57.2 (#20), Mistral Medium: 34.2 (#243)

BenchmarkClaude Opus 4.6Mistral Medium
FrontierCode26.6%8%
WeirdML78%43.7%
LMArena Coding15361434
ALE-Bench996.5763.98
SWE-bench Verified78.7%—
SWE-bench Verified (bash only)75.6%—
LMArena WebDev1547—
SWE-bench Multilingual72%—
SciCode—40.2%
GSO41.2%—
AlgoTune1.47—

Agentic & Tool Use Claude Opus 4.6 leads

Claude Opus 4.6: 51.1 (#4), Mistral Medium: 28.3 (#90)

BenchmarkClaude Opus 4.6Mistral Medium
Terminal-Bench79.8%—
APEX-Agents46.3%—
Berkeley Function Calling Leaderboard—37.7%
Remote Labor Index4.2%—
τ²-bench Banking27.3%—
Cybench93%—
DeepResearch Bench55.3%—
GBAEval44.1%—
LMArena Search1253—
METR Time Horizons78.9%—
Vending-Bench 28,018—

Reasoning Claude Opus 4.6 leads

Claude Opus 4.6: 57.8 (#23), Mistral Medium: 24.0 (#167)

BenchmarkClaude Opus 4.6Mistral Medium
Kagi LLM Benchmark83.6%50%
LMArena Hard Prompts15271426
DTBench91.2%75.5%
LMCA55.8%26.1%
ARC-AGI-269.2%—
SimpleBench67.6%—
NYT Connections (extended)92.1%—
ARC-AGI-194%—
CritPt—0%
Chess Puzzles17%—
EnigmaEval7.6%—
Thematic Generalization80.6%—
EBR-Bench12.7%—
Mystery Game Puzzles25%—
Surface Evolver Bench—26.9%
Epoch Capabilities Index155.24—
ForecastBench60—

Math Claude Opus 4.6 leads

Claude Opus 4.6: 63.0 (#31), Mistral Medium: 28.1 (#245)

BenchmarkClaude Opus 4.6Mistral Medium
OTIS Mock AIME 2024-202594.4%32.2%
ProofBench50%9%
LMArena Math15191408
FrontierMath (Feb 2025 set)40.7%0.3%
FrontierMath (Tiers 1-3)66%—
FrontierMath Tier 426.8%—
MathArena Final-Answer Competitions78.5%—
MATH Level 5—81.6%
FrontierMath Tier 4 (v1)22.9%—

Knowledge Claude Opus 4.6 leads

Claude Opus 4.6: 61.9 (#26), Mistral Medium: 25.0 (#265)

BenchmarkClaude Opus 4.6Mistral Medium
GPQA Diamond90.5%59.5%
Humanity's Last Exam34.4%4.5%
Vectara Hallucination Rate12.2%22.7%
LMArena Expert15461408
SimpleQA Verified47%—

Multimodal Claude Opus 4.6 leads

Claude Opus 4.6: 37.3 (#74), Mistral Medium: 35.3 (#88)

BenchmarkClaude Opus 4.6Mistral Medium
LMArena Vision13161172
Furniture Assembly28.3%—
LMArena Document1507—

Multilingual Claude Opus 4.6 leads

Claude Opus 4.6: 57.9 (#6), Mistral Medium: 52.1 (#91)

BenchmarkClaude Opus 4.6Mistral Medium
LMArena Non-English14891408
LMArena Chinese15511447
LMArena French15131459
LMArena German15021432
LMArena Japanese14841378
LMArena Korean14641380
LMArena Russian14971411
LMArena Spanish15101433

Instruction Following Claude Opus 4.6 leads

Claude Opus 4.6: 79.5 (#4), Mistral Medium: 73.7 (#116)

BenchmarkClaude Opus 4.6Mistral Medium
LMArena Instruction Following15231398

Long Context Claude Opus 4.6 leads

Claude Opus 4.6: 48.1 (#13), Mistral Medium: 42.9 (#114)

BenchmarkClaude Opus 4.6Mistral Medium
LMArena Longer Query15201406
CL-bench20.7%—
CL-bench Life17%—

Writing & Preference Claude Opus 4.6 leads

Claude Opus 4.6: 73.5 (#10), Mistral Medium: 60.0 (#103)

BenchmarkClaude Opus 4.6Mistral Medium
LMArena Text15031424
LMArena Creative Writing15051391
LMArena Multi-Turn15131418
Short-Story Creative Writing—77.3%
EQ-Bench Creative Writing1809—
EQ-Bench 41223—

Frequently asked questions

Is Claude Opus 4.6 better than Mistral Medium?

Claude Opus 4.6 is the stronger model overall, scoring 58.2 to 36.3 on the Noometry Index. Mistral Medium costs 3.3× less per token, which makes it the better buy when Claude Opus 4.6's lead doesn't matter for your workload.

Which is cheaper, Claude Opus 4.6 or Mistral Medium?

Mistral Medium is cheaper. It lists at $1.50 per million input tokens and $7.50 per million output tokens; Claude Opus 4.6 lists at $5 and $25.

Is Claude Opus 4.6 or Mistral Medium better for coding?

Claude Opus 4.6 scores higher on coding benchmarks: 57.2 versus 34.2 in the Noometry coding category.

Which has the bigger context window?

Claude Opus 4.6 does, with 1M tokens against 262K.

How many benchmarks do Claude Opus 4.6 and Mistral Medium share?

30 benchmarks have published results for both models. Claude Opus 4.6 has 68 scored results on Noometry and Mistral Medium has 36.

Related comparisons

Go deeper