Noometry

Model comparison

Mistral Small 3.1 vs Solar Pro4

Solar Pro4 is the stronger model overall, scoring 42.1 to 31.7 on the Noometry Index.

Last verified . 17 shared benchmarks.

Mistral Small 3.1 Mistral AI

31.7

Rank #269 Confirmed

Solar Pro4 Upstage

42.1

Rank #121 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Mistral Small 3.1 scores higher in 0 categories and Solar Pro4 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Solar Pro4 leads 38.8 to 14.7.
  • Mistral Small 3.1 is cheaper at $0.35 / $0.56 per million input/output tokens, against $0.30 / $1.20 for Solar Pro4.
  • Solar Pro4 accepts more context: 524K tokens versus 128K.
  • Mistral Small 3.1 has downloadable open weights; the other is API-only.

Side by side

Mistral Small 3.1Solar Pro4
ProviderMistral AIUpstage
Noometry Index31.742.1
Released2025-03-172026-08-06
WeightsOpenProprietary
Context window128K524K
Max output102K131K
Input $ / M tokens$0.35$0.30
Output $ / M tokens$0.56$1.20
Results tracked2818

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Solar Pro4 leads

Mistral Small 3.1: 38.3 (#179), Solar Pro4: 40.1 (#149)

BenchmarkMistral Small 3.1Solar Pro4
LMArena Coding13091437
LMArena WebDev—1371

Reasoning Solar Pro4 leads

Mistral Small 3.1: 19.7 (#254), Solar Pro4: 28.5 (#104)

BenchmarkMistral Small 3.1Solar Pro4
LMArena Hard Prompts12781399
Chess Puzzles1%—
Epoch Capabilities Index127.48—

Math Solar Pro4 leads

Mistral Small 3.1: 14.7 (#301), Solar Pro4: 38.8 (#128)

BenchmarkMistral Small 3.1Solar Pro4
LMArena Math12621416
OTIS Mock AIME 2024-20253.9%—
Omni-MATH24.8%—

Knowledge Solar Pro4 leads

Mistral Small 3.1: 22.6 (#271), Solar Pro4: 39.8 (#129)

BenchmarkMistral Small 3.1Solar Pro4
LMArena Expert12571427
GPQA Diamond41.9%—
MMLU-Pro61%—
GPQA (HELM)39.2%—

Multimodal Not comparable

Mistral Small 3.1: 33.2 (#99), Solar Pro4: —

BenchmarkMistral Small 3.1Solar Pro4
LMArena Vision1136—

Multilingual Solar Pro4 leads

Mistral Small 3.1: 41.2 (#209), Solar Pro4: 48.7 (#139)

BenchmarkMistral Small 3.1Solar Pro4
LMArena Non-English12551361
LMArena Chinese12531415
LMArena French12731397
LMArena German12661364
LMArena Japanese12081309
LMArena Korean12061382
LMArena Russian12631360
LMArena Spanish12831401

Instruction Following Solar Pro4 leads

Mistral Small 3.1: 63.6 (#230), Solar Pro4: 72.7 (#132)

BenchmarkMistral Small 3.1Solar Pro4
LMArena Instruction Following12641377
IFEval75%—

Long Context Solar Pro4 leads

Mistral Small 3.1: 39.5 (#178), Solar Pro4: 42.1 (#130)

BenchmarkMistral Small 3.1Solar Pro4
LMArena Longer Query12991381

Writing & Preference Solar Pro4 leads

Mistral Small 3.1: 37.0 (#259), Solar Pro4: 56.5 (#138)

BenchmarkMistral Small 3.1Solar Pro4
LMArena Text12771386
LMArena Creative Writing12531316
LMArena Multi-Turn12701385
EQ-Bench Creative Writing761—
WildBench78.8%—

Frequently asked questions

Is Mistral Small 3.1 better than Solar Pro4?

Solar Pro4 is the stronger model overall, scoring 42.1 to 31.7 on the Noometry Index.

Which is cheaper, Mistral Small 3.1 or Solar Pro4?

Mistral Small 3.1 is cheaper. It lists at $0.35 per million input tokens and $0.56 per million output tokens; Solar Pro4 lists at $0.30 and $1.20.

Is Mistral Small 3.1 or Solar Pro4 better for coding?

Solar Pro4 scores higher on coding benchmarks: 40.1 versus 38.3 in the Noometry coding category.

Which has the bigger context window?

Solar Pro4 does, with 524K tokens against 128K.

How many benchmarks do Mistral Small 3.1 and Solar Pro4 share?

17 benchmarks have published results for both models. Mistral Small 3.1 has 28 scored results on Noometry and Solar Pro4 has 18.

Related comparisons

Go deeper