Model comparison

Mistral Small vs Nova 2.0 Pro Preview

Mistral Small and Nova 2.0 Pro Preview score almost the same on the Noometry Index (33.4 vs 33.4), so choose on price, context window or the category you care about most.

Last verified . 2 shared benchmarks.

Mistral Small Mistral AI

33.4

Rank #243 Confirmed

Nova 2.0 Pro Preview Amazon

33.4

Rank #244 Reported

Summary

  • They share 2 benchmarks with published results for both. Mistral Small scores higher in 1 category and Nova 2.0 Pro Preview in 2 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in coding, where Nova 2.0 Pro Preview leads 40.8 to 34.0.
  • The biggest single-benchmark swing is SciCode: 26.5% for Mistral Small and 42.7% for Nova 2.0 Pro Preview.
  • Mistral Small has downloadable open weights; the other is API-only.

Side by side

Mistral Small and Nova 2.0 Pro Preview specifications
Mistral SmallNova 2.0 Pro Preview
ProviderMistral AIAmazon
Noometry Index33.433.4
Released2024-02-262025-12-02
WeightsOpenProprietary
Context window262K—
Max output256K—
Input $ / M tokens$0.15—
Output $ / M tokens$0.60—
Results tracked393

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nova 2.0 Pro Preview leads

Mistral Small: 34.0 (#247), Nova 2.0 Pro Preview: 40.8 (#133)

Coding benchmarks
BenchmarkMistral SmallNova 2.0 Pro Preview
SciCode26.5%42.7%
BigCodeBench Instruct36.1%—
LiveBench Coding36.2%—
LMArena Coding1362—
BigCodeBench Complete46.6%—
ALE-Bench497.62—

Agentic & Tool Use Mistral Small leads

Mistral Small: 28.1 (#93), Nova 2.0 Pro Preview: 21.9 (#136)

Agentic & Tool Use benchmarks
BenchmarkMistral SmallNova 2.0 Pro Preview
Berkeley Function Calling Leaderboard37.1%—
GDP.pdf—2%

Reasoning Nova 2.0 Pro Preview leads

Mistral Small: 19.8 (#250), Nova 2.0 Pro Preview: 22.4 (#194)

Reasoning benchmarks
BenchmarkMistral SmallNova 2.0 Pro Preview
CritPt0%0%
Kagi LLM Benchmark37.8%—
LiveBench Reasoning44.8%—
LMArena Hard Prompts1335—
DTBench70.9%—
LiveBench Data Analysis53.7%—
LMCA20.6%—
LiveBench44%—

Math Not comparable

Mistral Small: 16.4 (#293), Nova 2.0 Pro Preview: —

Math benchmarks
BenchmarkMistral SmallNova 2.0 Pro Preview
OTIS Mock AIME 2024-20255.8%—
LiveBench Math39.9%—
LMArena Math1341—
MATH Level 546.8%—

Knowledge Not comparable

Mistral Small: 31.0 (#222), Nova 2.0 Pro Preview: —

Knowledge benchmarks
BenchmarkMistral SmallNova 2.0 Pro Preview
GPQA Diamond47.5%—
Vectara Hallucination Rate5.1%—
LMArena Expert1291—
MMLU68.7%—

Multimodal Not comparable

Mistral Small: 33.5 (#96), Nova 2.0 Pro Preview: —

Multimodal benchmarks
BenchmarkMistral SmallNova 2.0 Pro Preview
LMArena Vision1142—

Multilingual Not comparable

Mistral Small: 45.5 (#169), Nova 2.0 Pro Preview: —

Multilingual benchmarks
BenchmarkMistral SmallNova 2.0 Pro Preview
LMArena Non-English1315—
LMArena Chinese1340—
LMArena French1337—
LMArena German1340—
LMArena Japanese1275—
LMArena Korean1259—
LMArena Russian1324—
LMArena Spanish1346—

Instruction Following Not comparable

Mistral Small: 66.4 (#209), Nova 2.0 Pro Preview: —

Instruction Following benchmarks
BenchmarkMistral SmallNova 2.0 Pro Preview
LiveBench Instruction Following63.7%—
LMArena Instruction Following1310—

Long Context Not comparable

Mistral Small: 40.4 (#156), Nova 2.0 Pro Preview: —

Long Context benchmarks
BenchmarkMistral SmallNova 2.0 Pro Preview
LMArena Longer Query1327—

Writing & Preference Not comparable

Mistral Small: 52.5 (#171), Nova 2.0 Pro Preview: —

Writing & Preference benchmarks
BenchmarkMistral SmallNova 2.0 Pro Preview
LMArena Text1338—
LMArena Creative Writing1305—
LMArena Multi-Turn1344—
LiveBench Language30.5%—

Frequently asked questions

Is Mistral Small better than Nova 2.0 Pro Preview?

Mistral Small and Nova 2.0 Pro Preview score almost the same on the Noometry Index (33.4 vs 33.4), so choose on price, context window or the category you care about most.

Is Mistral Small or Nova 2.0 Pro Preview better for coding?

Nova 2.0 Pro Preview scores higher on coding benchmarks: 40.8 versus 34.0 in the Noometry coding category.

How many benchmarks do Mistral Small and Nova 2.0 Pro Preview share?

2 benchmarks have published results for both models. Mistral Small has 39 scored results on Noometry and Nova 2.0 Pro Preview has 3.

Related comparisons

Go deeper