Model comparison

Devstral Small 2505 vs Wizardlm 70b

Devstral Small 2505 is the stronger model overall, scoring 34.3 to 33.0 on the Noometry Index.

Last verified . 0 shared benchmarks.

Devstral Small 2505 Mistral AI

34.3

Rank #233 Reported

Wizardlm 70b Microsoft

33.0

Rank #249 Confirmed

Summary

  • The widest gap is in coding, where Devstral Small 2505 leads 38.9 to 31.4.

Side by side

Devstral Small 2505 and Wizardlm 70b specifications
Devstral Small 2505Wizardlm 70b
ProviderMistral AIMicrosoft
Noometry Index34.333.0
Released2025-05-07—
WeightsOpenOpen
Context window128K—
Max output128K—
Input $ / M tokens$0.10—
Output $ / M tokens$0.30—
Results tracked412

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Devstral Small 2505 leads

Devstral Small 2505: 38.9 (#166), Wizardlm 70b: 31.4 (#285)

Coding benchmarks
BenchmarkDevstral Small 2505Wizardlm 70b
SWE-bench Verified (bash only)56.4%—
SciCode28.8%—
LMArena Coding—1081

Reasoning Too close to call

Devstral Small 2505: 19.7 (#252), Wizardlm 70b: 20.7 (#234)

Reasoning benchmarks
BenchmarkDevstral Small 2505Wizardlm 70b
Kagi LLM Benchmark37.7%—
CritPt0%—
LMArena Hard Prompts—1079

Math Not comparable

Devstral Small 2505: —, Wizardlm 70b: 32.2 (#218)

Math benchmarks
BenchmarkDevstral Small 2505Wizardlm 70b
LMArena Math—1116

Multilingual Not comparable

Devstral Small 2505: —, Wizardlm 70b: 29.6 (#265)

Multilingual benchmarks
BenchmarkDevstral Small 2505Wizardlm 70b
LMArena Non-English—1078
LMArena Chinese—1052
LMArena German—1083
LMArena Russian—1155

Instruction Following Not comparable

Devstral Small 2505: —, Wizardlm 70b: 56.3 (#273)

Instruction Following benchmarks
BenchmarkDevstral Small 2505Wizardlm 70b
LMArena Instruction Following—1093

Long Context Not comparable

Devstral Small 2505: —, Wizardlm 70b: 33.3 (#263)

Long Context benchmarks
BenchmarkDevstral Small 2505Wizardlm 70b
LMArena Longer Query—1097

Writing & Preference Not comparable

Devstral Small 2505: —, Wizardlm 70b: 34.8 (#269)

Writing & Preference benchmarks
BenchmarkDevstral Small 2505Wizardlm 70b
LMArena Text—1120
LMArena Creative Writing—1149
LMArena Multi-Turn—1108

Frequently asked questions

Is Devstral Small 2505 better than Wizardlm 70b?

Devstral Small 2505 is the stronger model overall, scoring 34.3 to 33.0 on the Noometry Index.

Is Devstral Small 2505 or Wizardlm 70b better for coding?

Devstral Small 2505 scores higher on coding benchmarks: 38.9 versus 31.4 in the Noometry coding category.

How many benchmarks do Devstral Small 2505 and Wizardlm 70b share?

0 benchmarks have published results for both models. Devstral Small 2505 has 4 scored results on Noometry and Wizardlm 70b has 12.

Related comparisons

Go deeper