Noometry

Model comparison

Command A vs Devstral Small 2505

Command A is the stronger model overall, scoring 36.5 to 34.3 on the Noometry Index. Devstral Small 2505 costs 29× less per token, which makes it the better buy when Command A's lead doesn't matter for your workload.

Last verified . 1 shared benchmarks.

Command A Cohere

36.5

Rank #215 Confirmed

Devstral Small 2505 Mistral AI

34.3

Rank #233 Reported

Summary

  • They share 1 benchmark with published results for both. Command A scores higher in 0 categories and Devstral Small 2505 in 2 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in coding, where Devstral Small 2505 leads 38.9 to 27.2.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 28.8% for Command A and 37.7% for Devstral Small 2505.
  • Devstral Small 2505 is cheaper at $0.10 / $0.30 per million input/output tokens, against $2.50 / $10 for Command A.
  • Command A accepts more context: 256K tokens versus 128K.

Side by side

Command ADevstral Small 2505
ProviderCohereMistral AI
Noometry Index36.534.3
Released2025-03-132025-05-07
WeightsOpenOpen
Context window256K128K
Max output8K128K
Input $ / M tokens$2.50$0.10
Output $ / M tokens$10$0.30
Results tracked244

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Devstral Small 2505 leads

Command A: 27.2 (#322), Devstral Small 2505: 38.9 (#166)

BenchmarkCommand ADevstral Small 2505
SWE-bench Verified (bash only)—56.4%
Aider Polyglot12%—
SciCode—28.8%
LMArena Coding1330—

Agentic & Tool Use Not comparable

Command A: 35.9 (#40), Devstral Small 2505: —

BenchmarkCommand ADevstral Small 2505
Berkeley Function Calling Leaderboard57.1%—

Reasoning Devstral Small 2505 leads

Command A: 18.3 (#283), Devstral Small 2505: 19.7 (#252)

BenchmarkCommand ADevstral Small 2505
Kagi LLM Benchmark28.8%37.7%
CritPt—0%
LMArena Hard Prompts1326—
DTBench61.3%—
LMCA10.3%—

Math Not comparable

Command A: 36.2 (#171), Devstral Small 2505: —

BenchmarkCommand ADevstral Small 2505
LMArena Math1300—

Knowledge Not comparable

Command A: 37.1 (#159), Devstral Small 2505: —

BenchmarkCommand ADevstral Small 2505
Vectara Hallucination Rate9.3%—
LMArena Expert1295—

Multilingual Not comparable

Command A: 45.3 (#170), Devstral Small 2505: —

BenchmarkCommand ADevstral Small 2505
LMArena Non-English1313—
LMArena Chinese1327—
LMArena French1351—
LMArena German1341—
LMArena Japanese1285—
LMArena Korean1285—
LMArena Russian1314—
LMArena Spanish1347—

Instruction Following Not comparable

Command A: 69.1 (#177), Devstral Small 2505: —

BenchmarkCommand ADevstral Small 2505
LMArena Instruction Following1309—

Long Context Not comparable

Command A: 40.6 (#151), Devstral Small 2505: —

BenchmarkCommand ADevstral Small 2505
LMArena Longer Query1334—

Writing & Preference Not comparable

Command A: 47.6 (#208), Devstral Small 2505: —

BenchmarkCommand ADevstral Small 2505
LMArena Text1331—
LMArena Creative Writing1319—
EQ-Bench Creative Writing1145—
LMArena Multi-Turn1339—

Frequently asked questions

Is Command A better than Devstral Small 2505?

Command A is the stronger model overall, scoring 36.5 to 34.3 on the Noometry Index. Devstral Small 2505 costs 29× less per token, which makes it the better buy when Command A's lead doesn't matter for your workload.

Which is cheaper, Command A or Devstral Small 2505?

Devstral Small 2505 is cheaper. It lists at $0.10 per million input tokens and $0.30 per million output tokens; Command A lists at $2.50 and $10.

Is Command A or Devstral Small 2505 better for coding?

Devstral Small 2505 scores higher on coding benchmarks: 38.9 versus 27.2 in the Noometry coding category.

Which has the bigger context window?

Command A does, with 256K tokens against 128K.

How many benchmarks do Command A and Devstral Small 2505 share?

1 benchmark has published results for both models. Command A has 24 scored results on Noometry and Devstral Small 2505 has 4.

Related comparisons

Go deeper