Model comparison

Command R vs Qwen2.5 32B Instruct

Command R is the stronger model overall, scoring 31.0 to 29.7 on the Noometry Index.

Last verified . 2 shared benchmarks.

Command R Cohere

31.0

Rank #267 Confirmed

Qwen2.5 32B Instruct Alibaba (Qwen)

29.7

Rank #291 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Command R scores higher in 2 categories and Qwen2.5 32B Instruct in 2 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where Command R leads 25.8 to 15.3.
  • The biggest single-benchmark swing is BigCodeBench Instruct: 37.1% for Command R and 45% for Qwen2.5 32B Instruct.
  • Command R is cheaper at $0.15 / $0.60 per million input/output tokens, against $0.70 / $2.80 for Qwen2.5 32B Instruct.
  • Qwen2.5 32B Instruct accepts more context: 131K tokens versus 128K.

Side by side

Command R and Qwen2.5 32B Instruct specifications
Command RQwen2.5 32B Instruct
ProviderCohereAlibaba (Qwen)
Noometry Index31.029.7
Released2024-08-302024-09
WeightsOpenOpen
Context window128K131K
Max output4K8K
Input $ / M tokens$0.15$0.70
Output $ / M tokens$0.60$2.80
Results tracked297

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen2.5 32B Instruct leads

Command R: 28.8 (#301), Qwen2.5 32B Instruct: 38.1 (#165)

Coding benchmarks
BenchmarkCommand RQwen2.5 32B Instruct
BigCodeBench Instruct37.1%45%
BigCodeBench Complete45.2%52.3%
LiveBench Coding17.9%—
LMArena Coding1170—

Reasoning Qwen2.5 32B Instruct leads

Command R: 13.3 (#329), Qwen2.5 32B Instruct: 18.5 (#262)

Reasoning benchmarks
BenchmarkCommand RQwen2.5 32B Instruct
Chess Puzzles—0%
LiveBench Reasoning21.9%—
LMArena Hard Prompts1164—
DTBench46.4%—
LiveBench Data Analysis33.3%—
LMCA9.2%—
Epoch Capabilities Index—128.52
LiveBench27.5%—

Math Command R leads

Command R: 25.8 (#244), Qwen2.5 32B Instruct: 15.3 (#289)

Math benchmarks
BenchmarkCommand RQwen2.5 32B Instruct
OTIS Mock AIME 2024-2025—7.4%
LiveBench Math19.4%—
LMArena Math1155—
MATH Level 5—56.1%

Knowledge Command R leads

Command R: 30.5 (#219), Qwen2.5 32B Instruct: 24.9 (#259)

Knowledge benchmarks
BenchmarkCommand RQwen2.5 32B Instruct
GPQA Diamond—46.1%
LMArena Expert1138—
MMLU65.2%—

Multilingual Not comparable

Command R: 35.9 (#240), Qwen2.5 32B Instruct: —

Multilingual benchmarks
BenchmarkCommand RQwen2.5 32B Instruct
LMArena Non-English1174—
LMArena Chinese1182—
LMArena French1161—
LMArena German1176—
LMArena Japanese1143—
LMArena Korean1162—
LMArena Russian1174—
LMArena Spanish1150—

Instruction Following Not comparable

Command R: 58.3 (#256), Qwen2.5 32B Instruct: —

Instruction Following benchmarks
BenchmarkCommand RQwen2.5 32B Instruct
LiveBench Instruction Following55.6%—
LMArena Instruction Following1167—

Long Context Not comparable

Command R: 36.3 (#226), Qwen2.5 32B Instruct: —

Long Context benchmarks
BenchmarkCommand RQwen2.5 32B Instruct
LMArena Longer Query1198—

Writing & Preference Not comparable

Command R: 38.4 (#248), Qwen2.5 32B Instruct: —

Writing & Preference benchmarks
BenchmarkCommand RQwen2.5 32B Instruct
LMArena Text1187—
LMArena Creative Writing1170—
LMArena Multi-Turn1163—
LiveBench Language16.7%—

Frequently asked questions

Is Command R better than Qwen2.5 32B Instruct?

Command R is the stronger model overall, scoring 31.0 to 29.7 on the Noometry Index.

Which is cheaper, Command R or Qwen2.5 32B Instruct?

Command R is cheaper. It lists at $0.15 per million input tokens and $0.60 per million output tokens; Qwen2.5 32B Instruct lists at $0.70 and $2.80.

Is Command R or Qwen2.5 32B Instruct better for coding?

Qwen2.5 32B Instruct scores higher on coding benchmarks: 38.1 versus 28.8 in the Noometry coding category.

Which has the bigger context window?

Qwen2.5 32B Instruct does, with 131K tokens against 128K.

How many benchmarks do Command R and Qwen2.5 32B Instruct share?

2 benchmarks have published results for both models. Command R has 29 scored results on Noometry and Qwen2.5 32B Instruct has 7.

Related comparisons

Go deeper