Model comparison

Command R+ vs Muse Glimmer

Muse Glimmer is the stronger model overall, scoring 41.3 to 32.0 on the Noometry Index.

Last verified . 12 shared benchmarks.

Command R+ Cohere

32.0

Rank #251 Confirmed

Muse Glimmer Meta

41.3

Rank #128 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Command R+ scores higher in 0 categories and Muse Glimmer in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Muse Glimmer leads 27.2 to 8.9.

Side by side

Command R+ and Muse Glimmer specifications
Command R+Muse Glimmer
ProviderCohereMeta
Noometry Index32.041.3
Released2024-08-30—
WeightsOpenOpen
Context window128K—
Max output4K—
Input $ / M tokens$2.50—
Output $ / M tokens$10—
Results tracked3413

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Glimmer leads

Command R+: 28.6 (#304), Muse Glimmer: 38.7 (#157)

Coding benchmarks
BenchmarkCommand R+Muse Glimmer
LMArena Coding11871417
LMArena WebDev—1355
BigCodeBench Instruct33.8%—
LiveBench Coding19.1%—
BigCodeBench Complete41.9%—
HumanEval+56.7%—
MBPP+63.5%—

Reasoning Muse Glimmer leads

Command R+: 8.9 (#341), Muse Glimmer: 27.2 (#111)

Reasoning benchmarks
BenchmarkCommand R+Muse Glimmer
LMArena Hard Prompts11861395
SimpleBench17.4%—
LiveBench Reasoning24.8%—
DTBench54.9%—
LiveBench Data Analysis38.1%—
LMCA5%—
Epoch Capabilities Index119.28—
LiveBench31.8%—

Math Muse Glimmer leads

Command R+: 26.6 (#239), Muse Glimmer: 36.1 (#128)

Math benchmarks
BenchmarkCommand R+Muse Glimmer
LMArena Math11881419
LiveBench Math21.3%—

Knowledge Muse Glimmer leads

Command R+: 35.9 (#165), Muse Glimmer: 37.9 (#140)

Knowledge benchmarks
BenchmarkCommand R+Muse Glimmer
LMArena Expert11741388
Vectara Hallucination Rate6.9%—
MMLU69.4%—

Multilingual Muse Glimmer leads

Command R+: 38.8 (#222), Muse Glimmer: 50.6 (#117)

Multilingual benchmarks
BenchmarkCommand R+Muse Glimmer
LMArena Non-English12161384
LMArena Chinese12261412
LMArena Russian12271393
LMArena French1208—
LMArena German1216—
LMArena Japanese1166—
LMArena Korean1138—
LMArena Spanish1189—

Instruction Following Muse Glimmer leads

Command R+: 60.2 (#249), Muse Glimmer: 72.7 (#134)

Instruction Following benchmarks
BenchmarkCommand R+Muse Glimmer
LMArena Instruction Following11971374
LiveBench Instruction Following57.6%—

Long Context Muse Glimmer leads

Command R+: 37.3 (#214), Muse Glimmer: 42.1 (#124)

Long Context benchmarks
BenchmarkCommand R+Muse Glimmer
LMArena Longer Query12311381

Writing & Preference Muse Glimmer leads

Command R+: 43.7 (#223), Muse Glimmer: 57.7 (#122)

Writing & Preference benchmarks
BenchmarkCommand R+Muse Glimmer
LMArena Text12291389
LMArena Creative Writing12351338
LMArena Multi-Turn12131398
LiveBench Language29.7%—

Frequently asked questions

Is Command R+ better than Muse Glimmer?

Muse Glimmer is the stronger model overall, scoring 41.3 to 32.0 on the Noometry Index.

Is Command R+ or Muse Glimmer better for coding?

Muse Glimmer scores higher on coding benchmarks: 38.7 versus 28.6 in the Noometry coding category.

How many benchmarks do Command R+ and Muse Glimmer share?

12 benchmarks have published results for both models. Command R+ has 34 scored results on Noometry and Muse Glimmer has 13.

Related comparisons

Go deeper