Noometry

Model comparison

Command A vs Llama 3.1 Nemotron Ultra 253b v1

Command A and Llama 3.1 Nemotron Ultra 253b v1 score almost the same on the Noometry Index (36.5 vs 36.7), so choose on price, context window or the category you care about most.

Last verified . 11 shared benchmarks.

Command A Cohere

36.5

Rank #215 Confirmed

Llama 3.1 Nemotron Ultra 253b v1 NVIDIA

36.7

Rank #213 Confirmed

Summary

  • They share 11 benchmarks with published results for both. Command A scores higher in 4 categories and Llama 3.1 Nemotron Ultra 253b v1 in 4 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in agentic & tool use, where Command A leads 35.9 to 15.7.
  • The biggest single-benchmark swing is Berkeley Function Calling Leaderboard: 57.1% for Command A and 10% for Llama 3.1 Nemotron Ultra 253b v1.

Side by side

Command ALlama 3.1 Nemotron Ultra 253b v1
ProviderCohereNVIDIA
Noometry Index36.536.7
Released2025-03-13—
WeightsOpenOpen
Context window256K—
Max output8K—
Input $ / M tokens$2.50—
Output $ / M tokens$10—
Results tracked2411

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Llama 3.1 Nemotron Ultra 253b v1 leads

Command A: 27.2 (#322), Llama 3.1 Nemotron Ultra 253b v1: 38.4 (#177)

BenchmarkCommand ALlama 3.1 Nemotron Ultra 253b v1
LMArena Coding13301312
Aider Polyglot12%—

Agentic & Tool Use Command A leads

Command A: 35.9 (#40), Llama 3.1 Nemotron Ultra 253b v1: 15.7 (#149)

BenchmarkCommand ALlama 3.1 Nemotron Ultra 253b v1
Berkeley Function Calling Leaderboard57.1%10%

Reasoning Llama 3.1 Nemotron Ultra 253b v1 leads

Command A: 18.3 (#283), Llama 3.1 Nemotron Ultra 253b v1: 26.3 (#134)

BenchmarkCommand ALlama 3.1 Nemotron Ultra 253b v1
LMArena Hard Prompts13261316
Kagi LLM Benchmark28.8%—
DTBench61.3%—
LMCA10.3%—

Math Llama 3.1 Nemotron Ultra 253b v1 leads

Command A: 36.2 (#171), Llama 3.1 Nemotron Ultra 253b v1: 37.5 (#152)

BenchmarkCommand ALlama 3.1 Nemotron Ultra 253b v1
LMArena Math13001360

Knowledge Not comparable

Command A: 37.1 (#159), Llama 3.1 Nemotron Ultra 253b v1: —

BenchmarkCommand ALlama 3.1 Nemotron Ultra 253b v1
Vectara Hallucination Rate9.3%—
LMArena Expert1295—

Multilingual Command A leads

Command A: 45.3 (#170), Llama 3.1 Nemotron Ultra 253b v1: 43.1 (#187)

BenchmarkCommand ALlama 3.1 Nemotron Ultra 253b v1
LMArena Non-English13131282
LMArena Russian13141284
LMArena Chinese1327—
LMArena French1351—
LMArena German1341—
LMArena Japanese1285—
LMArena Korean1285—
LMArena Spanish1347—

Instruction Following Too close to call

Command A: 69.1 (#177), Llama 3.1 Nemotron Ultra 253b v1: 69.0 (#178)

BenchmarkCommand ALlama 3.1 Nemotron Ultra 253b v1
LMArena Instruction Following13091308

Long Context Command A leads

Command A: 40.6 (#151), Llama 3.1 Nemotron Ultra 253b v1: 39.5 (#177)

BenchmarkCommand ALlama 3.1 Nemotron Ultra 253b v1
LMArena Longer Query13341299

Writing & Preference Llama 3.1 Nemotron Ultra 253b v1 leads

Command A: 47.6 (#208), Llama 3.1 Nemotron Ultra 253b v1: 52.2 (#175)

BenchmarkCommand ALlama 3.1 Nemotron Ultra 253b v1
LMArena Text13311320
LMArena Creative Writing13191314
LMArena Multi-Turn13391317
EQ-Bench Creative Writing1145—

Frequently asked questions

Is Command A better than Llama 3.1 Nemotron Ultra 253b v1?

Command A and Llama 3.1 Nemotron Ultra 253b v1 score almost the same on the Noometry Index (36.5 vs 36.7), so choose on price, context window or the category you care about most.

Is Command A or Llama 3.1 Nemotron Ultra 253b v1 better for coding?

Llama 3.1 Nemotron Ultra 253b v1 scores higher on coding benchmarks: 38.4 versus 27.2 in the Noometry coding category.

How many benchmarks do Command A and Llama 3.1 Nemotron Ultra 253b v1 share?

11 benchmarks have published results for both models. Command A has 24 scored results on Noometry and Llama 3.1 Nemotron Ultra 253b v1 has 11.

Related comparisons

Go deeper