Noometry

Model comparison

Llama 4 Scout vs Yi-34B

Llama 4 Scout and Yi-34B score almost the same on the Noometry Index (27.7 vs 27.8), so choose on price, context window or the category you care about most.

Last verified . 20 shared benchmarks.

Llama 4 Scout Meta

27.7

Rank #330 Confirmed

Yi-34B 01.AI

27.8

Rank #329 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Llama 4 Scout scores higher in 4 categories and Yi-34B in 4 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Llama 4 Scout leads 31.9 to 7.5.
  • The biggest single-benchmark swing is MATH Level 5: 62.3% for Llama 4 Scout and 5.1% for Yi-34B.

Side by side

Llama 4 ScoutYi-34B
ProviderMeta01.AI
Noometry Index27.727.8
Released2025-04-052023-11-02
WeightsOpenOpen
Context window128K—
Max output4K—
Input $ / M tokens$0.10—
Output $ / M tokens$0.30—
Results tracked4323

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Yi-34B leads

Llama 4 Scout: 20.2 (#339), Yi-34B: 32.3 (#274)

BenchmarkLlama 4 ScoutYi-34B
LMArena Coding12861112
SWE-bench Verified (bash only)9.1%—
SciCode17%—
BigCodeBench Complete43.1%—

Agentic & Tool Use Not comparable

Llama 4 Scout: 24.6 (#119), Yi-34B: —

BenchmarkLlama 4 ScoutYi-34B
Berkeley Function Calling Leaderboard28.1%—

Reasoning Yi-34B leads

Llama 4 Scout: 9.1 (#345), Yi-34B: 21.2 (#226)

BenchmarkLlama 4 ScoutYi-34B
LMArena Hard Prompts12661104
Epoch Capabilities Index129.64117.39
ARC-AGI-20%—
Kagi LLM Benchmark36.9%—
ARC-AGI-10.5%—
CritPt0%—
DTBench57.9%—
LMCA12%—
BIG-Bench Hard—71.7%
ForecastBench57.5—

Math Yi-34B leads

Llama 4 Scout: 19.6 (#286), Yi-34B: 21.6 (#282)

BenchmarkLlama 4 ScoutYi-34B
LMArena Math12871114
MATH Level 562.3%5.1%
OTIS Mock AIME 2024-20257.8%—
Omni-MATH37.3%—
FrontierMath (Feb 2025 set)0%—
GSM8K—76%

Knowledge Llama 4 Scout leads

Llama 4 Scout: 31.9 (#217), Yi-34B: 7.5 (#309)

BenchmarkLlama 4 ScoutYi-34B
GPQA Diamond51.8%14.7%
LMArena Expert12351061
MMLU-Pro74.2%—
Vectara Hallucination Rate7.7%—
GPQA (HELM)50.7%—
MMLU—76.3%

Multimodal Not comparable

Llama 4 Scout: 32.2 (#102), Yi-34B: —

BenchmarkLlama 4 ScoutYi-34B
LMArena Vision1118—
SpatialViz-Bench34.2%—

Multilingual Llama 4 Scout leads

Llama 4 Scout: 41.0 (#212), Yi-34B: 29.7 (#264)

BenchmarkLlama 4 ScoutYi-34B
LMArena Non-English12521079
LMArena Chinese12551176
LMArena French12821081
LMArena German12721042
LMArena Japanese1206993
LMArena Korean1207959
LMArena Russian12631050
LMArena Spanish12781070

Instruction Following Llama 4 Scout leads

Llama 4 Scout: 65.8 (#217), Yi-34B: 56.2 (#274)

BenchmarkLlama 4 ScoutYi-34B
LMArena Instruction Following12481091
IFEval81.8%—

Long Context Yi-34B leads

Llama 4 Scout: 27.5 (#294), Yi-34B: 33.2 (#264)

BenchmarkLlama 4 ScoutYi-34B
LMArena Longer Query12651094
Fiction.LiveBench36%—

Writing & Preference Llama 4 Scout leads

Llama 4 Scout: 37.0 (#261), Yi-34B: 34.1 (#273)

BenchmarkLlama 4 ScoutYi-34B
LMArena Text12791129
LMArena Creative Writing12491108
LMArena Multi-Turn12801113
EQ-Bench Creative Writing783—
WildBench78%—

Frequently asked questions

Is Llama 4 Scout better than Yi-34B?

Llama 4 Scout and Yi-34B score almost the same on the Noometry Index (27.7 vs 27.8), so choose on price, context window or the category you care about most.

Is Llama 4 Scout or Yi-34B better for coding?

Yi-34B scores higher on coding benchmarks: 32.3 versus 20.2 in the Noometry coding category.

How many benchmarks do Llama 4 Scout and Yi-34B share?

20 benchmarks have published results for both models. Llama 4 Scout has 43 scored results on Noometry and Yi-34B has 23.

Related comparisons

Go deeper