Noometry

Model comparison

Claude Opus 4 vs Yi-Lightning

Claude Opus 4 is the stronger model overall, scoring 43.1 to 37.1 on the Noometry Index.

Last verified . 18 shared benchmarks.

Claude Opus 4 Anthropic

43.1

Rank #100 Confirmed

Yi-Lightning 01.AI

37.1

Rank #209 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Claude Opus 4 scores higher in 8 categories and Yi-Lightning in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in coding, where Claude Opus 4 leads 47.2 to 27.4.
  • The biggest single-benchmark swing is Aider Polyglot: 72% for Claude Opus 4 and 12.9% for Yi-Lightning.

Side by side

Claude Opus 4Yi-Lightning
ProviderAnthropic01.AI
Noometry Index43.137.1
Released2025-05-222024-12-02
WeightsProprietaryProprietary
Context window200K—
Max output32K—
Input $ / M tokens$15—
Output $ / M tokens$75—
Results tracked5618

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Opus 4 leads

Claude Opus 4: 47.2 (#62), Yi-Lightning: 27.4 (#320)

BenchmarkClaude Opus 4Yi-Lightning
Aider Polyglot72%12.9%
LMArena Coding14421312
SWE-bench Verified70.7%—
SWE-bench Verified (bash only)67.6%—
GSO6.9%—
WeirdML43.7%—
AlgoTune1.33—

Agentic & Tool Use Not comparable

Claude Opus 4: 34.8 (#42), Yi-Lightning: —

BenchmarkClaude Opus 4Yi-Lightning
Cybench38%—
DeepResearch Bench46.8%—
LMArena Search1127—
METR Time Horizons63.9%—

Reasoning Claude Opus 4 leads

Claude Opus 4: 27.3 (#121), Yi-Lightning: 25.9 (#139)

BenchmarkClaude Opus 4Yi-Lightning
LMArena Hard Prompts13991302
ARC-AGI-28.6%—
SimpleBench58.8%—
Kagi LLM Benchmark74.3%—
ARC-AGI-135.7%—
CritPt0.3%—
EnigmaEval5.6%—
DTBench81.6%—
LMCA37.4%—
Epoch Capabilities Index142.67—
ForecastBench61.1—

Math Claude Opus 4 leads

Claude Opus 4: 42.0 (#86), Yi-Lightning: 36.2 (#172)

BenchmarkClaude Opus 4Yi-Lightning
LMArena Math13901300
OTIS Mock AIME 2024-202564.4%—
Omni-MATH61.6%—
MATH Level 585%—
FrontierMath (Feb 2025 set)4.5%—
FrontierMath Tier 4 (v1)4.2%—

Knowledge Claude Opus 4 leads

Claude Opus 4: 44.0 (#88), Yi-Lightning: 35.4 (#185)

BenchmarkClaude Opus 4Yi-Lightning
LMArena Expert13861286
GPQA Diamond76.3%—
Humanity's Last Exam10.7%—
MMLU-Pro87.5%—
Confabulations15.9%—
Vectara Hallucination Rate12%—
GPQA (HELM)70.8%—

Multimodal Not comparable

Claude Opus 4: 31.5 (#106), Yi-Lightning: —

BenchmarkClaude Opus 4Yi-Lightning
LMArena Vision1192—
GeoBench49%—
VPCT38%—

Multilingual Claude Opus 4 leads

Claude Opus 4: 48.8 (#138), Yi-Lightning: 42.2 (#196)

BenchmarkClaude Opus 4Yi-Lightning
LMArena Non-English13621269
LMArena Chinese13861320
LMArena French13721305
LMArena German13911267
LMArena Japanese13311228
LMArena Korean13211192
LMArena Russian13921255
LMArena Spanish13891315

Instruction Following Claude Opus 4 leads

Claude Opus 4: 77.1 (#28), Yi-Lightning: 67.4 (#196)

BenchmarkClaude Opus 4Yi-Lightning
LMArena Instruction Following14061278
IFEval91.8%—

Long Context Too close to call

Claude Opus 4: 39.6 (#172), Yi-Lightning: 39.4 (#181)

BenchmarkClaude Opus 4Yi-Lightning
LMArena Longer Query14221297
Fiction.LiveBench61.1%—

Writing & Preference Claude Opus 4 leads

Claude Opus 4: 61.2 (#89), Yi-Lightning: 50.2 (#184)

BenchmarkClaude Opus 4Yi-Lightning
LMArena Text13771302
LMArena Creative Writing13871280
LMArena Multi-Turn13961311
Short-Story Creative Writing83.6%—
EQ-Bench Creative Writing1580—
WildBench85.2%—

Frequently asked questions

Is Claude Opus 4 better than Yi-Lightning?

Claude Opus 4 is the stronger model overall, scoring 43.1 to 37.1 on the Noometry Index.

Is Claude Opus 4 or Yi-Lightning better for coding?

Claude Opus 4 scores higher on coding benchmarks: 47.2 versus 27.4 in the Noometry coding category.

How many benchmarks do Claude Opus 4 and Yi-Lightning share?

18 benchmarks have published results for both models. Claude Opus 4 has 56 scored results on Noometry and Yi-Lightning has 18.

Related comparisons

Go deeper