Model comparison

Muse Spark 1.2 vs Yi-Lightning

Muse Spark 1.2 is the stronger model overall, scoring 49.8 to 36.5 on the Noometry Index.

Last verified . 11 shared benchmarks.

Muse Spark 1.2 Meta

49.8

Rank #44 Confirmed

Yi-Lightning 01.AI

36.5

Rank #206 Confirmed

Summary

  • They share 11 benchmarks with published results for both. Muse Spark 1.2 scores higher in 8 categories and Yi-Lightning in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Muse Spark 1.2 leads 50.4 to 24.9.

Side by side

Muse Spark 1.2 and Yi-Lightning specifications
Muse Spark 1.2Yi-Lightning
ProviderMeta01.AI
Noometry Index49.836.5
Released2026-08-052024-12-02
WeightsProprietaryProprietary
Context window1.05M—
Max output131K—
Input $ / M tokens$1.25—
Output $ / M tokens$4.25—
Results tracked2818

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark 1.2 leads

Muse Spark 1.2: 48.6 (#49), Yi-Lightning: 27.0 (#315)

Coding benchmarks
BenchmarkMuse Spark 1.2Yi-Lightning
LMArena Coding14971313
DeepSWE54.9%—
Aider Polyglot—12.9%
LMArena WebDev1532—
FrontierSWE12%—
SciCode56.4%—
WeirdML60.3%—

Agentic & Tool Use Not comparable

Muse Spark 1.2: 29.5 (#77), Yi-Lightning: —

Agentic & Tool Use benchmarks
BenchmarkMuse Spark 1.2Yi-Lightning
APEX-Agents36.4%—
GDP.pdf16%—

Reasoning Muse Spark 1.2 leads

Muse Spark 1.2: 50.4 (#32), Yi-Lightning: 24.9 (#137)

Reasoning benchmarks
BenchmarkMuse Spark 1.2Yi-Lightning
LMArena Hard Prompts14901302
SimpleBench74.5%—
NYT Connections (extended)79.2%—
CritPt17.7%—
DTBench94.7%—
LMCA48.4%—
Epoch Capabilities Index155.18—

Math Muse Spark 1.2 leads

Muse Spark 1.2: 43.8 (#68), Yi-Lightning: 33.5 (#173)

Math benchmarks
BenchmarkMuse Spark 1.2Yi-Lightning
ProofBench43%—
LMArena Math—1300

Knowledge Muse Spark 1.2 leads

Muse Spark 1.2: 53.9 (#49), Yi-Lightning: 34.8 (#182)

Knowledge benchmarks
BenchmarkMuse Spark 1.2Yi-Lightning
LMArena Expert14851286
SimpleQA Verified60.3%—

Multimodal Not comparable

Muse Spark 1.2: 42.6 (#24), Yi-Lightning: —

Multimodal benchmarks
BenchmarkMuse Spark 1.2Yi-Lightning
LMArena Vision1304—

Multilingual Muse Spark 1.2 leads

Muse Spark 1.2: 57.4 (#10), Yi-Lightning: 42.4 (#191)

Multilingual benchmarks
BenchmarkMuse Spark 1.2Yi-Lightning
LMArena Non-English14791269
LMArena Chinese15191320
LMArena Russian14941255
LMArena French—1304
LMArena German—1267
LMArena Japanese—1228
LMArena Korean—1192
LMArena Spanish—1315

Instruction Following Muse Spark 1.2 leads

Muse Spark 1.2: 77.1 (#30), Yi-Lightning: 67.6 (#191)

Instruction Following benchmarks
BenchmarkMuse Spark 1.2Yi-Lightning
LMArena Instruction Following14661278

Long Context Muse Spark 1.2 leads

Muse Spark 1.2: 45.4 (#35), Yi-Lightning: 39.4 (#176)

Long Context benchmarks
BenchmarkMuse Spark 1.2Yi-Lightning
LMArena Longer Query14831297

Writing & Preference Muse Spark 1.2 leads

Muse Spark 1.2: 72.6 (#14), Yi-Lightning: 50.4 (#178)

Writing & Preference benchmarks
BenchmarkMuse Spark 1.2Yi-Lightning
LMArena Text14861302
LMArena Creative Writing14441280
LMArena Multi-Turn15041311
EQ-Bench Creative Writing1840—

Frequently asked questions

Is Muse Spark 1.2 better than Yi-Lightning?

Muse Spark 1.2 is the stronger model overall, scoring 49.8 to 36.5 on the Noometry Index.

Is Muse Spark 1.2 or Yi-Lightning better for coding?

Muse Spark 1.2 scores higher on coding benchmarks: 48.6 versus 27.0 in the Noometry coding category.

How many benchmarks do Muse Spark 1.2 and Yi-Lightning share?

11 benchmarks have published results for both models. Muse Spark 1.2 has 28 scored results on Noometry and Yi-Lightning has 18.

Related comparisons

Go deeper