Model comparison

Qwen1.5-7B vs Solar Pro4

Solar Pro4 is the stronger model overall, scoring 41.5 to 30.8 on the Noometry Index.

Last verified . 12 shared benchmarks.

Qwen1.5-7B Alibaba (Qwen)

30.8

Rank #270 Confirmed

Solar Pro4 Upstage

41.5

Rank #123 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Qwen1.5-7B scores higher in 0 categories and Solar Pro4 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Solar Pro4 leads 56.7 to 29.8.
  • Qwen1.5-7B has downloadable open weights; the other is API-only.

Side by side

Qwen1.5-7B and Solar Pro4 specifications
Qwen1.5-7BSolar Pro4
ProviderAlibaba (Qwen)Upstage
Noometry Index30.841.5
Released2024-02-042026-08-06
WeightsOpenProprietary
Context window—524K
Max output—131K
Input $ / M tokens—$0.30
Output $ / M tokens—$1.20
Results tracked1318

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Solar Pro4 leads

Qwen1.5-7B: 31.6 (#271), Solar Pro4: 39.9 (#135)

Coding benchmarks
BenchmarkQwen1.5-7BSolar Pro4
LMArena Coding11071439
LMArena WebDev—1371

Reasoning Solar Pro4 leads

Qwen1.5-7B: 19.5 (#237), Solar Pro4: 27.3 (#107)

Reasoning benchmarks
BenchmarkQwen1.5-7BSolar Pro4
LMArena Hard Prompts10661398

Math Solar Pro4 leads

Qwen1.5-7B: 29.0 (#222), Solar Pro4: 36.1 (#129)

Math benchmarks
BenchmarkQwen1.5-7BSolar Pro4
LMArena Math10801418

Knowledge Solar Pro4 leads

Qwen1.5-7B: 28.2 (#239), Solar Pro4: 39.0 (#128)

Knowledge benchmarks
BenchmarkQwen1.5-7BSolar Pro4
LMArena Expert10551421
MMLU62.6%—

Multilingual Solar Pro4 leads

Qwen1.5-7B: 28.6 (#266), Solar Pro4: 49.0 (#134)

Multilingual benchmarks
BenchmarkQwen1.5-7BSolar Pro4
LMArena Non-English10581362
LMArena Chinese11401417
LMArena Russian10061360
LMArena French—1403
LMArena German—1351
LMArena Japanese—1300
LMArena Korean—1383
LMArena Spanish—1408

Instruction Following Solar Pro4 leads

Qwen1.5-7B: 54.4 (#276), Solar Pro4: 72.8 (#128)

Instruction Following benchmarks
BenchmarkQwen1.5-7BSolar Pro4
LMArena Instruction Following10581376

Long Context Solar Pro4 leads

Qwen1.5-7B: 33.1 (#261), Solar Pro4: 42.0 (#125)

Long Context benchmarks
BenchmarkQwen1.5-7BSolar Pro4
LMArena Longer Query10901379

Writing & Preference Solar Pro4 leads

Qwen1.5-7B: 29.8 (#288), Solar Pro4: 56.7 (#133)

Writing & Preference benchmarks
BenchmarkQwen1.5-7BSolar Pro4
LMArena Text10841386
LMArena Creative Writing10351313
LMArena Multi-Turn10611391

Frequently asked questions

Is Qwen1.5-7B better than Solar Pro4?

Solar Pro4 is the stronger model overall, scoring 41.5 to 30.8 on the Noometry Index.

Is Qwen1.5-7B or Solar Pro4 better for coding?

Solar Pro4 scores higher on coding benchmarks: 39.9 versus 31.6 in the Noometry coding category.

How many benchmarks do Qwen1.5-7B and Solar Pro4 share?

12 benchmarks have published results for both models. Qwen1.5-7B has 13 scored results on Noometry and Solar Pro4 has 18.

Related comparisons

Go deeper