Model comparison

Grok 4.20 Multi-Agent vs Solar Pro4

Grok 4.20 Multi-Agent is the stronger model overall, scoring 45.5 to 41.5 on the Noometry Index. Solar Pro4 costs 3.0× less per token, which makes it the better buy when Grok 4.20 Multi-Agent's lead doesn't matter for your workload.

Last verified October 10, 2026. 17 shared benchmarks.

Grok 4.20 Multi-Agent xAI

45.5

Rank #62 Confirmed

Solar Pro4

Upstage

41.5

Rank #123 Confirmed

Summary

They share 17 benchmarks with published results for both. Grok 4.20 Multi-Agent scores higher in 8 categories and Solar Pro4 in 0 categories; 6 gaps are clear of the uncertainty.
The widest gap is in reasoning, where Grok 4.20 Multi-Agent leads 42.4 to 27.3.
Solar Pro4 is cheaper at $0.30 / $1.20 per million input/output tokens, against $1.25 / $2.50 for Grok 4.20 Multi-Agent.
Grok 4.20 Multi-Agent accepts more context: 1M tokens versus 524K.

Side by side

Grok 4.20 Multi-Agent and Solar Pro4 specifications
	Grok 4.20 Multi-Agent	Solar Pro4
Provider	xAI	Upstage
Noometry Index	45.5	41.5
Released	2026-03-09	2026-08-06
Weights	Proprietary	Proprietary
Context window	1M	524K
Max output	30K	131K
Input $ / M tokens	$1.25	$0.30
Output $ / M tokens	$2.50	$1.20
Results tracked	20	18

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 42.4 (#91), Solar Pro4: 39.9 (#135)

Coding benchmarks
Benchmark	Grok 4.20 Multi-Agent	Solar Pro4
LMArena Coding	1458	1439
LMArena WebDev	—	1371

Agentic & Tool Use Not comparable

Grok 4.20 Multi-Agent: —, Solar Pro4: —

Agentic & Tool Use benchmarks
Benchmark	Grok 4.20 Multi-Agent	Solar Pro4
LMArena Search	1204	—

Reasoning Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 42.4 (#44), Solar Pro4: 27.3 (#107)

Reasoning benchmarks
Benchmark	Grok 4.20 Multi-Agent	Solar Pro4
LMArena Hard Prompts	1448	1398
NYT Connections (extended)	89.6%	—

Math Too close to call

Grok 4.20 Multi-Agent: 36.6 (#106), Solar Pro4: 36.1 (#129)

Math benchmarks
Benchmark	Grok 4.20 Multi-Agent	Solar Pro4
LMArena Math	1441	1418

Knowledge Too close to call

Grok 4.20 Multi-Agent: 39.7 (#116), Solar Pro4: 39.0 (#128)

Knowledge benchmarks
Benchmark	Grok 4.20 Multi-Agent	Solar Pro4
LMArena Expert	1445	1421

Multimodal Not comparable

Grok 4.20 Multi-Agent: 39.8 (#44), Solar Pro4: —

Multimodal benchmarks
Benchmark	Grok 4.20 Multi-Agent	Solar Pro4
LMArena Vision	1259	—

Multilingual Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 54.6 (#40), Solar Pro4: 49.0 (#134)

Multilingual benchmarks
Benchmark	Grok 4.20 Multi-Agent	Solar Pro4
LMArena Non-English	1440	1362
LMArena Chinese	1475	1417
LMArena French	1467	1403
LMArena German	1456	1351
LMArena Japanese	1405	1300
LMArena Korean	1416	1383
LMArena Russian	1457	1360
LMArena Spanish	1447	1408

Instruction Following Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 75.0 (#80), Solar Pro4: 72.8 (#128)

Instruction Following benchmarks
Benchmark	Grok 4.20 Multi-Agent	Solar Pro4
LMArena Instruction Following	1420	1376

Long Context Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 43.7 (#84), Solar Pro4: 42.0 (#125)

Long Context benchmarks
Benchmark	Grok 4.20 Multi-Agent	Solar Pro4
LMArena Longer Query	1430	1379

Writing & Preference Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 64.1 (#57), Solar Pro4: 56.7 (#133)

Writing & Preference benchmarks
Benchmark	Grok 4.20 Multi-Agent	Solar Pro4
LMArena Text	1450	1386
LMArena Creative Writing	1435	1313
LMArena Multi-Turn	1451	1391

Frequently asked questions

Is Grok 4.20 Multi-Agent better than Solar Pro4?

Which is cheaper, Grok 4.20 Multi-Agent or Solar Pro4?

Solar Pro4 is cheaper. It lists at $0.30 per million input tokens and $1.20 per million output tokens; Grok 4.20 Multi-Agent lists at $1.25 and $2.50.

Is Grok 4.20 Multi-Agent or Solar Pro4 better for coding?

Grok 4.20 Multi-Agent scores higher on coding benchmarks: 42.4 versus 39.9 in the Noometry coding category.

Which has the bigger context window?

Grok 4.20 Multi-Agent does, with 1M tokens against 524K.

How many benchmarks do Grok 4.20 Multi-Agent and Solar Pro4 share?

17 benchmarks have published results for both models. Grok 4.20 Multi-Agent has 20 scored results on Noometry and Solar Pro4 has 18.