Noometry

Model comparison

Grok 4.20 Multi-Agent vs Longcat Flash Chat

Grok 4.20 Multi-Agent is the stronger model overall, scoring 45.5 to 41.5 on the Noometry Index.

Last verified . 18 shared benchmarks.

Grok 4.20 Multi-Agent xAI

45.5

Rank #62 Confirmed

Longcat Flash Chat Meituan

41.5

Rank #121 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Grok 4.20 Multi-Agent scores higher in 6 categories and Longcat Flash Chat in 2 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.20 Multi-Agent leads 42.4 to 18.3.
  • The biggest single-benchmark swing is NYT Connections (extended): 89.6% for Grok 4.20 Multi-Agent and 17.7% for Longcat Flash Chat.
  • Longcat Flash Chat has downloadable open weights; the other is API-only.

Side by side

Grok 4.20 Multi-AgentLongcat Flash Chat
ProviderxAIMeituan
Noometry Index45.541.5
Released2026-03-09—
WeightsProprietaryOpen
Context window1M—
Max output30K—
Input $ / M tokens$1.25—
Output $ / M tokens$2.50—
Results tracked2019

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Grok 4.20 Multi-Agent: 42.4 (#91), Longcat Flash Chat: 42.9 (#85)

BenchmarkGrok 4.20 Multi-AgentLongcat Flash Chat
LMArena Coding14581471

Agentic & Tool Use Not comparable

Grok 4.20 Multi-Agent: —, Longcat Flash Chat: —

BenchmarkGrok 4.20 Multi-AgentLongcat Flash Chat
LMArena Search1204—

Reasoning Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 42.4 (#44), Longcat Flash Chat: 18.3 (#267)

BenchmarkGrok 4.20 Multi-AgentLongcat Flash Chat
NYT Connections (extended)89.6%17.7%
LMArena Hard Prompts14481440
Kagi LLM Benchmark—43.9%

Math Too close to call

Grok 4.20 Multi-Agent: 36.6 (#106), Longcat Flash Chat: 36.6 (#107)

BenchmarkGrok 4.20 Multi-AgentLongcat Flash Chat
LMArena Math14411441

Knowledge Too close to call

Grok 4.20 Multi-Agent: 39.7 (#116), Longcat Flash Chat: 40.0 (#111)

BenchmarkGrok 4.20 Multi-AgentLongcat Flash Chat
LMArena Expert14451454

Multimodal Not comparable

Grok 4.20 Multi-Agent: 39.8 (#44), Longcat Flash Chat: —

BenchmarkGrok 4.20 Multi-AgentLongcat Flash Chat
LMArena Vision1259—

Multilingual Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 54.6 (#40), Longcat Flash Chat: 52.1 (#95)

BenchmarkGrok 4.20 Multi-AgentLongcat Flash Chat
LMArena Non-English14401404
LMArena Chinese14751465
LMArena French14671457
LMArena German14561409
LMArena Japanese14051373
LMArena Korean14161372
LMArena Russian14571396
LMArena Spanish14471445

Instruction Following Too close to call

Grok 4.20 Multi-Agent: 75.0 (#80), Longcat Flash Chat: 74.6 (#92)

BenchmarkGrok 4.20 Multi-AgentLongcat Flash Chat
LMArena Instruction Following14201411

Long Context Too close to call

Grok 4.20 Multi-Agent: 43.7 (#84), Longcat Flash Chat: 43.5 (#89)

BenchmarkGrok 4.20 Multi-AgentLongcat Flash Chat
LMArena Longer Query14301425

Writing & Preference Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 64.1 (#57), Longcat Flash Chat: 61.2 (#88)

BenchmarkGrok 4.20 Multi-AgentLongcat Flash Chat
LMArena Text14501427
LMArena Creative Writing14351388
LMArena Multi-Turn14511418

Frequently asked questions

Is Grok 4.20 Multi-Agent better than Longcat Flash Chat?

Grok 4.20 Multi-Agent is the stronger model overall, scoring 45.5 to 41.5 on the Noometry Index.

Is Grok 4.20 Multi-Agent or Longcat Flash Chat better for coding?

They score almost the same on coding (42.4 vs 42.9); test both on your own repository before choosing.

How many benchmarks do Grok 4.20 Multi-Agent and Longcat Flash Chat share?

18 benchmarks have published results for both models. Grok 4.20 Multi-Agent has 20 scored results on Noometry and Longcat Flash Chat has 19.

Related comparisons

Go deeper