Long Context benchmark

LMArena Longer Query leaderboard

As of October 2026, Gemini 4 Argon has the highest published LMArena Longer Query score on Noometry at 1549, out of 291 models with results.

Last verified

About LMArena Longer Query

LMArena ratings restricted to long prompts.

Category
Long Context
Introduced
2024
Format
Pairwise human votes
Unit
Arena rating (Bradley–Terry)
Official site
lmarena.ai

Top 15 models

Top models on LMArena Longer Query
  1. Gemini 4 Argon 1549
  2. Claude Opus 5.5 1532
  3. Claude Fable 5.1 1522
  4. Claude Opus 4.6 1520
  5. Claude Opus 5 1515
  6. Claude Fable 5 1509
  7. Gemini 3.8 Flash 1508
  8. Claude Opus 4.7 1505
  9. MiMo-V2.6-Pro 1501
  10. Claude Sonnet 5.5 1498
  11. Kimi K3 1494
  12. Gemini 3.7 Flash 1492
  13. Qwen3.8 Max 1489
  14. Muse Spark 1.3 1488
  15. GPT-5.5 1484

Sponsored placements are available on pages like this one. Advertise on Noometry

All results

LMArena Longer Query results by model
#ModelProviderRatingSettingSourceDate
1Gemini 4 Argon Google1549highLMArena2026-10-08
2Claude Opus 5.5 Anthropic1532highLMArena2026-10-08
3Claude Fable 5.1 Anthropic1522LMArena2026-10-08
4Claude Opus 4.6 Anthropic1520highLMArena2026-10-08
5Claude Opus 5 Anthropic1515LMArena2026-10-08
6Claude Fable 5 Anthropic1509highLMArena2026-10-08
7Gemini 3.8 Flash Google1508highLMArena2026-10-08
8Claude Opus 4.7 Anthropic1505highLMArena2026-10-08
9MiMo-V2.6-Pro Xiaomi1501LMArena2026-10-08
10Claude Sonnet 5.5 Anthropic1498xhighLMArena2026-10-08
11Kimi K3 Moonshot AI1494LMArena2026-10-08
12Gemini 3.7 Flash Google1492highLMArena2026-10-08
13Qwen3.8 Max Alibaba (Qwen)1489LMArena2026-10-08
14Muse Spark 1.3 Meta1488LMArena2026-10-08
15GPT-5.5 OpenAI1484highLMArena2026-10-08
16Claude Opus 4.8 Anthropic1483highLMArena2026-10-08
17Gemini 3.1 Pro Preview Google1483LMArena2026-10-08
18MiMo-V2.5-Pro Xiaomi1483LMArena2026-10-08
19Qwen3.7 Max Alibaba (Qwen)1482LMArena2026-10-08
20Gemini 3.5 Flash Google1482highLMArena2026-10-08
21GLM-5.3-Flash Z.ai (Zhipu)1482LMArena2026-10-08
22GLM-5.3 Z.ai (Zhipu)1482LMArena2026-10-08
23GPT-5.6 Sol OpenAI1480xhighLMArena2026-10-08
24Claude Opus 4.5 Anthropic1480LMArena2026-10-08
25GLM-5.2 Z.ai (Zhipu)1479LMArena2026-10-08
26Claude Sonnet 4.6 Anthropic1479LMArena2026-10-08
27Qwen3.5 Max Preview Alibaba (Qwen)1476LMArena2026-10-08
28Claude Sonnet 4.5 Anthropic1476LMArena2026-10-08
29DeepSeek V4.1 Flash DeepSeek1475LMArena2026-10-08
30Muse Spark 1.2 Meta1475muse-spark-1.2 (xHigh)LMArena2026-10-08
31Gemini 3.6 Flash Google1474highLMArena2026-10-08
32GPT-5.4 OpenAI1473highLMArena2026-10-08
33Gemini 3 Pro Google1471LMArena2026-10-08
34Kimi K2.6 Moonshot AI1468LMArena2026-10-08
35GLM-5.1 Z.ai (Zhipu)1466LMArena2026-10-08
36GPT-6.1 Sol OpenAI1465LMArena2026-10-08
37Claude Sonnet 5 Anthropic1463highLMArena2026-10-08
38MiMo-V2.6-Flash Xiaomi1463LMArena2026-10-08
39Grok 4.5 xAI1463LMArena2026-10-08
40Muse Spark 1.1 Meta1462LMArena2026-10-08
41ERNIE 5.1 Baidu1462LMArena2026-10-08
42DeepSeek V4 Pro DeepSeek1458LMArena2026-10-08
43Qwen3.6 Max Preview Alibaba (Qwen)1457LMArena2026-10-08
44GPT-6 Astra OpenAI1456LMArena2026-10-08
45Step 5 Preview StepFun1455Step 5 PreviewLMArena2026-10-08
46Claude Opus 4.1 Anthropic1455thinking-16kLMArena2026-10-08
47MiMo-V2-Pro Xiaomi1455LMArena2026-10-08
48Qwen3.7 Plus Alibaba (Qwen)1455LMArena2026-10-08
49Grok 4.6 xAI1454highLMArena2026-10-08
50Gemini 3 Flash Preview Google1452LMArena2026-10-08
51GPT-5.6 Terra OpenAI1451xhighLMArena2026-10-08
52Muse Spark Meta1451LMArena2026-10-08
53Qwen3.8 27B Alibaba (Qwen)1450LMArena2026-10-08
54Gemini 2.5 Pro Google1449LMArena2026-10-08
55GPT-5.1 OpenAI1447highLMArena2026-10-08
56Gemma 4 31B IT Google1446LMArena2026-10-08
57GLM-5 Z.ai (Zhipu)1446LMArena2026-10-08
58Kimi K2.5 Moonshot AI1445thinkingLMArena2026-10-08
59MiniMax-M3 MiniMax1445LMArena2026-10-08
60MiMo-V2.5 Xiaomi1445LMArena2026-10-08
61Qwen3.5 397B-A17B Alibaba (Qwen)1442LMArena2026-10-08
62Hy3 Tencent1442LMArena2026-10-08
63MiMo-V2-Omni Xiaomi1442LMArena2026-10-08
64Amazon Nova Experimental Chat 26 02 10 Amazon1441LMArena2026-10-08
65Qwen3.6 Plus Alibaba (Qwen)1439LMArena2026-10-08
66Grok 3 xAI1439LMArena2026-10-08
67GLM-5V-Turbo Z.ai (Zhipu)1438LMArena2026-10-08
68Qwen3 Max Alibaba (Qwen)1438LMArena2026-10-08
69Nemotron 3 Ultra NVIDIA1437LMArena2026-10-08
70Grok 4.20 (Non-Reasoning) xAI1437LMArena2026-10-08
71GPT-5.6 Luna OpenAI1436xhighLMArena2026-10-08
72Kimi K2.5 Instant Moonshot AI1435LMArena2026-10-08
73Gemini 3.5 Flash Lite Google1435LMArena2026-10-08
74DeepSeek V4 Flash DeepSeek1434LMArena2026-10-08
75Inkling Thinking Machines Lab1434LMArena2026-10-08
76GLM-4.7 Z.ai (Zhipu)1432LMArena2026-10-08
77Grok 4.20 Multi-Agent xAI1431LMArena2026-10-08
78Mistral Large 4 Mistral AI1429LMArena2026-10-08
79DeepSeek-V3.2-Exp DeepSeek1428LMArena2026-10-08
80GPT-5.2 OpenAI1428LMArena2026-10-08
81Seed 2.0 Pro ByteDance Seed1428LMArena2026-10-08
82Gemma 4 26B A4B IT Google1428LMArena2026-10-08
83Claude Haiku 4.5 Anthropic1427LMArena2026-10-08
84Qwen3 235B-A22B Alibaba (Qwen)1426LMArena2026-10-08
85Longcat Flash Chat Meituan1425LMArena2026-10-08
86Claude Opus 4 Anthropic1422thinking-16kLMArena2026-10-08
87GLM-4.6 Z.ai (Zhipu)1422LMArena2026-10-08
88GPT-5.5 Instant OpenAI1422LMArena2026-10-08
89ERNIE 5.0 0110 Baidu1422LMArena2026-10-08
90DeepSeek-V3.1 DeepSeek1422thinkingLMArena2026-10-08
91DeepSeek-V3.1-Terminus DeepSeek1421thinkingLMArena2026-10-08
92Qwen3-VL 235B-A22B Alibaba (Qwen)1420LMArena2026-10-08
93Gemini 2.5 Flash Google1419LMArena2026-10-08
94MiniMax-M2.7 MiniMax1419LMArena2026-10-08
95Grok 4.1 xAI1416LMArena2026-10-08
96MiniMax-M2.1 MiniMax1416LMArena2026-10-08
97Kimi K2 Thinking Turbo Moonshot AI1415LMArena2026-10-08
98Mistral Medium 3.5 Mistral AI1415LMArena2026-10-08
99Grok 4 Fast xAI1415LMArena2026-10-08
100Mistral Large 3 Mistral AI1413LMArena2026-10-08
101Grok 4.7 xAI1413xhighLMArena2026-10-08
102Qwen3.5 27B Alibaba (Qwen)1413LMArena2026-10-08
103Chatgpt 4o Latest 20250326 OpenAI1413LMArena2026-10-08
104GLM-4.5 Z.ai (Zhipu)1412LMArena2026-10-08
105GPT-6 Sol OpenAI1411LMArena2026-10-08
106Qwen3.5 122B-A10B Alibaba (Qwen)1410LMArena2026-10-08
107MiMo-V2-Flash Xiaomi1409LMArena2026-10-08
108GPT-6 Luna OpenAI1409LMArena2026-10-08
109Grok 4 xAI1409LMArena2026-10-08
110GPT-5.4 mini OpenAI1407highLMArena2026-10-08
111Mistral Medium Mistral AI1406LMArena2026-10-08
112GPT-4.5 OpenAI1406LMArena2026-10-08
113Hunyuan Vision 1.5 Tencent1404thinkingLMArena2026-10-08
114Qwen3-Next 80B-A3B Instruct Alibaba (Qwen)1403LMArena2026-10-08
115Step 3.5 Flash StepFun1402LMArena2026-10-08
116Inkling-Small Thinking Machines Lab1401Inkling SmallLMArena2026-10-08
117Amazon Nova Experimental Chat 26 01 10 Amazon1400LMArena2026-10-08
118GPT-5 OpenAI1399LMArena2026-10-08
119Claude Sonnet 4 Anthropic1398thinking-32kLMArena2026-10-08
120GPT-5.3 Chat OpenAI1396LMArena2026-10-08
121Amazon Nova Experimental Chat 11 10 Amazon1395LMArena2026-10-08
122Gemini 3.1 Flash Lite Google1394LMArena2026-10-08
123Grok 4.3 xAI1393LMArena2026-10-08
124Qwen3.5-Flash Alibaba (Qwen)1392LMArena2026-10-08
125DeepSeek-R1 DeepSeek1391LMArena2026-10-08
126Amazon Nova Experimental Chat 12 10 Amazon1391LMArena2026-10-08
127Grok 4.1 Fast xAI1390LMArena2026-10-08
128Qwen3.5 35B-A3B Alibaba (Qwen)1389LMArena2026-10-08
129GPT-4.1 OpenAI1385LMArena2026-10-08
130Hunyuan T1 20250711 Tencent1384LMArena2026-10-08
131Muse Glimmer Meta1382LMArena2026-10-08
132Solar Pro4 Upstage1381LMArena2026-10-08
133Qwen3-30B-A3B Alibaba (Qwen)1379LMArena2026-10-08
134Qwen3-Coder 480B-A35B Instruct Alibaba (Qwen)1378LMArena2026-10-08
135o1 OpenAI1378LMArena2026-10-08
136Gemini 2.5 Flash-Lite Google1373thinkingLMArena2026-10-08
137Claude 3.7 Sonnet Anthropic1373thinking-32kLMArena2026-10-08
138Grok-3 mini xAI1372highLMArena2026-10-08
139o3 OpenAI1372LMArena2026-10-08
140Amazon Nova Experimental Chat 10 20 Amazon1370LMArena2026-10-08
141MiniMax-M2.5 MiniMax1366LMArena2026-10-08
142GLM-4.5-Air Z.ai (Zhipu)1366LMArena2026-10-08
143Hunyuan Turbos 20250226 Tencent1366LMArena2026-10-08
144GPT-5.4 nano OpenAI1366highLMArena2026-10-08
145Nemotron 3 Super NVIDIA1362LMArena2026-10-08
146Granite 4.2 30b IBM1359LMArena2026-10-08
147Qwen2.5-Max Alibaba (Qwen)1358LMArena2026-10-08
148GLM-4.6V Z.ai (Zhipu)1358LMArena2026-10-08
149GPT-5 Mini OpenAI1355highLMArena2026-10-08
150Trinity Large Thinking Arcee AI1355LMArena2026-10-08
151Kimi K2 (Jul 2025) Moonshot AI1353LMArena2026-10-08
152DeepSeek-V3 DeepSeek1352LMArena2026-10-08
153Step 1o Turbo 202506 StepFun1348LMArena2026-10-08
154GLM-4.7-Flash Z.ai (Zhipu)1345LMArena2026-10-08
155Gemini 2.0 Flash (Feb 2025) Google1344LMArena2026-10-08
156GPT-4.1 mini OpenAI1344LMArena2026-10-08
157o3-mini OpenAI1343highLMArena2026-10-08
158Hunyuan Large 2025 02 10 Tencent1341LMArena2026-10-08
159Nova 2 Lite Amazon1335LMArena2026-10-08
160Command A Cohere1334LMArena2026-10-08
161Gemma 3 27B Google1333LMArena2026-10-08
162Amazon Nova Experimental Chat 10 09 Amazon1333LMArena2026-10-08
163MiniMax-M2 MiniMax1331LMArena2026-10-08
164Mercury 2 Inception1330LMArena2026-10-08
165Qwen3 32B Alibaba (Qwen)1327LMArena2026-10-08
166Mistral Small Mistral AI1327LMArena2026-10-08
167MiniMax M1 MiniMax1326LMArena2026-10-08
168Step 3 StepFun1326LMArena2026-10-08
169Qwen Plus Alibaba (Qwen)1324LMArena2026-10-08
170Granite 4.2 8B IBM1324LMArena2026-10-08
171Gemini 2.0 Flash-Lite Google1320LMArena2026-10-08
172o1-mini OpenAI1320LMArena2026-10-08
173gpt-oss-120b OpenAI1319LMArena2026-10-08
174Gemma 3 12B Google1317LMArena2026-10-08
175Nvidia Llama 3.3 Nemotron Super 49b v1.5 NVIDIA1315LMArena2026-10-08
176o4-mini OpenAI1315LMArena2026-10-08
177Nemotron 3.5 Lightning NVIDIA1314LMArena2026-10-08
178Olmo 3.1 32b Instruct Allen Institute for AI (Ai2)1312LMArena2026-10-08
179GPT-5 Nano OpenAI1312highLMArena2026-10-08
180Claude 3.5 Sonnet Anthropic1311LMArena2026-10-08
181Hunyuan Turbo 0110 Tencent1309LMArena2026-10-08
182QwQ-32B Alibaba (Qwen)1308LMArena2026-10-08
183Gemini 1.5 Pro (May 2024) Google1308LMArena2026-10-08
184Step 2 16k Exp 202412 StepFun1307LMArena2026-10-08
185GLM-4.5V Z.ai (Zhipu)1304LMArena2026-10-08
186Hunyuan Standard 2025 02 10 Tencent1301LMArena2026-10-08
187DeepSeek-V2.5 (Sep 2024) DeepSeek1301LMArena2026-10-08
188Nemotron 3 Nano 30B A3B NVIDIA1300LMArena2026-10-08
189Llama 3.3 Nemotron 49b Super v1 NVIDIA1299LMArena2026-10-08
190Llama 3.1 Nemotron Ultra 253b v1 NVIDIA1299LMArena2026-10-08
191Mistral Small 3.1 Mistral AI1299LMArena2026-10-08
192Yi-Lightning 01.AI1297LMArena2026-10-08
193Olmo 3 32b Think Allen Institute for AI (Ai2)1296LMArena2026-10-08
194Magistral Medium Mistral AI1295LMArena2026-10-08
195Qwen2.5 Plus 1127 Alibaba (Qwen)1292LMArena2026-10-08
196Granite 4.2 3b IBM1291LMArena2026-10-08
197GPT-4o mini OpenAI1289LMArena2026-10-08
198GPT-4o OpenAI1289LMArena2026-10-08
199Qwen Max Alibaba (Qwen)1288LMArena2026-10-08
200Gemini 1.5 Flash (May 2024) Google1284LMArena2026-10-08
201GPT-4.1 nano OpenAI1283LMArena2026-10-08
202Qwen2.5 72B Instruct Alibaba (Qwen)1282LMArena2026-10-08
203Llama 4 Maverick Meta1280LMArena2026-10-08
204Hunyuan Large Vision Tencent1280LMArena2026-10-08
205Grok-2 (Dec 2024) xAI1276LMArena2026-10-08
206Gemma 3n E4b IT Google1276LMArena2026-10-08
207Granite 4.1 8b IBM1275LMArena2026-10-08
208Gemma 3 4B Google1273LMArena2026-10-08
209Olmo 3.1 32b Think Allen Institute for AI (Ai2)1272LMArena2026-10-08
210Grok 2 Mini 2024 08 13 xAI1266LMArena2026-10-08
211Llama 3.1-405B Meta1266LMArena2026-10-08
212Mercury Inception1266LMArena2026-10-08
213Llama 4 Scout Meta1265LMArena2026-10-08
214Mistral Large Mistral AI1261LMArena2026-10-08
215Claude 3.5 Haiku Anthropic1261LMArena2026-10-08
216Claude 3 Opus Anthropic1259LMArena2026-10-08
217Llama-3.3-70B-Instruct Meta1256LMArena2026-10-08
218Amazon Nova Pro Amazon1255LMArena2026-10-08
219GPT-4 Turbo OpenAI1254LMArena2026-10-08
220Gemini Advanced 0514 Google1253LMArena2026-10-08
221Qwen2.5-Coder-32B Alibaba (Qwen)1251LMArena2026-10-08
222gpt-oss-20b OpenAI1250LMArena2026-10-08
223Mistral Small 3 Mistral AI1246LMArena2026-10-08
224GPT-4 OpenAI1244LMArena2026-10-08
225Granite 4.0 H Small IBM1242LMArena2026-10-08
226Llama 3.1-70B Meta1241LMArena2026-10-08
227Llama 3.1 Nemotron 70b Instruct NVIDIA1238LMArena2026-10-08
228Amazon Nova Lite Amazon1234LMArena2026-10-08
229Gemma 2 27B Google1231LMArena2026-10-08
230Command R+ Cohere1230LMArena2026-10-08
231C4ai Aya Expanse 32b Cohere1228LMArena2026-10-08
232Nemotron 4 340b Instruct NVIDIA1225LMArena2026-10-08
233Tulu 3 (Tülu 3) 70B Allen Institute for AI (Ai2)1224LMArena2026-10-08
234Deepseek Coder v2 DeepSeek1219LMArena2026-10-08
235Gemini 1.5 Flash 8B Google1219LMArena2026-10-08
236Phi-4 Microsoft1217LMArena2026-10-08
237Ministral 8B Mistral AI1212LMArena2026-10-08
238Claude 3 Sonnet Anthropic1211LMArena2026-10-08
239Amazon Nova Micro Amazon1205LMArena2026-10-08
240Llama 3.1 Nemotron 51b Instruct NVIDIA1205LMArena2026-10-08
241Command R Cohere1198LMArena2026-10-08
242Gemma 2 9B Google1197LMArena2026-10-08
243Olmo 2 0325 32b Instruct Allen Institute for AI (Ai2)1194LMArena2026-10-08
244Qwen2-72B Alibaba (Qwen)1192LMArena2026-10-08
245C4ai Aya Expanse 8b Cohere1191LMArena2026-10-08
246Claude 3 Haiku Anthropic1190LMArena2026-10-08
247Llama 3.1-8B Meta1182LMArena2026-10-08
248Llama 3.1 Tulu 3 8b Allen Institute for AI (Ai2)1181LMArena2026-10-08
249Llama 3-70B Meta1174LMArena2026-10-08
250Granite 3.1 8b Instruct IBM1162LMArena2026-10-08
251Qwen1.5-110B Alibaba (Qwen)1157LMArena2026-10-08
252Qwen1.5-72B Alibaba (Qwen)1157LMArena2026-10-08
253Granite 3.1 2b Instruct IBM1155LMArena2026-10-08
254Mistral Mistral AI1153mediumLMArena2026-10-08
255Qwen1.5-32B Alibaba (Qwen)1146LMArena2026-10-08
256Mixtral 8x22B Mistral AI1144LMArena2026-10-08
257Yi-1.5-34B 01.AI1143LMArena2026-10-08
258Gemini 1.0 Pro Google1132LMArena2026-10-08
259Gemma 2 2b IT Google1130LMArena2026-10-08
260Llama 3-8B Meta1128LMArena2026-10-08
261Granite 3.0 8b Instruct IBM1122LMArena2026-10-08
262GPT-3.5-turbo OpenAI1121LMArena2026-10-08
263Phi 3 Medium 4k Instruct Microsoft1120LMArena2026-10-08
264Qwen1.5-14B Alibaba (Qwen)1113LMArena2026-10-08
265DBRX Databricks1112LMArena2026-10-08
266Mixtral 8x7B Mistral AI1103LMArena2026-10-08
267Llama 3.2 3B Meta1100LMArena2026-10-08
268Wizardlm 70b Microsoft1097LMArena2026-10-08
269Yi-34B 01.AI1094LMArena2026-10-08
270DeepSeek LLM 67B DeepSeek1092LMArena2026-10-08
271Qwen1.5-7B Alibaba (Qwen)1090LMArena2026-10-08
272Phi 3 Small 8k Instruct Microsoft1088LMArena2026-10-08
273Granite 3.0 2b Instruct IBM1070LMArena2026-10-08
274Llama 2-13B Meta1064LMArena2026-10-08
275Llama 2-70B Meta1062LMArena2026-10-08
276Mistral 7B Mistral AI1060LMArena2026-10-08
277Gemma 1.1 7b IT Google1056LMArena2026-10-08
278Wizardlm 13b Microsoft1054LMArena2026-10-08
279Llama 3.2 1B Meta1050LMArena2026-10-08
280Phi 3 Mini 4k Instruct Microsoft1044LMArena2026-10-08
281Phi 3 Mini 4k Instruct June 2024 Microsoft1042LMArena2026-10-08
282Qwen-14B Alibaba (Qwen)1028LMArena2026-10-08
283Gemma 7B Google1022LMArena2026-10-08
284Codellama 34b Instruct Meta1013LMArena2026-10-08
285Palm 2 Google1010LMArena2026-10-08
286Gemma 1.1 2b IT Google1003LMArena2026-10-08
287Llama 2-7B Meta999LMArena2026-10-08
288Llama2 70b Steerlm Chat NVIDIA998LMArena2026-10-08
289Phi 3 Mini 128k Instruct Microsoft996LMArena2026-10-08
290Qwen1.5 4b Chat Alibaba (Qwen)988LMArena2026-10-08
291Gemma 2B Google981LMArena2026-10-08

Compare the leaders

Other long context benchmarks

Frequently asked questions

What does LMArena Longer Query measure?

LMArena ratings restricted to long prompts.

Which model has the highest LMArena Longer Query score?

As of October 2026, Gemini 4 Argon has the highest published LMArena Longer Query score on Noometry at 1549, out of 291 models with results.

What is the best open-weight model on LMArena Longer Query?

MiMo-V2.6-Pro has the highest LMArena Longer Query rating among open-weight models at 1501, ranking 9 of 291 overall.