Model comparison

Falcon-180B vs Mistral Medium

Mistral Medium is the stronger model overall, scoring 36.0 to 31.8 on the Noometry Index.

Last verified October 10, 2026. 6 shared benchmarks.

Falcon-180B

Technology Innovation Institute

31.8

Rank #254 Confirmed

Mistral Medium

Mistral AI

36.0

Rank #211 Confirmed

Summary

They share 6 benchmarks with published results for both. Falcon-180B scores higher in 0 categories and Mistral Medium in 4 categories; 4 gaps are clear of the uncertainty.
The widest gap is in writing & preference, where Mistral Medium leads 60.2 to 29.3.

Side by side

Falcon-180B and Mistral Medium specifications
	Falcon-180B	Mistral Medium
Provider	Technology Innovation Institute	Mistral AI
Noometry Index	31.8	36.0
Released	2023-09-06	2023-12-11
Weights	Open	Open
Context window	—	262K
Max output	—	262K
Input $ / M tokens	—	$1.50
Output $ / M tokens	—	$7.50
Results tracked	16	36

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon-180B: —, Mistral Medium: 33.8 (#241)

Coding benchmarks
Benchmark	Falcon-180B	Mistral Medium
FrontierCode	—	8%
SciCode	—	40.2%
WeirdML	—	43.7%
LMArena Coding	—	1434
ALE-Bench	—	763.98

Agentic & Tool Use Not comparable

Falcon-180B: —, Mistral Medium: 28.1 (#84)

Agentic & Tool Use benchmarks
Benchmark	Falcon-180B	Mistral Medium
Berkeley Function Calling Leaderboard	—	37.7%

Reasoning Mistral Medium leads

Falcon-180B: 18.3 (#266), Mistral Medium: 23.3 (#165)

Reasoning benchmarks
Benchmark	Falcon-180B	Mistral Medium
LMArena Hard Prompts	1007	1426
Kagi LLM Benchmark	—	50%
CritPt	—	0%
DTBench	—	75.5%
LMCA	—	26.1%
Surface Evolver Bench	—	26.9%
Epoch Capabilities Index	111.89	—
HellaSwag	89%	—
LAMBADA	79.8%	—
PIQA	84.9%	—
WinoGrande	87.1%	—

Math Not comparable

Falcon-180B: —, Mistral Medium: 27.2 (#238)

Math benchmarks
Benchmark	Falcon-180B	Mistral Medium
OTIS Mock AIME 2024-2025	—	32.2%
ProofBench	—	9%
LMArena Math	—	1409
MATH Level 5	—	81.6%
FrontierMath (Feb 2025 set)	—	0.3%
GSM8K	54.4%	—

Knowledge Not comparable

Falcon-180B: —, Mistral Medium: 24.9 (#260)

Knowledge benchmarks
Benchmark	Falcon-180B	Mistral Medium
GPQA Diamond	—	59.5%
Humanity's Last Exam	—	4.5%
Vectara Hallucination Rate	—	22.7%
LMArena Expert	—	1408
ARC (AI2) Challenge	67.8%	—
BoolQ	89%	—
MMLU	70.6%	—
OpenBookQA	64.2%	—

Multimodal Not comparable

Falcon-180B: —, Mistral Medium: 34.6 (#82)

Multimodal benchmarks
Benchmark	Falcon-180B	Mistral Medium
LMArena Vision	—	1172

Multilingual Mistral Medium leads

Falcon-180B: 25.3 (#281), Mistral Medium: 52.3 (#86)

Multilingual benchmarks
Benchmark	Falcon-180B	Mistral Medium
LMArena Non-English	1000	1408
LMArena Chinese	—	1448
LMArena French	—	1460
LMArena German	—	1433
LMArena Japanese	—	1378
LMArena Korean	—	1382
LMArena Russian	—	1411
LMArena Spanish	—	1433

Instruction Following Mistral Medium leads

Falcon-180B: 53.6 (#281), Mistral Medium: 73.9 (#111)

Instruction Following benchmarks
Benchmark	Falcon-180B	Mistral Medium
LMArena Instruction Following	1047	1398

Long Context Not comparable

Falcon-180B: —, Mistral Medium: 42.9 (#108)

Long Context benchmarks
Benchmark	Falcon-180B	Mistral Medium
LMArena Longer Query	—	1406

Writing & Preference Mistral Medium leads

Falcon-180B: 29.3 (#290), Mistral Medium: 60.2 (#97)

Writing & Preference benchmarks
Benchmark	Falcon-180B	Mistral Medium
LMArena Text	1054	1424
LMArena Creative Writing	1089	1391
LMArena Multi-Turn	1013	1418
Short-Story Creative Writing	—	77.3%

Frequently asked questions

Is Falcon-180B better than Mistral Medium?