Model comparison

Llama 2-7B vs Mistral Medium

Mistral Medium is the stronger model overall, scoring 36.3 to 29.1 on the Noometry Index.

Last verified October 10, 2026. 15 shared benchmarks.

Summary

They share 15 benchmarks with published results for both. Llama 2-7B scores higher in 2 categories and Mistral Medium in 6 categories; 8 gaps are clear of the uncertainty.
The widest gap is in writing & preference, where Mistral Medium leads 60.0 to 28.0.

Side by side

Llama 2-7B and Mistral Medium specifications
	Llama 2-7B	Mistral Medium
Provider	Meta	Mistral AI
Noometry Index	29.1	36.3
Released	2023-07-18	2023-12-11
Weights	Open	Open
Context window	—	262K
Max output	—	262K
Input $ / M tokens	—	$1.50
Output $ / M tokens	—	$7.50
Results tracked	29	36

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Medium leads

Llama 2-7B: 29.2 (#307), Mistral Medium: 34.2 (#243)

Coding benchmarks
Benchmark	Llama 2-7B	Mistral Medium
LMArena Coding	1002	1434
FrontierCode	—	8%
SciCode	—	40.2%
WeirdML	—	43.7%
ALE-Bench	—	763.98

Agentic & Tool Use Not comparable

Llama 2-7B: —, Mistral Medium: 28.3 (#90)

Agentic & Tool Use benchmarks
Benchmark	Llama 2-7B	Mistral Medium
Berkeley Function Calling Leaderboard	—	37.7%

Reasoning Mistral Medium leads

Llama 2-7B: 15.7 (#312), Mistral Medium: 24.0 (#167)

Reasoning benchmarks
Benchmark	Llama 2-7B	Mistral Medium
LMArena Hard Prompts	1009	1426
Kagi LLM Benchmark	—	50%
CritPt	—	0%
Chess Puzzles	0%	—
DTBench	—	75.5%
LMCA	—	26.1%
Surface Evolver Bench	—	26.9%
BIG-Bench Hard	39.2%	—
Epoch Capabilities Index	99.06	—
HellaSwag	77.2%	—
LAMBADA	73.3%	—
PIQA	78.8%	—
WinoGrande	69.2%	—

Math Llama 2-7B leads

Llama 2-7B: 30.7 (#233), Mistral Medium: 28.1 (#245)

Math benchmarks
Benchmark	Llama 2-7B	Mistral Medium
LMArena Math	1042	1408
OTIS Mock AIME 2024-2025	—	32.2%
ProofBench	—	9%
MATH Level 5	—	81.6%
FrontierMath (Feb 2025 set)	—	0.3%
GSM8K	16.7%	—

Knowledge Llama 2-7B leads

Llama 2-7B: 28.2 (#248), Mistral Medium: 25.0 (#265)

Knowledge benchmarks
Benchmark	Llama 2-7B	Mistral Medium
LMArena Expert	1036	1408
GPQA Diamond	—	59.5%
Humanity's Last Exam	—	4.5%
Vectara Hallucination Rate	—	22.7%
ARC (AI2) Challenge	45.9%	—
BoolQ	77.9%	—
MMLU	45.8%	—
OpenBookQA	58.6%	—
TriviaQA	73.7%	—

Multimodal Not comparable

Llama 2-7B: —, Mistral Medium: 35.3 (#88)

Multimodal benchmarks
Benchmark	Llama 2-7B	Mistral Medium
LMArena Vision	—	1172
ScienceQA	43.1%	—

Multilingual Mistral Medium leads

Llama 2-7B: 23.8 (#293), Mistral Medium: 52.1 (#91)

Multilingual benchmarks
Benchmark	Llama 2-7B	Mistral Medium
LMArena Non-English	973	1408
LMArena Chinese	973	1447
LMArena French	970	1459
LMArena German	978	1432
LMArena Russian	995	1411
LMArena Spanish	1007	1433
LMArena Japanese	—	1378
LMArena Korean	—	1380

Instruction Following Mistral Medium leads

Llama 2-7B: 50.8 (#298), Mistral Medium: 73.7 (#116)

Instruction Following benchmarks
Benchmark	Llama 2-7B	Mistral Medium
LMArena Instruction Following	1006	1398

Long Context Mistral Medium leads

Llama 2-7B: 30.4 (#287), Mistral Medium: 42.9 (#114)

Long Context benchmarks
Benchmark	Llama 2-7B	Mistral Medium
LMArena Longer Query	999	1406

Writing & Preference Mistral Medium leads

Llama 2-7B: 28.0 (#298), Mistral Medium: 60.0 (#103)

Writing & Preference benchmarks
Benchmark	Llama 2-7B	Mistral Medium
LMArena Text	1053	1424
LMArena Creative Writing	1033	1391
LMArena Multi-Turn	1029	1418
Short-Story Creative Writing	—	77.3%

Frequently asked questions

Is Llama 2-7B better than Mistral Medium?