Model comparison

Mistral Large 3 vs Qwen3-4B

Mistral Large 3 is the stronger model overall, scoring 39.1 to 31.9 on the Noometry Index.

Last verified . 1 shared benchmarks.

Mistral Large 3 Mistral AI

39.1

Rank #176 Confirmed

Qwen3-4B Alibaba (Qwen)

31.9

Rank #264 Confirmed

Summary

  • They share 1 benchmark with published results for both. Mistral Large 3 scores higher in 2 categories and Qwen3-4B in 1 category; 3 gaps are clear of the uncertainty.
  • The widest gap is in math, where Mistral Large 3 leads 38.7 to 29.7.
  • The biggest single-benchmark swing is Vectara Hallucination Rate: 14.5% for Mistral Large 3 and 5.7% for Qwen3-4B.

Side by side

Mistral Large 3 and Qwen3-4B specifications
Mistral Large 3Qwen3-4B
ProviderMistral AIAlibaba (Qwen)
Noometry Index39.131.9
Released2025-12-022025-04-29
WeightsOpenOpen
Context window262K—
Max output8K—
Input $ / M tokens$0.25—
Output $ / M tokens$0.75—
Results tracked246

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Large 3: 34.4 (#237), Qwen3-4B: —

Coding benchmarks
BenchmarkMistral Large 3Qwen3-4B
LMArena WebDev1230—
LMArena Coding1448—

Agentic & Tool Use Not comparable

Mistral Large 3: —, Qwen3-4B: 27.6 (#100)

Agentic & Tool Use benchmarks
BenchmarkMistral Large 3Qwen3-4B
Berkeley Function Calling Leaderboard—35.7%

Reasoning Qwen3-4B leads

Mistral Large 3: 15.2 (#319), Qwen3-4B: 19.2 (#268)

Reasoning benchmarks
BenchmarkMistral Large 3Qwen3-4B
Kagi LLM Benchmark50.9%—
NYT Connections (extended)7.5%—
Chess Puzzles—4%
Thematic Generalization23%—
LMArena Hard Prompts1429—

Math Mistral Large 3 leads

Mistral Large 3: 38.7 (#129), Qwen3-4B: 29.7 (#240)

Math benchmarks
BenchmarkMistral Large 3Qwen3-4B
MathArena Final-Answer Competitions—38.5%
OTIS Mock AIME 2024-2025—52.2%
LMArena Math1414—

Knowledge Mistral Large 3 leads

Mistral Large 3: 36.0 (#177), Qwen3-4B: 33.0 (#208)

Knowledge benchmarks
BenchmarkMistral Large 3Qwen3-4B
Vectara Hallucination Rate14.5%5.7%
GPQA Diamond—52.3%
LMArena Expert1421—

Multimodal Not comparable

Mistral Large 3: 38.2 (#66), Qwen3-4B: —

Multimodal benchmarks
BenchmarkMistral Large 3Qwen3-4B
LMArena Vision1221—

Multilingual Not comparable

Mistral Large 3: 52.5 (#84), Qwen3-4B: —

Multilingual benchmarks
BenchmarkMistral Large 3Qwen3-4B
LMArena Non-English1413—
LMArena Chinese1447—
LMArena French1455—
LMArena German1437—
LMArena Japanese1394—
LMArena Korean1384—
LMArena Russian1411—
LMArena Spanish1440—

Instruction Following Not comparable

Mistral Large 3: 74.0 (#108), Qwen3-4B: —

Instruction Following benchmarks
BenchmarkMistral Large 3Qwen3-4B
LMArena Instruction Following1403—

Long Context Not comparable

Mistral Large 3: 43.1 (#105), Qwen3-4B: —

Long Context benchmarks
BenchmarkMistral Large 3Qwen3-4B
LMArena Longer Query1413—

Writing & Preference Not comparable

Mistral Large 3: 60.0 (#101), Qwen3-4B: —

Writing & Preference benchmarks
BenchmarkMistral Large 3Qwen3-4B
LMArena Text1428—
LMArena Creative Writing1386—
EQ-Bench Creative Writing1412—
LMArena Multi-Turn1429—

Frequently asked questions

Is Mistral Large 3 better than Qwen3-4B?

Mistral Large 3 is the stronger model overall, scoring 39.1 to 31.9 on the Noometry Index.

How many benchmarks do Mistral Large 3 and Qwen3-4B share?

1 benchmark has published results for both models. Mistral Large 3 has 24 scored results on Noometry and Qwen3-4B has 6.

Related comparisons

Go deeper