Model comparison

Gemini 3 Pro vs Pixtral Large

Gemini 3 Pro is the stronger model overall, scoring 54.8 to 32.2 on the Noometry Index.

Last verified . 3 shared benchmarks.

Gemini 3 Pro Google

54.8

Rank #28 Confirmed

Pixtral Large Mistral AI

32.2

Rank #259 Reported

Summary

  • They share 3 benchmarks with published results for both. Gemini 3 Pro scores higher in 3 categories and Pixtral Large in 0 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Gemini 3 Pro leads 66.4 to 32.9.
  • The biggest single-benchmark swing is EnigmaEval: 18.2% for Gemini 3 Pro and 0.8% for Pixtral Large.
  • Pixtral Large has downloadable open weights; the other is API-only.

Side by side

Gemini 3 Pro and Pixtral Large specifications
Gemini 3 ProPixtral Large
ProviderGoogleMistral AI
Noometry Index54.832.2
Released2025-11-182024-11-01
WeightsProprietaryOpen
Context window—128K
Max output—128K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked673

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemini 3 Pro: 51.6 (#39), Pixtral Large: —

Coding benchmarks
BenchmarkGemini 3 ProPixtral Large
SWE-bench Verified72.9%—
SWE-bench Verified (bash only)74.2%—
LMArena WebDev1440—
SWE-bench Multilingual68.7%—
GSO18.6%—
WeirdML69.9%—
LMArena Coding1481—
ALE-Bench1,177—
AlgoTune1.83—

Agentic & Tool Use Not comparable

Gemini 3 Pro: 40.6 (#23), Pixtral Large: —

Agentic & Tool Use benchmarks
BenchmarkGemini 3 ProPixtral Large
Terminal-Bench69.4%—
Berkeley Function Calling Leaderboard72.5%—
GDPval40.3%—
Remote Labor Index1.3%—
τ²-bench Airline80.5%—
τ²-bench Banking18%—
τ²-bench Retail75.9%—
τ²-bench Telecom91%—
DeepResearch Bench46.3%—
BALROG58.1%—
LMArena Search1207—
METR Time Horizons71%—
Vending-Bench 25,478—

Reasoning Gemini 3 Pro leads

Gemini 3 Pro: 52.5 (#31), Pixtral Large: 21.7 (#218)

Reasoning benchmarks
BenchmarkGemini 3 ProPixtral Large
EnigmaEval18.2%0.8%
ARC-AGI-231.1%—
SimpleBench76.4%—
Kagi LLM Benchmark80.1%—
NYT Connections (extended)94.4%—
ARC-AGI-175%—
CritPt6.9%—
Chess Puzzles31%—
LMArena Hard Prompts1480—
Epoch Capabilities Index152.92—
ForecastBench61.2—

Math Not comparable

Gemini 3 Pro: 49.9 (#59), Pixtral Large: —

Math benchmarks
BenchmarkGemini 3 ProPixtral Large
MathArena Final-Answer Competitions67%—
OTIS Mock AIME 2024-202591.4%—
ProofBench20%—
Omni-MATH55.5%—
LMArena Math1476—
FrontierMath (Feb 2025 set)37.6%—
FrontierMath Tier 4 (v1)18.8%—

Knowledge Not comparable

Gemini 3 Pro: 64.4 (#16), Pixtral Large: —

Knowledge benchmarks
BenchmarkGemini 3 ProPixtral Large
GPQA Diamond92.6%—
Humanity's Last Exam37.5%—
MMLU-Pro90.3%—
Vectara Hallucination Rate13.6%—
GPQA (HELM)80.3%—
LMArena Expert1475—

Multimodal Gemini 3 Pro leads

Gemini 3 Pro: 57.6 (#2), Pixtral Large: 30.6 (#111)

Multimodal benchmarks
BenchmarkGemini 3 ProPixtral Large
LMArena Vision13051089
GeoBench84%—
VPCT91%—
LMArena Document1434—

Multilingual Not comparable

Gemini 3 Pro: 56.9 (#16), Pixtral Large: —

Multilingual benchmarks
BenchmarkGemini 3 ProPixtral Large
LMArena Non-English1474—
LMArena Chinese1523—
LMArena French1492—
LMArena German1515—
LMArena Japanese1510—
LMArena Korean1448—
LMArena Russian1493—
LMArena Spanish1470—

Instruction Following Not comparable

Gemini 3 Pro: 76.3 (#45), Pixtral Large: —

Instruction Following benchmarks
BenchmarkGemini 3 ProPixtral Large
IFEval87.7%—
LMArena Instruction Following1458—

Long Context Not comparable

Gemini 3 Pro: 44.0 (#79), Pixtral Large: —

Long Context benchmarks
BenchmarkGemini 3 ProPixtral Large
CL-bench15.8%—
LMArena Longer Query1471—

Writing & Preference Gemini 3 Pro leads

Gemini 3 Pro: 66.4 (#35), Pixtral Large: 32.9 (#278)

Writing & Preference benchmarks
BenchmarkGemini 3 ProPixtral Large
EQ-Bench Creative Writing1525988
LMArena Text1479—
LMArena Creative Writing1482—
WildBench85.9%—
LMArena Multi-Turn1484—

Frequently asked questions

Is Gemini 3 Pro better than Pixtral Large?

Gemini 3 Pro is the stronger model overall, scoring 54.8 to 32.2 on the Noometry Index.

How many benchmarks do Gemini 3 Pro and Pixtral Large share?

3 benchmarks have published results for both models. Gemini 3 Pro has 67 scored results on Noometry and Pixtral Large has 3.

Related comparisons

Go deeper