Model comparison

Ministral 8B vs Pixtral Large

Pixtral Large is the stronger model overall, scoring 31.7 to 27.8 on the Noometry Index. Ministral 8B costs 30× less per token, which makes it the better buy when Pixtral Large's lead doesn't matter for your workload.

Last verified . 0 shared benchmarks.

Ministral 8B Mistral AI

27.8

Rank #321 Confirmed

Pixtral Large Mistral AI

31.7

Rank #257 Reported

Summary

  • The widest gap is in writing & preference, where Ministral 8B leads 39.8 to 32.9.
  • Ministral 8B is cheaper at $0.10 / $0.10 per million input/output tokens, against $2 / $6 for Pixtral Large.

Side by side

Ministral 8B and Pixtral Large specifications
Ministral 8BPixtral Large
ProviderMistral AIMistral AI
Noometry Index27.831.7
Released2024-10-012024-11-01
WeightsOpenOpen
Context window128K128K
Max output128K128K
Input $ / M tokens$0.10$2
Output $ / M tokens$0.10$6
Results tracked173

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Ministral 8B: 34.4 (#226), Pixtral Large: —

Coding benchmarks
BenchmarkMinistral 8BPixtral Large
LMArena Coding1202—

Agentic & Tool Use Not comparable

Ministral 8B: 16.2 (#140), Pixtral Large: —

Agentic & Tool Use benchmarks
BenchmarkMinistral 8BPixtral Large
Berkeley Function Calling Leaderboard11.1%—

Reasoning Pixtral Large leads

Ministral 8B: 17.7 (#279), Pixtral Large: 20.9 (#208)

Reasoning benchmarks
BenchmarkMinistral 8BPixtral Large
EnigmaEval—0.8%
LMArena Hard Prompts1191—
DTBench45.7%—

Math Not comparable

Ministral 8B: 23.7 (#262), Pixtral Large: —

Math benchmarks
BenchmarkMinistral 8BPixtral Large
LMArena Math1188—
MATH Level 514.9%—

Knowledge Not comparable

Ministral 8B: 12.5 (#292), Pixtral Large: —

Knowledge benchmarks
BenchmarkMinistral 8BPixtral Large
GPQA Diamond27.1%—
Vectara Hallucination Rate7.4%—
LMArena Expert1170—

Multimodal Not comparable

Ministral 8B: —, Pixtral Large: 30.0 (#105)

Multimodal benchmarks
BenchmarkMinistral 8BPixtral Large
LMArena Vision—1089

Multilingual Not comparable

Ministral 8B: 35.3 (#242), Pixtral Large: —

Multilingual benchmarks
BenchmarkMinistral 8BPixtral Large
LMArena Non-English1165—
LMArena Chinese1193—
LMArena Russian1195—

Instruction Following Not comparable

Ministral 8B: 60.7 (#245), Pixtral Large: —

Instruction Following benchmarks
BenchmarkMinistral 8BPixtral Large
LMArena Instruction Following1161—

Long Context Not comparable

Ministral 8B: 36.7 (#222), Pixtral Large: —

Long Context benchmarks
BenchmarkMinistral 8BPixtral Large
LMArena Longer Query1212—

Writing & Preference Ministral 8B leads

Ministral 8B: 39.8 (#241), Pixtral Large: 32.9 (#273)

Writing & Preference benchmarks
BenchmarkMinistral 8BPixtral Large
LMArena Text1191—
LMArena Creative Writing1175—
EQ-Bench Creative Writing—988
LMArena Multi-Turn1166—

Frequently asked questions

Is Ministral 8B better than Pixtral Large?

Pixtral Large is the stronger model overall, scoring 31.7 to 27.8 on the Noometry Index. Ministral 8B costs 30× less per token, which makes it the better buy when Pixtral Large's lead doesn't matter for your workload.

Which is cheaper, Ministral 8B or Pixtral Large?

Ministral 8B is cheaper. It lists at $0.10 per million input tokens and $0.10 per million output tokens; Pixtral Large lists at $2 and $6.

Which has the bigger context window?

Both accept 128K tokens.

How many benchmarks do Ministral 8B and Pixtral Large share?

0 benchmarks have published results for both models. Ministral 8B has 17 scored results on Noometry and Pixtral Large has 3.

Related comparisons

Go deeper