Model comparison

Mistral Medium 3.1 vs Phi-4 Mini

Mistral Medium 3.1 is the stronger model overall, scoring 31.9 to 30.9 on the Noometry Index. Phi-4 Mini costs 6.1× less per token, which makes it the better buy when Mistral Medium 3.1's lead doesn't matter for your workload.

Last verified . 0 shared benchmarks.

Mistral Medium 3.1 Mistral AI

31.9

Rank #266 Reported

Phi-4 Mini Microsoft

30.9

Rank #283 Reported

Summary

  • The widest gap is in reasoning, where Phi-4 Mini leads 22.4 to 10.6.
  • Phi-4 Mini is cheaper at $0.075 / $0.30 per million input/output tokens, against $0.40 / $2 for Mistral Medium 3.1.
  • Mistral Medium 3.1 accepts more context: 131K tokens versus 128K.
  • Phi-4 Mini has downloadable open weights; the other is API-only.

Side by side

Mistral Medium 3.1 and Phi-4 Mini specifications
Mistral Medium 3.1Phi-4 Mini
ProviderMistral AIMicrosoft
Noometry Index31.930.9
Released—2024-12-11
WeightsProprietaryOpen
Context window131K128K
Max output105K4K
Input $ / M tokens$0.40$0.075
Output $ / M tokens$2$0.30
Results tracked33

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Medium 3.1: —, Phi-4 Mini: 28.1 (#317)

Coding benchmarks
BenchmarkMistral Medium 3.1Phi-4 Mini
SciCode—10.8%

Reasoning Phi-4 Mini leads

Mistral Medium 3.1: 10.6 (#341), Phi-4 Mini: 22.4 (#195)

Reasoning benchmarks
BenchmarkMistral Medium 3.1Phi-4 Mini
NYT Connections (extended)6.5%—
CritPt—0%
Thematic Generalization20.3%—

Knowledge Not comparable

Mistral Medium 3.1: —, Phi-4 Mini: 25.3 (#262)

Knowledge benchmarks
BenchmarkMistral Medium 3.1Phi-4 Mini
Vectara Hallucination Rate—23.5%

Writing & Preference Not comparable

Mistral Medium 3.1: 55.5 (#145), Phi-4 Mini: —

Writing & Preference benchmarks
BenchmarkMistral Medium 3.1Phi-4 Mini
EQ-Bench Creative Writing1476—

Frequently asked questions

Is Mistral Medium 3.1 better than Phi-4 Mini?

Mistral Medium 3.1 is the stronger model overall, scoring 31.9 to 30.9 on the Noometry Index. Phi-4 Mini costs 6.1× less per token, which makes it the better buy when Mistral Medium 3.1's lead doesn't matter for your workload.

Which is cheaper, Mistral Medium 3.1 or Phi-4 Mini?

Phi-4 Mini is cheaper. It lists at $0.075 per million input tokens and $0.30 per million output tokens; Mistral Medium 3.1 lists at $0.40 and $2.

Which has the bigger context window?

Mistral Medium 3.1 does, with 131K tokens against 128K.

How many benchmarks do Mistral Medium 3.1 and Phi-4 Mini share?

0 benchmarks have published results for both models. Mistral Medium 3.1 has 3 scored results on Noometry and Phi-4 Mini has 3.

Related comparisons

Go deeper