Model comparison

Codestral vs Phi-4 Mini

Codestral and Phi-4 Mini score almost the same on the Noometry Index (30.6 vs 30.9), so choose on price, context window or the category you care about most.

Last verified . 0 shared benchmarks.

Codestral Mistral AI

30.6

Rank #290 Reported

Phi-4 Mini Microsoft

30.9

Rank #283 Reported

Summary

  • Phi-4 Mini is cheaper at $0.075 / $0.30 per million input/output tokens, against $0.30 / $0.90 for Codestral.
  • Codestral accepts more context: 256K tokens versus 128K.
  • Phi-4 Mini has downloadable open weights; the other is API-only.

Side by side

Codestral and Phi-4 Mini specifications
CodestralPhi-4 Mini
ProviderMistral AIMicrosoft
Noometry Index30.630.9
Released2024-05-292024-12-11
WeightsProprietaryOpen
Context window256K128K
Max output8K4K
Input $ / M tokens$0.30$0.075
Output $ / M tokens$0.90$0.30
Results tracked73

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Codestral: 27.3 (#321), Phi-4 Mini: 28.1 (#317)

Coding benchmarks
BenchmarkCodestralPhi-4 Mini
Aider Polyglot11.1%—
SciCode—10.8%
BigCodeBench Instruct41.8%—
BigCodeBench Complete52.5%—
ALE-Bench137.78—
HumanEval+73.8%—
MBPP+61.9%—

Reasoning Phi-4 Mini leads

Codestral: 19.8 (#251), Phi-4 Mini: 22.4 (#195)

Reasoning benchmarks
BenchmarkCodestralPhi-4 Mini
Kagi LLM Benchmark32.5%—
CritPt—0%

Knowledge Not comparable

Codestral: —, Phi-4 Mini: 25.3 (#262)

Knowledge benchmarks
BenchmarkCodestralPhi-4 Mini
Vectara Hallucination Rate—23.5%

Frequently asked questions

Is Codestral better than Phi-4 Mini?

Codestral and Phi-4 Mini score almost the same on the Noometry Index (30.6 vs 30.9), so choose on price, context window or the category you care about most.

Which is cheaper, Codestral or Phi-4 Mini?

Phi-4 Mini is cheaper. It lists at $0.075 per million input tokens and $0.30 per million output tokens; Codestral lists at $0.30 and $0.90.

Is Codestral or Phi-4 Mini better for coding?

They score almost the same on coding (27.3 vs 28.1); test both on your own repository before choosing.

Which has the bigger context window?

Codestral does, with 256K tokens against 128K.

How many benchmarks do Codestral and Phi-4 Mini share?

0 benchmarks have published results for both models. Codestral has 7 scored results on Noometry and Phi-4 Mini has 3.

Related comparisons

Go deeper