Noometry

Model comparison

Claude 2 vs Codestral

Codestral is the stronger model overall, scoring 30.1 to 24.7 on the Noometry Index.

Last verified . 1 shared benchmarks.

Claude 2 Anthropic

24.7

Rank #342 Reported

Codestral Mistral AI

30.1

Rank #287 Reported

Summary

  • They share 1 benchmark with published results for both. Claude 2 scores higher in 1 category and Codestral in 0 categories; one gap is clear of the uncertainty.
  • Codestral has downloadable open weights; the other is API-only.

Side by side

Claude 2Codestral
ProviderAnthropicMistral AI
Noometry Index24.730.1
Released2023-07-112024-05-29
WeightsProprietaryOpen
Context window—256K
Max output—4K
Input $ / M tokens—$0.30
Output $ / M tokens—$0.90
Results tracked87

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude 2: —, Codestral: 26.9 (#316)

BenchmarkClaude 2Codestral
HumanEval+61.6%73.8%
Aider Polyglot—11.1%
BigCodeBench Instruct—41.8%
BigCodeBench Complete—52.5%
ALE-Bench—137.78
MBPP+—61.9%

Reasoning Claude 2 leads

Claude 2: 20.8 (#213), Codestral: 19.1 (#244)

BenchmarkClaude 2Codestral
Kagi LLM Benchmark—32.5%
DTBench51.9%—
Epoch Capabilities Index120.08—

Math Not comparable

Claude 2: 8.7 (#314), Codestral: —

BenchmarkClaude 2Codestral
OTIS Mock AIME 2024-20252.5%—
MATH Level 511.7%—

Knowledge Not comparable

Claude 2: 17.0 (#282), Codestral: —

BenchmarkClaude 2Codestral
GPQA Diamond34.7%—
MMLU78.5%—
TriviaQA87.5%—

Frequently asked questions

Is Claude 2 better than Codestral?

Codestral is the stronger model overall, scoring 30.1 to 24.7 on the Noometry Index.

How many benchmarks do Claude 2 and Codestral share?

1 benchmark has published results for both models. Claude 2 has 8 scored results on Noometry and Codestral has 7.

Related comparisons

Go deeper