Noometry

Model comparison

DBRX vs Mistral Medium 3.1

Mistral Medium 3.1 is the stronger model overall, scoring 31.9 to 29.4 on the Noometry Index.

Last verified . 0 shared benchmarks.

DBRX Databricks

29.4

Rank #311 Confirmed

Mistral Medium 3.1 Mistral AI

31.9

Rank #266 Reported

Summary

  • The widest gap is in writing & preference, where Mistral Medium 3.1 leads 55.5 to 33.6.
  • DBRX has downloadable open weights; the other is API-only.

Side by side

DBRXMistral Medium 3.1
ProviderDatabricksMistral AI
Noometry Index29.431.9
Released2024-03-27—
WeightsOpenProprietary
Context window—131K
Max output—105K
Input $ / M tokens—$0.40
Output $ / M tokens—$2
Results tracked213

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

DBRX: 32.9 (#266), Mistral Medium 3.1: —

BenchmarkDBRXMistral Medium 3.1
LMArena Coding1132—
HumanEval+70.1%—
MBPP+55.8%—

Reasoning DBRX leads

DBRX: 21.4 (#222), Mistral Medium 3.1: 10.6 (#341)

BenchmarkDBRXMistral Medium 3.1
NYT Connections (extended)—6.5%
Thematic Generalization—20.3%
LMArena Hard Prompts1113—

Math Not comparable

DBRX: 24.3 (#269), Mistral Medium 3.1: —

BenchmarkDBRXMistral Medium 3.1
LMArena Math1145—
MATH Level 511.7%—

Knowledge Not comparable

DBRX: 14.9 (#294), Mistral Medium 3.1: —

BenchmarkDBRXMistral Medium 3.1
GPQA Diamond32.9%—
LMArena Expert1076—

Multilingual Not comparable

DBRX: 29.3 (#268), Mistral Medium 3.1: —

BenchmarkDBRXMistral Medium 3.1
LMArena Non-English1071—
LMArena Chinese1068—
LMArena French1096—
LMArena German1057—
LMArena Japanese990—
LMArena Korean993—
LMArena Russian1078—
LMArena Spanish1064—

Instruction Following Not comparable

DBRX: 57.5 (#270), Mistral Medium 3.1: —

BenchmarkDBRXMistral Medium 3.1
LMArena Instruction Following1112—

Long Context Not comparable

DBRX: 33.7 (#258), Mistral Medium 3.1: —

BenchmarkDBRXMistral Medium 3.1
LMArena Longer Query1112—

Writing & Preference Mistral Medium 3.1 leads

DBRX: 33.6 (#275), Mistral Medium 3.1: 55.5 (#145)

BenchmarkDBRXMistral Medium 3.1
LMArena Text1119—
LMArena Creative Writing1104—
EQ-Bench Creative Writing—1476
LMArena Multi-Turn1111—

Frequently asked questions

Is DBRX better than Mistral Medium 3.1?

Mistral Medium 3.1 is the stronger model overall, scoring 31.9 to 29.4 on the Noometry Index.

How many benchmarks do DBRX and Mistral Medium 3.1 share?

0 benchmarks have published results for both models. DBRX has 21 scored results on Noometry and Mistral Medium 3.1 has 3.

Related comparisons

Go deeper