Model comparison

DeepSeek-R1-Distill-Llama-70B vs Grok 2 Mini 2024 08 13

DeepSeek-R1-Distill-Llama-70B and Grok 2 Mini 2024 08 13 score almost the same on the Noometry Index (37.8 vs 37.7), so choose on price, context window or the category you care about most.

Last verified . 0 shared benchmarks.

Grok 2 Mini 2024 08 13 xAI

37.7

Rank #198 Confirmed

Summary

  • The widest gap is in knowledge, where Grok 2 Mini 2024 08 13 leads 33.9 to 30.7.
  • DeepSeek-R1-Distill-Llama-70B has downloadable open weights; the other is API-only.

Side by side

DeepSeek-R1-Distill-Llama-70B and Grok 2 Mini 2024 08 13 specifications
DeepSeek-R1-Distill-Llama-70BGrok 2 Mini 2024 08 13
ProviderDeepSeekxAI
Noometry Index37.837.7
Released2025-01-202024-08-13
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1317

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

DeepSeek-R1-Distill-Llama-70B: 36.8 (#202), Grok 2 Mini 2024 08 13: 37.0 (#199)

Coding benchmarks
BenchmarkDeepSeek-R1-Distill-Llama-70BGrok 2 Mini 2024 08 13
BigCodeBench Instruct35.3%—
LiveBench Coding51.6%—
LMArena Coding—1269
BigCodeBench Complete49.9%—

Reasoning Too close to call

DeepSeek-R1-Distill-Llama-70B: 24.9 (#156), Grok 2 Mini 2024 08 13: 24.8 (#159)

Reasoning benchmarks
BenchmarkDeepSeek-R1-Distill-Llama-70BGrok 2 Mini 2024 08 13
Kagi LLM Benchmark52.3%—
LiveBench Reasoning67.6%—
LMArena Hard Prompts—1255
LiveBench Data Analysis55.9%—
LiveBench54.5%—

Math Too close to call

DeepSeek-R1-Distill-Llama-70B: 36.0 (#176), Grok 2 Mini 2024 08 13: 35.4 (#185)

Math benchmarks
BenchmarkDeepSeek-R1-Distill-Llama-70BGrok 2 Mini 2024 08 13
OTIS Mock AIME 2024-202551.4%—
LiveBench Math58.1%—
LMArena Math—1265
MATH Level 589.9%—

Knowledge Grok 2 Mini 2024 08 13 leads

DeepSeek-R1-Distill-Llama-70B: 30.7 (#225), Grok 2 Mini 2024 08 13: 33.9 (#200)

Knowledge benchmarks
BenchmarkDeepSeek-R1-Distill-Llama-70BGrok 2 Mini 2024 08 13
GPQA Diamond55.7%—
LMArena Expert—1238

Multilingual Not comparable

DeepSeek-R1-Distill-Llama-70B: —, Grok 2 Mini 2024 08 13: 41.4 (#208)

Multilingual benchmarks
BenchmarkDeepSeek-R1-Distill-Llama-70BGrok 2 Mini 2024 08 13
LMArena Non-English—1257
LMArena Chinese—1262
LMArena French—1286
LMArena German—1273
LMArena Japanese—1213
LMArena Korean—1195
LMArena Russian—1261
LMArena Spanish—1279

Instruction Following DeepSeek-R1-Distill-Llama-70B leads

DeepSeek-R1-Distill-Llama-70B: 68.2 (#190), Grok 2 Mini 2024 08 13: 65.5 (#220)

Instruction Following benchmarks
BenchmarkDeepSeek-R1-Distill-Llama-70BGrok 2 Mini 2024 08 13
LiveBench Instruction Following69.9%—
LMArena Instruction Following—1245

Long Context Not comparable

DeepSeek-R1-Distill-Llama-70B: —, Grok 2 Mini 2024 08 13: 38.4 (#196)

Long Context benchmarks
BenchmarkDeepSeek-R1-Distill-Llama-70BGrok 2 Mini 2024 08 13
LMArena Longer Query—1266

Writing & Preference DeepSeek-R1-Distill-Llama-70B leads

DeepSeek-R1-Distill-Llama-70B: 49.0 (#194), Grok 2 Mini 2024 08 13: 47.3 (#211)

Writing & Preference benchmarks
BenchmarkDeepSeek-R1-Distill-Llama-70BGrok 2 Mini 2024 08 13
LMArena Text—1281
LMArena Creative Writing—1242
LMArena Multi-Turn—1265
LiveBench Language23.8%—

Frequently asked questions

Is DeepSeek-R1-Distill-Llama-70B better than Grok 2 Mini 2024 08 13?

DeepSeek-R1-Distill-Llama-70B and Grok 2 Mini 2024 08 13 score almost the same on the Noometry Index (37.8 vs 37.7), so choose on price, context window or the category you care about most.

Is DeepSeek-R1-Distill-Llama-70B or Grok 2 Mini 2024 08 13 better for coding?

They score almost the same on coding (36.8 vs 37.0); test both on your own repository before choosing.

How many benchmarks do DeepSeek-R1-Distill-Llama-70B and Grok 2 Mini 2024 08 13 share?

0 benchmarks have published results for both models. DeepSeek-R1-Distill-Llama-70B has 13 scored results on Noometry and Grok 2 Mini 2024 08 13 has 17.

Related comparisons

Go deeper