Model comparison

GPT-5-Codex vs Grok 2 Mini 2024 08 13

GPT-5-Codex and Grok 2 Mini 2024 08 13 score almost the same on the Noometry Index (37.9 vs 37.7), so choose on price, context window or the category you care about most.

Last verified . 0 shared benchmarks.

GPT-5-Codex OpenAI

37.9

Rank #192 Reported

Grok 2 Mini 2024 08 13 xAI

37.7

Rank #198 Confirmed

Summary

  • The widest gap is in reasoning, where GPT-5-Codex leads 30.9 to 24.8.

Side by side

GPT-5-Codex and Grok 2 Mini 2024 08 13 specifications
GPT-5-CodexGrok 2 Mini 2024 08 13
ProviderOpenAIxAI
Noometry Index37.937.7
Released2025-09-152024-08-13
WeightsProprietaryProprietary
Context window400K—
Max output128K—
Input $ / M tokens$1.25—
Output $ / M tokens$10—
Results tracked317

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5-Codex leads

GPT-5-Codex: 42.4 (#103), Grok 2 Mini 2024 08 13: 37.0 (#199)

Coding benchmarks
BenchmarkGPT-5-CodexGrok 2 Mini 2024 08 13
WeirdML54.5%—
LMArena Coding—1269

Agentic & Tool Use Not comparable

GPT-5-Codex: 31.0 (#72), Grok 2 Mini 2024 08 13: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5-CodexGrok 2 Mini 2024 08 13
Terminal-Bench44.3%—

Reasoning GPT-5-Codex leads

GPT-5-Codex: 30.9 (#83), Grok 2 Mini 2024 08 13: 24.8 (#159)

Reasoning benchmarks
BenchmarkGPT-5-CodexGrok 2 Mini 2024 08 13
Kagi LLM Benchmark70.3%—
LMArena Hard Prompts—1255

Math Not comparable

GPT-5-Codex: —, Grok 2 Mini 2024 08 13: 35.4 (#185)

Math benchmarks
BenchmarkGPT-5-CodexGrok 2 Mini 2024 08 13
LMArena Math—1265

Knowledge Not comparable

GPT-5-Codex: —, Grok 2 Mini 2024 08 13: 33.9 (#200)

Knowledge benchmarks
BenchmarkGPT-5-CodexGrok 2 Mini 2024 08 13
LMArena Expert—1238

Multilingual Not comparable

GPT-5-Codex: —, Grok 2 Mini 2024 08 13: 41.4 (#208)

Multilingual benchmarks
BenchmarkGPT-5-CodexGrok 2 Mini 2024 08 13
LMArena Non-English—1257
LMArena Chinese—1262
LMArena French—1286
LMArena German—1273
LMArena Japanese—1213
LMArena Korean—1195
LMArena Russian—1261
LMArena Spanish—1279

Instruction Following Not comparable

GPT-5-Codex: —, Grok 2 Mini 2024 08 13: 65.5 (#220)

Instruction Following benchmarks
BenchmarkGPT-5-CodexGrok 2 Mini 2024 08 13
LMArena Instruction Following—1245

Long Context Not comparable

GPT-5-Codex: —, Grok 2 Mini 2024 08 13: 38.4 (#196)

Long Context benchmarks
BenchmarkGPT-5-CodexGrok 2 Mini 2024 08 13
LMArena Longer Query—1266

Writing & Preference Not comparable

GPT-5-Codex: —, Grok 2 Mini 2024 08 13: 47.3 (#211)

Writing & Preference benchmarks
BenchmarkGPT-5-CodexGrok 2 Mini 2024 08 13
LMArena Text—1281
LMArena Creative Writing—1242
LMArena Multi-Turn—1265

Frequently asked questions

Is GPT-5-Codex better than Grok 2 Mini 2024 08 13?

GPT-5-Codex and Grok 2 Mini 2024 08 13 score almost the same on the Noometry Index (37.9 vs 37.7), so choose on price, context window or the category you care about most.

Is GPT-5-Codex or Grok 2 Mini 2024 08 13 better for coding?

GPT-5-Codex scores higher on coding benchmarks: 42.4 versus 37.0 in the Noometry coding category.

How many benchmarks do GPT-5-Codex and Grok 2 Mini 2024 08 13 share?

0 benchmarks have published results for both models. GPT-5-Codex has 3 scored results on Noometry and Grok 2 Mini 2024 08 13 has 17.

Related comparisons

Go deeper