Model comparison

Grok Build 0.1 vs Nvidia Llama 3.3 Nemotron Super 49b v1.5

Nvidia Llama 3.3 Nemotron Super 49b v1.5 is the stronger model overall, scoring 40.3 to 36.4 on the Noometry Index.

Last verified October 10, 2026. 0 shared benchmarks.

Grok Build 0.1 xAI

36.4

Rank #216 Reported

Nvidia Llama 3.3 Nemotron Super 49b v1.5

NVIDIA

40.3

Rank #151 Confirmed

Summary

The widest gap is in reasoning, where Grok Build 0.1 leads 32.2 to 26.8.
Nvidia Llama 3.3 Nemotron Super 49b v1.5 is cheaper at $0.40 / $0.40 per million input/output tokens, against $1 / $2 for Grok Build 0.1.
Grok Build 0.1 accepts more context: 256K tokens versus 131K.
Nvidia Llama 3.3 Nemotron Super 49b v1.5 has downloadable open weights; the other is API-only.

Side by side

Grok Build 0.1 and Nvidia Llama 3.3 Nemotron Super 49b v1.5 specifications
	Grok Build 0.1	Nvidia Llama 3.3 Nemotron Super 49b v1.5
Provider	xAI	NVIDIA
Noometry Index	36.4	40.3
Released	2026-04-16	2025-07-25
Weights	Proprietary	Open
Context window	256K	131K
Max output	256K	131K
Input $ / M tokens	$1	$0.40
Output $ / M tokens	$2	$0.40
Results tracked	3	12

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok Build 0.1 leads

Grok Build 0.1: 43.1 (#91), Nvidia Llama 3.3 Nemotron Super 49b v1.5: 39.8 (#154)

Coding benchmarks
Benchmark	Grok Build 0.1	Nvidia Llama 3.3 Nemotron Super 49b v1.5
SciCode	50.2%	—
LMArena Coding	—	1355

Agentic & Tool Use Not comparable

Grok Build 0.1: 22.7 (#129), Nvidia Llama 3.3 Nemotron Super 49b v1.5: —

Agentic & Tool Use benchmarks
Benchmark	Grok Build 0.1	Nvidia Llama 3.3 Nemotron Super 49b v1.5
GBAEval	2.4%	—

Reasoning Grok Build 0.1 leads

Grok Build 0.1: 32.2 (#77), Nvidia Llama 3.3 Nemotron Super 49b v1.5: 26.8 (#128)

Reasoning benchmarks
Benchmark	Grok Build 0.1	Nvidia Llama 3.3 Nemotron Super 49b v1.5
CritPt	9.1%	—
LMArena Hard Prompts	—	1336

Math Not comparable

Grok Build 0.1: —, Nvidia Llama 3.3 Nemotron Super 49b v1.5: 38.2 (#141)

Math benchmarks
Benchmark	Grok Build 0.1	Nvidia Llama 3.3 Nemotron Super 49b v1.5
LMArena Math	—	1392

Knowledge Not comparable

Grok Build 0.1: —, Nvidia Llama 3.3 Nemotron Super 49b v1.5: 36.7 (#165)

Knowledge benchmarks
Benchmark	Grok Build 0.1	Nvidia Llama 3.3 Nemotron Super 49b v1.5
LMArena Expert	—	1330

Multilingual Not comparable

Grok Build 0.1: —, Nvidia Llama 3.3 Nemotron Super 49b v1.5: 45.5 (#168)

Multilingual benchmarks
Benchmark	Grok Build 0.1	Nvidia Llama 3.3 Nemotron Super 49b v1.5
LMArena Non-English	—	1316
LMArena Japanese	—	1300
LMArena Russian	—	1332

Instruction Following Not comparable

Grok Build 0.1: —, Nvidia Llama 3.3 Nemotron Super 49b v1.5: 68.6 (#188)

Instruction Following benchmarks
Benchmark	Grok Build 0.1	Nvidia Llama 3.3 Nemotron Super 49b v1.5
LMArena Instruction Following	—	1299

Long Context Not comparable

Grok Build 0.1: —, Nvidia Llama 3.3 Nemotron Super 49b v1.5: 40.0 (#164)

Long Context benchmarks
Benchmark	Grok Build 0.1	Nvidia Llama 3.3 Nemotron Super 49b v1.5
LMArena Longer Query	—	1315

Writing & Preference Not comparable

Grok Build 0.1: —, Nvidia Llama 3.3 Nemotron Super 49b v1.5: 53.1 (#159)

Writing & Preference benchmarks
Benchmark	Grok Build 0.1	Nvidia Llama 3.3 Nemotron Super 49b v1.5
LMArena Text	—	1338
LMArena Creative Writing	—	1307
LMArena Multi-Turn	—	1334

Frequently asked questions

Is Grok Build 0.1 better than Nvidia Llama 3.3 Nemotron Super 49b v1.5?

Nvidia Llama 3.3 Nemotron Super 49b v1.5 is the stronger model overall, scoring 40.3 to 36.4 on the Noometry Index.

Which is cheaper, Grok Build 0.1 or Nvidia Llama 3.3 Nemotron Super 49b v1.5?

Nvidia Llama 3.3 Nemotron Super 49b v1.5 is cheaper. It lists at $0.40 per million input tokens and $0.40 per million output tokens; Grok Build 0.1 lists at $1 and $2.

Is Grok Build 0.1 or Nvidia Llama 3.3 Nemotron Super 49b v1.5 better for coding?

Grok Build 0.1 scores higher on coding benchmarks: 43.1 versus 39.8 in the Noometry coding category.

Which has the bigger context window?

Grok Build 0.1 does, with 256K tokens against 131K.

How many benchmarks do Grok Build 0.1 and Nvidia Llama 3.3 Nemotron Super 49b v1.5 share?

0 benchmarks have published results for both models. Grok Build 0.1 has 3 scored results on Noometry and Nvidia Llama 3.3 Nemotron Super 49b v1.5 has 12.