Hugging Face, unknown

INTELLECT-1

INTELLECT-1 by Hugging Face has 7 published benchmark results on Noometry, not yet enough to be ranked.

Last verified

Specifications

Noometry rank
Unranked
Index score
Not ranked
Evidence
7 results
Released
November 29, 2024
Weights
Unknown
Reasoning
Unknown
Context window
—
Max output
—
Input price
Not listed
Output price
Not listed
Blended price
Not listed
Output speed
Not measured
Value
Not ranked
Knowledge cutoff
Unknown

Sponsored placements are available on pages like this one. Advertise on Noometry

Benchmark results

Every published result we track, with its source. Bold rows are the ones used for ranking; where several exist we prefer independent runs over self-reported numbers.

Reasoning

INTELLECT-1 Reasoning benchmark results
BenchmarkScorePositionSettingSourceDate
BIG-Bench Hard34.9%#26 of 27, top 97%Epoch AI
Epoch Capabilities Index100.86#202 of 213, top 95%Epoch AI2024-11-29
HellaSwag71.4%#25 of 29, top 87%Epoch AI
WinoGrande65.8%#34 of 43, top 80%Epoch AI

Math

INTELLECT-1 Math benchmark results
BenchmarkScorePositionSettingSourceDate
GSM8K38.6%#27 of 38, top 72%Epoch AI

Knowledge

INTELLECT-1 Knowledge benchmark results
BenchmarkScorePositionSettingSourceDate
ARC (AI2) Challenge54.5%#25 of 39, top 65%Epoch AI
MMLU49.9%#69 of 81, top 86%Epoch AI

Compare INTELLECT-1

Frequently asked questions

How good is INTELLECT-1?

INTELLECT-1 by Hugging Face has 7 published benchmark results on Noometry, not yet enough to be ranked.

Is INTELLECT-1 open source?

Hugging Face has not published downloadable weights for INTELLECT-1 that we can confirm.