Technology Innovation Institute, open weights

Falcon-40B

Falcon-40B by Technology Innovation Institute has 12 published benchmark results on Noometry, not yet enough to be ranked.

Last verified

Specifications

Noometry rank
Unranked
Index score
Not ranked
Evidence
12 results
Released
March 15, 2023
Weights
Open weights
Reasoning
Unknown
Context window
—
Max output
—
Input price
Not listed
Output price
Not listed
Blended price
Not listed
Output speed
Not measured
Value
Not ranked
Knowledge cutoff
Unknown

Sponsored placements are available on pages like this one. Advertise on Noometry

Benchmark results

Every published result we track, with its source. Bold rows are the ones used for ranking; where several exist we prefer independent runs over self-reported numbers.

Reasoning

Falcon-40B Reasoning benchmark results
BenchmarkScorePositionSettingSourceDate
BIG-Bench Hard37.1%#24 of 27, top 89%Epoch AI
Epoch Capabilities Index104.45#200 of 213, top 94%Epoch AI2023-05-25
HellaSwag85.3%#9 of 29, top 32%Epoch AI
LAMBADA77.3%#3 of 9, top 34%Epoch AI
PIQA83%#11 of 27, top 41%Epoch AI
WinoGrande76.9%#20 of 43, top 47%Epoch AI

Math

Falcon-40B Math benchmark results
BenchmarkScorePositionSettingSourceDate
GSM8K33.8%#30 of 38, top 79%Epoch AI
GSM8K25%Epoch AI

Knowledge

Falcon-40B Knowledge benchmark results
BenchmarkScorePositionSettingSourceDate
ARC (AI2) Challenge61.9%#21 of 39, top 54%Epoch AI
BoolQ83.1%#12 of 23, top 53%Epoch AI
MMLU56.9%#65 of 81, top 81%Epoch AI
OpenBookQA56.6%#15 of 19, top 79%Epoch AI
TriviaQA79.9%#11 of 25, top 44%Epoch AI

Compare Falcon-40B

Other Technology Innovation Institute models

Frequently asked questions

How good is Falcon-40B?

Falcon-40B by Technology Innovation Institute has 12 published benchmark results on Noometry, not yet enough to be ranked.

Is Falcon-40B open source?

Yes. Falcon-40B's weights are downloadable; check the license for commercial terms.