in the loop

Falcon-40B
#243 of 274 scored.

TIIMay 25, 2023Open weights

Capabilities Index

Range 92.8–109.9

104.5

Context

Tokens

—

Input

Per 1M tokens

—

Output

Per 1M tokens

—

Benchmarks

No independent scores yet.

Epoch AI hasn't run Falcon-40B yet. Its scores show up here the morning after they do.

Everything else Epoch has for it

  • HellaSwag80.4%
  • TriviaQA79.9%
  • LAMBADA77.3%
  • PIQA66.0%
  • Winogrande53.8%
  • ARC AI249.1%
  • MMLU42.5%
  • OpenBookQA42.1%
  • GSM8K33.8%
  • BBH16.1%

On the index

Around it.

  1. #240Llama 2-34BMeta105.2
  2. #241StarCoder 2 15BHugging Face105.0
  3. #242Yi 6B01.AI104.8
  4. #243Falcon-40BTII104.5
  5. #244Baichuan2-13BBaichuan103.2
  6. #245Qwen2.5-Coder (1.5B)Alibaba103.0
  7. #246internlm-7bShanghai AI Lab102.9

Sources