in the loop

open_llama_7b
#264 of 274 scored.

MetaJun 7, 2023

Capabilities Index

Range 76.9–99.2

91.7

Context

Tokens

—

Input

Per 1M tokens

—

Output

Per 1M tokens

—

Benchmarks

No independent scores yet.

Epoch AI hasn't run open_llama_7b yet. Its scores show up here the morning after they do.

Everything else Epoch has for it

  • HellaSwag62.4%
  • PIQA52.0%
  • Winogrande34.0%
  • OpenBookQA18.7%
  • ARC AI218.3%
  • MMLU6.5%

On the index

Around it.

  1. #261StarCoder 2 7BHugging Face93.6
  2. #262XGen-7BSalesforce93.4
  3. #263Qwen-1_8BAlibaba92.9
  4. #264open_llama_7bMeta91.7
  5. #265Phi-1.5Microsoft91.5
  6. #266Baichuan1-7BBaichuan90.5
  7. #267RedPajama-INCITE-7B-BaseTogether90.4

Sources