in the loop

StarCoder 2 7B
#261 of 274 scored.

Hugging FaceFeb 20, 2024Open weights

Capabilities Index

Range 76.8–101.7

93.6

Context

Tokens

—

Input

Per 1M tokens

—

Output

Per 1M tokens

—

Benchmarks

No independent scores yet.

Epoch AI hasn't run StarCoder 2 7B yet. Its scores show up here the morning after they do.

Everything else Epoch has for it

  • GSM8K32.7%
  • MMLU18.4%
  • ARC AI218.3%
  • Winogrande14.2%

On the index

Around it.

  1. #258vicuna-13b-v1.1LMSYS94.7
  2. #259MPT-7BDatabricks94.6
  3. #260Gemma 2BGoogle94.2
  4. #261StarCoder 2 7BHugging Face93.6
  5. #262XGen-7BSalesforce93.4
  6. #263Qwen-1_8BAlibaba92.9
  7. #264open_llama_7bMeta91.7

Sources