in the loop

StarCoder 2 15B
#241 of 274 scored.

Hugging FaceFeb 20, 2024Open weights

Capabilities Index

Range 91.0–111.3

105.0

Context

Tokens

—

Input

Per 1M tokens

—

Output

Per 1M tokens

—

Benchmarks

No independent scores yet.

Epoch AI hasn't run StarCoder 2 15B yet. Its scores show up here the morning after they do.

Everything else Epoch has for it

  • GSM8K57.7%
  • MMLU52.1%
  • ARC AI229.6%
  • Winogrande28.6%

On the index

Around it.

  1. #238Llama 2-13BMeta106.2
  2. #239PaLM 2-SGoogle106.2
  3. #240Llama 2-34BMeta105.2
  4. #241StarCoder 2 15BHugging Face105.0
  5. #242Yi 6B01.AI104.8
  6. #243Falcon-40BTII104.5
  7. #244Baichuan2-13BBaichuan103.2

Sources