in the loop

DeepSeek LLM 67B
#226 of 274 scored.

DeepSeekNov 29, 2023Open weights

Capabilities Index

Range 95.6–116.6

110.5

Context

Tokens

—

Input

Per 1M tokens

—

Output

Per 1M tokens

—

Benchmarks

How it scores.

  • GPQA Diamond0.0%

    182nd of 186

  • Mock AIME0.7%

    171st of 176

Everything else Epoch has for it

  • MATH level 56.4%
  • Chess Puzzles0.0%

On the index

Around it.

  1. #223Falcon-180BTII112.1
  2. #224internlm-20bShanghai AI Lab112.1
  3. #225Gemma 7BGoogle112.0
  4. #226DeepSeek LLM 67BDeepSeek110.5
  5. #227LLaMA-65BMeta110.2
  6. #228Falcon 2 11BTII109.6
  7. #229Mistral 7B v0.3Mistral109.0

Sources