in the loop

DeepSeek-V2 (MoE-236B, May 2024)
#184 of 274 scored.

DeepSeekMay 7, 2024Open weights

Capabilities Index

Range 118.5–127.8

124.8

Context

Tokens

—

Input

Per 1M tokens

—

Output

Per 1M tokens

—

Benchmarks

No independent scores yet.

Epoch AI hasn't run DeepSeek-V2 (MoE-236B, May 2024) yet. Its scores show up here the morning after they do.

Everything else Epoch has for it

  • ARC AI289.6%
  • HellaSwag82.8%
  • TriviaQA80.0%
  • Winogrande72.6%
  • BBH71.7%
  • MMLU71.2%
  • PIQA67.8%

On the index

Around it.

  1. #181GPT-4 (Mar 2023)OpenAI125.9
  2. #182Llama 3.2 90BMeta125.5
  3. #183Qwen2-72BAlibaba125.3
  4. #184DeepSeek-V2 (MoE-236B, May 2024)DeepSeek124.8
  5. #185Amazon Nova ProAmazon123.8
  6. #186Gemma 3 12BGoogle · $0.05 in123.5
  7. #187GPT-4 (Jun 2023)OpenAI123.1

Sources