in the loop

DeepSeek-Coder-V2-Lite-Base
#230 of 274 scored.

DeepSeekJun 13, 2024

Capabilities Index

Range 97.5–113.8

108.9

Context

Tokens

—

Input

Per 1M tokens

—

Output

Per 1M tokens

—

Benchmarks

No independent scores yet.

Epoch AI hasn't run DeepSeek-Coder-V2-Lite-Base yet. Its scores show up here the morning after they do.

Everything else Epoch has for it

  • GSM8K67.1%
  • MMLU47.3%
  • Winogrande45.8%
  • ARC AI243.1%

On the index

Around it.

  1. #227LLaMA-65BMeta110.2
  2. #228Falcon 2 11BTII109.6
  3. #229Mistral 7B v0.3Mistral109.0
  4. #230DeepSeek-Coder-V2-Lite-BaseDeepSeek108.9
  5. #231PaLM 2-MGoogle108.3
  6. #232Phi-2Microsoft107.9
  7. #233Qwen2.5-Coder-3BAlibaba107.7

Sources