in the loop

DeepSeek Coder 1.3B
#273 of 274 scored.

DeepSeekNov 2, 2023Open weights

Capabilities Index

Range 42.3–76.8

63.6

Context

Tokens

—

Input

Per 1M tokens

—

Output

Per 1M tokens

—

Benchmarks

No independent scores yet.

Epoch AI hasn't run DeepSeek Coder 1.3B yet. Its scores show up here the morning after they do.

Everything else Epoch has for it

  • Winogrande6.6%
  • GSM8K4.4%
  • MMLU1.1%
  • ARC AI20.5%

On the index

Around it.

  1. #270StarCoder 2 3BHugging Face88.8
  2. #271Qwen2.5-Coder-0.5BAlibaba88.2
  3. #272Cerebras-GPT-13BCerebras83.2
  4. #273DeepSeek Coder 1.3BDeepSeek63.6
  5. #274stablelm-tuned-alpha-7bStability AI55.8

Sources