in the loop

DeepSeek Coder 33B
#255 of 274 scored.

DeepSeekNov 2, 2023Open weights

Capabilities Index

Range 82.8–103.5

96.3

Context

Tokens

—

Input

Per 1M tokens

—

Output

Per 1M tokens

—

Benchmarks

No independent scores yet.

Epoch AI hasn't run DeepSeek Coder 33B yet. Its scores show up here the morning after they do.

Everything else Epoch has for it

  • GSM8K35.4%
  • Winogrande24.0%
  • ARC AI222.9%
  • MMLU19.2%

On the index

Around it.

  1. #252chatglm2-6bZ.ai98.9
  2. #253LLaMA-7BMeta96.7
  3. #254Baichuan 2-7BBaichuan96.3
  4. #255DeepSeek Coder 33BDeepSeek96.3
  5. #256Falcon-7BTII95.1
  6. #257CodeQwen1.5-7BAlibaba94.9
  7. #258vicuna-13b-v1.1LMSYS94.7

Sources