in the loop

CodeQwen1.5-7B
#257 of 274 scored.

AlibabaApr 15, 2024

Capabilities Index

Range 79.0–102.9

94.9

Context

Tokens

—

Input

Per 1M tokens

—

Output

Per 1M tokens

—

Benchmarks

No independent scores yet.

Epoch AI hasn't run CodeQwen1.5-7B yet. Its scores show up here the morning after they do.

Everything else Epoch has for it

  • GSM8K37.7%
  • MMLU20.7%
  • Winogrande19.6%
  • ARC AI214.3%

On the index

Around it.

  1. #254Baichuan 2-7BBaichuan96.3
  2. #255DeepSeek Coder 33BDeepSeek96.3
  3. #256Falcon-7BTII95.1
  4. #257CodeQwen1.5-7BAlibaba94.9
  5. #258vicuna-13b-v1.1LMSYS94.7
  6. #259MPT-7BDatabricks94.6
  7. #260Gemma 2BGoogle94.2

Sources