in the loop

Claude Instant
#196 of 274 scored.

AnthropicAug 9, 2023Closed

Capabilities Index

Range 112.5–122.8

120.3

Context

Tokens

—

Input

Per 1M tokens

—

Output

Per 1M tokens

—

Benchmarks

No independent scores yet.

Epoch AI hasn't run Claude Instant yet. Its scores show up here the morning after they do.

Everything else Epoch has for it

  • GSM8K86.7%
  • ARC AI281.7%
  • TriviaQA78.9%
  • MMLU64.5%
  • DTBench9.6%

On the index

Around it.

  1. #193phi-3-small 7.4BMicrosoft121.8
  2. #194phi-3-medium 14BMicrosoft121.2
  3. #195Claude 3 SonnetAnthropic120.7
  4. #196Claude InstantAnthropic120.3
  5. #197Claude 2Anthropic120.1
  6. #198Gemma 2 9BGoogle119.8
  7. #199Qwen2.5-Coder-32BAlibaba119.5

Sources