Claude 3 Haiku
#206 of 274 scored.
AnthropicMar 7, 2024Closed
Capabilities Index
Range 110.5–121.5
118.3
Context
Tokens
—
Input
Per 1M tokens
—
Output
Per 1M tokens
—
Benchmarks
How it scores.
- GPQA Diamond15.1%
164th of 186
- Mock AIME1.7%
166th of 176
Everything else Epoch has for it
- MMLU65.1%
- ScienceQA62.7%
- Winogrande48.4%
- DTBench16.9%
- MATH level 514.9%
- CadEval12.0%
- LMCA10.4%
- WeirdML9.8%
On the index
Around it.
Sources