Claude 3.5 Sonnet
#159 of 274 scored.
AnthropicJun 20, 2024Closed
Capabilities Index
Range undefined–undefined
130.0
Context
Tokens
—
Input
Per 1M tokens
—
Output
Per 1M tokens
—
Benchmarks
How it scores.
- GPQA Diamond38.7%
128th of 186
- Mock AIME6.4%
147th of 176
Everything else Epoch has for it
- MMLU82.0%
- MATH level 551.7%
- DTBench46.3%
- METR Time Horizons40.2%
- WeirdML31.0%
- Cybench17.5%
- SimpleBench13.0%
- FrontierMath-2025-02-28-Private1.8%
- FrontierMath-Tier-4-2025-07-01-Private0.0%
- VPCT0.0%
On the index
Around it.
Sources