o1
#106 of 274 scored.
OpenAIDec 17, 2024Closed
Capabilities Index
Range 139.7–143.2
141.9
Context
Takes text, image, file
200K
Input
Per 1M tokens
$15
Output
Per 1M tokens
$60
Benchmarks
How it scores.
- GPQA Diamond69.0%
88th of 186
- FrontierMath14.7%
74th of 81
- Humanity's Last Exam3.3%
30th of 40
- SimpleQA Verified41.1%
42nd of 77
- Mock AIME73.3%
85th of 176
Everything else Epoch has for it
- MATH level 594.7%
- Fiction.LiveBench83.3%
- GeoBench80.0%
- Lech Mazur Writing70.2%
- Aider polyglot61.7%
- DTBench57.8%
- CadEval56.0%
- METR Time Horizons51.0%
- WeirdML46.1%
- ARC-AGI30.7%
- SimpleBench28.1%
- LMCA26.2%
- Chess Puzzles10.6%
- VPCT5.5%
On the index
Around it.
Sources