Gemini 1.5 Flash (Sep 2024)
#162 of 274 scored.
GoogleSep 24, 2024Closed
Capabilities Index
Range 123.2–131.3
129.4
Context
Tokens
—
Input
Per 1M tokens
—
Output
Per 1M tokens
—
Benchmarks
How it scores.
- GPQA Diamond29.8%
145th of 186
- Mock AIME16.2%
130th of 176
Everything else Epoch has for it
- GeoBench76.0%
- PIQA75.0%
- MMLU65.2%
- MATH level 561.9%
- WeirdML24.9%
- DTBench23.0%
- Balrog14.6%
- FrontierMath-2025-02-28-Private0.0%
On the index
Around it.
Sources