Gemma 7B
#225 of 274 scored.
GoogleFeb 21, 2024Open weights
Capabilities Index
Range 102.4–116.5
112.0
Context
Tokens
—
Input
Per 1M tokens
—
Output
Per 1M tokens
—
Benchmarks
No independent scores yet.
Epoch AI hasn't run Gemma 7B yet. Its scores show up here the morning after they do.
Everything else Epoch has for it
- HellaSwag76.3%
- TriviaQA72.3%
- OpenBookQA71.5%
- ARC AI271.1%
- PIQA62.4%
- Winogrande58.0%
- MMLU54.8%
- GSM8K46.4%
- BBH40.1%
- ANLI23.1%
On the index
Around it.
Sources