Mixtral 8x7B
#205 of 274 scored.
MistralDec 11, 2023Open weights
Capabilities Index
Range 110.4–121.1
118.5
Context
Tokens
—
Input
Per 1M tokens
—
Output
Per 1M tokens
—
Benchmarks
How it scores.
- GPQA Diamond7.4%
172nd of 186
Everything else Epoch has for it
- ARC AI283.1%
- HellaSwag82.3%
- TriviaQA82.2%
- OpenBookQA81.1%
- GSM8K74.4%
- PIQA67.2%
- MMLU60.8%
- Winogrande54.4%
- ANLI32.8%
- DTBench16.0%
- MATH level 510.0%
On the index
Around it.
Sources