in the loop

Mixtral 8x22B
#191 of 274 scored.

MistralApr 17, 2024Open weights

Capabilities Index

Range 114.6–124.5

122.0

Context

Tokens

—

Input

Per 1M tokens

—

Output

Per 1M tokens

—

Benchmarks

How it scores.

  • GPQA Diamond12.1%

    168th of 186

Everything else Epoch has for it

  • MMLU70.4%
  • DTBench25.2%
  • MATH level 524.2%
  • Cybench7.5%
  • WeirdML3.2%

On the index

Around it.

  1. #188Llama 3-70BMeta122.9
  2. #189Gemini 1.5 Flash (May 2024)Google122.6
  3. #190Gemma 2 27BGoogle · $0.65 in122.1
  4. #191Mixtral 8x22BMistral122.0
  5. #192Mistral LargeMistral · $2.00 in122.0
  6. #193phi-3-small 7.4BMicrosoft121.8
  7. #194phi-3-medium 14BMicrosoft121.2

Sources