in the loop

Mistral NeMo
#202 of 274 scored.

MistralJul 18, 2024Open weights

Capabilities Index

Range 111.0–121.2

118.7

Context

Takes text

131K

Input

Per 1M tokens

$0.029

Output

Per 1M tokens

$0.03

Benchmarks

How it scores.

  • GPQA Diamond6.5%

    173rd of 186

Everything else Epoch has for it

  • GSM8K84.2%
  • PIQA67.0%
  • Balrog17.6%
  • DTBench14.3%
  • MATH level 510.8%

On the index

Around it.

  1. #199Qwen2.5-Coder-32BAlibaba119.5
  2. #200Command R+Cohere119.3
  3. #201Claude 2.1Anthropic119.3
  4. #202Mistral NeMoMistral · $0.029 in118.7
  5. #203GPT-3.5 Turbo (Nov 2023)OpenAI118.5
  6. #204Qwen2.5-7BAlibaba118.5
  7. #205Mixtral 8x7BMistral118.5

Sources