in the loop

Ministral 3B
#207 of 274 scored.

MistralOct 16, 2024Closed

Capabilities Index

Range 106.2–121.7

118.1

Context

Tokens

—

Input

Per 1M tokens

—

Output

Per 1M tokens

—

Benchmarks

How it scores.

  • GPQA Diamond0.3%

    181st of 186

Everything else Epoch has for it

  • DTBench19.6%
  • MATH level 514.4%
  • LMCA6.5%

On the index

Around it.

  1. #204Qwen2.5-7BAlibaba118.5
  2. #205Mixtral 8x7BMistral118.5
  3. #206Claude 3 HaikuAnthropic118.3
  4. #207Ministral 3BMistral118.1
  5. #208Yi-34B01.AI117.4
  6. #209phi-3-mini 3.8BMicrosoft117.4
  7. #210Stable Beluga 2Stability AI117.1

Sources