in the loop

Qwen2.5-Max
#150 of 274 scored.

AlibabaJan 25, 2025Closed

Capabilities Index

Range 127.8–135.9

132.5

Context

Tokens

—

Input

Per 1M tokens

—

Output

Per 1M tokens

—

Benchmarks

How it scores.

  • GPQA Diamond41.5%

    123rd of 186

  • Mock AIME16.0%

    131st of 176

Everything else Epoch has for it

  • Lech Mazur Writing72.9%
  • MATH level 567.2%
  • Fiction.LiveBench66.7%
  • Aider polyglot21.8%
  • FrontierMath-2025-02-28-Private1.8%

On the index

Around it.

  1. #147Gemini 2.5 Flash-Lite (Jun 2025)Google133.9
  2. #148Claude 3.5 Sonnet (October 2024)Anthropic133.6
  3. #149Magistral Small 1.0Mistral133.2
  4. #150Qwen2.5-MaxAlibaba132.5
  5. #151DeepSeek-V3DeepSeek · $0.32 in132.3
  6. #152Llama 4 MaverickMeta · $0.19 in132.2
  7. #153Mistral Small 3.2Mistral131.7

Sources