in the loop

Gemma 2 9B
#198 of 274 scored.

GoogleJun 24, 2024Open weights

Capabilities Index

Range 111.6–122.6

119.8

Context

Tokens

—

Input

Per 1M tokens

—

Output

Per 1M tokens

—

Benchmarks

How it scores.

  • GPQA Diamond3.3%

    176th of 186

  • Mock AIME0.5%

    172nd of 176

Everything else Epoch has for it

  • GSM8K84.9%
  • PIQA67.4%
  • MMLU62.8%
  • MATH level 521.0%

On the index

Around it.

  1. #195Claude 3 SonnetAnthropic120.7
  2. #196Claude InstantAnthropic120.3
  3. #197Claude 2Anthropic120.1
  4. #198Gemma 2 9BGoogle119.8
  5. #199Qwen2.5-Coder-32BAlibaba119.5
  6. #200Command R+Cohere119.3
  7. #201Claude 2.1Anthropic119.3

Sources