in the loop

Gemma 2 27B
#190 of 274 scored.

GoogleJun 24, 2024Open weights

Capabilities Index

Range 114.4–124.1

122.1

Context

Takes text

8K

Input

Per 1M tokens

$0.65

Output

Per 1M tokens

$0.65

Benchmarks

How it scores.

  • GPQA Diamond15.3%

    163rd of 186

  • Mock AIME1.3%

    168th of 176

Everything else Epoch has for it

  • MMLU67.6%
  • MATH level 527.9%
  • DTBench13.3%
  • LMCA8.3%

On the index

Around it.

  1. #187GPT-4 (Jun 2023)OpenAI123.1
  2. #188Llama 3-70BMeta122.9
  3. #189Gemini 1.5 Flash (May 2024)Google122.6
  4. #190Gemma 2 27BGoogle · $0.65 in122.1
  5. #191Mixtral 8x22BMistral122.0
  6. #192Mistral LargeMistral · $2.00 in122.0
  7. #193phi-3-small 7.4BMicrosoft121.8

Sources