in the loop

Gemma 3 4B
#215 of 274 scored.

GoogleMar 12, 2025Open weights

Capabilities Index

Range 97.6–123.8

116.0

Context

Takes text, image

131K

Input

Per 1M tokens

$0.05

Output

Per 1M tokens

$0.10

Benchmarks

How it scores.

  • GPQA Diamond0.0%

    182nd of 186

  • Mock AIME7.4%

    141st of 176

Everything else Epoch has for it

  • DTBench18.2%
  • LMCA3.3%
  • Chess Puzzles0.0%

On the index

Around it.

  1. #212Llama 3.1-8BMeta116.6
  2. #213Llama 3-8BMeta116.5
  3. #214Qwen2.5-Coder-14BAlibaba116.4
  4. #215Gemma 3 4BGoogle · $0.05 in116.0
  5. #216GPT-3.5 Turbo (Jan 2024)OpenAI115.7
  6. #217PaLM 2-LGoogle115.0
  7. #218Llama 2-70BMeta113.8

Sources