in the loop

Gemma 2B
#260 of 274 scored.

GoogleFeb 21, 2024Open weights

Capabilities Index

Range 80.8–101.3

94.2

Context

Tokens

—

Input

Per 1M tokens

—

Output

Per 1M tokens

—

Benchmarks

No independent scores yet.

Epoch AI hasn't run Gemma 2B yet. Its scores show up here the morning after they do.

Everything else Epoch has for it

  • HellaSwag61.9%
  • PIQA54.6%
  • TriviaQA53.2%
  • Winogrande30.8%
  • MMLU23.1%
  • ARC AI222.8%
  • GSM8K17.7%
  • BBH13.6%

On the index

Around it.

  1. #257CodeQwen1.5-7BAlibaba94.9
  2. #258vicuna-13b-v1.1LMSYS94.7
  3. #259MPT-7BDatabricks94.6
  4. #260Gemma 2BGoogle94.2
  5. #261StarCoder 2 7BHugging Face93.6
  6. #262XGen-7BSalesforce93.4
  7. #263Qwen-1_8BAlibaba92.9

Sources