in the loop

PaLM 2-S
#239 of 274 scored.

GoogleMay 17, 2023

Capabilities Index

Range 94.8–114.5

106.2

Context

Tokens

—

Input

Per 1M tokens

—

Output

Per 1M tokens

—

Benchmarks

No independent scores yet.

Epoch AI hasn't run PaLM 2-S yet. Its scores show up here the morning after they do.

Everything else Epoch has for it

  • HellaSwag76.0%
  • TriviaQA75.2%
  • Winogrande55.8%
  • ARC AI246.1%
  • OpenBookQA41.6%

On the index

Around it.

  1. #236LLaMA-33BMeta107.4
  2. #237Qwen-7BAlibaba106.8
  3. #238Llama 2-13BMeta106.2
  4. #239PaLM 2-SGoogle106.2
  5. #240Llama 2-34BMeta105.2
  6. #241StarCoder 2 15BHugging Face105.0
  7. #242Yi 6B01.AI104.8

Sources