in the loop

Llama 3-70B
#188 of 274 scored.

MetaApr 18, 2024Open weights

Capabilities Index

Range 116.6–125.8

122.9

Context

Tokens

—

Input

Per 1M tokens

—

Output

Per 1M tokens

—

Benchmarks

How it scores.

  • GPQA Diamond20.8%

    157th of 186

  • Mock AIME4.2%

    154th of 176

Everything else Epoch has for it

  • MMLU72.4%
  • Winogrande67.0%
  • DTBench23.6%
  • MATH level 522.6%
  • Cybench5.0%

On the index

Around it.

  1. #185Amazon Nova ProAmazon123.8
  2. #186Gemma 3 12BGoogle · $0.05 in123.5
  3. #187GPT-4 (Jun 2023)OpenAI123.1
  4. #188Llama 3-70BMeta122.9
  5. #189Gemini 1.5 Flash (May 2024)Google122.6
  6. #190Gemma 2 27BGoogle · $0.65 in122.1
  7. #191Mixtral 8x22BMistral122.0

Sources