in the loop

GPT-4o (May 2024)
#164 of 274 scored.

OpenAIMay 13, 2024Closed

Capabilities Index

Range 123.8–131.7

129.0

Context

Tokens

—

Input

Per 1M tokens

—

Output

Per 1M tokens

—

Benchmarks

How it scores.

  • GPQA Diamond31.9%

    139th of 186

  • Mock AIME6.2%

    149th of 176

Everything else Epoch has for it

  • ScienceQA84.7%
  • MMLU78.9%
  • MATH level 551.0%
  • DTBench40.9%
  • Balrog32.3%
  • LMCA19.5%

On the index

Around it.

  1. #161GPT-4.1 nanoOpenAI · $0.10 in129.6
  2. #162Gemini 1.5 Flash (Sep 2024)Google129.4
  3. #163Qwen2.5-72BAlibaba129.0
  4. #164GPT-4o (May 2024)OpenAI129.0
  5. #165GPT-4o (Nov 2024)OpenAI128.8
  6. #166GPT-4o (Aug 2024)OpenAI128.8
  7. #167Llama 3.1-405BMeta128.8

Sources