in the loop

Nemotron-4 15B
#234 of 274 scored.

NvidiaFeb 26, 2024Closed

Capabilities Index

Range 97.3–113.3

107.7

Context

Tokens

—

Input

Per 1M tokens

—

Output

Per 1M tokens

—

Benchmarks

No independent scores yet.

Epoch AI hasn't run Nemotron-4 15B yet. Its scores show up here the morning after they do.

Everything else Epoch has for it

  • HellaSwag76.5%
  • PIQA64.8%
  • Winogrande56.0%
  • GSM8K46.0%
  • MMLU44.9%
  • BBH44.9%
  • ARC AI240.7%

On the index

Around it.

  1. #231PaLM 2-MGoogle108.3
  2. #232Phi-2Microsoft107.9
  3. #233Qwen2.5-Coder-3BAlibaba107.7
  4. #234Nemotron-4 15BNvidia107.7
  5. #235Yi-9B01.AI107.6
  6. #236LLaMA-33BMeta107.4
  7. #237Qwen-7BAlibaba106.8

Sources