in the loop

phi-3-small 7.4B
#193 of 274 scored.

MicrosoftApr 23, 2024Open weights

Capabilities Index

Range 114.8–124.4

121.8

Context

Tokens

—

Input

Per 1M tokens

—

Output

Per 1M tokens

—

Benchmarks

No independent scores yet.

Epoch AI hasn't run phi-3-small 7.4B yet. Its scores show up here the morning after they do.

Everything else Epoch has for it

  • ARC AI287.6%
  • OpenBookQA84.0%
  • BBH72.1%
  • HellaSwag69.3%
  • MMLU67.6%
  • Winogrande63.0%
  • TriviaQA58.1%
  • ANLI37.1%

On the index

Around it.

  1. #190Gemma 2 27BGoogle · $0.65 in122.1
  2. #191Mixtral 8x22BMistral122.0
  3. #192Mistral LargeMistral · $2.00 in122.0
  4. #193phi-3-small 7.4BMicrosoft121.8
  5. #194phi-3-medium 14BMicrosoft121.2
  6. #195Claude 3 SonnetAnthropic120.7
  7. #196Claude InstantAnthropic120.3

Sources