Skip to content
OSMEXO

Claude 3.5 Haiku

anthropic/claude-3.5-haiku
  • Anthropic
  • Family · Claude 3 Haiku
  • Released 22 Oct 2024
Not on OSMEXO yet
Scores · standing
Intelligence8.9#279/489
Coding15.9#154/196

Benchmarks

bar = share of the top score · Benchmark data: Artificial Analysis
MATH-500#107 of 167
72.1%
MMLU-Pro#194 of 273
63.4%
IFBench#175 of 328
42.8%
GPQA Diamond#360 of 445
40.8%
LiveCodeBench#160 of 269
31.4%
Long-context reasoning#268 of 393
27.3%
τ²-Bench#219 of 319
24.6%
Coding index#154 of 196
15.9
Intelligence index#279 of 489
8.9
Terminal-Bench 2.1#142 of 182
10.1%
Humanity's Last Exam#432 of 465
3.6%
AIME#131 of 160
3.3%
Family progress
Intelligence Index
56789AprMayJunJulAugSepOct
  • Family releases8.9

Same family

Claude 3 Haiku

Alternatives

other vendors · similar capability

Want Claude 3.5 Haiku on OSMEXO?

Sign in to request it. Requests are reviewed; a request does not guarantee availability.