Skip to content
OSMEXO

Mixtral 8x22B Instruct

mistral/mixtral-8x22b-instruct
  • Mistral
  • Family · Mixtral
  • Released 17 Apr 2024
  • Open weights
  • Text · File → Text
  • Tools · JSON
Not on OSMEXO yet
Spec & list price
Context64K
Max output52K
Input / 1M$2.00
Output / 1M$6.003× input
Scores · standing
Intelligence5.7#413/489
Usage
Tokens / day18.8M▲ 90% 7d
Usage rank#372
Requests / day2.9K
Tool calls / req0.02
Per request · 30 days
Avg input2.0K0.1× median
Avg output2080.3× median
Cache hit41%0.6× median
Tool-call failures1.1%0.6× median

Consumption

8.3M16.7M25.0M3 Oct17 Oct1 Nov
Peak 22.0M 1 OctLow 1.4M 20 OctRank today #372

News & trends

News · latest from Mistral

Benchmarks

bar = share of the top score · Benchmark data: Artificial Analysis
MMLU-Pro#218 of 273
53.7%
MATH-500#134 of 167
54.5%
GPQA Diamond#389 of 445
33.2%
LiveCodeBench#220 of 269
14.8%
Intelligence index#413 of 489
5.7
Humanity's Last Exam#405 of 465
4.0%
AIME#147 of 160
0.0%
Speed · median across 2 providers, latest day
Output speed#58/334109 tok/s1.7× faster than median
First token#360.42 s2.4× quicker than median

#21 cheapest of 29 with a similar score

Value
Intelligence Index
56789$1$2$5Mixtral 8x22B Instruct
Blended price per 1M tokens (log)
Family progress
Intelligence Index
55.25.45.65.82024FebMarAprMixtral 8x22B Instruct
  • Family releases5.7

Technical details

Tokenizer
Mistral
Knowledge cutoff
2024-01-31
License
Apache 2.0
Parameters
141B
Moderation
none
Downloads · likes
39.7K · 781
Request parameters 11
  • tools
  • tool_choice
  • response_format
  • structured_outputs
  • temperature
  • top_p
  • max_tokens
  • stop
  • seed
  • frequency_penalty
+1 more
  • presence_penalty

Interesting facts

  1. 3.2× the output room of similar models (52.4K against a 16.4K median).
  2. Weekdays average 6.3M tokens a day against 8.9M on weekends.
  3. Released 929 days ago, the newest of 2 Mixtral models.

When to use

Best for

  • Self-hosted general text assistants
  • Function-calling prototypes
  • Multilingual drafting and summaries
  • Structured JSON extraction

Think twice for

  • Hard math, science and coding tasks
  • Image understanding
  • Long documents (modest context)
  • New builds where newer models are stronger

Same family

Mixtral

Alternatives

other vendors · similar capability

Want Mixtral 8x22B Instruct on OSMEXO?

Sign in to request it. Requests are reviewed; a request does not guarantee availability.