Llama 3.1 70B Instruct
meta/llama-3.1-70b-instruct- Meta
- Family · Llama 3
- Open weights
- Text → Text
- Tools · JSON
Not on OSMEXO yet
Spec & list price
Context128K
Max output16K
Input / 1M$0.40
Output / 1M$0.401× input
Usage
Tokens / day212.0M▼ 23% 7d
Usage rank#267
Requests / day236.2K
Tool calls / req0.01
Per request · 30 days
Avg input1.2K0.1× median
Avg output930.1× median
Tool-call failures5.8%3.1× median
Consumption
Peak 563.4M 19 OctLow 83.6M 25 OctRank today #267
News & trends
1 mentions this week ▼ 80%Llama 3 family · videos, posts, articles · 30 days
News · latest from Meta
- Meta Networking at the 2026 OCP Global Summit: Open Innovation for Scale-Up, Scale-Out, and Scale-Across AI NetworksMeta Engineering · 26 Oct
- Scale Agentic Coding Workflows with Meta’s Muse Spark Open on NVIDIA GB300 NVL72NVIDIA · 15 Oct
- Meta Muse Spark Open is live on Together AITogether AI · 15 Oct
- Welcome Muse Spark Open: open-weight frontier multimodal mixture-of-experts model from Meta15 Oct
Benchmarks
Benchmark data: Artificial AnalysisOutput speed#206/33452 tok/s1.2× slower than median
Fastest provider69 tok/sbest of 2 providers
First token#220.36 s3.0× quicker than median
Family progress
Intelligence Index
- Family releases7.7
Technical details
- Tokenizer
- Llama3
- Knowledge cutoff
- 2023-12-31
- License
- llama3.1
- Parameters
- 70.6B
- Moderation
- none
- Downloads · likes
- 94.0K · 1.0K
Request parameters 15
- tools
- tool_choice
- response_format
- structured_outputs
- temperature
- top_p
- top_k
- min_p
- max_tokens
- stop
+5 more
- seed
- frequency_penalty
- logit_bias
- presence_penalty
- repetition_penalty
When to use
Best for
- General-purpose chat with open weights
- Tool calling and structured output
- Self-hosted production assistants
- Long document Q&A
Think twice for
- Image input
- Reasoning-heavy tasks
- Newest-generation quality needs
Same family
Llama 3- G
- 5.5
- 4.8
- 7.3
- 6.6
- 6.9
- 5.4
Want Llama 3.1 70B Instruct on OSMEXO?
Sign in to request it. Requests are reviewed; a request does not guarantee availability.