Llama 3.1 8B Instant
Llama 3.1 8B Instant is a multilingual, instruction-tuned model with a context window of 131.1K tokens and tool-use capability. It suits cost-effective production deployments that need multilingual coverage and trained tool use. Your use is subject to Meta's Terms & Privacy Policies.
Implicit CachingTool Use
import { streamText } from 'ai'
const result = streamText({ model: 'meta/llama-3.1-8b', prompt: 'Why is the sky blue?'})More models by Meta
| Model |
|---|
| 1M | 3.1s | 116tps | $0.10/M | $0.20/M | Read:$0.0/M Write:— | — | +2 |  | 08/05/2026 | ||||
| 1M | 3.9s | 192tps | $1.25/M | $4.25/M | Read:$0.15/M Write:— | — | +2 | | 08/05/2026 | ||||
| 1M | 3.9s | 159tps | $1.25/M | $4.25/M | Read:$0.15/M Write:— | — | +2 | | 07/09/2026 | ||||
| 131K | 0.2s | 123tps | $0.17/M | $0.66/M | — |   | 04/05/2025 | ||||||
| 131K | 0.2s | 76tps | $0.24/M | $0.97/M | — | | 04/05/2025 | ||||||
| 128K | 0.2s | $0.59/M | $0.72/M | — |  | 12/06/2024 |