Model reference · Synced 2025-04-29
Llama 3.1 8B Instruct
Llama 3.1 8B Instruct is an AI model from Abacus. 128K context window. Capabilities: reasoning, tool calling, open weights. Available on 16 providers. Cheapest listing: $0.02 input / $0.05 output per 1M tokens.
Quick facts
- Cheapest input: $0.02 per 1M tokens (Abacus)
- Cheapest output: $0.05 per 1M tokens
- Context window: 128K tokens
- Max output: 4K tokens
- Release date: 2024-07-23
- Capabilities: reasoning, tool calling, open weights
- Provider count: 16
Provider pricing
Same model, different providers, different prices. Cheapest first.
| Provider | Input / 1M | Output / 1M | Context | Listed |
|---|---|---|---|---|
| Abacus | $0.02 | $0.05 | 128K | 2024-07-23 |
| NovitaAI | $0.02 | $0.05 | 16K | 2024-07-24 |
| Deep Infra | $0.02 | $0.05 | 131K | 2024-07-23 |
| Inference | $0.025 | $0.025 | 16K | 2025-01-01 |
| Vercel AI Gateway | $0.03 | $0.05 | 131K | 2024-07-23 |
| Regolo AI | $0.05 | $0.25 | 120K | 2025-04-07 |
| NanoGPT | $0.054 | $0.054 | 131K | 2024-07-23 |
| Cerebras | $0.1 | $0.1 | 32K | 2025-01-01 |
| Friendli | $0.1 | $0.1 | 131K | 2024-08-01 |
| OVHcloud AI Endpoints | $0.11 | $0.11 | 131K | 2025-06-11 |
| STACKIT | $0.16 | $0.27 | 128K | 2024-07-23 |
| Scaleway | $0.2 | $0.2 | 128K | 2025-01-01 |
| Synthetic | $0.2 | $0.2 | 128K | 2024-07-23 |
| Amazon Bedrock | $0.22 | $0.22 | 128K | 2024-07-23 |
| LLM Gateway | $0.22 | $0.22 | 128K | 2024-07-23 |
| Cloudflare AI Gateway | $0.28 | $0.83 | 128K | 2025-04-03 |
Prices synced daily from models.dev + provider docs.
How to use this model
If you're picking Llama 3.1 8B Instruct for a project, the three things that matter most:
- Compare it side-by-side with one or two alternatives in the live comparison tool. Pricing differences matter more than benchmarks at scale.
- Pick the cheapest provider that meets your latency / SLA need. Big spread across providers for the same weights.
- Re-evaluate every 3 months. Frontier prices drop fast; a model that's cheapest today may not be in a quarter.
Related models
FAQ
How much does Llama 3.1 8B Instruct cost? $0.02 input / $0.05 output per 1M tokens at the cheapest listing. See the table above for other providers.
What is the context window? 128K tokens.
Which providers offer it? Scaleway, NanoGPT, Abacus, NovitaAI, Deep Infra, Cloudflare AI Gateway, Amazon Bedrock, Cerebras, Synthetic, Inference, and others — see the full table above.
Where do these numbers come from? models.dev + provider documentation, synced daily. About the data.