Llama 3.1 8B Instruct

by Meta

Released 96 days after Llama 3 8B Instruct · All Meta releases

Llama 3.1 8B Instruct is Meta's production-grade lightweight model, released July 2024. With 8 billion parameters and a 131,072-token context window, it offers a strong cost-to-capability ratio, with solid instruction following and reasoning in a compact footprint. The model supports tool calling and structured output, enabling agentic workflows and programmatic integration without moving to larger models. It handles general-purpose tasks including summarization, question answering, code generation, and classification with competitive quality for its size. Its open-weight design and multilingual training make it suitable for fine-tuning and on-premise deployment. It is a common pick where compute is limited yet enough capability remains for diverse downstream tasks beyond simple text generation.

Call Llama 3.1 8B Instruct on Opper with the OpenAI SDK. Sign up without a credit card. Get started

Key info

Input
Output
Features
Context window
131K
Max output
131K
Input price
$0.02 /1M
Output price
$0.05 /1M
Released
  • EU residency available
  • US residency available
  • Zero data retention on pay-as-you-go
  • No training by default
  • GDPR DPA available

Available routes

Llama 3.1 8B Instruct runs on 3 different routes through the Opper gateway. Compare residency, zero data retention and training posture at a glance, with full data-handling detail per route below.

ProviderRegionZero data retentionTrainingInputOutputCache read
USNo$0.02$0.05Input price
EUNo$0.01$0.02$0.0050
USNo$0.02$0.05Input price

Uptime and availability

Llama 3.1 8B Instruct runs on 2 independently monitored routes through the Opper gateway. A direct integration leaves you on one of them, the gateway serves whichever is healthy.

100%effective uptime, last 30 days
Averaged across these routes on their own, a single provider reached 100% over the same window.
Daily status through the gateway, which serves each request from whichever route is healthy.
2 monitored providers serve Llama 3.1 8B Instruct.

Measured over the last 30 days from each provider's official status feed via StatusGator. Refreshed hourly. 1 further route for this model is not on the board yet and is not counted above. See uptime for every provider Opper monitors.

Data handling per route

Each route hosting Llama 3.1 8B Instruct has its own privacy posture, residency, and GDPR terms. Postures are maintained by Opper with a last-verification timestamp.

DeepInfra — United States🇺🇸

Zero data retention: nothing is logged, held for abuse monitoring or used for training. No training on customer data. US; unknown; DPA available.

Zero data retention
Yes. Nothing is logged, held for abuse monitoring or used for training.
Training
No training on customer data.
Logging
None
Abuse monitoring
No classifier
GDPR DPA
DPA available
Transfer mechanism
unknown

Greenference — European Union🇪🇺

Zero data retention: nothing is logged, held for abuse monitoring or used for training. No training on customer data. EU; DPA available.

Zero data retention
Yes. Nothing is logged, held for abuse monitoring or used for training.
Training
No training on customer data.
Logging
None
Abuse monitoring
No classifier
Caching
Content cached for replay
Subprocessor access
Subprocessors may read content
GDPR DPA
DPA available
Transfer mechanism
Not applicable — data stays in EU

Novita — United States🇺🇸

Zero data retention: nothing is logged, held for abuse monitoring or used for training. No training on customer data. US; SCCs; DPA available.

Zero data retention
Yes. Nothing is logged, held for abuse monitoring or used for training.
Training
No training on customer data.
Logging
None
Abuse monitoring
On by default, keeps nothing
GDPR DPA
DPA available
Transfer mechanism
SCCs

Benchmarks

Independent benchmark scores — composite indices for reasoning, coding, and math, plus individual eval scores where available.

Intelligence Index6.9
Coding Index5.4
Math Index4.3
Reasoning & knowledge
MMLU-Pro
48%
GPQA Diamond
26%
Humanity's Last Exam
5%
Long-context reasoning
18%
Coding
LiveCodeBench
12%
Agentic & tool use
Terminal-Bench Hard
1%
τ²-Bench Telecom
16%
Math & instruction following
AIME 2025
4%
IFBench
29%

Get started

Call Llama 3.1 8B Instruct through the Opper gateway with one API key. Opper is drop-in compatible with the OpenAI, Anthropic and Google AI SDKs.

Llama 3.1 8B Instruct is a premium model on Opper. Sign up needs no credit card: you get an API key straight away and the free models work in the playground and the API. Add a card to use premium models, pay-as-you-go with no minimum.

Set it up with your agent

Copy this and paste it into a coding agent like Claude Code, Cursor or Codex and it'll wire up Opper for you.

Or call it directly

import OpenAI from "openai";
const client = new OpenAI({
apiKey: process.env.OPPER_API_KEY,
baseURL: "https://api.opper.ai/v3/compat",
});
const completion = await client.chat.completions.create({
model: "deepinfra/meta-llama/Meta-Llama-3.1-8B-Instruct",
messages: [{ role: "user", content: "Hello" }],
});
console.log(completion.choices[0].message.content);

Compare Llama 3.1 8B Instruct with…

Side-by-side on privacy, EU hosting, pricing, and benchmarks.

Other models from Meta

Start building with 700+ models

One API key. Every major provider. Up and running in minutes.

Get startedView Documentation