When was Llama 3.1 8B Instruct released?

Meta released Llama 3.1 8B Instruct on 23 Jul 2024. It is available through the Opper gateway.

Does Llama 3.1 8B Instruct support zero data retention?

Yes. Llama 3.1 8B Instruct is available with zero data retention on DeepInfra, Novita through the Opper gateway.

Where is Llama 3.1 8B Instruct hosted?

Llama 3.1 8B Instruct runs on US hosting routes through the Opper gateway.

Is Llama 3.1 8B Instruct trained on prompts and outputs?

No. Every hosting route for Llama 3.1 8B Instruct is configured so customer prompts and outputs are not used to train models by default.

Is a GDPR DPA available for Llama 3.1 8B Instruct?

Yes. A GDPR Data Processing Agreement is available on at least one route serving Llama 3.1 8B Instruct. Contact hello@opper.ai to receive it.

Llama 3.1 8B Instruct

by Meta

Announcement · All Meta releases

Llama 3.1 8B Instruct is Meta's production-grade lightweight model, released July 2024. With 8 billion parameters and a 131,072-token context window, it offers a strong cost-to-capability ratio, with solid instruction following and reasoning in a compact footprint. The model supports tool calling and structured output, enabling agentic workflows and programmatic integration without moving to larger models. It handles general-purpose tasks including summarization, question answering, code generation, and classification with competitive quality for its size. Its open-weight design and multilingual training make it suitable for fine-tuning and on-premise deployment. It is a common pick where compute is limited yet enough capability remains for diverse downstream tasks beyond simple text generation.

Call Llama 3.1 8B Instruct on Opper with the OpenAI SDK. Sign up without a credit card. Get started

Get your API key Try in chat Compare

Key info

Input

Output

Features

Context window

131K

Max output

131K

Input price

$0.02 /1M

Output price

$0.05 /1M

Released

23 Jul 2024

Web search

Via Opper

US residency available
Zero data retention on pay-as-you-go
No training by default
GDPR DPA available

Available routes

Llama 3.1 8B Instruct runs on 2 different routes through the Opper gateway. Compare residency, zero data retention and training posture at a glance, with full data-handling detail per route below.

Provider	Region	Zero data retention	Training	Input	Output	Cache read
DeepInfra	US		No	$0.02	$0.05	Input price
Novita	US		No	$0.02	$0.05	Input price

Live routes and prices as JSON: api.opper.ai/v3/models?q=deepinfra%2Fmeta-llama%2FMeta-Llama-3.1-8B-Instruct

Uptime and availability

Llama 3.1 8B Instruct runs on 2 independently monitored routes through the Opper gateway. A direct integration leaves you on one of them, the gateway serves whichever is healthy.

100%effective uptime, last 30 days

Averaged across these routes on their own, a single provider reached 99.93% over the same window.

Daily status through the gateway, which serves each request from whichever route is healthy.

2 monitored providers serve Llama 3.1 8B Instruct.

Measured over the last 30 days from each provider's official status feed via StatusGator. Refreshed hourly. See uptime for every provider Opper monitors.

Data handling per route

Each route hosting Llama 3.1 8B Instruct has its own privacy posture, residency, and GDPR terms. Postures are maintained by Opper with a last-verification timestamp.

DeepInfra — United States🇺🇸

Zero data retention: nothing is logged, held for abuse monitoring or used for training. No training on customer data. US; SCCs; DPA available.

Zero data retention: Yes. Nothing is logged, held for abuse monitoring or used for training.
Training: No training on customer data.
Logging: None
Abuse monitoring: No classifier
GDPR DPA: DPA available
Transfer mechanism: SCCs

Novita — United States🇺🇸

Zero data retention: nothing is logged, held for abuse monitoring or used for training. No training on customer data. US; SCCs; DPA available.

Zero data retention: Yes. Nothing is logged, held for abuse monitoring or used for training.
Training: No training on customer data.
Logging: None
Abuse monitoring: On by default, keeps nothing
GDPR DPA: DPA available
Transfer mechanism: SCCs

Best for

Where Llama 3.1 8B Instruct ranks among the models on Opper with a score for each use case.

Multilingual35.1

Tasks across languagesSee the Multilingual ranking →

Benchmarks

Independent benchmark scores: the Intelligence Index and the individual evaluations behind it, grouped by skill.

Global rank#379 of 508 LLMs

TierEfficient

Output speed141 tok/s

Intelligence Index (previous version)6.9

Coding

LiveCodeBench

12%

Agentic & knowledge work

GDPval

Terminal-Bench Hard

τ²-Bench Telecom

16%

Science & reasoning

Humanity's Last Exam

GPQA Diamond

26%

Long-context reasoning

18%

Knowledge

MMLU-Pro

48%

Math & instruction following

AIME 2025

IFBench

29%

See full leaderboard →Benchmarks via Artificial Analysis · View on AA

Get started

Call Llama 3.1 8B Instruct through the Opper gateway with one API key. Opper is drop-in compatible with the OpenAI, Anthropic and Google AI SDKs.

Llama 3.1 8B Instruct is a premium model on Opper. Sign up needs no credit card: you get an API key straight away and the free models work in the playground and the API. Add a card to use premium models, pay-as-you-go with no minimum.

Set it up with your agent

Copy this and paste it into a coding agent like Claude Code, Cursor or Codex and it'll wire up Opper for you.

Or call it directly

1import OpenAI from "openai";
2
3const client = new OpenAI({
4  apiKey: process.env.OPPER_API_KEY,
5  baseURL: "https://api.opper.ai/v3/compat",
6});
7
8const completion = await client.chat.completions.create({
9  model: "deepinfra/meta-llama/Meta-Llama-3.1-8B-Instruct",
10  messages: [{ role: "user", content: "Hello" }],
11});
12console.log(completion.choices[0].message.content);