Does Llama 3.1 8B support zero data retention?

Not self-serve on Pay-as-you-go. Zero data retention for Llama 3.1 8B is available on request via Opper Enterprise — contact hello@opper.ai.

Where is Llama 3.1 8B hosted?

Llama 3.1 8B runs on US hosting routes through the Opper gateway.

Is Llama 3.1 8B trained on prompts and outputs?

No. Every hosting route for Llama 3.1 8B is configured so customer prompts and outputs are not used to train models by default.

Is a GDPR DPA available for Llama 3.1 8B?

Yes. A GDPR Data Processing Agreement is available on at least one route serving Llama 3.1 8B. Contact hello@opper.ai to receive it.

Llama 3.1 8B

by Meta

Llama 3.1 8B is the successor to Llama 3 8B, an 8-billion-parameter instruction-tuned model with a 128,000-token context window, a large jump from Llama 3's 8,192-token limit. Released on July 23, 2024, it supports eight languages including English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai. Trained on over 15 trillion tokens from publicly available sources with a December 2023 knowledge cutoff, Llama 3.1 8B combines supervised fine-tuning with reinforcement learning from human feedback for improved reasoning, coding, and instruction-following. It uses Grouped-Query Attention for inference efficiency and is suited to assistant-style chat, synthetic data generation, and distillation into smaller models. Compared to Llama 3 8B, the 3.1 release offers a roughly 16x longer context window for extended documents and conversations, broader multilingual coverage, and stronger reasoning and coding. Its balance of capability and efficiency makes it a good fit for applications that need long context without a large compute budget.

Open in playground Try in chat Compare

Key info

Input

Output

Features

Context window

128K

Max output

Input price

$0.10 /1M

Output price

$0.10 /1M

US residency available
Zero data retention via Enterprise
No training by default
GDPR DPA available

Available routes

Llama 3.1 8B runs on 1 route through the Opper gateway. Compare residency, ZDR, and training posture at a glance — full data-handling detail per route below.

Provider	Region	Zero data retention	Training	Input	Output
Cerebras	US	Enterprise	No	$0.10	$0.10

Training posture across routes: No training on prompts by default.

Data handling per route

Each route hosting Llama 3.1 8B has its own privacy posture, residency, and GDPR terms. Postures are maintained by Opper with a last-verification timestamp.

Cerebras — United States🇺🇸

Zero data retention is available via Opper Enterprise contract. No training on customer data. US; SCCs; DPA available.

Zero data retention: Available via Opper Enterprise contract.
Training: No training on customer data.
Logging: None
Third-party access: Provider may share with subprocessors / partners
GDPR DPA: DPA available
Transfer mechanism: SCCs

Get started

Call Llama 3.1 8B through the Opper gateway with one API key. Let your coding agent set it up, or call it directly — Opper is drop-in compatible with the OpenAI, Anthropic, and Google AI SDKs.

Set it up with your agent

Copy this and paste it into your coding agent — Claude Code, Cursor, Codex, and more — and it'll wire up Opper for you.

Or call it directly

1import OpenAI from "openai";
2
3const client = new OpenAI({
4  apiKey: process.env.OPPER_API_KEY,
5  baseURL: "https://api.opper.ai/v3/compat",
6});
7
8const completion = await client.chat.completions.create({
9  model: "cerebras/llama3.1-8b",
10  messages: [{ role: "user", content: "Hello" }],
11});
12console.log(completion.choices[0].message.content);