When was Llama 3.1 70B Instruct released?

Meta released Llama 3.1 70B Instruct on 23 Jul 2024. It is available through the Opper gateway.

Does Llama 3.1 70B Instruct support zero data retention?

Yes. Llama 3.1 70B Instruct is available with zero data retention on DeepInfra through the Opper gateway.

Where is Llama 3.1 70B Instruct hosted?

Llama 3.1 70B Instruct runs on US hosting routes through the Opper gateway.

Is Llama 3.1 70B Instruct trained on prompts and outputs?

No. Every hosting route for Llama 3.1 70B Instruct is configured so customer prompts and outputs are not used to train models by default.

Is a GDPR DPA available for Llama 3.1 70B Instruct?

Yes. A GDPR Data Processing Agreement is available on at least one route serving Llama 3.1 70B Instruct. Contact hello@opper.ai to receive it.

Llama 3.1 70B Instruct

by Meta

Announcement · All Meta releases

Llama 3.1 70B Instruct is Meta's open-weight general-purpose model, released July 2024. With 70 billion parameters and a 131,072-token context window, it balances capability and efficiency, offering strong reasoning, instruction following, and multilingual fluency. The model handles tool calling, structured output generation, and complex reasoning workflows. It supports long-form generation, code understanding, and agentic behavior where tool use is central, and the extended context window supports document analysis and multi-turn conversations. As an open-weight model, it suits organizations that want customizable, auditable inference. Multilingual support officially spans eight languages, including English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai, making it practical for global applications.

Call Llama 3.1 70B Instruct on Opper with the OpenAI SDK. Sign up without a credit card. Get started

Get your API key Try in chat Compare

Key info

Input

Output

Features

Context window

131K

Max output

131K

Input price

$0.40 /1M

Output price

$0.40 /1M

Released

23 Jul 2024

Web search

Via Opper

US residency available
Zero data retention on pay-as-you-go
No training by default
GDPR DPA available

Available routes

Llama 3.1 70B Instruct runs on 1 route through the Opper gateway. Compare residency, zero data retention and training posture at a glance, with full data-handling detail per route below.

Provider	Region	Zero data retention	Training	Input	Output	Cache read
DeepInfra	US		No	$0.40	$0.40	Input price

Live routes and prices as JSON: api.opper.ai/v3/models?q=deepinfra%2Fmeta-llama%2FMeta-Llama-3.1-70B-Instruct

Uptime and availability

Llama 3.1 70B Instruct runs on a single route through the Opper gateway today, so its availability is that provider's availability.

99.86%route uptime, last 30 days

Single route, no failover target within this model.

Name a second model in the same request and the gateway tries it on retriable errors, so a busy hour never has to reach your users. Set up a fallback chain.

Measured over the last 30 days from each provider's official status feed via StatusGator. Refreshed hourly. See uptime for every provider Opper monitors.

Data handling per route

Each route hosting Llama 3.1 70B Instruct has its own privacy posture, residency, and GDPR terms. Postures are maintained by Opper with a last-verification timestamp.

DeepInfra — United States🇺🇸

Zero data retention: nothing is logged, held for abuse monitoring or used for training. No training on customer data. US; SCCs; DPA available.

Zero data retention: Yes. Nothing is logged, held for abuse monitoring or used for training.
Training: No training on customer data.
Logging: None
Abuse monitoring: No classifier
GDPR DPA: DPA available
Transfer mechanism: SCCs

Benchmarks

Independent benchmark scores: the Intelligence Index and the individual evaluations behind it, grouped by skill.

Global rank#384 of 505 LLMs

TierEfficient

Output speed41 tok/s

Intelligence Index (previous version)6.6

Coding

LiveCodeBench

23%

Agentic & knowledge work

Terminal-Bench Hard

τ²-Bench Telecom

15%

Science & reasoning

Humanity's Last Exam

GPQA Diamond

41%

Knowledge

MMLU-Pro

68%

Math & instruction following

AIME 2025

IFBench

34%

See full leaderboard →Benchmarks via Artificial Analysis · View on AA

Get started

Call Llama 3.1 70B Instruct through the Opper gateway with one API key. Opper is drop-in compatible with the OpenAI, Anthropic and Google AI SDKs.

Llama 3.1 70B Instruct is a premium model on Opper. Sign up needs no credit card: you get an API key straight away and the free models work in the playground and the API. Add a card to use premium models, pay-as-you-go with no minimum.

Set it up with your agent

Copy this and paste it into a coding agent like Claude Code, Cursor or Codex and it'll wire up Opper for you.

Or call it directly

1import OpenAI from "openai";
2
3const client = new OpenAI({
4  apiKey: process.env.OPPER_API_KEY,
5  baseURL: "https://api.opper.ai/v3/compat",
6});
7
8const completion = await client.chat.completions.create({
9  model: "deepinfra/meta-llama/Meta-Llama-3.1-70B-Instruct",
10  messages: [{ role: "user", content: "Hello" }],
11});
12console.log(completion.choices[0].message.content);