Llama 3.1 70B Instruct

by Meta

All Meta releases

Llama 3.1 70B Instruct is Meta's open-weight general-purpose model, released July 2024. With 70 billion parameters and a 131,072-token context window, it balances capability and efficiency, offering strong reasoning, instruction following, and multilingual fluency. The model handles tool calling, structured output generation, and complex reasoning workflows. It supports long-form generation, code understanding, and agentic behavior where tool use is central, and the extended context window supports document analysis and multi-turn conversations. As an open-weight model, it suits organizations that want customizable, auditable inference. Multilingual support officially spans eight languages, including English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai, making it practical for global applications.

Call Llama 3.1 70B Instruct on Opper with the OpenAI SDK. Sign up without a credit card. Get started

Key info

Input
Output
Features
Context window
131K
Max output
131K
Input price
$0.40 /1M
Output price
$0.40 /1M
Released
  • US residency available
  • Zero data retention on pay-as-you-go
  • No training by default
  • GDPR DPA available

Available routes

Llama 3.1 70B Instruct runs on 1 route through the Opper gateway. Compare residency, zero data retention and training posture at a glance, with full data-handling detail per route below.

ProviderRegionZero data retentionTrainingInputOutputCache read
USNo$0.40$0.40Input price

Uptime and availability

Llama 3.1 70B Instruct runs on a single route through the Opper gateway today, so its availability is that provider's availability.

100%route uptime, last 30 days
Single route, no failover target within this model.

Name a second model in the same request and the gateway tries it on retriable errors, so a busy hour never has to reach your users. Set up a fallback chain.

Measured over the last 30 days from each provider's official status feed via StatusGator. Refreshed hourly. See uptime for every provider Opper monitors.

Data handling per route

Each route hosting Llama 3.1 70B Instruct has its own privacy posture, residency, and GDPR terms. Postures are maintained by Opper with a last-verification timestamp.

DeepInfra United States🇺🇸

Zero data retention: nothing is logged, held for abuse monitoring or used for training. No training on customer data. US; unknown; DPA available.

Zero data retention
Yes. Nothing is logged, held for abuse monitoring or used for training.
Training
No training on customer data.
Logging
None
Abuse monitoring
No classifier
GDPR DPA
DPA available
Transfer mechanism
unknown

Benchmarks

Independent benchmark scores — composite indices for reasoning, coding, and math, plus individual eval scores where available.

Intelligence Index6.6
Math Index4.0
Reasoning & knowledge
MMLU-Pro
68%
GPQA Diamond
41%
Humanity's Last Exam
5%
Coding
LiveCodeBench
23%
Agentic & tool use
Terminal-Bench Hard
3%
τ²-Bench Telecom
15%
Math & instruction following
AIME 2025
4%
IFBench
34%

Get started

Call Llama 3.1 70B Instruct through the Opper gateway with one API key. Opper is drop-in compatible with the OpenAI, Anthropic and Google AI SDKs.

Llama 3.1 70B Instruct is a premium model on Opper. Sign up needs no credit card: you get an API key straight away and the free models work in the playground and the API. Add a card to use premium models, pay-as-you-go with no minimum.

Set it up with your agent

Copy this and paste it into a coding agent like Claude Code, Cursor or Codex and it'll wire up Opper for you.

Or call it directly

import OpenAI from "openai";
const client = new OpenAI({
apiKey: process.env.OPPER_API_KEY,
baseURL: "https://api.opper.ai/v3/compat",
});
const completion = await client.chat.completions.create({
model: "deepinfra/meta-llama/Meta-Llama-3.1-70B-Instruct",
messages: [{ role: "user", content: "Hello" }],
});
console.log(completion.choices[0].message.content);

Compare Llama 3.1 70B Instruct with…

Side-by-side on privacy, EU hosting, pricing, and benchmarks.

Other models from Meta

Start building with 700+ models

One API key. Every major provider. Up and running in minutes.

Get startedView Documentation