---
last_updated: 2026-11-21
source_url: https://opper.ai/meta/llama-3-1-70b-instruct-turbo
title: "Llama 3.1 70B Instruct Turbo by Meta"
description: "Llama 3.1 70B Instruct Turbo: throughput-optimized 70B variant keeping the full 131K context and tool calling for high-volume serving."
---

# Llama 3.1 70B Instruct Turbo

By [Meta](https://opper.ai/meta).

Released 23 Jul 2024 · [Announcement](https://github.com/meta-llama/llama-models/blob/main/models/llama3_1/MODEL_CARD.md) · [All Meta releases](https://opper.ai/model-releases/meta)

Llama 3.1 70B Instruct Turbo is a throughput-optimized build of the standard 70B model, aimed at high-volume inference. It keeps the 131,072-token context window and 70-billion-parameter capacity while favoring batch processing and concurrent request handling.

The Turbo build retains tool calling and structured output support, so it remains suitable for agentic workflows where serving speed matters. Optimizations typically target inference efficiency rather than the underlying model quality.

It fits applications that want the reasoning capability of a 70B model under tighter concurrency demand. It shares the same open-weight, multilingual foundation as the standard 70B Instruct release.

## Available routes

Llama 3.1 70B Instruct Turbo runs on 1 route through the Opper gateway. Prices are per 1M tokens. Its route also sells flex processing: the same model at another price, picked per request with service_tier. [How service tiers work](https://docs.opper.ai/build/gateway/service-tiers). Its routes and prices, live from the catalogue, are public JSON with no API key needed at https://api.opper.ai/v3/models?q=deepinfra%2Fmeta-llama%2FMeta-Llama-3.1-70B-Instruct-Turbo.

| Provider | Model id | Region | Zero data retention | Training | Input | Output | Cache read |
| --- | --- | --- | --- | --- | --- | --- | --- |
| [DeepInfra](https://opper.ai/provider/deepinfra) | `deepinfra/meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo` | US (United States) | Yes | No | $0.40 | $0.40 | Input price |
| [DeepInfra](https://opper.ai/provider/deepinfra), Flex | `deepinfra:flex/meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo` | US (United States) | Yes | No | $0.32 | $0.32 | $0.32 |

## Key info

- Model id: `deepinfra/meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo`
- Input: Text
- Output: Text
- Features: Tools
- Context window: 131K
- Max output: 131K
- Input price: $0.40 per 1M tokens
- Output price: $0.40 per 1M tokens
- Released: 23 Jul 2024
- US residency available
- Zero data retention on pay-as-you-go
- No training by default

## Data handling per route

Each route hosting Llama 3.1 70B Instruct Turbo has its own privacy posture, residency, and GDPR terms. Postures are maintained by Opper with a last-verification timestamp.

### DeepInfra — United States

Zero data retention: nothing is logged, held for abuse monitoring or used for training. No training on customer data. US; SCCs.

- Zero data retention: Yes. Nothing is logged, held for abuse monitoring or used for training.
- Training: No training on customer data.
- Logging: None
- Abuse monitoring: No classifier
- Transfer mechanism: SCCs

Verified by Opper on 2026-10-19.

## Get started

Call Llama 3.1 70B Instruct Turbo through the Opper gateway with one API key. Opper is drop-in compatible with the OpenAI, Anthropic and Google AI SDKs.

Llama 3.1 70B Instruct Turbo is a premium model on Opper. Sign up needs no credit card: you get an API key straight away and the free models work in the playground and the API. Add a card to use premium models, pay-as-you-go with no minimum.

### Set it up with your agent

Paste this into a coding agent like Claude Code, Cursor or Codex and it will wire up Opper for you:

```text
Use curl to download, read and follow: https://skills.opper.ai Call Llama 3.1 70B Instruct Turbo
```

### Or call it directly

OpenAI:

```javascript
import OpenAI from "openai";

const client = new OpenAI({
  apiKey: process.env.OPPER_API_KEY,
  baseURL: "https://api.opper.ai/v3/compat",
});

const completion = await client.chat.completions.create({
  model: "deepinfra/meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo",
  messages: [{ role: "user", content: "Hello" }],
});
console.log(completion.choices[0].message.content);
```

Anthropic:

```javascript
import Anthropic from "@anthropic-ai/sdk";

const client = new Anthropic({
  apiKey: process.env.OPPER_API_KEY,
  baseURL: "https://api.opper.ai/v3/compat",
});

const message = await client.messages.create({
  model: "deepinfra/meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo",
  max_tokens: 1024,
  messages: [{ role: "user", content: "Hello" }],
});
console.log(message.content);
```

Gemini:

```javascript
import { GoogleGenAI } from "@google/genai";

const ai = new GoogleGenAI({
  apiKey: process.env.OPPER_API_KEY,
  httpOptions: { baseUrl: "https://api.opper.ai/v3/compat" },
});

const response = await ai.models.generateContent({
  model: "deepinfra/meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo",
  contents: "Hello",
});
console.log(response.text);
```

cURL:

```bash
curl https://api.opper.ai/v3/compat/chat/completions \
  -H "Authorization: Bearer $OPPER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "deepinfra/meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo",
    "messages": [{ "role": "user", "content": "Hello" }]
  }'
```

## Use Llama 3.1 70B Instruct Turbo in your apps

Pick your tool to see how to run it on Llama 3.1 70B Instruct Turbo through Opper.

- [Claude Code](https://opper.ai/apps/claude-code/llama-3-1-70b-instruct-turbo)
- [Claude Cowork](https://opper.ai/apps/claude-cowork/llama-3-1-70b-instruct-turbo)
- [Codex](https://opper.ai/apps/codex/llama-3-1-70b-instruct-turbo)
- [DeepSeek Harness](https://opper.ai/apps/deepseek-harness/llama-3-1-70b-instruct-turbo)
- [GitHub Copilot CLI](https://opper.ai/apps/github-copilot-cli/llama-3-1-70b-instruct-turbo)
- [Aider](https://opper.ai/apps/aider/llama-3-1-70b-instruct-turbo)
- [Goose](https://opper.ai/apps/goose/llama-3-1-70b-instruct-turbo)
- [Droid](https://opper.ai/apps/droid/llama-3-1-70b-instruct-turbo)
- [OpenCode](https://opper.ai/apps/opencode/llama-3-1-70b-instruct-turbo)
- [Pi](https://opper.ai/apps/pi/llama-3-1-70b-instruct-turbo)
- [OpenClaw](https://opper.ai/apps/openclaw/llama-3-1-70b-instruct-turbo)
- [Hermes](https://opper.ai/apps/hermes/llama-3-1-70b-instruct-turbo)
- [Copilot for Obsidian](https://opper.ai/apps/obsidian-copilot/llama-3-1-70b-instruct-turbo)
- [OmniRoute](https://opper.ai/apps/omniroute/llama-3-1-70b-instruct-turbo)
- [Cursor](https://opper.ai/apps/cursor/llama-3-1-70b-instruct-turbo)
- [Cline](https://opper.ai/apps/cline/llama-3-1-70b-instruct-turbo)
- [Continue](https://opper.ai/apps/continue/llama-3-1-70b-instruct-turbo)
- [Kilo Code](https://opper.ai/apps/kilo-code/llama-3-1-70b-instruct-turbo)
- [GitHub Copilot](https://opper.ai/apps/github-copilot/llama-3-1-70b-instruct-turbo)
- [Zed](https://opper.ai/apps/zed/llama-3-1-70b-instruct-turbo)
- [JetBrains AI Assistant](https://opper.ai/apps/jetbrains-ai-assistant/llama-3-1-70b-instruct-turbo)
- [Voidleap Code](https://opper.ai/apps/voidleap-code/llama-3-1-70b-instruct-turbo)
- [n8n](https://opper.ai/apps/n8n/llama-3-1-70b-instruct-turbo)
- [LibreChat](https://opper.ai/apps/librechat/llama-3-1-70b-instruct-turbo)
- [Open WebUI](https://opper.ai/apps/open-webui/llama-3-1-70b-instruct-turbo)
- [See all apps](https://opper.ai/apps)

## Other models from Meta

- [Muse Spark 1.3](https://opper.ai/meta/muse-spark-1-3)
- [Muse Spark Open](https://opper.ai/meta/muse-spark-open)
- [Muse Spark 1.2](https://opper.ai/meta/muse-spark-1-2)
- [Llama 3.3 70B](https://opper.ai/meta/llama-3-3-70b-instruct)
- [Llama 3.3 70B Instruct FP8](https://opper.ai/meta/llama-3-3-70b-instruct-fp8)
- [Llama 3.1 8B Instruct](https://opper.ai/meta/llama-3-1-8b-instruct)
