OmniRoute logo

Run OmniRoute on Llama 3.1 70B Instruct

by Diego SouzaCoding agentomniroute.online

OmniRoute is an open-source gateway you run yourself: one endpoint in front of 350 providers, with quota-aware fallback, token compression, and MCP support, built for Claude Code, Codex, Cursor, OpenCode, Cline and Copilot. Opper is listed in its provider catalogue, so you paste your Opper key once under Providers and every agent you point at OmniRoute can pick from Opper's 700+ models, EU-hosted routes included, alongside whatever else you have configured.

RunOmniRoute logoOmniRouteonin

Connect OmniRoute to Llama 3.1 70B Instruct

Add Opper in OmniRoute

In OmniRoute (v3.8.51 or later), open Providers → API key providers, pick Opper and paste your key; on older builds add a custom OpenAI-compatible provider with base URL https://api.opper.ai/v3/compat. Then pick Llama 3.1 70B Instruct.

Model id
Get your API key

Where you can run it

Llama 3.1 70B Instruct runs on the routes below. Route only to EU providers when your data has to stay in Europe.

ProviderRegionZero data retentionTrainingInputOutputCache read
USNo$0.40$0.40Input price

The model

by Meta

Meta's Llama 3.1 70B Instruct: open-weight general-purpose model with a 131K context window, multilingual support, and tool calling for complex reasoning.

Available on

Pricing from$0.40/ 1M input$0.40/ 1M output131Kcontext

Privacy

ZDR
Training
No
Region
US

Run OmniRoute on other models

Step-by-step setup for running OmniRoute on each of these models through Opper.

More apps on Opper

Run OmniRoute on Llama 3.1 70B Instruct

One key, 700+ models, a choice of region, and zero data retention. Switch the model behind your app without changing your workflow.

Get startedView Documentation