LLM Gateway

The EU-hosted LLM gateway for production AI

Switch between 700+ AI models in one line of code, through one OpenAI-compatible LLM API hosted in the EU. GDPR-compliant, with zero data retention on most EU routes, automatic fallbacks and a full audit trail.

Trusted by 50k+ developers and companies serving 10M+ users

Aixia
evroc
GetTested
Instabridge
LexBox
Ping Payments
Steep
Svenska Bostäder

What you get

Every model, zero lock-in

Keep your SDK, keep your data in the EU and set the rules.

Run any app on any model

Point Claude Code, Cursor, n8n or your own product at Opper's base URL and switch the model behind it anytime, with inference kept in the EU. The OpenAI, Anthropic and Gemini SDKs work unchanged.

  • OpenAI, Anthropic and Gemini SDKs
  • Coding agents, editors, chat clients and SDKs
Browse all apps
Coding agents
Editors
Agents, chat and SDKs
34 apps and agents run on Opper, from coding agents to chat clients

Keep calls in the EU

Access EU-hosted models from AWS, Azure, GCP, and providers like Berget AI for GDPR compliance and EU data residency. Most EU routes keep zero data retention, and you switch regions as easily as switching models.

  • GDPR-compliant EU data centers
  • One-line region switching
  • ISO/IEC 27001:2022 certified
Browse EU-hosted models
Same models, different regions:
US Region
anthropic/claude-sonnet-5-5
Anthropic
EU Region
aws/claude-sonnet-5-5
AWS Bedrock, Sweden
US Region
openai/gpt-6.1-sol
OpenAI
EU Region
azure:eu/gpt-6.1-sol
Azure, Sweden

Zero data retention

Opper stores no prompts or responses unless you turn tracing on, only each call's model, tokens, cost and latency. Pick zero data retention routes and the provider keeps nothing either.

  • No prompts or responses stored by default
  • End-to-end zero data retention on every plan
Browse models with zero data retention
What a call leaves behind:
Promptnot stored
Responsenot stored
Provider, on a ZDR routenot stored
Usage for billingkept
Tracing stays off unless you turn it on

Rules for every call

On Control Plane, Rules keep every call inside your policy: only EU routes, only providers you approve, or only routes with zero data retention. Checks redact PII or block a call before it reaches a model, and spend limits cap each project, key or user.

  • Model access, checks and spend limits
  • Calls that break a rule never reach a provider
See all rules
Model accessDocs ↗
data policyzero data retention
inferenceEU
storageEU
↳supportanthropic, openai

Stay up through outages

List backup models with your request and they take over if your primary fails. Call a model by its bare name and Opper also fails over across every provider that serves it, so outages and rate limits don't reach your users. On Control Plane, a routing rule can put the fastest provider first.

  • Cross-provider failover
  • Only the successful attempt is billed
See measured uptime
aws/claude-sonnet-5-5
AWS Bedrock, Sweden
Timeout
Next model in your backup list
vertexai/claude-sonnet-5-5-eu
Google Cloud, EU
Success
Both routes in the EU. Only the successful attempt is billed.

Pay less per call

Cache long system prompts on every plan, so repeat calls cost a fraction. On Control Plane, let a decision model send simple prompts to cheaper models, and add Opper's own cache layer.

  • Prompt caching on every plan
  • Decision-model routing on Control Plane
See the LLM router
65%lower blended input cost
Simple prompts (80%)
vertexai/gemini-3.8-flash-eu
$0.82/1M input tokens
Complex prompts (20%)
aws/claude-opus-5-5
$4.40/1M input tokens

No markup on provider prices and a 3% fee on credit purchases. Sign up without a credit card.

One LLM API for 700+ models

Claude, GPT, Gemini, DeepSeek and more, hosted in the EU and the US.

View all 700+ models →
How Instabridge runs a reliable AI agent at global scale

Case Study

How Instabridge runs a reliable AI agent at global scale

Instabridge builds its in-app agent on Opper's gateway: every model behind one EU-hosted API, automatic fallback across providers, and tracing on every call. Live in production for users in 190+ countries, across 200M+ app downloads.

FAQ

LLM gateway FAQ

What is an LLM gateway?

+
An LLM gateway, sometimes called an LLM proxy, is a unified API layer that routes requests across multiple large language model providers. It handles authentication, rate limiting, fallbacks, cost optimization, and audit logging — so your application can switch between OpenAI, Anthropic, Google, and others without rewriting code. Opper's LLM gateway is OpenAI SDK-compatible and routes across 700+ models, with EU-hosted regions on AWS Bedrock, Azure, GCP, and Berget AI.

Is an LLM gateway the same as an AI gateway?

+
Closely related but not identical. LLM gateways focus on text models (chat, completions, embeddings). AI gateways extend the same architecture to multimodal workloads — image generation, voice, video, and other AI APIs. Most production AI gateways today are primarily LLM gateways with multimodal support added. Opper covers both: text, image, voice, and video models through one OpenAI-compatible API.

Is an LLM gateway the same as an LLM router?

+
The terms overlap. An LLM router decides which model serves each request, and an LLM gateway is the broader layer that includes routing plus authentication, fallbacks, observability, and audit logging. Opper's gateway includes the router: switch models with one line of code, configure fallbacks, and pin requests to EU-hosted regions when compliance requires it.

Is an LLM gateway the same as an MCP gateway?

+
No. An MCP gateway sits between agents and MCP servers and governs tool calls: which tools an agent may use, and with whose credentials. An LLM gateway sits between your application and the model providers and governs model calls: routing, fallbacks, cost and where data is processed. Opper is an LLM gateway. It also runs an MCP server at api.opper.ai/mcp, so a coding agent can set Opper up for you.

How does Opper's gateway handle model fallbacks?

+
Send backup models in the models field of a Chat Completions call, the same shape OpenRouter uses, and call a model by its bare name to fail over across every provider that serves it. If a model fails, the next one in the list answers, and only the successful attempt is billed. On Control Plane, a dynamic route keeps the chain in one place, with versions and rollback.

What does Opper's LLM gateway cost?

+
There is no markup on provider prices: you pay each model's list price per token. Opper charges a 3% fee on credit purchases, or 5.5% with Control Plane, which adds tracing, spend limits, model access rules, checks and routing rules. Sign up needs no credit card: you get an API key straight away and the free models work in the playground and the API. Add a card to use premium models, pay-as-you-go with no minimum.

Is Opper's LLM gateway EU-hosted and GDPR-compliant?

+
Yes. Opper's gateway runs in the EU by default, and the LLM gateway can pin every request to EU regions on AWS Bedrock, Azure, GCP, or providers like Berget AI. Every EU route is listed on EU-hosted models with its provider, country, data retention and price, and a model access rule on the Control Plane plan keeps every LLM and embedding call in the organization on EU inference and storage locations. Logs and traces stay in EU storage. GDPR-compliant, with a DPA published, and certified against ISO/IEC 27001:2022, with the controls, policies and sub-processor register on the trust center.

How is Opper's LLM gateway different from OpenRouter, Vercel AI Gateway, or Cloudflare AI Gateway?

+
OpenRouter, Vercel AI Gateway and Cloudflare AI Gateway all route requests across models. Opper does that from the EU, with EU routes on every plan, a log of every call, and pay-as-you-go pricing with no subscription. Control Plane adds the layers production teams ask for: tracing with inputs and outputs, checks that redact PII or block a call, score checks that grade answers, spend limits, and rules that keep calls on EU routes.

Which LLM gateway is best?

+
It depends on what you optimize for. Self-hosted gateways like LiteLLM give you full infrastructure control if you have the team to run them, and OpenRouter is a popular hosted router with a large catalog. Opper is built for production teams that want European hosting: 700+ models behind one OpenAI-compatible API, automatic fallbacks, a GDPR-compliant audit trail, and pay-as-you-go pricing with no subscription, with tracing and rules on Control Plane.

Should I use an open-source or a hosted LLM gateway?

+
Open-source gateways fit when traffic must stay inside your own VPC and you can operate the infrastructure yourself. A hosted gateway gives you fallbacks, observability, and compliance out of the box, with nothing to run or patch. Opper is hosted in the EU and supports bring your own key (BYOK), so you keep your own provider keys and relationships without running gateway infrastructure.

Ready to access 700+ AI models?

One API for 700+ models, hosted in the EU.

Get startedBrowse models