LPU-based inference — sub-100ms first-token latencies on open-weight models.
Groq's LPU architecture delivers some of the lowest first-token latencies in the industry across Llama, GPT-OSS, Whisper, and Qwen models. US-hosted; zero data retention is available on request via Opper Enterprise. The fast-path route for latency-sensitive applications — chat, agents, interactive tool use — where time-to-first-token is the critical metric.
Every model we route through Groq. Compare residency, ZDR, training posture, and price at a glance — full data-handling detail per route below.
| Model | Region | Zero data retention | Training | Context | Input | Output |
|---|---|---|---|---|---|---|
| US | Enterprise | No | 128K | $0.15 | $0.60 | |
| US | Enterprise | No | 128K | $0.07 | $0.30 | |
| US | Enterprise | No | 128K | $0.07 | $0.30 | |
| US | Enterprise | No | 128K | $0.11 | $0.34 | |
| US | Enterprise | No | 128K | $0.59 | $0.79 | |
| US | Enterprise | No | 128K | $0.05 | $0.08 | |
| US | Enterprise | No | 131K | $0.29 | $0.59 | |
| US | Enterprise | No | 256K | $1.00 | $3.00 | |
| US | Enterprise | No | 128K | $1.00 | $3.00 |
Groq hosts on 1 route. Each route has its own privacy posture, residency, and GDPR terms. Postures are maintained by Opper with a last-verification timestamp.
Zero data retention is available via Opper Enterprise contract. No training on customer data. US; SCCs; DPA available.
