When was Hermes 3 Llama 3.1 70B released?

Nous Research released Hermes 3 Llama 3.1 70B on 15 Aug 2024. It is available through the Opper gateway.

Does Hermes 3 Llama 3.1 70B support zero data retention?

Yes. Hermes 3 Llama 3.1 70B is available with zero data retention on DeepInfra through the Opper gateway.

Where is Hermes 3 Llama 3.1 70B hosted?

Hermes 3 Llama 3.1 70B runs on US hosting routes through the Opper gateway.

Is Hermes 3 Llama 3.1 70B trained on prompts and outputs?

No. Every hosting route for Hermes 3 Llama 3.1 70B is configured so customer prompts and outputs are not used to train models by default.

Is a GDPR DPA available for Hermes 3 Llama 3.1 70B?

Yes. A GDPR Data Processing Agreement is available on at least one route serving Hermes 3 Llama 3.1 70B. Contact hello@opper.ai to receive it.

Hermes 3 Llama 3.1 70B

by Nous Research

All Nous Research releases

Hermes 3 70B is a fine-tune of Llama 3.1 70B that delivers Nous Research's agentic capabilities at a more deployable scale than the 405B model. With a 131,072 token context window, it supports extended multi-turn conversations and long-form reasoning while keeping strong function calling and structured output support for tool-use applications. Built through fine-tuning on high-quality instruction data, Hermes 3 70B is positioned as competitive, if not superior, to Llama 3.1 Instruct on general tasks, with particular gains in roleplaying, multi-turn dialogue coherence, and reasoning. The model uses the ChatML prompt format and supports function calling within assistant turns. This model suits teams balancing capability against compute cost, especially for agentic systems, content generation that needs consistency over long contexts, and reasoning workloads where 70B parameters are sufficient. It works with common OpenAI-compatible serving stacks including vLLM and SGLang.

Call Hermes 3 Llama 3.1 70B on Opper with the OpenAI SDK. Sign up without a credit card. Get started

Get your API key Try in chat Compare

Key info

Input

Output

Features

Context window

131K

Max output

131K

Input price

$0.70 /1M

Output price

$0.70 /1M

Released

15 Aug 2024

US residency available
Zero data retention on pay-as-you-go
No training by default
GDPR DPA available

Available routes

Hermes 3 Llama 3.1 70B runs on 1 route through the Opper gateway. Compare residency, zero data retention and training posture at a glance, with full data-handling detail per route below.

Provider	Region	Zero data retention	Training	Input	Output	Cache read
DeepInfra	US		No	$0.70	$0.70	Input price

Uptime and availability

Hermes 3 Llama 3.1 70B runs on a single route through the Opper gateway today, so its availability is that provider's availability.

100%route uptime, last 30 days

Single route, no failover target within this model.

Name a second model in the same request and the gateway tries it on retriable errors, so a busy hour never has to reach your users. Set up a fallback chain.

Measured over the last 30 days from each provider's official status feed via StatusGator. Refreshed hourly. See uptime for every provider Opper monitors.

Data handling per route

Each route hosting Hermes 3 Llama 3.1 70B has its own privacy posture, residency, and GDPR terms. Postures are maintained by Opper with a last-verification timestamp.

DeepInfra — United States🇺🇸

Zero data retention: nothing is logged, held for abuse monitoring or used for training. No training on customer data. US; unknown; DPA available.

Zero data retention: Yes. Nothing is logged, held for abuse monitoring or used for training.
Training: No training on customer data.
Logging: None
Abuse monitoring: No classifier
GDPR DPA: DPA available
Transfer mechanism: unknown

Benchmarks

Independent benchmark scores — composite indices for reasoning, coding, and math, plus individual eval scores where available.

Global rank#573 of 676 LLMs

TierEfficient

Intelligence Index6.0

Reasoning & knowledge

MMLU-Pro

57%

GPQA Diamond

40%

Humanity's Last Exam

Coding

LiveCodeBench

19%

See full leaderboard →Benchmarks via Artificial Analysis · View on AA

Get started

Call Hermes 3 Llama 3.1 70B through the Opper gateway with one API key. Opper is drop-in compatible with the OpenAI, Anthropic and Google AI SDKs.

Hermes 3 Llama 3.1 70B is a premium model on Opper. Sign up needs no credit card: you get an API key straight away and the free models work in the playground and the API. Add a card to use premium models, pay-as-you-go with no minimum.

Set it up with your agent

Copy this and paste it into a coding agent like Claude Code, Cursor or Codex and it'll wire up Opper for you.

Or call it directly

1import OpenAI from "openai";
2
3const client = new OpenAI({
4  apiKey: process.env.OPPER_API_KEY,
5  baseURL: "https://api.opper.ai/v3/compat",
6});
7
8const completion = await client.chat.completions.create({
9  model: "deepinfra/NousResearch/Hermes-3-Llama-3.1-70B",
10  messages: [{ role: "user", content: "Hello" }],
11});
12console.log(completion.choices[0].message.content);