Hermes 2 Pro Llama 3 8B

by Nous Research

Hermes 2 Pro is an 8 billion parameter model built on Meta's Llama 3, designed for developers building tool-using and agentic systems. The model reaches 90% on Nous Research's function calling evaluation, built in partnership with Fireworks.AI, and 84% on its structured JSON output evaluation, enabling reliable schema-constrained generation. Training combined an updated and cleaned OpenHermes 2.5 dataset with a newly introduced function-calling and JSON-mode dataset, using DPO and RLHF techniques. The model uses the ChatML prompt format and adds dedicated agentic tokens (<tools>, <tool_call>, <tool_response>), making it well suited to structured, multi-turn agent workflows. With an 8,192 token context window and general assistant capabilities alongside tool use, Hermes 2 Pro fills the niche between smaller models lacking agentic features and larger models, offering a practical balance for production systems.

Key info

Input
Output
Features
Context window
8K
Max output
8K
Input price
$0.14 /1M
Output price
$0.14 /1M
  • US residency available
  • Zero data retention via Enterprise
  • No training by default
  • GDPR DPA available

Available routes

Hermes 2 Pro Llama 3 8B runs on 1 route through the Opper gateway. Compare residency, ZDR, and training posture at a glance β€” full data-handling detail per route below.

ProviderRegionZero data retentionTrainingInputOutput
NovitaUSEnterpriseNo$0.14$0.14

Training posture across routes: No training on prompts by default.

Data handling per route

Each route hosting Hermes 2 Pro Llama 3 8B has its own privacy posture, residency, and GDPR terms. Postures are maintained by Opper with a last-verification timestamp.

Novita β€” United StatesπŸ‡ΊπŸ‡Έ

Zero data retention is available via Opper Enterprise contract. No training on customer data. US; SCCs; DPA available.

Zero data retention
Available via Opper Enterprise contract.
Training
No training on customer data.
Logging
Abuse monitoring
Third-party access
None disclosed
GDPR DPA
DPA available
Transfer mechanism
SCCs

Get started

Call Hermes 2 Pro Llama 3 8B through the Opper gateway with one API key. Let your coding agent set it up, or call it directly β€” Opper is drop-in compatible with the OpenAI, Anthropic, and Google AI SDKs.

Set it up with your agent

Copy this and paste it into your coding agent β€” Claude Code, Cursor, Codex, and more β€” and it'll wire up Opper for you.

Or call it directly

import OpenAI from "openai";
const client = new OpenAI({
apiKey: process.env.OPPER_API_KEY,
baseURL: "https://api.opper.ai/v3/compat",
});
const completion = await client.chat.completions.create({
model: "novita/nousresearch/hermes-2-pro-llama-3-8b",
messages: [{ role: "user", content: "Hello" }],
});
console.log(completion.choices[0].message.content);

Compare Hermes 2 Pro Llama 3 8B with…

Side-by-side on privacy, EU hosting, pricing, and benchmarks.

Other models from Nous Research

Start building with 300+ models

One API key. Every major provider. Up and running in minutes.

Get startedView Documentation
Hermes 2 Pro Llama 3 8B by Nous Research β€” pricing, benchmarks | Opper AI