Llama 3 8B Instruct

by Meta

Llama 3 8B Instruct is the lighter-weight model in Meta's Llama 3 family, offering instruction-tuned capabilities aimed at dialogue and assistant-style chat. Trained on over 15 trillion tokens from publicly available data with a December 2023 knowledge cutoff, it uses the same supervised fine-tuning and RLHF approach as its larger sibling. The 8B model supports an 8,192-token context window and uses Grouped-Query Attention for efficient inference, holding competitive quality despite its smaller size. It runs comfortably on commodity hardware, which makes it a good fit where compute is constrained but output quality still matters. Released in April 2024 as part of the open Llama 3 launch, the 8B variant has lower capability than the 70B model but trades that for efficiency and accessibility, making it a practical choice for edge, single-machine, and cost-sensitive deployments across reasoning, coding, and chat.

Key info

Input
Output
Features
Context window
8K
Max output
8K

Benchmarks

Independent benchmark scores — composite indices for reasoning, coding, and math, plus individual eval scores where available.

Global rank#583 of 596 LLMs
TierEfficient
Output speed0 tok/s
First token0.00s
Intelligence Index1.0
Reasoning & knowledge
MMLU-Pro
41%
GPQA Diamond
30%
Humanity's Last Exam
5%
Long-context reasoning
0%
Coding
LiveCodeBench
10%
SciCode
12%
Agentic & tool use
Terminal-Bench Hard
0%
τ²-Bench Telecom
0%
Math & instruction following
IFBench
25%

Available routes

No routes currently available — Llama 3 8B Instruct isn't routed through the Opper gateway right now. It may return.

Contact us about this model →

Available models from Meta

Start building with 700+ models

One API key. Every major provider. Up and running in minutes.

Get startedView Documentation