Inkling NVFP4

by Thinking Machines

Inkling NVFP4 is the 4-bit NVFP4 quantization of Inkling, the from-scratch model Thinking Machines Lab published on July 15, 2026 under Apache 2.0. Underneath is a 66-layer decoder-only Mixture-of-Experts transformer with 975 billion total and 41 billion active parameters, where each token is handled by 6 routed experts out of 256 alongside 2 shared ones. Pretraining covered 45 trillion tokens spanning text, image, audio, and video, and the model takes text, images, and 16 kHz audio (ideally under 20 minutes) as input, generating text across a context window of up to 1 million tokens. Thinking effort is adjustable, and the lab's efficiency pitch is that Inkling reaches a given score with fewer output tokens than comparable models, for instance landing level with Nemotron 3 Ultra on Terminal-Bench 2.1 while spending about a third as many tokens. Published results include 97.1% on AIME 2026, 87.2% on GPQA Diamond, 77.6% on SWE-bench Verified, 63.8% on Terminal-Bench 2.1, 73.5% on MMMU Pro, and 91.4% on VoiceBench. Thinking Machines does not claim the top spot for Inkling and instead pitches it as an open base to customize, with fine-tuning on its Tinker platform available from day one. The NVFP4 checkpoint brings the aggregate memory requirement down from at least 2 TB in BF16 to about 600 GB, enough to run on 4 B300 or 8 H200 GPUs, which is what makes a model this size deployable on a single eight-GPU system.

Call Inkling NVFP4 on Opper with the OpenAI SDK. Sign up without a credit card. Get started

Key info

Input
Output
Features
Context window
1M
Max output
262K
Input price
$1.20 /1M$0.27 cache read
Output price
$5.00 /1M
  • Zero data retention on pay-as-you-go
  • No training by default
  • GDPR DPA available

Available routes

Inkling NVFP4 runs on 1 route through the Opper gateway. Compare residency, zero data retention and training posture at a glance, with full data-handling detail per route below.

ProviderRegionZero data retentionTrainingInputOutputCache read
MultiNo (opt-in)$1.20$5.00$0.27

Data handling per route

Each route hosting Inkling NVFP4 has its own privacy posture, residency, and GDPR terms. Postures are maintained by Opper with a last-verification timestamp.

Modal — Multi-region

Zero data retention: nothing is logged, held for abuse monitoring or used for training. No training by default; opt-in possible. GLOBAL; SCCs; DPA available.

Zero data retention
Yes. Nothing is logged, held for abuse monitoring or used for training.
Training
No training by default; opt-in possible.
Logging
None
Abuse monitoring
No classifier
Caching
Content cached for replay
GDPR DPA
DPA available
Transfer mechanism
SCCs

Get started

Call Inkling NVFP4 through the Opper gateway with one API key. Opper is drop-in compatible with the OpenAI, Anthropic and Google AI SDKs.

Inkling NVFP4 is a premium model on Opper. Sign up needs no credit card: you get an API key straight away and the free models work in the playground and the API. Add a card to use premium models, pay-as-you-go with no minimum.

Set it up with your agent

Copy this and paste it into a coding agent like Claude Code, Cursor or Codex and it'll wire up Opper for you.

Or call it directly

import OpenAI from "openai";
const client = new OpenAI({
apiKey: process.env.OPPER_API_KEY,
baseURL: "https://api.opper.ai/v3/compat",
});
const completion = await client.chat.completions.create({
model: "modal/inkling-nvfp4",
messages: [{ role: "user", content: "Hello" }],
});
console.log(completion.choices[0].message.content);

Use Inkling NVFP4 in your apps

Pick your tool to see how to run it on Inkling NVFP4 through Opper.

Compare Inkling NVFP4 with…

Side-by-side on privacy, EU hosting, pricing, and benchmarks.

Other models from Thinking Machines

Start building with 700+ models

One API key. Every major provider. Up and running in minutes.

Get startedView Documentation