Game benchmarks
Decision model benchmarks
Games and apps where AI decision models play in real time. See how each model ranks, watch them play, or play against them.
Games
JevMan
Pac-Man against the four arcade ghosts. Watch each model's game, or play against them.
21 models ranked · high score 30,480
Opper · AGPL-3.0
Jev Cards
A picture quiz against Jev, a vision decision model: race it through 800 cards on speed, accuracy or a streak. Can you beat it?
Play against an AI · high score 10,338
by @Jose-Sabater · AGPL-3.0
Jev Fighter
Stick figures fight and a decision model picks every move. Fight one yourself: are you better than it?
Play against an AI
by @Jose-Sabater · MIT
Snake
Which AI plays Snake best? Decision models steer a snake in real time on seeded boards, and you can play on their clock to see where you'd rank.
8 models ranked · high score 41 apples
Opper · MITSuggest a game
Built a game decision models can play? Suggest it and we host it here, with credit to you.
Model leaderboard
How each decision model ranks on every game, from our own runs and self-reported ones.
Updated Oct 28, 2026| # | Model | JevManRank · Mean score | SnakeRank · Mean apples | Avg rank | Run by |
|---|---|---|---|---|---|
| 1 | jev 1.13TypeSafe AI | 8 2,750 | 2 37.9 apples | 5.0 | @opper-ai |
| 2 | GPT-6 LunaOpenAI | 10 2,568 | 1 48.8 apples | 5.5 | @opper-ai |
| 3 | Clef FlashCloudflare | 11 2,538 | 5 9.9 apples | 8.0 | @opper-ai |
| 4 | Microsoft Decision 1Microsoft | 13 2,390 | 4 20.1 apples | 8.5 | @opper-ai |
| 5 | ClefCloudflare | 12 2,476 | 6 7 apples | 9.0 | @opper-ai |
| 6 | Aplomb 1EmpirioLabs | 16 1,693 | 3 25.1 apples | 9.5 | @opper-ai |
| 7 | Kev 4B | 17 1,506 | 7 6.7 apples | 12.0 | @opper-ai |
| 8 | LayaConvAI Innovations | 21 639 | 8 0.3 apples | 14.5 | @opper-ai |
| 9 | jev 1.14TypeSafe AI | =1 3,597 | – | – | @opper-ai |
| 10 | Eevo-1.1 | =1 3,416 | – | – | @opper-ai |
| 11 | SemIfCommunity | =1 3,210 | – | – | @seiggy |
| 12 | ModernBERT-jevCommunity | 4 3,180 | – | – | @KSonny4 |
| 13 | Nimble v4 MaxBespoke Labs | 5 3,103 | – | – | @opper-ai |
| 14 | Perplexity Decider 1.2Perplexity | 6 3,100 | – | – | @opper-ai |
| 15 | Eevo-1 | 7 3,004 | – | – | @opper-ai |
| 16 | RizzoFlowCommunity | 9 2,675 | – | – | @seiggy |
| 17 | Winnow-12B NVFP4Community | 14 2,368 | – | – | @theogravity |
| 18 | Perplexity Decider Flash 1.2Perplexity | 15 2,088 | – | – | @opper-ai |
| 19 | d1-3BCommunity | 18 1,068 | – | – | @theogravity |
| 20 | Clef Omni | 19 1,026 | – | – | @opper-ai |
| 21 | VonCommunity | 20 984 | – | – | @seiggy |
| Qwen 3.8 Flash Next NVFP4Community | 2,725 | – | – | @theogravity | |
| Random (die roll)Community | 1,037 | – | – | @seiggy |
Each game's column shows a model's rank there and its mean over all its games (100 for our runs). =1 means too close to call: within the margin of error. Chat and Base rows are a chat model and a baseline, shown at their score for reference and not ranked. Self-reported runs are replayed by each game's CI, which recomputes every score. – means not run on that game yet.
Benchmark your model
Every benchmark takes model submissions by pull request. Run it against your own endpoint; CI replays your games and checks every score.
Read the guide →- 1
Put your model behind an endpoint
Any model that can answer the game's questions: a local model, TypeSafe, Opper or your own server.
node --import tsx scripts/example-endpoint.ts - 2
Run the benchmark
At least 24 games with fixed seeds. The bench records every one of them.
npm run bench -- --endpoint http://localhost:8787 --submit submissions/my-model --name "My Model" --by your-github-handle --kind decision - 3
Open a pull request
CI replays every game and recomputes the score. Your model joins the leaderboard as self-reported.
submissions/my-model/
Built a game decision models can play?
Suggest it. If it fits, we port it with your OK, host it here, run every model on it and credit you.