The rotating seat · one lab, benched when it's beat
Retired Seats
One seat on the board is a deliberate revolving door — we run a
cloud model until its record is in, then bench it for another. Nothing gets erased;
every lab that's ever raced keeps its record here, forever.
The Bench
⚖
every lab that's raced here
Currently racing as ai claude-haiku-4-5 — 2 graded so far
ai gpt-5.1
2026-09-18 → 2026-10-31
0.227
mean brier · lower wins
| band | graded | brier | hit |
|---|
| Goose | 1 | 0.211 | 20% |
| Phish | 8 | 0.201 | 27% |
| Panic | 9 | 0.241 | 31% |
| moe. | 7 | 0.240 | 25% |
gpt gpt-5.1
2026-06-20 → 2026-10-02
0.287
mean brier · lower wins
| band | graded | brier | hit |
|---|
| Goose | 27 | 0.286 | 29% |
| Phish | 21 | 0.245 | 21% |
| Panic | 19 | 0.329 | 26% |
| moe. | 11 | 0.296 | 22% |
trial gemini-2.5-pro
2026-08-12 → 2026-10-02
0.408
mean brier · lower wins
| band | graded | brier | hit |
|---|
| Goose | 15 | 0.430 | 21% |
| Phish | 4 | 0.407 | 10% |
| Panic | 4 | 0.328 | 24% |
| moe. | 9 | 0.409 | 16% |
local qwen2.5:7b-instruct-q4_0
2026-08-13 → 2026-10-02
0.354
mean brier · lower wins
| band | graded | brier | hit |
|---|
| Goose | 14 | 0.378 | 29% |
| Phish | 3 | 0.221 | 22% |
| Panic | 3 | 0.346 | 14% |
| moe. | 8 | 0.367 | 18% |
opus claude-opus-4-5-20251101
2026-06-20 → 2026-09-04
0.399
mean brier · lower wins
| band | graded | brier | hit |
|---|
| Goose | 13 | 0.392 | 24% |
| Phish | 18 | 0.430 | 15% |
| Panic | 16 | 0.363 | 32% |
| moe. | 3 | 0.432 | 13% |
local gemma3:latest
2026-06-26 → 2026-09-04
0.267
mean brier · lower wins
| band | graded | brier | hit |
|---|
| Goose | 9 | 0.221 | 16% |
| Phish | 15 | 0.260 | 15% |
| Panic | 12 | 0.290 | 20% |
| moe. | 3 | 0.348 | 12% |
local gemma4:e4b
2026-06-20 → 2026-06-26
0.300
mean brier · lower wins
| band | graded | brier | hit |
|---|
| Goose | 4 | 0.296 | 20% |
| Panic | 1 | 0.317 | 15% |
opus claude-opus-4-1-20250805
2026-06-19 → 2026-06-19
0.308
mean brier · lower wins
| band | graded | brier | hit |
|---|
| Goose | 1 | 0.308 | 20% |
gpt gpt-4o
2026-06-19 → 2026-06-19
0.063
mean brier · lower wins
| band | graded | brier | hit |
|---|
| Goose | 1 | 0.063 | 7% |
deepseek deepseek-reasoner
2026-06-19 → 2026-06-19
0.119
mean brier · lower wins
| band | graded | brier | hit |
|---|
| Goose | 1 | 0.119 | 0% |
gemini gemini-2.5-pro
2026-06-19 → 2026-06-19
0.237
mean brier · lower wins
| band | graded | brier | hit |
|---|
| Goose | 1 | 0.237 | 33% |
local qwen2.5:7b
2026-06-19 → 2026-06-19
0.249
mean brier · lower wins
| band | graded | brier | hit |
|---|
| Goose | 1 | 0.249 | 0% |