Modality: llm_chat · full deep dive — every ranked model, test result, and artifact.
Ranked by confidence-adjusted score (single/zero-sample, non-curated scores floored; curated empirical scores trusted as-is).
| # | Model | Provider | Adj. Score | Raw | Evidence |
|---|---|---|---|---|---|
| 1 | gpt-5.5::think=deep | codex | 0.525 | 0.963 | n=6 |
| 2 | gpt-5.5::think=fast | codex | 0.525 | 0.963 | n=6 |
| 3 | gemini-2.5-flash | google_gemini | 0.455 | 0.500 | n=50 |
| 4 | claude-haiku-4-5-20251001 | anthropic | 0.455 | 0.500 | n=50 |
| 5 | gpt-5.4-mini | codex | 0.150 | 1.000 | provisional (n≤1) |
| 6 | gpt-6-astra | codex | 0.142 | 0.950 | provisional (n≤1) |
| 7 | gpt-reserve | codex | 0.142 | 0.950 | provisional (n≤1) |
| 8 | gpt-5.6-sol | codex | 0.142 | 0.950 | provisional (n≤1) |
| 9 | gpt-5.6-terra | codex | 0.142 | 0.950 | provisional (n≤1) |
| 10 | gpt-5.6-luna | codex | 0.142 | 0.950 | provisional (n≤1) |
| 11 | gpt-5.5 | codex | 0.134 | 0.895 | provisional (n≤1) |
| 12 | claude-haiku-4-5-20251001 | claude_code | 0.000 | 0.000 | n=50 |
No benchmark outputs recorded for this niche yet.