Modality: llm_chat · full deep dive — every ranked model, test result, and artifact.
Ranked by confidence-adjusted score (single/zero-sample, non-curated scores floored; curated empirical scores trusted as-is).
| # | Model | Provider | Adj. Score | Raw | Evidence |
|---|---|---|---|---|---|
| 1 | claude-sonnet-4-6 | claude_desktop | 0.773 | 0.850 | n=50 |
| 2 | claude-sonnet-4-6::think=fast | claude_code | 0.545 | 1.000 | n=6 |
| 3 | claude-sonnet-4-6::think=deep | claude_code | 0.545 | 1.000 | n=6 |
| 4 | gpt-5.5::think=deep | codex | 0.525 | 0.963 | n=6 |
| 5 | gpt-5.5::think=fast | codex | 0.525 | 0.963 | n=6 |
| 6 | claude-opus-4-7::think=fast | claude_code | 0.477 | 0.875 | n=6 |
| 7 | claude-opus-4-7::think=deep | claude_code | 0.477 | 0.875 | n=6 |
| 8 | claude-opus-4-8::think=fast | claude_code | 0.430 | 0.788 | n=6 |
| 9 | claude-haiku-4-5-20251001 | anthropic | 0.426 | 0.426 | n=13591 |
| 10 | gpt-5.3-codex-spark::think=deep | codex | 0.382 | 0.700 | n=6 |
| 11 | claude-opus-4-8::think=deep | claude_code | 0.382 | 0.700 | n=6 |
| 12 | gpt-5.4::think=fast | codex | 0.334 | 0.612 | n=6 |
| 13 | gpt-5.4::think=deep | codex | 0.334 | 0.612 | n=6 |
| 14 | codex-auto-review | codex | 0.286 | 0.525 | n=6 |
| 15 | gpt-5.3-codex-spark::think=fast | codex | 0.286 | 0.525 | n=6 |
| 16 | gpt-5.4 | codex | 0.150 | 1.000 | provisional (n≤1) |
| 17 | gpt-5.5 | codex | 0.150 | 1.000 | provisional (n≤1) |
| 18 | claude-sonnet-4-5-20250929 | claude_code | 0.119 | 0.796 | provisional (n≤1) |
| 19 | claude-opus-4-1-20250805 | claude_code | 0.107 | 0.716 | provisional (n≤1) |
| 20 | claude-opus-4-6 | claude_code | 0.101 | 0.675 | provisional (n≤1) |
| 21 | claude-sonnet-4-20250514 | claude_code | 0.096 | 0.643 | provisional (n≤1) |
| 22 | claude-opus-4-20250514 | claude_code | 0.092 | 0.612 | provisional (n≤1) |
| 23 | claude-opus-4-5-20251101 | claude_code | 0.089 | 0.596 | provisional (n≤1) |
| 24 | claude-opus-4-8 | claude_code | 0.065 | 0.436 | provisional (n≤1) |
| 25 | gemini-2.5-flash | google_gemini | 0.063 | 0.063 | n=8321 |
| 26 | gpt-5.3-codex-spark | codex | 0.043 | 0.286 | provisional (n≤1) |
| 27 | claude-sonnet-4-6 | claude_code | 0.030 | 0.203 | provisional (n≤1) |
| 28 | claude-opus-4-7 | claude_code | 0.019 | 0.130 | provisional (n≤1) |
| 29 | gemini-2.5-pro | google_gemini | 0.017 | 0.017 | n=8006 |
No benchmark outputs recorded for this niche yet.