Modality: llm_chat · full deep dive — every ranked model, test result, and artifact.
Ranked by confidence-adjusted score (single/zero-sample, non-curated scores floored; curated empirical scores trusted as-is).
| # | Model | Provider | Adj. Score | Raw | Evidence |
|---|---|---|---|---|---|
| 1 | deepseek-chat | deepseek | 0.994 | 1.000 | n=819 |
| 2 | gpt-4o-mini | openai | 0.987 | 0.992 | n=1068 |
| 3 | claude-sonnet-4-5-20250929 | anthropic | 0.875 | 1.000 | n=35 |
| 4 | claude-sonnet-4-6 | claude_desktop | 0.773 | 0.850 | n=50 |
| 5 | claude-sonnet-4-6 | anthropic | 0.722 | 1.000 | n=13 |
| 6 | claude-sonnet-4-6::think=fast | claude_code | 0.545 | 1.000 | n=6 |
| 7 | claude-sonnet-4-6::think=deep | claude_code | 0.545 | 1.000 | n=6 |
| 8 | gpt-5.5::think=deep | codex | 0.525 | 0.963 | n=6 |
| 9 | gpt-5.5::think=fast | codex | 0.525 | 0.963 | n=6 |
| 10 | claude-haiku-4-5-20251001 | anthropic | 0.500 | 0.550 | n=50 |
| 11 | claude-opus-4-7::think=fast | claude_code | 0.477 | 0.875 | n=6 |
| 12 | claude-opus-4-7::think=deep | claude_code | 0.477 | 0.875 | n=6 |
| 13 | gpt-4o | openai | 0.456 | 0.456 | curated |
| 14 | gemini-2.5-flash | google_gemini | 0.455 | 0.500 | n=50 |
| 15 | sonar | perplexity | 0.444 | 1.000 | n=4 |
| 16 | claude-opus-4-8::think=fast | claude_code | 0.430 | 0.788 | n=6 |
| 17 | gpt-5.3-codex-spark::think=deep | codex | 0.382 | 0.700 | n=6 |
| 18 | claude-opus-4-8::think=deep | claude_code | 0.382 | 0.700 | n=6 |
| 19 | gpt-5.4::think=fast | codex | 0.334 | 0.612 | n=6 |
| 20 | gpt-5.4::think=deep | codex | 0.334 | 0.612 | n=6 |
| 21 | codex-auto-review | codex | 0.286 | 0.525 | n=6 |
| 22 | gpt-5.3-codex-spark::think=fast | codex | 0.286 | 0.525 | n=6 |
| 23 | gpt-5.4 | codex | 0.150 | 1.000 | provisional (n≤1) |
| 24 | gpt-5.5 | codex | 0.150 | 1.000 | provisional (n≤1) |
| 25 | claude-sonnet-4-5-20250929 | claude_code | 0.143 | 0.951 | provisional (n≤1) |
| 26 | claude-opus-4-6 | claude_code | 0.130 | 0.870 | provisional (n≤1) |
| 27 | claude-opus-4-1-20250805 | claude_code | 0.130 | 0.869 | provisional (n≤1) |
| 28 | gemini-3.1-pro | gemini | 0.120 | 0.800 | provisional (n≤1) |
| 29 | antigravity:gemini-2.5-pro | antigravity | 0.117 | 0.780 | provisional (n≤1) |
| 30 | claude-opus-4-20250514 | claude_code | 0.113 | 0.751 | provisional (n≤1) |
| 31 | claude-sonnet-4-20250514 | claude_code | 0.111 | 0.737 | provisional (n≤1) |
| 32 | claude-opus-4-5-20251101 | claude_code | 0.109 | 0.725 | provisional (n≤1) |
| 33 | antigravity:gemini-2.5-flash | antigravity | 0.105 | 0.700 | provisional (n≤1) |
| 34 | antigravity:gemini-2.0-flash-thinking | antigravity | 0.105 | 0.700 | provisional (n≤1) |
| 35 | claude-opus-4-8 | claude_code | 0.083 | 0.555 | provisional (n≤1) |
| 36 | claude-sonnet-4-6 | claude_code | 0.037 | 0.247 | provisional (n≤1) |
| 37 | claude-opus-4-7 | claude_code | 0.025 | 0.168 | provisional (n≤1) |
| 38 | gpt-5.3-codex-spark | codex | 0.016 | 0.105 | provisional (n≤1) |
| 39 | gemini-2.5-pro | google_gemini | 0.000 | 0.002 | provisional (n≤1) |
| 40 | gpt-5.4-mini | codex | 0.000 | 0.000 | n=50 |
| 41 | claude-haiku-4-5-20251001 | claude_code | 0.000 | 0.000 | n=50 |
| 42 | copilot:gpt-4o | github_copilot | 0.000 | 0.000 | provisional (n≤1) |
| 43 | copilot:gpt-4o-mini | github_copilot | 0.000 | 0.000 | provisional (n≤1) |
| 44 | copilot:claude-3.5-sonnet | github_copilot | 0.000 | 0.000 | provisional (n≤1) |
| 45 | copilot:claude-3.7-sonnet | github_copilot | 0.000 | 0.000 | provisional (n≤1) |
| 46 | copilot:gemini-1.5-pro | github_copilot | 0.000 | 0.000 | provisional (n≤1) |
| 47 | copilot:gemini-2.0-flash | github_copilot | 0.000 | 0.000 | provisional (n≤1) |
| 48 | copilot:o1 | github_copilot | 0.000 | 0.000 | provisional (n≤1) |
| 49 | copilot:o3-mini | github_copilot | 0.000 | 0.000 | provisional (n≤1) |
No benchmark outputs recorded for this niche yet.
Requests semantically routed into this niche.
| Requested | Method | Confidence | When |
|---|---|---|---|
educational_chat | semantic | 0.593 | 2026-05-21 23:38 |
educational_chat | semantic | 0.593 | 2026-05-21 23:38 |
educational_chat | semantic | 0.593 | 2026-05-21 23:38 |
educational_chat | semantic | 0.593 | 2026-05-21 23:37 |
educational_chat | semantic | 0.593 | 2026-05-21 23:37 |
educational_chat | semantic | 0.593 | 2026-05-21 23:37 |
educational_chat | semantic | 0.593 | 2026-05-21 18:01 |
educational_chat | semantic | 0.593 | 2026-05-21 17:57 |
educational_chat | semantic | 0.593 | 2026-05-21 17:57 |
educational_chat | semantic | 0.593 | 2026-05-21 17:56 |
educational_chat | semantic | 0.593 | 2026-05-21 17:56 |
educational_chat | semantic | 0.593 | 2026-05-21 17:55 |
educational_chat | semantic | 0.593 | 2026-05-21 17:48 |
educational_chat | semantic | 0.593 | 2026-05-21 17:48 |
educational_chat | semantic | 0.593 | 2026-05-20 21:35 |
educational_chat | semantic | 0.593 | 2026-05-20 21:35 |
educational_chat | semantic | 0.593 | 2026-05-20 21:35 |
educational_chat | semantic | 0.593 | 2026-05-20 21:02 |
educational_chat | semantic | 0.593 | 2026-05-20 21:02 |
educational_chat | semantic | 0.593 | 2026-05-20 21:01 |