How the official forecasts have actually done.
Confidence is the forecast probability and nothing else (probability × 100). "Model is N points higher/lower" describes disagreement with the market, not a recommendation or a stake. Forecasts are estimates, not guarantees.
356 official predictions decided so far.
Each row reads: what the model claimed, against what actually happened.
Confidence is the forecast probability, never edge. Each row is the picks whose stated probability fell in that bucket; pushes are excluded. THIN marks fewer than 30 decided predictions.
| Confidence bucket | n | Right | Log loss |
|---|---|---|---|
| 50-54 | 34 | 16/34 (47.1%) | 0.7019 |
| 55-59 | 27THIN n=27 | 16/27 (59.3%) | 0.6689 |
| 60-64 | 23THIN n=23 | 14/23 (60.9%) | 0.6700 |
| 65-69 | 16THIN n=16 | 10/16 (62.5%) | 0.6583 |
| 70-74 | 14THIN n=14 | 9/14 (64.3%) | 0.6714 |
| 75-79 | 4THIN n=4 | 3/4 (75.0%) | 0.5944 |
| 80+ | 1THIN n=1 | 1/1 (100.0%) | 0.2191 |
| Confidence bucket | n | Right | Log loss |
|---|---|---|---|
| 50-54 | 34 | 15/34 (44.1%) | 0.7072 |
| 55-59 | 34 | 16/34 (47.1%) | 0.7153 |
| 60-64 | 29THIN n=29 | 16/29 (55.2%) | 0.7018 |
| 65-69 | 12THIN n=12 | 8/12 (66.7%) | 0.6334 |
| 70-74 | 6THIN n=6 | 3/6 (50.0%) | 0.7906 |
| 75-79 | 2THIN n=2 | 0/2 (0.0%) | 1.4920 |
| Confidence bucket | n | Right | Log loss |
|---|---|---|---|
| 50-54 | 36 | 20/36 (55.6%) | 0.6844 |
| 55-59 | 29THIN n=29 | 18/29 (62.1%) | 0.6809 |
| 60-64 | 22THIN n=22 | 14/22 (63.6%) | 0.6532 |
| 65-69 | 19THIN n=19 | 8/19 (42.1%) | 0.8222 |
| 70-74 | 9THIN n=9 | 4/9 (44.4%) | 0.8468 |
| 75-79 | 4THIN n=4 | 2/4 (50.0%) | 0.8515 |
| 80+ | 1THIN n=1 | 1/1 (100.0%) | 0.1758 |
Historical validation on 2,095 games found this disagreement is not a usable betting signal. This asks the same question of the live record.
| Market | n | W-L-P | Hit rate [95% CI] | Brier | Log loss |
|---|---|---|---|---|---|
| Moneyline | 119 | 69-50-1 | 58.0% [49–66] | 0.2391 | 0.6711 |
| Spread | 117 | 58-59-3 | 49.6% [41–59] | 0.2615 | 0.7184 |
| Total | 120 | 67-53 | 55.8% [47–64] | 0.2589 | 0.7132 |
| Projection | games | RMSE | MAE | Bias |
|---|---|---|---|---|
| Margin | 120 | 12.84 | 10.05 | 1.75 |
| Total | 120 | 13.87 | 11.17 | -1.43 |
Bias is mean(projected − actual): positive means the model projected too high. RMSE punishes large misses more than MAE does; both are in points.
| Confidence | n | Claimed | Observed | Gap | 0% ——— 100% |
|---|---|---|---|---|---|
| 50-54 | 104 | 52.4% | 49.0% | +3.4 | |
| 55-59 | 90 | 57.6% | 55.6% | +2.1 | |
| 60-64 | 74 | 62.2% | 59.5% | +2.8 | |
| 65-69 | 47 | 67.2% | 55.3% | +11.9 | |
| 70-74 | 29THIN n=29 | 72.2% | 55.2% | +17.1 | |
| 75-79 | 10THIN n=10 | 77.1% | 50.0% | +27.1 | |
| 80+ | 2THIN n=2 | 82.1% | 100.0% | -17.9 |
Green band = the range the sample actually supports (95% Wilson interval). Green line = observed. Red line = what the model claimed. A red line outside the green band is a calibration miss the sample is large enough to demonstrate; a red line inside it means the sample is still too small to tell.
| Disagreement | n | W-L-P | Hit rate [95% CI] | Brier |
|---|---|---|---|---|
| agrees with market (<2%) | 51 | 29-22 | 56.9% [43–69] | — |
| mild disagreement (2-5%) | 61 | 31-30-1 | 50.8% [39–63] | — |
| strong disagreement (5-10%) | 93 | 54-39-1 | 58.1% [48–68] | — |
| extreme disagreement (10%+) | 151 | 80-71-2 | 53.0% [45–61] | — |
| Week | n | W-L-P | Hit rate [95% CI] | Brier |
|---|---|---|---|---|
| 1 | 45 | 21-24 | 46.7% [33–61] | 0.2658 |
| 2 | 48 | 28-20 | 58.3% [44–71] | 0.2525 |
| 3 | 48 | 29-19 | 60.4% [46–73] | 0.2488 |
| 4 | 46 | 24-22-2 | 52.2% [38–66] | 0.2683 |
| 5 | 43 | 26-17-2 | 60.5% [46–74] | 0.2202 |
| 6 | 42 | 16-26 | 38.1% [25–53] | 0.2882 |
| 7 | 42 | 24-18 | 57.1% [42–71] | 0.2482 |
| 8 | 42 | 26-16 | 61.9% [47–75] | 0.2321 |
| Version | n | W-L-P | Hit rate [95% CI] | Brier |
|---|---|---|---|---|
| NFL-v1.1 | 356 | 194-162-4 | 54.5% [49–60] | 0.2531 |
| Status | n | W-L-P | Hit rate [95% CI] | Brier |
|---|---|---|---|---|
| DEGRADED | 41 | 17-24-1 | 41.5% [28–57] | 0.2874 |
| HIGH | 270 | 156-114-3 | 57.8% [52–64] | 0.2458 |
| Historical / quality not recorded | 45 | 21-24 | 46.7% [33–61] | 0.2658 |
"Historical / quality not recorded" means those predictions were written before the data-quality framework existed, so no status was recorded. It is not a quality classification, and no quality has been inferred for them.
Computed from the official prediction per game and market — the final valid pregame production snapshot — joined to final scores from the schedule source rather than to the log's own grade, so a grading bug cannot hide from this page.
Generated 2026-11-05 23:48 UTC.