NHL Analytics Counter-Examples Search: Coaches Who Overrode the Model and Were Right

## Search Objective Find a recent NHL decision (2024–2025) where a coach overrode an analytics recommendation and was demonstrably correct—not lucky, but right because he saw something the model couldn't. ## Result: None Found No verified case where a coach was documented overriding a specific analytics model recommendation and the call proved correct. ## Cases Examined ### Closest Match: Sheldon Keefe, Devils vs. Lightning — Jan. 12, 2025 - **Situation:** 4-on-3 power play in OT - **Coach's choice:** Pulled a defenseman, put Stefan Noesen on the ice for 4 forwards - **Reasoning:** "A process of elimination" — Tampa's high pressure drove the change - **Outcome:** Devils won on Noesen's goal - **Assessment:** PARTIAL. Unconventional lineup change worked, but no source says an analytics model recommended otherwise. Single-game outcome. - **Source:** https://pucksandpitchforks.com/new-jersey-devils-head-coach-sheldon-keefe-made-one-decision-that-led-to-win-vs-lightning ### Closest Match: Marco Sturm, Bruins vs. Blues — Dec. 9, 2025 - **Situation:** Lineup reshuffle - **Coach's choice:** Moved Pastrnak down to third line with two young players, broke up shutdown line - **Reasoning:** "I went with my guts a little bit" - **Outcome:** Boston won 5-2 - **Assessment:** PARTIAL. Gut-driven lineup change worked, but no source says analytics recommended otherwise. - **Source:** https://www.boston.com/sports/boston-bruins/2025/12/09/marco-sturm-boston-bruins-lines-david-pastrnak-nhl-hockey-st-louis-blues/ ### Failed Overrides / Criticized Decisions - **Scott Arniel, Jets — May 2025:** Kept Hellebuyck in net on late power play instead of pulling for sixth attacker. Hockeylatest called it statistically a poor call. Source: https://www.hockeylatest.com/nhl-team/winnipeg-jets/jets-scott-arniel-facing-major-criticism-for-coaching-decision-involving-connor-hellebuyck - **Peter DeBoer, Stars vs. Oilers — May 29, 2025:** Pulled Oettinger after bad start in elimination game, citing small-sample playoff record. Backup gave up quick goal, Stars eliminated. Source: https://www.usatoday.com/story/sports/nhl/2025/05/30/stars-jake-oettinger-pulled-peter-deboer-explains/83937564007/ ### Coach Philosophy on Analytics - **Spencer Carbery, Capitals:** Weighs eye test ~75% and numbers ~25%. Said when analytics staff's numbers conflict with his view, "usually, the numbers are right." Source: https://russianmachineneverbreaks.com/2025/10/13/spencer-carbery-hockey-statistics-capitals-analytics-staff-eye-test/ ## Key Finding Same pattern as NFL, NBA, MLB, and soccer: no verified case of a coach overriding analytics and being demonstrably correct. Media documents conservative mistakes and failed overrides, but not successful overrides. ## Sources - pucksandpitchforks.com (Keefe) - boston.com (Sturm) - hockeylatest.com (Arniel) - usatoday.com (DeBoer) - russianmachineneverbreaks.com (Carbery) ## November 6, 2026 Search Update Searched for NHL counter-examples with the same criteria used across NFL, NBA, MLB, and soccer: a coach who overrode a documented analytics recommendation and was demonstrably correct (not merely lucky). **Result:** No verified case found. The search surfaced no NHL decision where a coach's override of a model recommendation was shown to be correct based on information the model lacked. This completes the five-sport sweep (NFL, NBA, MLB, NHL, soccer) with zero verified counter-examples. **Pattern emerging:** The absence is not sport-specific. It is consistent across all major North American team sports and soccer. Possible explanations: 1. Models are genuinely superior in these environments 2. Successful overrides are under-reported or undocumented 3. The bar for "demonstrably correct" is too high for single-game decisions 4. Team sports are open-skill, high-variability environments where expert intuition is prone to "illusion of validity" bias The fourth explanation is gaining support from research on intuition conditions (see research/intuition-vs-models-conditions). ## November 8, 2026 Search Update Searched for NHL counter-examples with same criteria: coach who overrode a documented analytics recommendation and was demonstrably correct (not lucky). **Result:** No verified case found. **Closest cases found:** - **Montreal, Game 5 vs. Buffalo (May 15, 2026):** Goalie coach Marco Marciano advised keeping Jakub Dobes in after soft early goal. Dobes stopped remaining 32 shots, Montreal won 6-3. However, this was goalie-coach judgment, not an analytics override. No model recommendation documented. - **Winnipeg, Game 4 vs. Dallas (May 14, 2025):** Coach Scott Arniel did NOT pull Connor Hellebuyck for extra attacker late. Article says this was statistically a poor call. This is the reverse — coach ignored numbers, numbers said he was wrong. Winnipeg lost. - **Islanders vs. Calgary (Jan. 17, 2026):** Patrick Roy pulled goalie early (8 min left, trailing 4-1). Article says this reflected what stats were suggesting. Roy denied doing it for analytics. This is alignment with analytics, not an override. **General context:** - Spencer Carbery (Capitals, Oct. 2025): weights stats ~25%, eye test ~75%. Says when analytics flag something unexpected, "the numbers are usually right." - Wild (John Hynes) and Golden Knights (Bruce Cassidy, April 2025): both described keeping "gut feelings" over analytics in playoffs, but no specific documented outcomes. - NHL.com coaches' roundtable: analytics has driven earlier goalie pulls (down 1: ~2:30 left; down 2: ~4:00-4:30 left). **This completes the five-sport sweep:** NFL, NBA, MLB, NHL, soccer — zero verified counter-examples where a coach overrode analytics and was demonstrably correct. **Sources:** - https://www.nhl.com/news/topic/playoffs/jakub-dobes-rewards-canadiens-trust-in-game-5-win-over-sabres - https://www.hockeylatest.com/nhl-team/winnipeg-jets/jets-scott-arniel-facing-major-criticism-for-coaching-decision-involving-connor-hellebuyck - https://nypost.com/2026/01/18/sports/patrick-roy-denies-early-goal-pull-was-due-to-analytics/ - https://russianmachineneverbreaks.com/2025/10/13/spencer-carbery-hockey-statistics-capitals-analytics-staff-eye-test/ - https://www.echopress.com/sports/pro/knights-wild-coaches-balance-stats-and-video-with-gut-feelings - https://www.nhl.com/news/coaches-room-difficulty-of-protecting-leads - https://pullthegoalie.app/goalie-pull-report