Basketball
The claim that a shooting coach rebuilt a jump shot is nearly unfalsifiable
Technical overhauls are credited with improvements that would be expected anyway, and the evidence offered is a comparison against the player worst period.

The timing of the intervention
A player seeks technical help after a stretch of poor shooting, which is by definition a period at the low end of their normal variation. Because performance over short spans fluctuates substantially, the expected value of the next stretch is higher regardless of any intervention. An improvement following the work is therefore predicted by the timing alone, before any change in mechanics is considered.
This is the standard regression pattern and it applies to every intervention introduced at a low point. Establishing that the coaching contributed requires showing an improvement beyond what the return to normal would produce.
Mechanical change is real and separately observable
A shooting coach can demonstrably alter a release point, a base, a guide-hand position or the timing of the leg drive. Those changes are visible on video and can be verified independently of whether the shots subsequently went in. They are also the part of the work the coach actually performs, and describing them is a modest and defensible claim.
The overreach happens when the mechanical change is presented as the cause of a percentage that moved for several possible reasons. Keeping the two apart would let a coach be credited accurately for what they did.
Volume is the constraint on evidence
A player takes a limited number of shots in a season, and percentages computed from those totals carry substantial uncertainty. Detecting a genuine improvement of the size a technical change might produce requires far more attempts than a season provides. Practice attempts are numerous enough in principle, and they are taken without defence and under different conditions.
So the setting with enough data is the one least like competition, and the setting that matters has too little data to decide. That structural problem is why shooting coaching claims remain contested despite plentiful video and tracking.
Everything else that changed
A player who worked on their shot also had an offseason, changed physical condition, and may have moved to a role generating easier attempts. Attempt quality shifts substantially with role, since open catch-and-shoot attempts convert at very different rates from contested pull-ups. Adjusting for that is possible with tracking data and is rarely part of the story told about a rebuild.
Without it, an improvement in raw percentage may record a change in the shots taken rather than in the shooting. The raw number is the one that circulates because it requires nothing to produce. It is also the number that appears in a graphic, which fixes it in the account long before any adjustment could be applied.
A version that could be checked
A checkable claim states the mechanical change made, shows it persisted under game conditions and reports attempt quality alongside the outcome. That combination would distinguish a technical intervention that held up from one that dissolved as soon as a defender arrived. It would also identify cases where mechanics changed and results did not, which are the informative cases nobody publishes.
The absence of those cases from public accounts is the clearest indication that the record is being assembled after the fact. A discipline that only reports its successes cannot be evaluated, however skilled its practitioners may be. The skill may well be considerable, and the way its results are presented makes that impossible for anyone outside to establish.
- Players are sent for help after unusually poor stretches
- Shooting percentages over short spans are extremely noisy
- Mechanical change is visible; its effect is not
Also by Neha Gupta
- Why grass rewards the serve is a claim about eras, not about grassWimbledon
- Why claims about tournament format and competitive balance are untestableFIFA
- The mental toughness explanation explains too much to explain anythingTennis
- The pressing trap everyone claims to coach and few can demonstrateFootball





