Title text:
The plural of anecdote may not be data, but the singular of data is anecdote.
Transcript:
Transcript will show once it’s been added to explainxkcd.com
Source: https://xkcd.com/3262/
this post was submitted on 23 Jun 2026
435 points (99.1% liked)
xkcd
16751 readers
561 users here now
A community for a webcomic of romance, sarcasm, math, and language.
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Thanks for that. I'd never heard the term before.
It sounds a little subjective though? Are there features that can be used to quantity how "P-Hacky" something is?
I feel like a sports state of "a team tends to lose if thier top scoring player in the first quarter is injured before the end of the first half" has a lot of specific weirdness, but my intuition drives that this specifically could be a very legitimate observation.
How do you draw the line?
Usually p hacking doesn't come from 1 constraint, especially a well explained one, but instead comes from adding a couple or completely unexplained constraints (like a team losing more if their coaches wife is in one section of the stands or another) because at that point it's decreasing the number of samples (times you have as a reference) to force a significant result.
So usually for sports p hacking is stats about 1 team only, rather than a general stat about the sport. Preferably a restriction on the other team, then a follow up game based restriction so it seems plausible to the viewer.
you what
I'm normally not a praying dude, but if you're up there, save us Jungkook
Ok, that helps. I think you're saying the issue arises when the set of constraints limit the observed events to a number too small to draw appropriate conclusions from.
I'm hesitant to shy away from "bizzare" constraints. If there are enough data points for that scenario to draw some statistical correlation... then that just is the reality even if we can't explain it (yet).
If the coaches wife sits in a different section for 20% of the games, and they disproportionately lose when she sits there... that's the correlation.
Could be she sits in a further away section if she's pissed after a fight with her husband the night before, which is a signal the coach also had a bad night, and is fatigued and unfocused during the game now.
But yeah, you need enough observed instances.