> Consistency is a synonym for statistical significance.
So basically you're telling me that if I can visually see a consistency that does not show up in their statistical test, then they aren't running an appropriate statistical test on what I'm seeing.
> But if it's actually swamped, then it might not be real, so go get more data.
> So basically you're telling me that if I can visually see a consistency that does not show up in their statistical test, then they aren't running an appropriate statistical test on what I'm seeing.
Either they're not doing the right statistics, or it's a "consistency" that is much more likely to show up randomly than you naively expect, and the study needs to be repeated or enhanced.
Sometimes you can see a pattern that's just a figment of chance. See also: numerology, jelly bean xkcd
So basically you're telling me that if I can visually see a consistency that does not show up in their statistical test, then they aren't running an appropriate statistical test on what I'm seeing.
> But if it's actually swamped, then it might not be real, so go get more data.
Even better to design other experiments.