Stray thought: Why 4 and 9? Because the joke is funniest if the number is completely ordinary.
0 and 1 are special and so are all prime numbers. 6 is out because it's the maximum die throw. And one figure is more ordinary than two figures, or negatives, or decimals. That leaves 4 and 9.
Yeah. Alternative explanation: I'd say 3 and 7 are out because they often come up in fairy takes etc as magical. 5 is out because it's half of ten and the number of fingers. 2 is out because it is too small.
Very nice.
And also, what a cool read that was, thanks for sharing the article.