> Machine learning can also do a surprising good job of it, especially if you know what the target is (e.g. a face)

Yes. Though that's just a corollary of doing better when you know something about the probability distribution of inputs.

(But a very useful and practical corollary. My formulation didn't give any hint how you might make use of that knowledge of the distribution.)