I'd say most unfavourable opinions are tied to a lack of knowledge but having powerful features ultimately doesn't negate that it's uncomfortable for some.

I feel like that's a cruel thing to say. "You're supposed to put your guard down when you're ugly".

No. "You're supposed to not worry so much." People are drawn to people that are happy. It's a very attractive trait.

Or worse - reverse it and you have if I think you're ugly, you can't have good thoughts.

I wouldn't go that far.

But it is true (in my experience) that good looking people are a bit more self-absorbed than normal.