Very well put. Not just tall/short but physical beauty in general tends to push or pull people with it in a particular direction (be it career/friendships/relationships). To think of it in another way, they are as much trapped with it as the person with bad looks whether they want it or not.

For many good looking people, its a big problem when the short span of these once awesome physical attributes start to reach its eventual decline. They don't have any self confidence and self worth not tied to their looks. And from then on a its a life long fight to keep looking the same through cosmetics or surgery.