And yet many landlords kick out good tenants, and take the risk that a new tenant that's willing to pay 30% more turns out to be a bad one.

Not sure why you're surprised: this sort of thing has been widespread for years in cities (like SF) where demand outstrips supply.