Those people are already not paying tax in the UK though. The former PM’s wife has saved more in tax because of her status than everyone who works in my company combined will pay in income tax in their entire lives.
All this talk of "oh but all the rich people will leave and investment will dry up" is really cover for "but my friends don't want to pay tax". We lose nothing (good) by them leaving, if indeed they would anyway.