Usually whenever I see people evoke the paradox of tolerance they draw more attention to the authority of Popper compared to the nature of it being a paradox. It defers the question of what is tolerant, which depends on perspective as you rightly point out.

Arguments of authority are my favorites. It literally takes you 2 seconds to see through the person you are talking to and you can safely assume that they haven´t thought about the problems facing them long enough.