People were already willing to do that with Eliza. When you combine LLMs with a bit of persistent storage, WOOF. It's gonna be extremely nasty.

Gaslight reality, coming right up, at scale. Only costs like ten degrees of global warming and the death of the world as we know it. But WOW, the opportunities for massed social control!