I have a "large" (~40K 10s lines) corpus of captioned dialogue from a video game that I briefly investigated training a model similar to this to "clone voices" with, but pretty quickly came to the realisation that doing so would be pretty unethetical to all involved.

It became more apparent to me how icky this is as the voice actor of one of the most iconic characters in the game died suddenly 10 days ago...