> That would be truthfulness to the training material, I guess. If you train on Reddit posts, it’s questionable how true the output really is.

Maybe it learns to see when something is true, even if you don't feed it true statements all the time (?)