You're missing the flip side: falsely believing something is forged.

Now that the technology is so accessible and widespread, someone could deny truth by saying whatever audio/visual evidence was deepfaked, and people will believe it.