No AI lab thinks their AI is going to end the world, just that if they don't beat the other AI labs, the other labs' AI are going to end the world, so they can't slow down their own development to be maximally safe. Hence the whole "pacing the frontier" letter.
If there's a real chance (say 10% or greater) that one of the AI labs is going to end the world, then yeah it should be a crime to continue advancing the technology. A few people are potentially putting the entire world at risk without everyone else's permission, by their own p(doom) admission.
I'm real skeptical about p(doom) arguments, but since they seem to believe it and they're the ones working on it, the technology should be halted.
>If there's a real chance (say 10% or greater) that one of the AI labs is going to end the world, then yeah it should be a crime to continue advancing the technology.
>but since they seem to believe it and they're the ones working on it, the technology should be halted.
Again, you're missing the dynamic that stopping AI development yourself doesn't mean that others' AI development will also halt, and other labs has higher P(doom) than your lab (of course!).
