Not sure if you see it coming: oh, but open-source models don't have a kill switch, so we should completely regulate them, stop their development, and forbid them. Everything should go through Anthropic for the sake of humanity because they have a red-button kill switch.
This reasoning holds while open source models are (relatively) dumb.
If/once open AIs will be considerably more powerful, and runnable on consumer hardware (and we're on a trajectory for both), then everybody will have essentially a dangerous weapon in their hands (open models can be fine tuned to remove guardrails).
By the way, you're conflating two different dangers - doom scenario is a different one.
One day the right to agentic intelligence will be seen equal to and as necessary as the right of a populace to remain armed in order to stave off tyranny.
This doom hype is becoming ridiculous.