This is a linkpost to my substack post or LessWrong post.
The one-line summary: AI should not be compared to nuclear weapons but instead to biological weapons or memes, which evolve under the implicit evolutionary pressures that exist, leading to AI’s that are good at surviving and replicating.