Why the AI Industry Is Waiting for an AI-Driven Catastrophe Instead of Preventing It

Cybersecurity professionals have dubbed the past month "Black October" as AI-detected vulnerabilities emerged faster than many could patch, and much of the field now sees a major AI-driven catastrophe as a matter of when, not if. The likelier disaster is humans wielding AI: hackers have used Claude Code and models from Anthropic, SpaceX, and Moonshot AI to attack banks and more than 400 financial targets in Latin America. Despite pledges to "pace the frontier," the industry has taken no coordinated action to prevent the big one before it happens.