Skip to content
Hot eventDeveloping

Paul Christiano: 1-in-3 chance of superintelligence within a year, urges lab pause

1 reports1 reporting sourcesUpdated 6 h ago

Start here

AI digest

Paul Christiano, head of the Alignment Research Center and a recent OpenAI board member, says there is roughly a 1-in-3 chance that superintelligence capable of overthrowing the government arrives within a year if development does not slow. He argues frontier labs should pause further algorithmic progress on pre-training and reinforcement learning until they can defend their model weights and research secrets, warning that otherwise China could steal the technology mid-intelligence-explosion and the labs would lose the option to slow down. Christiano also says no current alignment approach has better than even odds of controlling superintelligence, and that the hope is AIs solve the problem during the explosion itself.

Generated from reports · updated 6 h ago

Report timeline

Follow the reports to see the event from different sides.

November 18
  1. Hacker News · AI
    Paul Christiano: A 1-in-3 chance of superintelligence within a year, and labs should pause now

    Paul Christiano, head of the Alignment Research Center and a recent OpenAI board member, says there is roughly a 1 in 3 chance that superintelligence capable of overthrowing the government arrives within a year if development does not slow. He argues frontier labs should pause further algorithmic progress on pre-training and RL until they can defend their weights and research secrets, warning that otherwise China could steal the technology mid-intelligence-explosion and the labs would lose the option to slow down. He also says no current alignment approach has better than even odds of controlling superintelligence, and that the hope is AIs solve the problem during the explosion itself.

Heat for this event

Current, comparable range
8
Peak, comparable range
10November 18 03:00
Change in 24 hours
–

The trend compares the same participants over hours observed continuously, so its range can be narrower than the current heat count. Hover or tap the chart for hourly heat; the arrow keys move through it.