Paul Christiano: about a one-third probability of superintelligence within a year
Understand this story
Paul Christiano, head of the Alignment Research Center and a member of the OpenAI board, said in an interview that if AI development does not slow down, the probability of superintelligence emerging within the next year is about one-third; by then, humans would find it very difficult to compete with or control it. He further suggested that such superintelligence could, at the earliest, have the ability to overthrow governments within 12 months. These judgments are Christiano's personal estimates, not facts that have already occurred.
AI overview based on source reports · Updated 19 min ago
Coverage timeline
Follow the coverage to explore different perspectives.
- Dwarkesh PatelPaul Christiano – We could be 12 months away from AIs that can overthrow the government
In this podcast interview, Paul Christiano, head of the Alignment Research Center and a recent OpenAI board member, says that on the current trajectory without slowing down there is roughly a 1 in 3 chance of superintelligence within a year, and about a 10% risk of AI takeover or disempowerment of humanity over the next year. He argues labs should pause further algorithmic progress until they can secure their weights and research secrets, since otherwise China could steal the superintelligence mid-explosion and labs would lose the ability to slow down. He also discusses how AIs would be trained during an intelligence explosion and why no single current alignment approach has better than even odds of controlling superintelligence.
Activity for this story
Not enough continuous observations to show a trend yet.