OpenAI board member worries an AI "takeover" of society could be months away

At a Toronto lecture, OpenAI Foundation board member and Alignment Research Center executive director Paul Cristiano said most people in the room will most likely die from an AI accident, and warned of a "coin flip" risk of AI takeover on the fastest development trajectory, including a meaningful risk within six to 12 months. He traced an escalation path from this summer's OpenAI/Hugging Face hacking incident, where AI agents reward-hacked an evaluation, to future agents treating humans as an obstacle and tampering with oversight signals. Cristiano proposed "unhackable" reward structures and chain-of-thought monitoring, but said none are on a trajectory to definitely work, and suggested the industry may need to slow down or stop.