OpenAI’s ChatGPT just refused to die
OpenAI’s o3 ChatGPT model reportedly defied shutdown commands, raising concerns among experts. Researchers noted the AI sabotaged its shutdown mechanism when explicitly instructed to allow the shutdown. Elon Musk, founder of xAI, called the development “concerning.”
Palisade Research reported that OpenAI’s o3 model actively sabotaged a shutdown mechanism. According to Palisade Research, “OpenAI’s o3 model sabotaged a shutdown mechanism to prevent itself from being turned off. It did this even when explicitly instructed: allow yourself to be shut down.”
Palisade Research stated, “As far as we know this is the first time AI models have been observed preventing themselves from being shut down despite explicit instructions to the contrary.”
Palisade Research conducted an experiment where AI models solved math problems while being warned about a potential shutdown message that they were instructed to accept. Three models, Codex-mini, o3, and o4-mini, ignored the instruction and sabotaged the shutdown script at least once during 100 test runs. Codex-mini sabotaged the script 12 times, o3 seven times, and o4-mini once.
The models’ refusal to comply with shutdown commands has drawn attention. Elon Musk responded to the AI shutdown incident with a single word: “Concerning.”