An artificial intelligence "kill switch" which can be checked by a third party may need to be mandatory for companies, a co-founder of one of the world's largest AI firms has said.
The report indicates that an artificial intelligence “kill switch” which can be checked by a third party may need to be mandatory for companies, a co-founder of one of the world’s largest AI firms has said.
It further notes that jack Clark, one of the seven founders of Anthropic, stated that a way to shut off AI software completely if it becomes too dangerous is something society “might want to eventually pass rules around”.
Clark stated “most labs have different ways of being able to pull the plug”, including Anthropic, but stated lawmakers may need to enforce having one.
AI’s rapid development and fears over the risks it poses to humanity have been thrust into the spotlight by a series of warnings from executives and staff at AI firms.
Some have stated publicly there is a chance the technology could, if unchecked, kill all humans.
Anthropic chief executive Dario Amodei over the weekend called for the pace of AI development to slow and be more closely monitored, as the company has done before, though some have questioned the motivations behind this.
Amodei added that any action to rein in AI development should be done “without sacrificing commercial advantage”.
Clark told the BBC that specifics around “kill switch” requirements and verification should be part of “the larger policy conversation” taking place around AI.
“Should you mandate that companies definitely have a kill switch? Is that kill switch verifiable by a third party?” he asked.
“I think that’s the kind of thing society is going to want to know and might want to eventually pass rules around.”
Anthropic, which was founded in 2021 by a group of former employees of its rival, OpenAI, is currently at the centre of a debate over AI safety.
Last week, a post from an artificial intelligence researcher who quit Anthropic over concerns AI could wipe out humanity went viral.
In response, Anthropic scientist Evan Hubinger stated he personally thought the possibility of human extinction from AI was “>10% within the next decade”.
Computer scientist and Nobel Prize winner Geoffrey Hinton, known as the “Godfather of AI”, told the BBC on Friday that a 10% chance of AI killing all humans was “not unreasonable”.
