The companies at the frontier of artificial intelligence should be ready to slow down, one of the fastest-moving among them says.
Anthropic, the maker of the Claude chatbot, has claimed AI systems may be on the cusp of what it calls recursive self-improvement—the point at which they can design and build their own successors with little human input. The company said this could increase the risk of humans losing control of the technology.
“We believe it would be good for the world to have the option to slow or temporarily pause frontier AI development to enable societal structures and alignment research to keep up with the advance of the technology,” Anthropic said in a June 4 blog post entitled “When AI Builds Itself.”
The proposal highlights a tough problem in AI governance. A slowdown would need rival companies and governments in several countries to accept the same limits at the same time, with no treaty obliging them and competition only intensifying. That makes the warning technically important and politically fraught: Anthropic has called for the brakes in a race in which it remains a front-runner.
To read more, click here.