AI companies want to regulate their open-source competitors out of existence and regulate themselves into riches. We do not usually think of innovative private companies inviting government regulation of their own industry, but that is exactly what is happening in AI.
Concerns about the pace of AI development have existed since the technology entered public awareness in late 2022. Early fears about AI’s economic impact focused largely on job losses for writers and coders and its effects on writing instruction. More recently, as major AI platforms have rolled out agents—AI bots that can be given a task and carry it out over an extended period—the focus has shifted.
What if the bots carry out a cyberattack? What if they are given instructions and the user forgets to tell them to stop? What if they gain access to the nuclear codes? We have not yet reached the point where people are worried about AI turning the universe into paperclips. We are, however, already in a situation where Anthropic CEO Dario Amodei felt the need to publish an essay, “We Must Pace the Frontier,” in which he announced, “We must slow the pace at which we improve the capabilities of AI models.”