The Pause Button Nobody Owns

The idea of a “pause button” for advanced AI sounds reassuring. If capabilities develop faster than our ability to understand or control them, we pause, investigate and continue when we know what we are dealing with. Sensible enough. But the interesting question is not whether such a button can technically exist. It is who gets to press it.

If the answer is the companies building the systems, then the person with their foot on the accelerator is also responsible for deciding when the speed becomes unacceptable. Governments may advise, scientists may warn, workers may raise concerns and the public may carry the consequences, but the actual decision remains with the organization whose money, market position and reputation depend on continuing.

A real pause button is therefore not primarily a technical feature. It is political authority. Somebody outside the race needs the legitimate power to say that the race stops here, even when the participants desperately want another lap. A brake controlled entirely by the person accelerating is not much of a brake.