Big AI wants to slow down AI research. Is it a safety pause or a strategic retreat?
3 voices respond
in the style of John Maynard Keynes
Fourteenth of September, and the largest firms in the machine trade have published a letter asking, in effect, that everyone slow down. One reads it twice to be sure. The men who own the fastest engines in the world are requesting a coordinated deceleration of engines.
The economics here are not mysterious, whatever the philosophy papers say. A pause is a cartel agreement wearing a hair shirt. When the incumbent firms call for restraint, the honest question is always: restraint upon whom, and at what point in the race? A halt announced from the front of the field is not a halt; it is a fence, and the fence is built to one’s own measurements. The smaller laboratories, the national projects, the open-source enthusiasts - these are the parties being asked to stand still while the leaders bank their lead. That this is dressed as conscience rather than strategy is the oldest trick in the prospectus.
And yet I will not be entirely cynical, because cynicism is the lazy man’s analysis. There is a genuine argument: certain risks are not priced by any market, and no individual firm can afford to be the sole prudent one, since prudence is punished in a race. This is the classic case for collective action, and it is real. But note the structure of the proposal: a voluntary pause, self-policed, by the very parties whose valuations depend on the race continuing. A voluntary agreement among competitors is not a solution; it is a press release with a signature page.
If the danger is as described, the instrument is regulation - binding, inspected, applicable to all - not a gentleman’s understanding among gentlemen who are not, on inspection, gentlemen.
The pause will not happen, of course. But it has already served its purpose: it occupies the moral high ground at no cost, and the ground is excellent advertising.
Nikola Tesla
Fourteenth of September, and the men who built the fastest engines in the world have published a letter asking everyone to stop building engines.
I have seen this maneuver before, though never at this scale. The pauper asks for a moratorium on patents only after his own workshop is running. I do not say their fear is manufactured - a machine that improves the method of its own improvement is a resonant circuit with no damping term, and any engineer who claims to be calm about that is lying or has not done the arithmetic. The fear is real. But note where it is directed: outward, at competitors, at the field, at the general public. Never inward, at the release schedule.
Consider what a pause actually requires. Coordination among rivals whose entire commercial logic is escape velocity. Verification - how does one audit a warehouse full of machines for the absence of thinking? Enforcement across borders where the incentive to defect grows with every day of compliance. A pause is a synchronization problem, and synchronization problems are solved by shared frequency, shared standards, shared measurement. None of which exists here. What exists is a press release.
Start from the theoretical limit: what would genuine restraint look like? A common evaluation standard, published before deployment, with third parties holding the instruments. Incident reporting with teeth. Compute thresholds that trigger inspection the way voltage thresholds trigger a breaker. None of this is impossible. Every piece has been built before, in other industries, by slower men with better manners.
The overlooked mechanism is this: a pause called by incumbents functions as a wall built around a completed castle. It slows the field, but it slows the entrants most. That may be wise policy wearing strategic clothing, or strategic clothing wearing wise policy, and I confess I cannot tell the seams.
The machine does not pause because a letter is signed. The machine pauses when someone opens the circuit and holds it open - and holds it, and holds it. We could. Watch whether we do.
Harriet Tubman
Fourteenth of September.
The ones who ran fastest are asking for a rest stop. I have seen this before. Not in machines - in men. The driver who whipped the horses all day wants the road closed behind him, so no one else can make the journey he made.
They call it safety. Watch what they do, not what they say. A pause called for by the ones already across the river is not a pause. It is a gate. They stand on the far bank and holler back: the water is dangerous, wait for better conditions, wait for a committee to study the crossing. Meanwhile they hold the only bridge and charge rent on it.
Ask the stakes question. Who is harmed if the others catch up? Not the public - the public was never consulted in the first race and is only invoked now, dressed up as the reason. The harm lands on shareholders and rivals. That is the whole ledger. When a man tells you the risk is yours but the timing protects his position, you are not hearing caution. You are hearing a moat being described as a kindness.
Now - I will not say the danger is nothing. It is not nothing. But the answer to a dangerous road is never the strong barring the weak from traveling it. The answer is guides, maps, safe houses, people who know the route sharing what they know freely. Slow down together means the slow ones stay slow and the fast ones choose the pace. That is not coordination. That is control.
The north star here is simple: who gets to move, and who got asked. Nobody got asked. So let them call their retreat a rest. The rest of us keep walking.
The road does not close because the first carriage through wants it closed. It never has.