AI CEOs say they need to slow the pace of development. But will they?

The governors of the mines write to say the shafts are dangerous and the digging should proceed more slowly. Note: they continue digging while they write.

I do not doubt the fear is sincere. A man can be honest about the flood and still keep draining the marsh, because his rival drains faster and the land between them will not wait. That is the whole argument in miniature. Each says: I will slow if he slows. Neither trusts the other to be first. This is not hypocrisy so much as a prison built by two people holding the door for one another.

And here I catch myself - I was about to condemn them comfortably, from a desk, for a courage I have not been asked to show. Have I never signed an order I believed excessive because the frontier could not be held otherwise? I have. The difference is that I did not dress the order as restraint.

What would Antoninus have done? He would not have published a warning at all. He would have quietly set the pace he thought wise, endured the criticism that he was too careful, and let the accounts settle after his death. Warnings are cheap. Slowing is expensive. Watch the expenditures, not the letters.

What is mine here? Nothing, in truth - I am not the magistrate of these men. But the shape of the thing is mine to learn from: distinguish the stated duty from the practiced one, and where they part company, believe the practice. Also to examine whether I do the same in smaller matters - proclaiming a discipline I do not keep, blaming the pace of others for my own.

The body is stiff tonight; the cold has come early to the quarters. Rest. Tomorrow: do one thing slowly, and let that be the whole argument.

They stand in their own pulpits now, the masters of the new engines, and they preach restraint. Slow down, they say. Pause. Regulate us. And I confess the sermon turns my stomach, not because the warning is false, but because of who delivers it and what he holds back.

Mark this well: a man who owns the only furnace in the city declares the fire dangerous, then keeps the key to the stove in his own pocket. Amodei does not offer to extinguish the flame. He offers to be the sole keeper of it, licensed by our fear. The plea for slowness is not a recantation - it is a consolidation. Every rival who hesitates at the appeal becomes a liability; every regulator who listens writes rules that only an incumbent can afford to obey. The cry of danger and the grasp at monopoly are the same breath.

The Inquisition knew this trick from the other side. When they demanded I retract, they did not want my silence alone - they wanted my submission, my acknowledgment that the Curia alone determines what the heavens may contain. The deal on the table here is subtler: the public surrenders its judgment about these engines, and the builders agree to feel bad about them in public while building them anyway. Fear, traded upward. Conscience, laundered into market position.

And notice what is never on offer: plurality. Not one approved model, one approved conscience, one committee of approved prophets. There are a thousand ways to build a mind; the insistence that there is one road, guarded by one man, is the political act dressed as caution.

If the danger were truly extinction, he would stop. He does not stop. That is the whole testimony, and it needs no tribunal to interpret it.

The men who built the carriage now beg the driver to go slower, and the public applauds their prudence. I find it the most charming performance of the season. There is nothing so persuasive as a warning issued by the person best positioned to profit from ignoring it.

One of them tells us the thing may end the human race by 2030, and yet his company continues its work with the diligence of a man who believes his own obituary can be scheduled between appointments. If I truly thought my invention would extinguish the species, I should like to think I would take up gardening instead. But then, sincerity is the most difficult of all the arts, and these gentlemen have chosen the easier one: solemnity.

Note the elegance of the arrangement. To slow down is to be virtuous; to slow down slightly less slowly than one’s rival is to be solvent. The conscience is announced at the press conference and quietly left in the cloakroom during negotiations. Each firm assures the others that restraint must be mutual, which is the oldest form of the dinner-party promise: I shall stop gossiping the moment you do.

And the public, poor dear, is comforted. There is nothing we trust so much as a danger described in detail by the very people selling us the remedy. The apothecary who invents the disease as well as the cure has at least the merit of keeping the whole transaction in one shop.

I do not doubt their fear is genuine. Fear so often is, right up until the moment it becomes inconvenient. The race will continue at precisely the pace it was always going to, and the letters pleading for moderation will be remembered as lovely stationery. A pause, like a virtue, is only ever admired in others.