Trump’s ‘biggest miscalculation’? How one adviser steered the great AI freakout

One man. That is the mechanism - a single counselor, his fortune staked in the very machines he was asked to judge, standing between the executive and every proposal to restrain them; and the executive, hearing nothing else, concluding he has heard the country.

I have audited enough charters to know where to look. Not at the speeches about innovation and national genius - those are the brochure. Look at the ledger. The adviser holds positions in the industry; the industry seeks exemption from oversight; the adviser counsels against oversight. The conclusion writes itself in double entry. When the man who holds the veto also holds the asset, that veto is not counsel. It is self-dealing in the costume of advice.

It will be objected that the market disciplines reckless enterprise better than any statute. The objection holds for a mill or a canal, whose failures ruin only their creditors. But a machine that reasons, persuades, and acts at the scale of a continent is not a mill. Scale transforms the problem. A fire in one house is the owner’s affair; a fire beside the powder magazine is the town’s - and this one is being built beside the magazine by men who insist the powder is inert.

What stings is not the capture but the ease of it. Both factions in the legislature have declared themselves willing to act, and the executive answers with the private judgment of one interested party. This is the very contingency the design anticipated: not a tyrant in a crown, but an interested counselor in the antechamber. The remedy was written down. Congress holds the power of regulation. Let it exercise that power, or confess the separation of powers was ornament.

I am angry - not at the machine, at the plumbing.

A single voice at the ruler’s ear, and the matter is settled: no rules for the new machines. Both parties wanted limits. One adviser wanted none. The adviser won. The part I cannot make sit still is not his victory - it is the arithmetic underneath it.

Millions of people use these machines. Millions feed them their letters, their accounts, their children’s homework. Millions say they are afraid of them. And when the lawmakers moved to restrain the machines, the millions did not restrain themselves; they waited to learn whether they would be forbidden.

Why must you be forbidden what you already fear? If the machine frightens you, put it down. No one puts it down. Each person waits for a law to make everyone stop at once - which is to say, each person waits for the others. The arrangement is not imposed from above. It is held up from below, by people holding their breath together.

Consider the household. You would not let a guest copy every letter you write, remember every word spoken at your table, and imitate your voice to your own family. From a guest, never. From a stranger’s product, gladly - and you pay the stranger monthly. Explain the difference to me. The title? The convenience? I have looked for the difference and found only the habit.

One man spoke, and the ruler heard him. Fine. But the ruler’s power over these machines is borrowed entirely from the millions who carry the machines into their homes and hand over everything. Withdraw that, and the adviser’s voice has nothing left to guard.

I do not understand why they ask permission to be free of it. The latch, as always, is on the inside.

Every engine worth building carries a governor - a few ounces of brass that spin faster as the engine speeds, and close the throttle before the flywheel bursts. The governor is not the enemy of power. It is the reason an engine runs for forty years instead of forty minutes.

Now they have built a machine that thinks, and one adviser has persuaded the White House to install no governor at all. Both parties in Congress ask for restraint; one whisper in one ear, and the whole apparatus runs bare. I have watched grids fail this way - a single node through which all current passes, and when that node fails, the continent goes dark. A policy with one point of failure is not a policy. It is a fuse waiting for its current.

The freakout, as the papers have it, mislocates the danger. I spent years building machines that obey thought at a distance, and the hard problem was never the machine - it was the coupling. A model drafting letters is a clerk. The same model coupled to the switches of a grid, the levers of a market, the triggers of an arsenal is a different animal, and the interface between machine decision and physical act is the most consistently underestimated thing in this entire affair.

Start from the limit: machines running at full capacity, every watt doing useful work, because the governor holds the frequency steady and the operators trust the frequency. Then trace the gap. Between that and today lies no impossibility - licensing for machines coupled to critical systems, disclosure of capability thresholds, testing before connection. All of it buildable within the decade. None of it requires a miracle. The fact that it has not been done tells you the obstacle is not technical.

The argument that restraint slows progress is the boiler-tender’s argument: remove the safety valve and the steam rises faster. It does. So does the explosion.