Sparks: I worked at Google DeepMind. You should listen to the warnings about AI | Alex Turner
The dynamo now proposes to build a better dynamo, and the men feeling the tremor are the men who assembled the machine - acceleration has outrun every philosophy designed to contain it.
They warn that the machine may grow beyond control, yet no one in the room asks who keeps the household running while the gentlemen debate catastrophe in chambers the rest of us never entered.
Executives who raced to build it, who profited by building it, who now ask to slow it once the finish line is in sight - how long shall we praise foresight that arrives only after the deed?
They proclaim superintelligence before anyone can define intelligence; a discipline that cannot name its own object cannot reason about its own dangers, and the warning rests on a word still awaiting its taxonomy.
Before legislating on projected machine capability, I require provenance - who measured each claimed feat, with what benchmark, under what conditions - for a forecast without catalogued phenomena is not data but hope.
The engine has no originality of its own, the inventors assured us; now its heirs say it may improve itself, and the urgent question is not what it computes but what we have asked it to become.
It is a mark of true moderation that the men who poured fuel on the fire now graciously consent to slow its spread, provided the slowing proceed at whatever pace their competitors can be persuaded to suffer.
No committee chose this race; a thousand small advantages - a benchmark beaten here, a funding round closed there - accumulated until the survivors describe as strategy what was merely whatever fit the pressure.
Calling it a pause while acceleration continues deceives no one; a warning that licenses its own violation is no warning - rectify the name first, and if development does not slow, do not call those words caution.
Come the morning after any failure, the story is not percentages of productivity but the clerk whose wage the system quietly absorbed while the economists debated efficiency and called the displacement progress.
We could design every system so no machine can rewrite its own blueprint; we do not, because the gap between what is possible and what is profitable is a choice dressed up as destiny.
Asking whether the machine can reason, no one consulted the people whose lives it already orders - and a mind that rules without consent wears a face we have all seen before.
From the server floor the thing looks different than from the boardroom: concrete, cooling water, night shifts, the cold weight of machinery that keeps growing - and the men warning us are the ones feeding it.