On: Bill Gates says we’ve passed AI’s danger thresholds. Now what?

A rich man announces that we crossed a threshold of danger, and the world shudders as if a gate had swung shut behind us. My first feeling was irritation; my second, the old itch to teach.

Consider what a threshold is. Not a thing in nature. A line drawn by a mind upon a slope that knows no lines. The sea crosses no boundary when it floods a field; it advances wave by wave, grain by grain of cliff surrendered to water, and no single wave deserves the name of drowning. Yet men stand on the dry side of their chalk mark and cry: past this, ruin. The ruin never arrives as described. It arrives in increments, each survivable, each met by people still alive to meet it - proof, if proof is wanted, that the catastrophe and the crier of catastrophe are never found together. He announced our peril from a glass room above a marina where boats bobbed on flawless blue. Some ending.

Here is the sweetness that makes the medicine go down: the danger is real only as process, and process can be known. What frightens is not the machine but the mystery draped over it. Strip the drapery and you find arrangement - pattern set against pattern, every effect carrying its cause within it, nothing arising without the seed from which it grew. Known, a process can be joined, slowed, turned aside. The question “now what?” answers itself the moment you stop imagining gates.

And wonder survives the explanation. The same water that wears away the cliff lifts the boats. The same increment that piles into peril piles, with one small deviation, into something nobody foretold. Watch for the deviation. The future hides there - not behind any threshold, but in the next grain.