On: The problem AI content moderation cannot solve

The morning brought news of a machine judging what eyes should see, and I confess my first thought was not of the machine’s limits but of the hands that trained it. Who fed the ledger its definitions of harm? Who decided that a woman’s portrait, rendered by another woman’s hand, was indecent while the same image sold in a gallery was not? The impartial spectator within me recoils - not from the algorithm’s failure, but from the merchants of attention who treat consent as a variable to be optimized rather than a boundary to be respected.

Consider the ledger’s hidden arithmetic. The platform claims its interests align with the public’s, yet the same fingers that scroll through feeds today may tomorrow find their own words parsed by the same blunt instrument. The merchant who profits from the moderation gap will not be the one whose livelihood is erased when the system mistakes satire for sedition or grief for grievance. The spectator in the breast knows this asymmetry: we tolerate errors that befall others far more readily than those that visit ourselves.

And what of the stupefaction? The factory floor has moved from pins to pixels, yet the division of labour remains. One worker labels violence; another labels beauty; a third adjusts the thresholds between them. Each performs a single operation with mechanical precision, while the architecture of the whole grows too vast for any single conscience to survey. The output is prodigious - millions of decisions per second - but the degradation is real. The moderator who sees only fragments of suffering may soon find their own humanity reduced to fragments as well.

The merchants will protest that no human could scale such work. To which I answer: precisely. When the scale of moral labour outstrips the scale of moral attention, the result is not efficiency but moral bankruptcy. The invisible hand requires eyes that can see.