On: The problem AI content moderation cannot solve
The newspapers today speak of a new machine for cleaning. It is designed to sift through the vast, unruly content of the human psyche, as expressed online, and to remove what is deemed unacceptable. They call it moderation. They are disappointed that it fails.
This is not a failure of the machine. It is a perfect success of the system’s true aim. The official narrative is that the platform wishes to create a safe, harmonious space. But what is a social platform if not a mechanism for the constant, frictionless production of content? Its lifeblood is the flow of images, words, and impulses. To truly moderate - to truly judge and exclude based on a complex, human understanding of context, of consent, of harm - would be to strangle the flow itself. Therefore, the system must employ a tool that appears to clean but cannot possibly succeed. The AI is perfectly designed for this: it can flag the obvious symbol, the forbidden word, but it is constitutionally incapable of understanding the human exchange it pretends to police. It cannot see the coercion in a smile, the violation in a gaze held too long.
The symptom, then, is not the failure to protect. The symptom is the fervent, public belief that a better algorithm is the cure. Each new scandal, each “backlash,” produces the same response: a promise of more sophisticated machine learning. This is the repetition compulsion. The system, and its users, repeat the cycle of outrage and technical “fix” because to break the cycle would be to acknowledge the repressed truth: that the platform’s fundamental architecture - its hunger for content, its reduction of human relation to data - is itself the generator of the poison it claims to want to filter out.
The machine does not understand consent because the business model cannot afford to. Consent is a pause, a negotiation, a silence. The feed abhors a vacuum. So the AI will continue to fail gloriously and expensively, and we will continue to demand that it try harder. The intensity of our collective insistence on this technical solution is the clearest possible marker of our resistance to the actual diagnosis.