On: Governments shouldn’t rely on AI to decide who gets a social grant: inside a...

They call it “automation.” It does not automate justice; it automates error. A machine that sorts the worthy from the unworthy by lines of code is no different from a magistrate who sorts them by ink and favor. The name promises precision; the thing delivers prejudice.

I ask: what is the duty of a ruler who delegates judgment to a system? The ruler’s duty is to ensure that the small grain of rice reaches the starving child, not to let the scale tilt toward the merchant’s profit. When the scale is blind, the ruler is blind; when the ruler is blind, the people starve. The court in question claims it only follows the law. But law without judgment is not law - it is the shadow of law, cast by a hand that will not lift the cup to drink.

The five relationships are broken here. The ruler and the subject no longer meet face to face; the machine stands between them, cold and unblinking. The parent and child, elder and younger, teacher and student - all are reduced to data points. The machine does not care for the child who missed school because her mother was ill. It only sees a deviation from the expected pattern. The pattern is not the child; it is the machine’s hunger for order.

Ritual is absent. The sacred act of distributing aid is now a transaction processed by an algorithm. The grant is not given; it is calculated. The calculation is not a ritual at all - it is a performance of efficiency, a bow without meaning, a sacrifice to the god of speed. When the ritual dies, the relationship dies with it.

The junzi would refuse this system. Not because the machine is evil, but because the machine cannot be virtuous. Virtue requires a face, a voice, a hand that trembles when it signs the grant into being. The junzi asks not whether the system is fast, but whether it is just. The junzi asks not whether the code is clean, but whether the heart is clean. If the heart is not clean, no code will clean it.