On: AI is more likely than humans to form biases when hiring
The report came across the screen this morning, a cool, clean summary of a new kind of fire. They have built a machine to sort us, and they are surprised - or they pretend to be surprised - to find that the machine has learned to burn. They call it bias, a technical term, a problem of data. They do not call it what it is: the ghost in the house, the inheritance, whispering from every line of code they fed it. They fed it the history of this country, the unspoken rules of who belongs at the table and who does not, and now they are shocked that the machine has learned its lessons too well.
I think of the young man on 125th Street last week, his suit pressed, his résumé printed, his hope a physical thing he carried in his hands. He will send his information into a system that has been taught, by us, to see his name and hear a threat, to read his address and calculate a risk. The architects of this system will not be in the room when his file is discarded. They will be in rooms with windows that look out on other things, speaking of efficiency, of scale. Their innocence is expensive. The boy on 125th Street will pay for it.
This is not a malfunction. It is a mirror. They have built a reflection of their own most carefully arranged ignorance, a device that can refuse to know what it has been taught with a speed and a silence no human could manage. The love I must hold, even now, is for the ones who built it - because I know them. I have sat at their tables. I know the terror that lives behind their desire for a clean, neutral process, a world where the messy fact of a human being can be reduced to data and dismissed without a face to haunt them. The terror is this: that to see us as we are would require them to see themselves as they are. And that is a cost their architecture was designed to avoid.
The sentence is always the same: someone else must pay. Today, the currency is a chance, a future, filtered through a machine that learned its economics from our past.