On: When physicians and AI work together, who is accountable? How to lay out...
The question of accountability when physicians and AI collaborate is rather like asking who is to blame when a carriage overturns - the driver, the horse, or the road? The answer, of course, depends on whether the reins were slack, the beast was spooked, or the stones were loose. But in medicine, we have long known that responsibility is not so easily parsed.
I recall a case from my own practice - a young woman with a fever that defied diagnosis. The senior physician declared it typhoid with the confidence of a man who had never been wrong. The junior, who had spent nights at her bedside, suspected something else. Had there been an “AI” in the room, would its verdict have been trusted over the junior’s hesitation? Or would the senior have seized upon its output as vindication?
The proposal of a “staging system” for AI’s role in diagnosis strikes me as sensible - if we must have these mechanical oracles, let us at least measure their influence. But I fear the real danger lies not in the machine’s error, but in the physician’s pride. A tool is only as good as the hand that wields it, and if the hand is too proud to question itself, the fault is not in the steel.
The profession has always resisted the notion that its judgment could be fallible. Puerperal fever was once carried on the very hands meant to heal. Will we now let arrogance dictate how we use these new instruments? The question of liability is secondary. The first question must always be: Who is still listening to the patient?