From model failure to system harm: operationalizing a sociotechnical pathway for healthcare AI safety
Burhan Sebin, Irem Karaman Sebin · 2026
Read From model failure to system harm: operationalizing a sociotechnical pathway for healthcare AI safety by Burhan Sebin, Irem Karaman Sebin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-13617058.txt.
Description
Burhan Sebin and Irem Karaman Sebin propose a framework that traces how a healthcare AI failure becomes real patient harm. AI is usually judged on discrimination, calibration, and accuracy. But safety depends on what happens after an output enters a clinical system: whether it is noticed, trusted, verified, acted on, and spread through workflows and capacity. Evidence from postmarket reports, human-AI studies, drift analyses, and equity audits shows hazards arise at many points, though harm rates remain unquantified.
Their five-stage sociotechnical pathway runs from upstream vulnerability through AI behavior, human-workflow mediation, and decision or system effect, to downstream harm. Each transition is treated as an auditable control point, with clear measures, named actors, escalation rules, and response actions. Thresholds should be set ahead for the intended use and local context. Rather than another catalog of principles for running things, the framework follows one vulnerability's spread.
Catalog record
| CREATOR | Burhan Sebin, Irem Karaman Sebin |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |