From model failure to system harm: operationalizing a sociotechnical pathway for healthcare AI safety

Burhan Sebin, Irem Karaman Sebin · 2026

Read From model failure to system harm: operationalizing a sociotechnical pathway for healthcare AI safety by Burhan Sebin, Irem Karaman Sebin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-13617058.txt.

Description

Burhan Sebin and Irem Karaman Sebin propose a framework that traces how a healthcare AI failure becomes real patient harm. AI is usually judged on discrimination, calibration, and accuracy. But safety depends on what happens after an output enters a clinical system: whether it is noticed, trusted, verified, acted on, and spread through workflows and capacity. Evidence from postmarket reports, human-AI studies, drift analyses, and equity audits shows hazards arise at many points, though harm rates remain unquantified.

Their five-stage sociotechnical pathway runs from upstream vulnerability through AI behavior, human-workflow mediation, and decision or system effect, to downstream harm. Each transition is treated as an auditable control point, with clear measures, named actors, escalation rules, and response actions. Thresholds should be set ahead for the intended use and local context. Rather than another catalog of principles for running things, the framework follows one vulnerability's spread.

Catalog record

CREATORBurhan Sebin, Irem Karaman Sebin
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC13617058

Browse the full library · About the Tower of Babel