Measuring directional bias amplification in image captions using predictability

Rahul Nair*, Bhanu Tokas*, Neel Shah, Hannah Kerner · 2025

Read Measuring directional bias amplification in image captions using predictability by Rahul Nair*, Bhanu Tokas*, Neel Shah, Hannah Kerner (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-07878.txt.

Description

Rahul Nair and co-authors build in 2025 a yardstick for when image captioning models do not just copy bias but make it worse. A captioning model trained on skewed photos may describe a woman with a knife as if the knife defined her, sharpening stereotypes at output time. Older bias measures were built for sorting tasks and cannot read caption wording.

One newer measure reads language but cannot say which side of a pairing the bias leans toward. Their new metric, directional bias amplification in captioning, fixes that: it tells whether captions bind a trait to one group over another. It also holds steadier when the sentence encoder behind it changes, and it estimates the effect more faithfully. Tested on gender and race in a standard photo caption set, theirs was the only measure the authors found reliable. Caption audits can now name the direction of a model's lean.

Catalog record

CREATORRahul Nair*, Bhanu Tokas*, Neel Shah, Hannah Kerner
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-07878

Browse the full library · About the Tower of Babel