CaptionSmiths: Flexibly Controlling Language Pattern in Image Captioning

Kuniaki SaitoDonghyun KimKwanyong Park, Atsushi Hashimoto, Yoshitaka Ushiku · 2025

Read CaptionSmiths: Flexibly Controlling Language Pattern in Image Captioning by Kuniaki SaitoDonghyun KimKwanyong Park, Atsushi Hashimoto, Yoshitaka Ushiku (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-01409.txt.

Description

Kuniaki Saito and co-workers present CaptionSmiths, a model that controls the language style of image captions, in a 2025 paper. Captioning tools serve many uses, but users cannot easily set how long or detailed a caption should be. Existing models were never trained with such properties as inputs.

Their method scores each training caption on length, descriptiveness, and word uniqueness, without human labeling. Those scores condition the model through interpolation between extreme style vectors, so style can slide smoothly. Tests showed smoother control and better word alignment than baselines. Error in hitting a target caption length fell sharply. Code is promised for release.

Catalog record

CREATORKuniaki SaitoDonghyun KimKwanyong Park, Atsushi Hashimoto, Yoshitaka Ushiku
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-01409

Browse the full library · About the Tower of Babel