Aligning Large Language Model Behavior with Human Citation Preferences
Kenichiro Ando, Tatsuya Harada · 2026
Read Aligning Large Language Model Behavior with Human Citation Preferences by Kenichiro Ando, Tatsuya Harada (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-05205.txt.
Description
Services powered by language models sprinkle citations over their answers to look trustworthy, but nobody had checked whether the models cite what humans would cite. Kenichiro Ando and Tatsuya Harada measure that alignment in this 2026 work-in-progress study. They sort web texts into eight types by citation motive, from medical claims to numeric statements, and compare model and human preferences across every pairing of types.
Humans most want citations on medical text, and stronger models share that instinct. But models were up to about 27 percent more likely than humans to cite text merely flagged as needing a citation, an overemphasis that hurt alignment. They also under-cited numeric sentences and sentences with personal names, exactly where humans do demand sources. A round of preference training then calibrated the models noticeably closer to human choices.
Catalog record
| CREATOR | Kenichiro Ando, Tatsuya Harada |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-05205