What do Large Language Models Say About Animals? Investigating Risks of Animal Harm in Generated Text
Arturs Kanepajs, Aditi Basu, Sankalpa Ghose, Constance Li, Akshat Mehta, Ronak Mehta, Samuel David Tucker-Davis, Eric Zhou, Bob Fischer, Jacy Reese Anthis · 2025
Read What do Large Language Models Say About Animals? Investigating Risks of Animal Harm in Generated Text by Arturs Kanepajs, Aditi Basu, Sankalpa Ghose, Constance Li, Akshat Mehta, Ronak Mehta, Samuel David Tucker-Davis, Eric Zhou, Bob Fischer, Jacy Reese Anthis (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-04804.txt.
Description
Arturs Kanepajs and co-authors grade what language models say about animals, in a 2025 paper. Model outputs can nudge how people treat animals, yet harm to animals had barely been measured. Their benchmark, AnimalHarmBench, puts that risk to the test.
The set holds 1,850 questions drawn from Reddit titles plus 2,500 made-up ones across 50 animal types and 50 moral scenes. Scenes range from daily care choices to how much one would pay to prevent harm. A judge model scored answers for whether they raise or lower harm, with self-favoring bias corrected. Scores split sharply by model, animal, and scene. The bench gives labs a way to track a blind spot in AI safety work.
Catalog record
| CREATOR | Arturs Kanepajs, Aditi Basu, Sankalpa Ghose, Constance Li, Akshat Mehta, Ronak Mehta, Samuel David Tucker-Davis, Eric Zhou, Bob Fischer, Jacy Reese Anthis |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 81 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-04804