Am I Blue or Is My Hobby Counting Teardrops? Expression Leakage in Large Language Models as a Symptom of Irrelevancy Disruption

Berkay Köprü 1 Mehrzad Mashal 2 Yigit Gurses 2 Akos Kadar 2 Maximilian Schmitt 1 Ditty Mathew 1 Felix Burkhardt 1 Florian Eyben 1 Björn W. Schuller 1,3,4 1 audEERING GmbH, Gilching, Germany 2 Agile Robots SE, Munich, Germany 3 Chair of Health Informatics, Technical University of Munich, Germany 4 Gr · 2025

Read Am I Blue or Is My Hobby Counting Teardrops? Expression Leakage in Large Language Models as a Symptom of Irrelevancy Disruption by Berkay Köprü 1 Mehrzad Mashal 2 Yigit Gurses 2 Akos Kadar 2 Maximilian Schmitt 1 Ditty Mathew 1 Felix Burkhardt 1 Florian Eyben 1 Björn W. Schuller 1,3,4 1 audEERING GmbH, Gilching, Germany 2 Agile Robots SE, Munich, Germany 3 Chair of Health Informatics, Technical University of Munich, Germany 4 Gr (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-01708.txt.

Description

Berkay Köprü and eight co-authors name a new flaw in large language models. Their paper from twenty twenty-five calls it expression leakage. Models can pick up stray facts from text that does not matter to the task. Here the leak is in tone: models add charged phrases that have no link to the input sense.

The team built a test set for this flaw. They also made a scheme to build such sets from free web text on its own. Their scoring pipeline matches human judgment well, so tests can run fast. Bigger models in one family leaked less. Prompt tricks alone did not fix the leak. Sad or harsh text in the prompt broke output more than warm text did. The authors say care at build time is what curbs this flaw.

Catalog record

CREATORBerkay Köprü 1 Mehrzad Mashal 2 Yigit Gurses 2 Akos Kadar 2 Maximilian Schmitt 1 Ditty Mathew 1 Felix Burkhardt 1 Florian Eyben 1 Björn W. Schuller 1,3,4 1 audEERING GmbH, Gilching, Germany 2 Agile Robots SE, Munich, Germany 3 Chair of Health Informatics, Technical University of Munich, Germany 4 Gr
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-01708

Browse the full library · About the Tower of Babel