Un-Attributability: Computing Novelty from Retrieval & Semantic Similarity
Philipp Davydov, Ameya Prabhu, Matthias Bethge, Elisa Nguyen, Seong Joon Oh · 2025
Read Un-Attributability: Computing Novelty from Retrieval & Semantic Similarity by Philipp Davydov, Ameya Prabhu, Matthias Bethge, Elisa Nguyen, Seong Joon Oh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-27313.txt.
Description
Philipp Davydov, Ameya Prabhu, and three other co-authors ask how new AI-written text really is, in a 2025 study. A language model may echo its training text or coin fresh wording. Word-by-word checks miss echoes that swap in synonyms. Judging against the full training set is also a huge task.
The team reframes newness as a search task based on meaning. Their three-step method finds near matches, re-ranks them by chunk length, then scales scores against human ratings. Run on the SmolLM model family, it found echoes across far longer spans than once thought. Some task types push models toward or away from fresh text. Extra tuning for chat raised newness too, not just style. Their data and index are public.
Catalog record
| CREATOR | Philipp Davydov, Ameya Prabhu, Matthias Bethge, Elisa Nguyen, Seong Joon Oh |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-27313