Un-Attributability: Computing Novelty from Retrieval & Semantic Similarity

Philipp Davydov, Ameya Prabhu, Matthias Bethge, Elisa Nguyen, Seong Joon Oh · 2025

Read Un-Attributability: Computing Novelty from Retrieval & Semantic Similarity by Philipp Davydov, Ameya Prabhu, Matthias Bethge, Elisa Nguyen, Seong Joon Oh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-27313.txt.

Description

Philipp Davydov, Ameya Prabhu, and three other co-authors ask how new AI-written text really is, in a 2025 study. A language model may echo its training text or coin fresh wording. Word-by-word checks miss echoes that swap in synonyms. Judging against the full training set is also a huge task.

The team reframes newness as a search task based on meaning. Their three-step method finds near matches, re-ranks them by chunk length, then scales scores against human ratings. Run on the SmolLM model family, it found echoes across far longer spans than once thought. Some task types push models toward or away from fresh text. Extra tuning for chat raised newness too, not just style. Their data and index are public.

Catalog record

CREATORPhilipp Davydov, Ameya Prabhu, Matthias Bethge, Elisa Nguyen, Seong Joon Oh
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-27313

Browse the full library · About the Tower of Babel