From Small to Large Language Models: Revisiting the Federalist Papers

So Won Jeong, Veronika Rockova · 2025

Read From Small to Large Language Models: Revisiting the Federalist Papers by So Won Jeong, Veronika Rockova (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-01869.txt.

Description

So Won Jeong and Veronika Rockova revisit the famous fight over who wrote the disputed Federalist Papers, now armed with language models, in a paper from 2025. In the nineteen sixties, two statisticians settled the question for Madison with the first celebrated Bayesian case study. The data set has been a test bed for authorship methods ever since.

The authors review modern language model tools through a statistician's eyes and try their built in text embeddings, without any tuning, on the attribution task. They explain how the embeddings differ and how to pool them across a document. Against their own expectations, expanding features with embeddings sometimes hurt attribution compared with leaner reductions. The paper is a caution and a guide for stylometry in the model era.

Catalog record

CREATORSo Won Jeong, Veronika Rockova
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE119 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-01869

Browse the full library · About the Tower of Babel