Publication trend analysis and synthesis via large language model: A case study of engineering in PNAS

Mason Smetana, Lev Khazanovich · 2025

Read Publication trend analysis and synthesis via large language model: A case study of engineering in PNAS by Mason Smetana, Lev Khazanovich (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-16152.txt.

Description

Mason Smetana and Lev Khazanovich test whether large language models can map the shape of a whole research field. Science writing is split by field borders and jargon, so its growth is hard to track. Their test case is twenty years of engineering papers, more than fifteen hundred in all, from one major journal.

Their method works in two passes. The model first gives each paper a main topic from its summary, then reads the full text for side topics. A hand check on a sample found the labels right about three times in four. The model also redrew much of the journal's own hidden two-topic scheme, with no prior hint of it. The result is a map that shows cross-field links which keyword lists tend to miss.

Catalog record

CREATORMason Smetana, Lev Khazanovich
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE103 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-16152

Browse the full library · About the Tower of Babel