Publication trend analysis and synthesis via large language model: A case study of engineering in PNAS
Mason Smetana, Lev Khazanovich · 2025
Read Publication trend analysis and synthesis via large language model: A case study of engineering in PNAS by Mason Smetana, Lev Khazanovich (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-16152.txt.
Description
Mason Smetana and Lev Khazanovich test whether large language models can map the shape of a whole research field. Science writing is split by field borders and jargon, so its growth is hard to track. Their test case is twenty years of engineering papers, more than fifteen hundred in all, from one major journal.
Their method works in two passes. The model first gives each paper a main topic from its summary, then reads the full text for side topics. A hand check on a sample found the labels right about three times in four. The model also redrew much of the journal's own hidden two-topic scheme, with no prior hint of it. The result is a map that shows cross-field links which keyword lists tend to miss.
Catalog record
| CREATOR | Mason Smetana, Lev Khazanovich |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 103 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-16152