Use of LLMs in preparing accessible scientific papers

Allison Doami, Christine James, Dan Lu, Lia Prins, Annette Torrence, Boris Veytsman · 2025

Read Use of LLMs in preparing accessible scientific papers by Allison Doami, Christine James, Dan Lu, Lia Prins, Annette Torrence, Boris Veytsman (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-00826.txt.

Introduction

Allison Doami and co-authors report a 2025 trial of using large language models to make old science papers easier for all readers to use. Papers saved in old formats often lack the logical tags that screen readers and other aids need. The team tried to add those tags by asking a model to convert papers with no prior examples.

The attempt worked at times, but the results were not steady enough to trust on their own. The report walks through where the conversion held up and where it broke down. It also weighs other routes to the same goal. For archives that must meet access rules, the paper is a plain warning that quick AI fixes still need care and checks.

Catalog record

CREATORAllison Doami, Christine James, Dan Lu, Lia Prins, Annette Torrence, Boris Veytsman
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-00826

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Use of LLMs in preparing accessible scientific papers Allison Doami, Christine James, Dan Lu, Lia Prins, Annette Torrence, Boris Veytsman Abstract Making scientific papers accessible may require reprocessing old papers to create output compliant with accessibility standards. An important step there is to convert the visual formatting to the logical one. In this report we describe our attempt at zero shot conversion of arXiv papers. Our results are mixed: while it is possible to do conversion, the reliability is not too good. We discuss alternative approaches to this problem. 1 Introduction Science becoming a mass occupation has been a revolutionary transformation for the society. The further acceleration of scientific progress might be achieved by the tapping of the pool of talents from the previously underrepresented populations: women, minorities, disabled people. Thus making science accessible for all is not just the matter of equity. It is important for all of us. This task has both social and technical dimensions. It is not enough just to attract these populations to science. To make contributions of the disabled people possible, we need to solve the technical problems of making work in science available for them. The importance of this task is being more and more recognized [ 6 , 13 ] . This is especially true with respect to people with low or no vision. Scientific output consists of mostly papers and books: textual information with images, tables etc. We need to make them available for assistive technologies like screen readers, Braille terminals, etc. There are standards for accessible Web pages [ 2 , 4 , 5 , 7 ] and PDFs [ 14 , 15 ] . An important part of these standards is the preservation of the logical formatting in the papers. A printed page uses a number of visual cues to convey the logical information to the reader. A sighted person knows that a bold-faced line probably is a section header, a centered line in the beginning of a paper is probably a title, a line under it probably has the information about authors, etc. All these devices are described as visual formatting. As the term itself suggests, this formatting is intended for visual consumption. It is more difficult for assistive devices like screen readers to express the meaning for the users. The recommendations of EBU [ 3 , § 4.1.2] insist on the logical formatting: Do not create manually individual headings by making them bold and by increasing the font size. Instead, create a style with this layout and apply it to every heading in your document. This will allow blind and partially sighted people to navigate easily through the document, using the heading list, generated by the screen reader. The advantages for you as an author are that it is easy to modify the style instead of all individual headings and that styles allow the automatic updating of your table of contents. Incidentally, logical formatting as opposed to visual formatting helps not just the people with low vision, but also another category of non-sighted consumers of texts: machines. Logically formatted papers are much more “machine-readable” and allow better analysis by various automatic tools, which is important for classification and summarization of knowledge. This is an example of the well known “curb-cut effect”: the changes made for the benefit of disabled people often have unintended positive effects for the society in general [ 1 ] . L a T e X is the system of choice of typesetting of papers in the \acronym STEM fields. Thus, the tendency of L a T e X to encourage logical formatting [ 9 ] is beneficial. Unfortunately, since L a T e X was designed in the previous century when computers were much less powerful than now, it is optimized to drop the information about the logical structure very early in the typesetting process, so the resulting \acronym PDF has only the visual information. As the author of the system underlying L a T e X said as early as 1974, “premature optimization is the root of all evil (or at least most of it) in programming.” [ 8 ] . The current effort of L a T e X 3 project is to override this early decision and make L a T e X to produce tagged \acronym PDF, satisfying the accessibility standards [ 10 , 11 ] . Tagged \acronym PDF files look like the traditional ones, but under the hood they contain the additional information available to the specialized software like screen readers. This information enables the software to discern the logical meaning of each element of the page, thus making the reading more understandable. Many publishers have the L a T e X source of the papers stored, so it will be possible to reprocess the old papers to get the new accessible versions. One of the biggest depositories of \acronym STEM papers in L a T e X format is the arXiv preprint server that has about 2.4 million articles and continues to grow fast. The vast majority of arXiv papers are in (La) T e X format, and arXiv pledged to reprocess them into accessible \acronym PDF [ 16 ] format. In preparation for this step, we need to assess whether the current papers in arXiv are suitable for conversion. While L a T e X encourages logical formatting, it does not enforce it, and some, especially older papers, indeed use visual instead of logical formatting. Spot checks show that this is the case for 5%–10% of preprints, which translates to hundreds thousands of papers that need to be addressed. Most papers with visual formatting are rather old (before 2020), but even some new papers use it. The translation from visual to logical formatting, especially at scale, is not trivial. If we had known that authors, for example, always use bold large fonts for section headers, we would write a simple regular expression to change \textbf{\large 1 Introduction} in a solitary paragraph to \section{Introduction} . Unfortunately,authors are quite inventive. There are too many ways to set up visual formatting—and almost any of them is used by an author! This looks like an interesting problem to try machine learning methods. Can an algorithm convert the visual formatting to logical formatting? While \acronym LLMs are ultimately language processing machines rather than information processing ones [ 19 ] , the conversion from visual format to a logical format can be seen as ultimately a language task, so hopefully \acronym LLM can deal with it. In September 2024, Chan Zuckerberg Initiative organized a hackathon for its employees. We decided this problem might be a good idea for a hackathon: an exploratory research by a dedicated team. We downloaded a sample of papers from arXiv, and selected those with elements of visual formatting. We interactively talked to ChatGPT 4o from OpenAI [ 12 ] and compared the results with the expected ones. While this research was completely exploratory, we decided to publish the results of our three days intense conversations with ChatGPT to show both the promises and pitfalls of this approach. 2 Dialogs with ChatGPT about L a T e X 2.1 The first attempt: assume you are a L

Read the complete text