Judge a Book by Its Cover: Investigating Multi-Modal LLMs for Multi-Page Handwritten Document Transcription

Benjamin Gutteridge, Matthew Jackson, Toni Kukurin, Xiaowen Dong · 2025

Read Judge a Book by Its Cover: Investigating Multi-Modal LLMs for Multi-Page Handwritten Document Transcription by Benjamin Gutteridge, Matthew Jackson, Toni Kukurin, Xiaowen Dong (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-20295.txt.

Description

Benjamin Gutteridge and co-authors test multimodal language models for transcribing multi-page handwritten documents. Handwriting recognition still needs costly labeled data for fine-tuning. Zero-shot tools promise a cheaper route for real archives.

Most handwriting is multi-page, with shared style and topic across pages. Standard tools read one page at a time and lose that context. The team compared several combined pipelines for the task. Options joined optical reading, language post-processing, and direct model reading. A new benchmark was built for multi-page transcription. Prompt strategies were a special focus of the tests. Results show where page context helps accuracy most. The work guides digitization of handwritten collections.

Catalog record

CREATORBenjamin Gutteridge, Matthew Jackson, Toni Kukurin, Xiaowen Dong
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-20295

Browse the full library · About the Tower of Babel