A Survey of OCR Evaluation Methods and Metrics and the Invisibility of Historical Documents DOI: XXXXXXX.XXXXXXX Conference: ACM Conference on Fairness, Accountability, and Transparency; June 25–26, 2026; Montréal, Ca CCS: Computing methodologies Artificial intelligence CCS: Information systems Information retrieval CCS: Applied computing Arts and humanities CCS: Computing methodologies Machine learning

Fitsum Sileshi Beyene, Christopher L. Dancy · 2026

Read A Survey of OCR Evaluation Methods and Metrics and the Invisibility of Historical Documents DOI: XXXXXXX.XXXXXXX Conference: ACM Conference on Fairness, Accountability, and Transparency; June 25–26, 2026; Montréal, Ca CCS: Computing methodologies Artificial intelligence CCS: Information systems Information retrieval CCS: Applied computing Arts and humanities CCS: Computing methodologies Machine learning by Fitsum Sileshi Beyene, Christopher L. Dancy (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-25761.txt.

Description

Beyene and Dancy survey how OCR systems are evaluated, and what those tests leave out. Modern vision models now read documents, yet benchmarks center on modern Western institutional files. Historical archives rarely appear in training data or test sets. The authors review papers and datasets from 2006 to 2025 with the PRISMA method. They focus on Black historical newspapers as a key case. Most tests stress character accuracy on clean modern layouts. They miss column collapse, type errors, and invented text. The authors tie these gaps to structural invisibility and harm.

Catalog record

CREATORFitsum Sileshi Beyene, Christopher L. Dancy
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41145
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.25761

Browse the full library · About the Tower of Babel