iDocV2: Leveraging Self-Supervision and Open-Set Detection for Improving Pattern Spotting in Historical Documents
Jose M. Saavedra, Christopher Stears, Marcelo Pizarro, Cristóbal Loyola, Luis Aros · 2026
Read iDocV2: Leveraging Self-Supervision and Open-Set Detection for Improving Pattern Spotting in Historical Documents by Jose M. Saavedra, Christopher Stears, Marcelo Pizarro, Cristóbal Loyola, Luis Aros (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-16726.txt.
Introduction
Saavedra and colleagues present iDocV2 for pattern spotting in documents with open-set detection. Searching by patterns grows critical as digital books massify. Best precision sits near 49 percent and near 43 percent for small non-square queries, with searches up to 7 seconds. The model pairs an encoder, iDoc, trained self-supervised, with an open-set detector to accelerate searching. It matches best retrieval and spotting, runs 10 times faster, and sets a best near 61 percent precision on small non-square queries. Non-maximum suppression reduces false positives over the previous version.
Catalog record
| CREATOR | Jose M. Saavedra, Christopher Stears, Marcelo Pizarro, Cristóbal Loyola, Luis Aros |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33213 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.16726
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
iDocV2: Leveraging Self-Supervision and Open-Set Detection for Improving Pattern Spotting in Historical Documents Jose M. Saavedra, Christopher Stears, Marcelo Pizarro, Cristóbal Loyola, Luis Aros Abstract Considering the imminent massification of digital books, it has become critical to facilitate searching collections through graphical patterns. Current strategies for document retrieval and pattern spotting in historical documents still need to be improved. State-of-the-art strategies achieve an overall precision of 0.494 0.494 for pattern spotting, where the precision for small non-square queries reaches 0.427. In addition, the processing time is excessive, requiring up to 7 seconds for searching in the DocExplore dataset due to a dense-based strategy used by SOTA models. Therefore, we propose a new model based on a better encoder (iDoc), trained under a self-supervised strategy, and an open-set detector to accelerate searching. Our model achieves competitive results with state-of-the-art pattern spotting and document retrieval, improving speed by 10x. Furthermore, our model reaches a new SOTA performance on the small non-square queries, achieving a new precision of 0.612.Different from the previous version, this leverages non-maximum suppression to reduce false positives. keywords Pattern Spotting, self-supervision, historical document retrieval. 1 Introduction The original historical documents are extremely valuable and often irreplaceable. They are a crucial collective memory component, representing a nation’s history, culture, and identity 29 . Moreover, the information extracted from historical documents allows people to reconstruct genealogies and perform demographic studies 17 . Historical documents include ancient handwritten texts, old printed or photostat copies, records preserved on microfilm, and engineering or architectural drawings in city, county, state, and business archives. Thus, it is essential to maintain the integrity of these documents as they provide crucial insights into the people, places, and events of ancient times. Digitization is a standard process to preserve the integrity of historical documents. In addition, digitization allows documents to be available online, facilitating access to researchers, students, interested institutions and anyone worldwide, while preventing damage by improper manipulation 18 ; 9 . Many components are involved in the document digitization process depending on the preservation or interaction level you expect from your documents. Scanning, cleaning, segmentation and content extraction are examples of some stages involved in the digitization process 31 . Once documents are available through digital means, other challenges arise. For instance, it is crucial to provide efficient mechanisms to query the content of digital documents. Traditional mechanisms use OCR or handwriting recognition algorithms to extract descriptions or annotations to facilitate keyword-based querying 34 . However, illustrations are a predominant type of content in medieval documents 3 . Thus, it is also essential to develop efficient models for searching databases based on image content to complement traditional text-based searching. Regarding the relevance of illustrations in historical document processing, our main interest is to provide effective and efficient mechanisms for graphical object localization (a.k.a. pattern spotting) in digital documents, where a simple image is used as a query. Current strategies for pattern spotting in historical documents still show poor behavior, especially for spotting small patterns. Indeed, a recent work 10 proposes a dense correlation-based method, achieving an overall mAP of 0.494 in the pattern spotting task on the DocExplore dataset 15 , where the performance for small non-square queries reaches 0.427 1 1 1 The Curi’s performance was obtained by running the original code kindly provided by the first author. . Although this method outperforms previous works, it undergoes an excessive searching time due to the dense strategy, requiring up to 7 seconds per query. In addition, current proposals are not robust to variations in scale of the target patterns. Therefore, this work proposes an efficient model for one-shot image detection in historical documents, changing the dense matching approach used in the Curi’s proposal 10 by sparse matching. Thus, our model reduces the querying time by 10x, making it appropriate for practical scenarios like searching in large libraries. Our proposal consists of two main components: an offline open-set region detector and a highly semantic encoder appropriately adapted to the context of historical documents using self-supervised learning. Our models show competitive precision regarding current methods in the pattern spotting task, increasing the effectiveness for the small non-square queries to 0.588, which allows us to reach a new overall mAP of 0.620. In addition, for document retrieval, our model achieves an overall mAP of 0.789, statistically similar to the best known model but 10x faster. To facilitate the reading, we organize this work as follows: Section 2 describes the related work. Section 3 presents our proposal. Section 4 describes the experimental settings. Section 5 presents the achieved results. Finally, Section 6 describes the final remarks. 2 Related Work 2.1 Searching on Historical Documents Considering the upcoming widespread use of digital books, we have seen diverse approaches for searching by content in digital historical documents repositories. This interest arises even before the deep learning era. For instance, in 2010, Zhu and Keogh 37 proposed the first method for mining historical manuscripts. They used a local color histogram and a divide-and-conquer approach to retrieve and locate queries from a few books. Later, 35 incorporated the Histogram of Oriented Gradients (HoG) and a color histogram in the HSV space for image representation. 13 proposed a BoVW image representation using densely sampled SIFT and a Longest Weighted Profile algorithm to impose spatial ordering in the visual words representation. In 2017, 15 proposed the DocExplore dataset to standardize evaluating the proposed models for searching historical documents. In addition, they proposed a complete system for searching images and locating small graphic objects in images of medieval documents 16 . Their work is based on a region proposal module using BING (Binarized Normed Gradients) 8 and a bag-of-words approach using VLAD and Fisher-Vector aggregation strategies. With the flourishing of deep learning, new approaches emerged, particularly for encoding the region of interest. In this vein, the proposals of 33 ; 32 were pioneers in applying deep learning encoders for document retrieval and pattern spotting. To this end, they use an FPN architecture 24 to represent images on different scales. The use of multiscale representations allows them to deal with the size diversity of the target patterns. The FPN-based Ubeda’s proposal beat En’s models in the pattern spotting task, increasing the performance from 0.157 to 0.272 (see Table 1 ). However, the results in document retrieval did not follow the same way, achieving a performance slightly worse than En’s proposal (see Table 2 ). More recently, 10 proposed a correlation-based model in the feature domain. Using a VGG-16 30 as the image encoder, this model computes a feature map for the query and each catalog document. The model then correlates the query and document embeddings. This approach achieves the best document retrieval and pattern spotting performance but undergoes critical weakness. Curi’s model is based on a dense correlation, which produces excessive time consumption, requiring over 7 seconds 2 2 2 All experiments were run with the same hardware, including a GPU RTX A6000 Ada. to search in the DocExplore catalog, which only contains 1447 pages. In addition, the correlation approach assumes that the size of the target pattern is identical to the query’s size, which is a strong constraint that can limit its applicability. size aspect ratio Pattern Spotting