Do Transformers Understand Ancient Roman Coin Motifs Better than CNNs?

David Reid, Ognjen Arandjelović · 2026

Read Do Transformers Understand Ancient Roman Coin Motifs Better than CNNs? by David Reid, Ognjen Arandjelović (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-09433.txt.

Introduction

David Reid and Ognjen Arandjelović ask whether transformers read ancient Roman coins better than convolutional networks. Their 2026 arXiv paper compares the two model families on coin motif recognition. Automated coin analysis could help researchers mine large collections and help collectors judge what they buy or sell.

Recent work has targeted the semantic elements shown on coins, the portraits, gods, and symbols, using convolutional neural networks. The authors test whether transformer models, now dominant in image tasks, do better on the same job. Reading motifs at scale would turn museum trays into searchable data. The comparison shows which architecture suits this niche of cultural heritage.

Catalog record

CREATORDavid Reid, Ognjen Arandjelović
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE80 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-09433

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Do Transformers Understand Ancient Roman Coin Motifs Better than CNNs? David Reid, Ognjen Arandjelović Abstract Automated analysis of ancient coins has the potential to help researchers extract more historical insights from large collections of coins and to help collectors understand what they are buying or selling. Recent research in this area has shown promise in focusing on identification of semantic elements as they are commonly depicted on ancient coins, by using convolutional neural networks (CNNs). This paper is the first to apply the recently proposed Vision Transformer (ViT) deep learning architecture to the task of identification of semantic elements on coins, using fully automatic learning from multi-modal data (images and unstructured text). This article summarises previous research in the area, discusses the training and implementation of ViT and CNN models for ancient coins analysis and provides an evaluation of their performance. The ViT models were found to outperform the newly trained CNN models in accuracy. 1 Introduction Numismatics is the study of physical currency, such as coins. Ancient numismatics, the focus of this paper, concerns ancient coins (such as Ancient Greek, Roman, and Celtic) and is of interest to both collectors and scholars. Over the course of the last 15 years or so, work on the employment of computer vision (CV) and machine learning (ML) in ancient coin analysis has been attracting an increasing attention from the research community, owing both to its potential to save time and increase the availability of emergent information to scholars, and assist as a learning tool to hobbyists. The task has also proven to be a most difficult one, introducing a series of domain-specific CV and ML challenges unencountered in the more mainstream image understanding applications. While most of the existing research in this realm thus far has focused on image-to-image matching problem, in the present paper we build upon a new strand of methods that seek to describe the semantic content depicted on coins, that is, that aim to understand their stylized visual elements. This shift in focus is driven by the observation that the volume of possible ancient coin issue types is enormous and practically prohibitive to obtain for the aforesaid matching, motivating more nuanced analysis more akin to how a human expect would approach it. In particular, following on the Convolutional Neural Network (CNN) approach introduced by Cooper and Arandjelović [ 12 ] , herein we investigate if the use of the Vision Transformer (ViT), an architecture which has largely overtaken the popularity of CNNs for many visual tasks, confers benefit in the recognition of such nuanced content. The remainder of the article is organized as follows. Firstly, considering the interdisciplinary nature of our work, we briefly summarize the key technical terminology so as to facilitate the understanding of the article content by as wide of an audience as possible. In Section 2 we survey the relevant prior work, starting from work on the use of ML and CV in ancient numismatics, continuing to a survey of the technical underpinnings of the Transformer architecture and then the Vision Transformer in particular, finishing with a discussion of research on explainable AI. Then we proceed with a comprehensive description of the proposed methodology in Section 3 . In Section 4 we present a description of our empirical evaluation, including the details of the data sets used, the obtained results, and a discussion thereof. Finally, in Section 5 we make concluding remarks, highlight the potential limitations of the present research, and make recommendations for future work. 1.1 Relevant specialist terminology In this context, a coin refers to an individual physical specimen, whereas its issue is the type of the coin and is of primary interest in many classification tasks. For two coins to be considered of the same issue, their designs must match in terms of the semantic content on either side, though there can be minor variations in artistic depictions and the spacing between letters, which complicates automated analysis. The two sides of a coin, colloquially known as ‘heads’ and ‘tails’, are technically called the obverse and reverse respectively. Inscriptions around the edge of a coin are referred to as a legend . The obverse (heads) features a bust as the central motif and the surrounding legend provides the name and titles of the issuer. The reverse has a central motif that may be a person, place or object, which is often related to the reverse legend. 2 Related Work The primary focus of this research is the application of the Vision Transformer (ViT) architecture to the task of automated analysis of ancient coins. To provide the necessary context for the subject matter, this section consists of: a survey of recent work to automate ancient coin analysis; an overview of Vision Transformers and related work; and a brief overview of visual explanation of deep learning models. 2.1 Automated Ancient Coin Analysis Historically, analysis of ancient coins has been performed by experts with long-acquired specialist knowledge, often with reference to authoritative sources for common classification schemes [ 14 , 29 ] . This is time-consuming and costly; therefore, efforts to automate such analysis have increased dramatically as computer vision has become ubiquitous in modern society. Arandjelović and Zachariou [ 6 ] identified eight key problems in the application of computer vision and machine learning to ancient numismatics, which are far from completely solved. These included specimen matching (for tracking an individual coin), issue matching (for identifying a coin’s type) and forgery recognition. Forgery recognition and specimen matching are of obvious interest to collectors and dealers of coins, who want to be sure of exactly what they are trading. 2.1.1 Challenges A number of factors make the automated analysis of ancient coins in images difficult and therefore an interesting research problem. Firstly, there is a high level of intra-class variability for most analysis problems. This can be due to differences in the dies used to produce coins of the same issue, which may differ in artistic depictions of motifs or spacing in legends, or variability introduced by the degradation of coins, both from wear while they were in circulation and, later, from the environment in which they were stored or buried prior to excavation. Secondly, there are many types of ancient coins (at least 43,000 Roman imperial coin issues [ 1 ] and 1,900 republican ones [ 2 ] ). Many of these coin issues do not have readily available high-quality images, which makes visual coin matching in general impractical, as noted by Cooper and Arandjelović [ 12 ] . Further challenges are posed by the lack of meaningful textural information from coins [ 6 ] and the variability among photos of coins, which can have uneven lighting or include objects irrelevant to analysis tasks. 2.1.2 Prior Work on Automation Automated analysis of ancient coins is a research field that has grown considerably in the past decade. During that time, a range of methods have been applied. Earlier work [ 40 , 22 , 5 ] tended to focus on visual matching of coin issues based on local features, typically using scale-invariant feature transform (SIFT) [ 25 ] . Such techniques, which worked well for modern coins, were found to perform poorly on ancient coins,

Read the complete text