Seeing The Words: Evaluating AI-generated Biblical Art

Hidde Makimei, Shuai Wang, Willem van Peursen · 2025

Read Seeing The Words: Evaluating AI-generated Biblical Art by Hidde Makimei, Shuai Wang, Willem van Peursen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-16974.txt.

Introduction

Hidde Makimei, Shuai Wang, and Willem van Peursen test AI image tools on Bible texts in this 2025 paper. New tools can make a picture from a short text prompt. The team asks if the pictures fit the Bible scene and its setting.

They built a set of more than seven thousand images made from Bible passages. Neural tools scored the images on several points. The authors judge how true the images are to the text. They also weigh questions of faith and art. The paper ends with thoughts on use of such images and on how well the tools did.

Catalog record

CREATORHidde Makimei, Shuai Wang, Willem van Peursen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE71 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-16974

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Seeing The Words: Evaluating AI-generated Biblical Art Hidde Makimei, Shuai Wang, Willem van Peursen Abstract The past years witnessed a significant amount of Artificial Intelligence (AI) tools that can generate images from texts. This triggers the discussion of whether AI can generate accurate images using text from the Bible with respect to the corresponding biblical contexts and backgrounds. Despite some existing attempts at a small scale, little work has been done to systematically evaluate these generated images. In this work, we provide a large dataset of over 7K images using biblical text as prompts. These images were evaluated with multiple neural network-based tools on various aspects. We provide an assessment of accuracy and some analysis from the perspective of religion and aesthetics. Finally, we discuss the use of the generated images and reflect on the performance of the AI generators. 1 Introduction The biblical text has served as a wellspring of inspiration for human creativity across various domains. Its stories, metaphors, ethical teachings, and representations of divine beings have guided and fueled the imagination of artists. Recently, there has been some primitive work on generated biblical art with Artificial Intelligence (AI). These are images generated using some recent text-to-image generators such as DALL·E 2. These generated images have been widely spread on the Internet due to their flexibility, buzzworthy effects, and little copyright concerns. More and more generated images have been used to promote churches, Bible messages, and religion-related events. In the usage of such new resources, there seems to be little reflection of the creation of these images. The elements and objects used in the generated images reflect the “understanding” of these generators, which may combine text and traditional interpretations, depending on the material on which the models are trained. Choosing inappropriate or inaccurate images can result in a misreading of biblical messages. These images can go beyond their intended scope and combine with unexpected features. For example, Figure 5 is an advertisement on social media by the Shaolin Boxing club in Amsterdam with Jesus lifting the weights. Such usage of religious motifs even raises the question whether there are any ethical or societal limits in such an "inappropriate" use of religious motifs. To carefully study questions of accuracy, creativity, biases, the role of imagination in both traditional and AI-generated visualizations of Biblical scenes, and the ethical and societal questions involved, a large-scale assessment of AI-generated images based on biblical texts is demanded. Figure 1 : An advertisement on Instagram using a generated image with Jesus lifting the weights by the Shaolin Boxing Club in Amsterdam (a screenshot with permission of use) Figure 2 : An image about the Last Supper generated by DALL·E, provided by OpenBible Figure 3 : The Last Supper painted by Lucas Cranach the Elder in 1547 Figure 4 : An image about the Last Supper generated by Midjourney in our VDD dataset Figure 5 : An image about the Last Supper generated by Midjourney in our VDD dataset To the best of our knowledge, the largest collection of generated biblical art is hosted on the OpenBible website with 1,128 images generated using DALL·E 2. 1 1 1 https://www.openbible.info/labs/ai-bible-art/ Figure 5 is about the Last Supper and shows that the generator accurately captured the idea that some people sit around a table with dining setting and plates with food. The image includes surprising elements such as modern chairs, floor-to-ceiling windows, and skyscrapers in the background. The interpretation differs obviously when compared, for example, with Leonardo da Vinci’s famous painting of the Last Supper. Evaluating every element and object in these images can be hard. An accurate evaluation involves not only historical and biblical context, the aesthetics, but also careful revision by experts in the history of art, clothes, architecture, cuisine, human anatomy, etc. This is impossible when scaling to hundreds and thousands of images. In fact, including contemporary elements can also happen in human art. An example is the medieval setting (clothes, castle in the background), in Figure 5 . A systematic study of these generated images requires clear standards that can be examined using an automatic approach and a reliable set of reference paintings. This paper takes a primitive step towards systematically evaluating generated biblical images. The research questions of this paper are the following. RQ1: How can we systematically generate biblical images using text-to-image generators? RQ2: How can we evaluate the generated biblical images? For this question, we perform the evaluation in three aspects using the subquestions: RQ2a: What is the accuracy of persons and objects in the generated images regarding their biblical context? RQ2b: How can we compare the sentimental values of the generated images? RQ2c: What features can be analyzed concerning religion and aesthetics? This paper makes the following contribution. 1. We present the Visio Divina Dataset (VDD in short) 2 2 2 The term ‘Visio Divina’ is used for a practice of divine seeing by careful interaction with an image through mediation and prayer. It is a variant of the more familiar ancient tradition of the Lectio Divina, but with the reading being replaced by visual experience. For a critical evaluation of lectio divina when used as a way to avoid the academic analytical study of sacred texts, see [ 16 ] . The code can be found on GitHub at https://github.com/ETCBC/SeeingTheWords . The code is under continuous development, but the version corresponding to this paper is published on Zenodo with DOI: 10.5281/zenodo.14674001. Our generated images can be found on DANS SSH Data stations with DOI: doi:10.17026/SS/QA271C . Intermediate results and other supplementary materials have been archived on YODA ( https://yoda.vu.nl/site/ ) and are available upon request. , a large open dataset consisting of 7,116 images from 9 text-to-image generators. 2. The paper presents the results of (manual or automatic) evaluation of several features: accuracy evaluation, sentimental analysis, religious analysis, and aesthetic analysis. 3. We make the first attempt to construct a workflow and incorporate automated evaluation of AI-generated images against well-known paintings by artists referring to the same biblical text. 4. We provide analysis from both the perspective of religion and aesthetics. 5. Selected images are included in an online Virtual Reality (VR) exhibition 3 3 3 https://shuai.ai/art/seeing . This paper is organized as follows: Section 2 provides the related work. Section 3 includes details on the selection of prompts and the generation of images. Section 4 describes the methodology and presents the pipeline and evaluation. In Section 5 we provide an analysis from the perspective of religion and aesthetics. Section 6 presents the results of the automated evaluation. In Section 7 , we discuss the findings and limitations of the approach. Finally, Section 8 presents the conclusion and future work. The prompts used are in Appendix 0.A . In Appendix 0.B , we provide details of our use case: an exhibition in virtual reality. 2 Related Work The BiblePics App 4 4 4 https://biblepics.co/ takes advantage of AI-generated images and provides visualized scenes of the Bible. As far as the authors know, the largest collection of generated art is hosted on the OpenBible website. 5 5 5 https://www.openbible.info/labs/ai-bible-art/ There are 1,128 images generated using DALL·E 2 including contributions from communities. Their corresponding prompts were not given, None of

Read the complete text