CRAFT: Cultural Russian-Oriented Dataset Adaptation for Focused Text-to-Image Generation
Viacheslav Vasilev, Vladimir Arkhipkin, Julia Agafonova, Tatiana Nikulina, Evelina Mironova, Alisa Shichanina, Nikolai Gerasimenko, Mikhail Shoytov, Denis Dimitrov · 2025
Read CRAFT: Cultural Russian-Oriented Dataset Adaptation for Focused Text-to-Image Generation by Viacheslav Vasilev, Vladimir Arkhipkin, Julia Agafonova, Tatiana Nikulina, Evelina Mironova, Alisa Shichanina, Nikolai Gerasimenko, Mikhail Shoytov, Denis Dimitrov (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-04851.txt.
Introduction
Viacheslav Vasilev and eight co-authors adapt a text to image model to Russian culture in a 2025 arXiv paper. Big image models learn from web data soaked in Western and American themes. Asked for Russian scenes, they can err, fall flat, or lean on stock clichés that offend.
The team sets out what a cultural code means for such models and builds a data set from it for Russia. Their CRAFT method gathers and cleans data that carries the code, from dress and rites to places and tales. They retrain the Kandinsky 3.1 image model on the set. Human judges then rated the new output as far more aware of Russian culture. The authors offer the method as a path for other lands as well.
Catalog record
| CREATOR | Viacheslav Vasilev, Vladimir Arkhipkin, Julia Agafonova, Tatiana Nikulina, Evelina Mironova, Alisa Shichanina, Nikolai Gerasimenko, Mikhail Shoytov, Denis Dimitrov |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-04851
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CRAFT: Cultural Russian-Oriented Dataset Adaptation for Focused Text-to-Image Generation Viacheslav Vasilev, Vladimir Arkhipkin, Julia Agafonova, Tatiana Nikulina, Evelina Mironova, Alisa Shichanina, Nikolai Gerasimenko, Mikhail Shoytov, Denis Dimitrov Abstract Despite the fact that popular text-to-image generation models cope well with international and general cultural queries, they have a significant knowledge gap regarding individual cultures. This is due to the content of existing large training datasets collected on the Internet, which are predominantly based on Western European or American popular culture. Meanwhile, the lack of cultural adaptation of the model can lead to incorrect results, a decrease in the generation quality, and the spread of stereotypes and offensive content. In an effort to address this issue, we examine the concept of cultural code and recognize the critical importance of its understanding by modern image generation models, an issue that has not been sufficiently addressed in the research community to date. We propose the methodology for collecting and processing the data necessary to form a dataset based on the cultural code, in particular the Russian one. We explore how the collected data affects the quality of generations in the national domain and analyze the effectiveness of our approach using the Kandinsky 3.1 text-to-image model. Human evaluation results demonstrate an increase in the level of awareness of Russian culture in the model. Keywords: Cultural Code, Russian Culture, Dataset Adaptation, Text-to-Image Generation, Fine-tuning, Captioning, Diffusion models, Data Engineering 1 Introduction The use of image generation models for various purposes through online applications and web editors has become the norm in modern daily life [ 1 , 2 , 3 , 4 , 5 , 6 , 7 ] . This increase in popularity and generation quality was made possible by training models on data from the Internet and large open datasets of text-image pairs, such as LAION-5B [ 8 ] , MS COCO [ 9 ] , etc. Much of this data allows models to learn a lot about international concepts, objects and events, and some elements of those national cultures that are most represented in modern mass media [ 10 ] . This raises the problem of a significant bias towards this data, often ignoring information that is represented in a smaller number of training examples. Such data domains can be the cultural characteristics of certain social groups, peoples and residents of different regions and states [ 11 , 12 ] . As a result, such generative models do not take into account the cultural code of these groups well enough. Erroneous and incorrect generations in this case can lead to, at a minimum, an unsatisfactory result, limited applicability of the model and partial loss of interest among users, and, at a maximum, to unintentional insult, and the spread of stereotypes and social biases. At the same time, it remains not entirely clear how to resolve the problem of cultural adaptation, since the concept of a cultural code is rather vague. To the best of our knowledge, there is currently no significant research in the field of visual content generation that would focus on working with the culture of a particular country or large enough community. The goal of this work is to analyze the problem of cultural awareness lack in text-to-image models and propose a solution that would move the field forward. We analyze the concept of a cultural code and describe a procedure for collecting a dataset that would allow us to adapt a generation model to better understand the concepts of Russian, Soviet and post-Soviet culture. We propose a CRAFT methodology ( C ultural R ussian-Oriented Dataset A daptation for F ocused T ext-to-Image Generation), emphasizing the general versatility of our approach. Therefore, the contribution of this article is as follows: • We expose the cultural awareness issues that current text-to-image generation models have. We discuss the concept of cultural code and identify domains of visual data that we believe should be taken into account for cultural adaptation of the model (Section 3 ). • We propose and describe a methodology for collecting and processing a cultural-aware dataset, in particular for Russian culture (Section 4 ). • We analyze the effectiveness of our approach and explore how the collected data affects the quality of Russian cultural data generation for the Kandinsky 3.1 model [ 6 , 7 ] . We report human evaluation results where we achieve higher quality compared to models lacking sufficient knowledge of Russian culture (Section 5 ). Figure 1: Comparison of Russian cultural code generations for popular text-to-image models. Reference is an example of a real image with a specific entity. The cultural adaptation procedure we propose helps improve the quality of cultural awareness for the Kandinsky 3.1 model, both in comparison with the previous version Kandinsky 2.2, and for other models. 2 Related works 2.1. Generative Models Finetuning Generative learning models in both natural language processing and computer vision are often pretrained on large datasets, allowing them to have extensive general knowledge about texts or images in the real world. Various finetuning methods, that is, additional training on a small dataset, can help expand the specific capabilities of the original models, both in terms of improving the generation quality and solving new types of problems [ 13 , 14 , 15 ] . The key role here is not even the quantity of additional data, but its quality and detailed description. For example, the work [ 16 ] shows that finetuning, even on a small set of high-quality text-image data, can significantly improve the visual generation quality. Also, finetuning a small number of parameters with a relatively small number of images with detailed descriptions can significantly improve the quality of caption generation in visual-language models [ 17 ] . Additionally, finetuning a model on additional data is also a key element for model enhancement approaches such as domain adaptation [ 18 ] , when the model is applied to data on which it was not pretrained, and AI alignment [ 19 ] , when a certain behavior and understanding are expected from the model. In this work, we focus on preparing a high-quality dataset that would expand the text-to-image model’s generation capabilities beyond the international visual domain and at the same time improve the visual quality of the generation of those national concepts that were already included in it at the pretraining stage. We also expect the model to expand its understanding of complex, culture-specific concepts, making it more relevant to the user who comes from a particular culture. In this sense, our work inherits the mentioned works. Figure 2: 17 main data categories for creating a dataset of the Russian cultural code. Examples for each category are generated by the Kandinsky 3.1 model. For each category, we collect a set of visual entities from which we form our dataset. As a result of additional training, the model increases its level of cultural awareness. 2.2. Cultural Adaptation By cultural awareness of a generation model we mean their ability to correctly resolve user requests and tasks that reflect certain features inherent in a particular culture. Cultural adaptation refers to techniques that allow models to achieve such results. Closely related to adaptation is the achievement of understanding linguistic