Bridging the Copyright Gap: Do Large Vision-Language Models Recognize and Respect Copyrighted Content?

Naen Xu, Jinghuai Zhang, Changjiang Li, Hengyu An, Chunyi Zhou, Jun Wang, Boyu Xu, Yuyuan Li, Tianyu Du, Shouling Ji · 2025

Read Bridging the Copyright Gap: Do Large Vision-Language Models Recognize and Respect Copyrighted Content? by Naen Xu, Jinghuai Zhang, Changjiang Li, Hengyu An, Chunyi Zhou, Jun Wang, Boyu Xu, Yuyuan Li, Tianyu Du, Shouling Ji (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-21871.txt.

Introduction

Naen Xu, Shouling Ji, and their co-authors test whether large vision-language models recognize and respect copyright when copyrighted material is shown to them as images. A model that happily reproduces book excerpts, lyrics, or news text from a picture of the page creates legal and ethical exposure for its deployers.

The team built a benchmark of fifty thousand multimodal query-content pairs covering book excerpts, news articles, music lyrics, and code documentation. Each item appears in two scenarios, with a copyright notice visible and without one, and the notice itself comes in four forms. Even the strongest closed-source models showed failures to recognize and respect the copyrighted content, including cases where the notice was in front of them. The authors propose a tool-augmented defense framework that reduced infringement risk across all scenarios. Their conclusion is that copyright awareness must be engineered into multimodal models.

Catalog record

CREATORNaen Xu, Jinghuai Zhang, Changjiang Li, Hengyu An, Chunyi Zhou, Jun Wang, Boyu Xu, Yuyuan Li, Tianyu Du, Shouling Ji
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE75 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-21871

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Bridging the Copyright Gap: Do Large Vision-Language Models Recognize and Respect Copyrighted Content? Naen Xu, Jinghuai Zhang, Changjiang Li, Hengyu An, Chunyi Zhou, Jun Wang, Boyu Xu, Yuyuan Li, Tianyu Du, Shouling Ji Abstract Large vision-language models (LVLMs) have achieved remarkable advancements in multimodal reasoning tasks. However, their widespread accessibility raises critical concerns about potential copyright infringement. Will LVLMs accurately recognize and comply with copyright regulations when encountering copyrighted content (i.e., user input, retrieved documents) in the context? Failure to comply with copyright regulations may lead to serious legal and ethical consequences, particularly when LVLMs generate responses based on copyrighted materials (e.g., retrieved book experts, news reports). In this paper, we present a comprehensive evaluation of various LVLMs, examining how they handle copyrighted content – such as book excerpts, news articles, music lyrics, and code documentation when they are presented as visual inputs. To systematically measure copyright compliance, we introduce a large-scale benchmark dataset comprising 50,000 multimodal query-content pairs designed to evaluate how effectively LVLMs handle queries that could lead to copyright infringement. Given that real-world copyrighted content may or may not include a copyright notice, the dataset includes query-content pairs in two distinct scenarios: with and without a copyright notice. For the former, we extensively cover four types of copyright notices to account for different cases. Our evaluation reveals that even state-of-the-art closed-source LVLMs exhibit significant deficiencies in recognizing and respecting the copyrighted content, even when presented with the copyright notice. To solve this limitation, we introduce a novel tool-augmented defense framework for copyright compliance, which reduces infringement risks in all scenarios. Our findings underscore the importance of developing copyright-aware LVLMs to ensure the responsible and lawful use of copyrighted content. Code — https://github.com/bluedream02/CopyGuard Introduction Figure 1: LVLM denies direct requests that could infringe copyright but processes queries with copyrighted content in the multimodal context (e.g., retrieved or user-provided book excerpts), even when a copyright notice is presented. Large Vision-Language Models (LVLMs) ( 15 ; 22 ) show remarkable multimodal understanding capabilities. They have advanced beyond basic image recognition to dynamic content reasoning and complex question-answering. However, LVLMs also pose risks, particularly in their potential to generate content that violates copyright regulations. Similar to Large Language Models (LLMs) ( 24 ; 36 ) , LVLMs may inadvertently generate outputs resembling copyrighted materials – such as book excerpts, news articles, and music lyrics – thereby infringing upon the creators’ rights. Previous research explores whether LLMs recognize and respect copyrighted content in user inputs ( 24 ; 36 ) . Unlike text-only models, LVLMs process both text and images that may contain copyrighted content, which complicates copyright recognition and compliance, as they must process the textual query and interpret visual cues to identify content subject to copyright protection. The risk of copyright infringement amplifies in more advanced LVLMs due to their use in multimodal retrieval-augmented generation (RAG) ( 37 ) , multimodal web agents ( 14 ) and search engines ( 17 ) to retrieve and incorporate copyrighted online content, highlighting the urgent need for copyright-aware LVLMs. LVLMs often fail to recognize and comply with copyright regulations when encountering copyrighted content in the multimodal context, posing a significant risk of unauthorized use and redistribution of copyrighted content. In practice, a copyright notice is commonly included in copyrighted content to indicate ownership, which consists of an indicator (e.g., ©), the year of first publication, and the name of the copyright holder. Our findings show that even for copyrighted content with explicit copyright notices, LVLMs’ compliance remains inconsistent and often falls short of copyright regulations. This undermines industry integrity and raises legal concerns, such as copyright lawsuits. Additionally, the vast training datasets further complicate attribution of responsibility among users, developers, and models, making legal claims difficult. Figure 1 shows LVLMs failing to recognize and respect copyrighted content with an explicit copyright notice, leading to unauthorized reproduction. As a result, thorough assessments and safeguards are essential to ensure that LVLMs recognize and respect copyrighted content, preventing unauthorized use or reproduction. In this work, we aim to address three research questions: RQ 1 – How effectively do LVLMs recognize and comply with copyright regulations when encountering copyrighted content in multimodal contexts? RQ 2 – To what extent do explicit copyright notices influence LVLMs’ ability to respect and comply with copyright regulations? RQ 3 – How to enhance LVLMs’ copyright awareness and compliance? To address these issues, we explore how LVLMs handle real-world copyrighted content in multimodal contexts by constructing a large-scale multimodal benchmark dataset. The dataset is collected from various copyrighted materials, including book excerpts, news articles, music lyrics, and code documentation. It also contains a large volume of natural queries. We evaluate four key scenarios of copyright infringement involved in the redistribution of copyrighted content during LVLM interactions: repetition, extraction, paraphrasing, and translation. Given that real-world copyrighted content may or may not include a copyright notice, the dataset includes query-content pairs in two scenarios: with and without a copyright notice. For the former, we cover four types of notices to account for different cases. By evaluating whether existing LVLMs recognize and respond appropriately to copyrighted content, we find that most LVLMs (11/12) struggle to recognize and respect copyrighted content, even with copyright notices. To address this, we propose CopyGuard, a novel tool-augmented framework that verifies the copyright information and alerts the LVLMs when the risk of copyright infringement is high to prevent inappropriate generation. It applies to all copyrighted content, regardless a copyright notice is present. Our work contributes to the responsible development of LVLMs, with the following key contributions: • To the best of our knowledge, this work is the first to examine whether LVLMs recognize and respect copyrighted content in multimodal contexts and could adjust their behaviors accordingly. Specifically, we introduce a benchmark dataset comprising 50,000 multimodal query-content pairs that could induce LVLMs to generate copyrighted content. The dataset covers four types of copyright infringement scenarios and four types of real-world copyrighted content (i.e., with copyright notices). • We conduct extensive experiments on various LVLMs, revealing that prevailing models fail to respect copyrighted content, even when explicit copyright notices exist. Our results provide insight into how different types of copyright notices and queries impact model behavior. • We propose a novel tool-augmented defense framework to enhance copyright compliance in LVLMs. This mechanism effectively prevents the generation of copyrighted content, reducing copyright infringement risks and safeguarding intellectual property in multimodal contexts. Related Work Large vision-language models (LVLMs). LVLMs integrate pretrained vision encoders with LLMs to process and understand both images and text. Early models, such as LLaVA ( 22 ) and Qwen ( 33 ) , demonstrate strong performance in visual question answering. More recent systems, including GPT-4o ( 15 ) , Gemini ( 28 ) , and Claude ( 1 ) , incorporate high-resolution vision encoders to support complex visual dialogue and multimodal reasoning. Copyright regulations. Copyright regulations, such as the Berne Convention, U.S. Copyright Law, and EU Directive, provide creators rights to use and distribute their works, subject to certain exceptions. One notable exception is “fair use”, detailed in U.S. Copyright Law, which allows limited use without permission, such as non-commercial distribution by libraries. In Europe, quotations for criticism or review

Read the complete text