Wiki-R1: Incentivizing Multimodal Reasoning for Knowledge-based VQA via Data and Sampling Curriculum

Shan Ning, Longtian Qiu, Xuming He · 2026

Read Wiki-R1: Incentivizing Multimodal Reasoning for Knowledge-based VQA via Data and Sampling Curriculum by Shan Ning, Longtian Qiu, Xuming He (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-05256.txt.

Description

Shan Ning and team offer Wiki-R1, curriculum reinforcement learning spurring mixed reasoning for knowledge-based visual question answering. External-knowledge image questions challenge models, since noisy retrieval and encyclopedic knowledge hinder change. Wiki-R1 chains training spreads to growing capability, bridging early training and target. Controllable data making manipulates the retriever to set sample difficulty. That sampling picks likely nonzero-advantage samples, with hardness from seen rewards spread to unseen samples. On Encyclopedic VQA and InfoSeek it sets new accuracy records.

Catalog record

CREATORShan Ning, Longtian Qiu, Xuming He
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37516
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.05256

Browse the full library · About the Tower of Babel