VideoRFT : Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuning
Qi Wang 1 , Yanrui Yu 1 , Ye Yuan 1 , Rui Mao 2 , Tianfei Zhou 1 1 Beijing Institute of Technology 2 Shenzhen University https://github.com/QiWang98/VideoRFT · 2025
Read VideoRFT : Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuning by Qi Wang 1 , Yanrui Yu 1 , Ye Yuan 1 , Rui Mao 2 , Tianfei Zhou 1 1 Beijing Institute of Technology 2 Shenzhen University https://github.com/QiWang98/VideoRFT (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-12434.txt.
Description
Qi Wang and four co-authors teach video-aware language models to reason about clips step by step. Their paper appeared in two thousand twenty-five. Models that read text and images have learned to think aloud on still tasks. Video is harder, since events unfold in time and cause each other.
Their method, VideoRFT, starts with guided training on written chains of thought. It then uses reward-based learning to sharpen the skill. Good video reasoning data is scarce, so the team built a pipeline to make it. A text model drafts each chain from rich notes on the clip, then a video model checks it against the frames. The result is two new data sets for the two training stages. A new reward also checks that the words match what the clip shows.
Catalog record
| CREATOR | Qi Wang 1 , Yanrui Yu 1 , Ye Yuan 1 , Rui Mao 2 , Tianfei Zhou 1 1 Beijing Institute of Technology 2 Shenzhen University https://github.com/QiWang98/VideoRFT |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-12434