STELAR-VISION: Self-Topology-Aware Efficient Learning for Aligned Reasoning in Vision
Chen Li, Han Zhang, Zhantao Yang, Fangyi Chen, Zihan Wang, Anudeepsekhar Bolimera, Marios Savvides · 2025
Read STELAR-VISION: Self-Topology-Aware Efficient Learning for Aligned Reasoning in Vision by Chen Li, Han Zhang, Zhantao Yang, Fangyi Chen, Zihan Wang, Anudeepsekhar Bolimera, Marios Savvides (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-08688.txt.
Introduction
Chen Li and six co-authors build STELAR-Vision, a training frame that teaches sight-language models to reason in the shape that fits the task. Their paper is from two thousand twenty-five.
Such models lean on chain-of-thought, a straight line of steps. Many tasks do better with trees or graphs. The frame's core is a pipeline that makes training data rich in such shapes. Models are then tuned and reward-trained for both care and brevity. A frugal strand trims output length with small loss. On two test sets, the tuned model beat its base by a wide mark, and beat a much larger kin model too.
Catalog record
| CREATOR | Chen Li, Han Zhang, Zhantao Yang, Fangyi Chen, Zihan Wang, Anudeepsekhar Bolimera, Marios Savvides |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-08688
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
STELAR-VISION: Self-Topology-Aware Efficient Learning for Aligned Reasoning in Vision Chen Li, Han Zhang, Zhantao Yang, Fangyi Chen, Zihan Wang, Anudeepsekhar Bolimera, Marios Savvides Abstract Vision-language models (VLMs) have made significant strides in reasoning, yet they often struggle with complex multimodal tasks and tend to generate overly verbose outputs. A key limitation is their reliance on chain-of-thought (CoT) reasoning, despite many tasks benefiting from alternative topologies like trees or graphs. To address this, we introduce STELAR-Vision, a training framework for topology-aware reasoning. At its core is TopoAug, a synthetic data pipeline that enriches training with diverse topological structures. Using supervised fine-tuning and reinforcement learning, we post-train Qwen2VL models with both accuracy and efficiency in mind. Additionally, we propose Frugal Learning, which reduces output length with minimal accuracy loss. On MATH-V and VLM_S2H, STELAR-Vision improves accuracy by 9.7% over its base model and surpasses the larger Qwen2VL-72B-Instruct by 7.3%. On five out-of-distribution benchmarks, it outperforms Phi-4-Multimodal-Instruct by up to 28.4% and LLaMA-3.2-11B-Vision-Instruct by up to 13.2%, demonstrating strong generalization. Compared to Chain-Only training, our approach achieves 4.3% higher overall accuracy on in-distribution datasets and consistently outperforms across all OOD benchmarks. We’ve released datasets, and code will be available. † † footnotetext: Preprint. Under review. Project and Datasets: https://stellar-neuron.github.io/stelar-vision/ 1 Introduction Recent advances in large language models (LLMs) have significantly improved reasoning capabilities, with models like GPT-o3 achieving strong performance on complex mathematical and scientific tasks. This progress has extended into the multimodal domain through vision-language models (VLMs) such as GPT-4o ( OpenAI et al. 2024 ) , GPT-4o-mini ( OpenAI 2024 ) , and Qwen2.5-VL ( Bai et al. 2025 ) . Despite the recent advances, there is still room of improvement in open-sourced VLMs when tackling complex vision-based reasoning tasks (e.g., math and science questions), and the path to enhance their abilities under an affordable training budget remains under-explored. To address this, we begin by analyzing VLMs’ reasoning behaviors and find that the popular models, both open-source and closed-source, tend to default to the chain-of-thought (CoT) ( Wei et al. 2023 ) generation. This behavior reflects the prevailing trend in their training data, which is overwhelmingly dominated by CoT-style reasoning samples. However, our empirical analysis reveals that different questions benefit from different reasoning topologies, such as Chain, Tree, or Graph structures (Please see Figure 1 ). The benefits of diverse reasoning topologies have yet been well studied or effectively incorporated into existing training pipelines. Moreover, even state-of-the-art reasoning VLMs tend to generate unnecessarily verbose responses, i.e., “overthinking", which increases the computational cost and makes real-time applications less viable. We find that there is a correlation between the topological reasoning structures and the output sequence length, thus providing an insight to the overthinking problem created by the CoT reasoning. We introduce S elf- T opology-Aware- E fficient- L earning for A ligned R easoning in Vision, STELAR-Vision , a training framework for topology-aware vision-language reasoning. The central to this framework is TopoAug , a synthetic data generation pipeline that produces augmented reasoning topologies with diverse structures, including \{Chain,Tree,Graph\} . Specifically, we generate a set of question-answer responses, where each question is repeatedly answered by different topological reasoning structures. For each question, we assign a preferred topology through an automated annotation process. The generated responses and their labels are used to post-train VLMs via supervised fine-tuning (SFT) and Reinforcement Learning (RL) ( Meng, Xia, and Chen 2024 ) . Regarding the learning process, we observe that RL further amplifies the performance gains introduced by topological augmentation. Moreover, we propose to further increase efficiency with Frugal Learning by promoting shorter responses. We show that only by leveraging the benefits of augmented reasoning topologies, can the model generate concise responses and maintain high accuracy with minimal performance drops, while the counterpart model trained only on CoT-style data fails to gain efficiency without incurring a greater loss in accuracy. Figure 1: Limitations of the Popular Chain-of-Thought Reasoning Structures. The widely adopted Chain-of-Thought (CoT) reasoning paradigm (in green) often results in unnecessarily verbose reasoning processes, as demonstrated in the first example. Under CoT reasoning, the model redundantly counts each cube, whereas with Graph topology (in blue), it quickly identifies the key point of the question. In the bottom-row example, CoT reasoning begins with a detailed examination of each subplot but ultimately arrives at an incorrect answer. In contrast, Tree topology (in red) initiates reasoning with a high-level overview before delving into specific features. In both scenarios, CoT-style reasoning proves suboptimal. The augmented topologies expand the exploration space, allowing RL to discover higher-quality optima and leading to superior performance improvement. In contrast, the model trained with CoT-style data only sees diminishing returnsWe also test our models on five out-of-distribution datasets and consistently outperform its base model. which suggests strong generalization of our proposed STELAR-Vision. Our contributions are summarized as follows: • We propose STELAR-Vision, a training framework explicitly trained for topology-aware reasoning. It leverages diverse reasoning topologies such as chains, trees, and graphs, aligns reasoning paths with question characteristics, and enables adaptive and efficient multimodal inference. • We introduce TopoAug, a data generation pipeline that automatically produces diverse topological reasoning and annotates optimal structures per question. We also integrate Frugal Learning into the learning framework, achieving reductions in output length with minimal accuracy tradeoff. • By conducting experiments with post-training supervision and reinforcement learning, STELAR-Vision improves accuracy by 9.7% over its base model and its larger variant Qwen2VL-72B-Instruct by 7.3%. On the out-of-distribution dataset, it surpasses The Frugal Learning variant reduces output length by 18.1% while maintaining comparable accuracy. 2 Related Work 2.1 Topological Reasoning in Language and Vision Models Chain-of-Thought (CoT) prompting ( Wei et al. 2023 ) is a widely used reasoning strategy in LLMs and VLMs, guiding models to generate step-by-step solutions. However, its linear structure may not suit all tasks. To address this, Tree-of-Thought (ToT) ( Yao et al. 2023 ) enables branching exploration, while Graph-of-Thought (GoT) ( Besta et al. 2024 ) supports iterative and global reasoning. Both improve performance on complex tasks like TSP, algorithmic problem-solving, and multi-stage decision-making. These methods, however, often rely on rule-based topology generations through sampling and are limited to language-only settings. In contrast, our framework automatically generates diverse topological structures and trains a VLM to adaptively select the optimal one per instance during decoding, enabling more flexible and generalizable reasoning. 2.2 Reinforcement Learning for LLM and VLM Reasoning Reinforcement learning (RL) is a key technique for aligning LLMs and VLMs with desired behaviors in reasoning and preference modeling. Approaches like RLHF ( Stiennon et al. 2022 ; Ouyang et al. 2022 ) and Constitutional AI ( Bai et al. 2022 ) enable models to acquire complex reasoning and ethical behaviors via preference optimization. Reward-based methods such as PPO ( Schulman et al. 2017 ) , RPO ( Yin et al. 2024 ) , and GRPO ( Shao et al. 2024 ) rely on explicit rewards, while reward-free approaches like DPO ( Rafailov et al. 2024 ) , SimPO ( Meng, Xia, and Chen 2024 ) , and ORPO ( Hong, Lee, and Thorne 2024 ) achieve comparable results without reward modeling. These methods are widely applied to mathematical reasoning, long-horizon tasks, and instruction tuning. In VLMs, RL