Training-Free Model Ensemble for Single-Image Super-Resolution via Strong-Branch Compensation
Gengjia Chang, Xining Ge, Weijun Yuan, Zhan Li, Qiurong Song, Luen Zhu, Shuhong Liu · 2026
Read Training-Free Model Ensemble for Single-Image Super-Resolution via Strong-Branch Compensation by Gengjia Chang, Xining Ge, Weijun Yuan, Zhan Li, Qiurong Song, Luen Zhu, Shuhong Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-11564.txt.
Introduction
Chang and six colleagues propose a training-free ensemble for single-image super-resolution that fuses two pretrained branches without extra training. A Hybrid attention branch with TLC inference gives stable main reconstruction, while a MambaIRv2 branch with geometric self-ensemble restores high-frequency detail. The branches run independently on the same low-resolution input and merge by lightweight weighted combination. As their NTIRE 2026 ×4 challenge entry, the design beats the base branch and slightly exceeds the strong branch in PSNR under a unified DIV2K bicubic ×4 protocol.
Catalog record
| CREATOR | Gengjia Chang, Xining Ge, Weijun Yuan, Zhan Li, Qiurong Song, Luen Zhu, Shuhong Liu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19253 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.11564
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Training-Free Model Ensemble for Single-Image Super-Resolution via Strong-Branch Compensation Gengjia Chang, Xining Ge, Weijun Yuan, Zhan Li, Qiurong Song, Luen Zhu, Shuhong Liu Abstract Single-image super-resolution has progressed from deep convolutional baselines to stronger Transformer and state-space architectures, yet the corresponding performance gains typically come with higher training cost, longer engineering iteration, and heavier deployment burden. In many practical settings, multiple pretrained models with partially complementary behaviors are already available, and the binding constraint is no longer architectural capacity but how effectively their outputs can be combined without additional training. Rather than pursuing further architectural redesign, this paper proposes a training-free output-level ensemble framework. A dual-branch pipeline is constructed in which a Hybrid attention network(HAT) with TLC inference provides stable main reconstruction, while a MambaIRv2 branch with geometric self-ensemble supplies strong compensation for high-frequency detail recovery. The two branches process the same low-resolution input independently and are fused in the image space via a lightweight weighted combination, without updating any model parameters or introducing an additional trainable module. As our solution to the NTIRE 2026 Image Super-Resolution ( × 4 \times 4 ) Challenge, the proposed design consistently improves over the base branch and slightly exceeds the strong branch alone in PSNR at the best operating point under a unified DIV2K bicubic × 4 \times 4 evaluation protocol. Ablation studies confirm that output-level compensation provides a low-overhead and practically accessible upgrade path for existing super-resolution systems. † † footnotetext: The NTIRE 2026 Image Super-Resolution (x4) challenge is hosted on Codabench. Challenge page: https://www.codabench.org/competitions/13516/ . 1 Introduction Image super-resolution is a fundamental task in low-level vision that underpins a wide range of downstream applications 52 , including autonomous driving 30 ; 43 ; 74 , VR/AR 29 , 3D reconstruction 45 ; 15 ; 40 , and scene understanding given low-quality images 42 ; 41 ; 44 ; 22 . In adverse-condition 3D pipelines, this demand becomes even more explicit: smoke and extreme low-light severely affect cross-view consistency, geometry recovery, and smoke-free novel-view synthesis 73 ; 47 ; 18 ; 3 ; 77 ; 9 ; 26 . Single-image super-resolution (SISR) aims to recover a high-resolution image from a low-resolution observation and remains a representative problem in this domain. Transformer-based restorers such as SwinIR and IPT established strong early baselines 36 ; 5 , and later models including Uformer, Restormer, and NAFNet improved the balance between quality and efficiency 63 ; 69 ; 7 . SR-specific designs such as HAT, ELAN, DAT, and SRFormer further strengthened attention and aggregation 14 ; 8 ; 72 ; 11 ; 76 , while state-space models MambaIR and MambaIRv2 introduced yet another strong design line 25 ; 24 . These advances have clearly improved reconstruction fidelity, but they also raise a practical question: once a capable SR system is already in place, is retraining a stronger model always the most efficient path to further gains? In many practical settings, the answer is no. Multiple pretrained models with different inductive biases are often already available, and the binding constraint is no longer architectural capacity alone, but how effectively their complementary strengths can be combined without additional training. The broader trend toward lightweight and deployment-aware SR reflects the same concern 59 ; 33 ; 55 ; 12 ; 57 ; 78 ; 16 ; 20 ; 51 ; 19 ; 17 ; 32 ; 31 ; 71 ; 27 . Real-world and blind SR further reinforces this view, where practical degradation handling and post hoc correction matter as much as raw backbone capacity 61 ; 6 ; 64 ; 34 ; 35 ; 65 ; 37 ; 49 ; 68 ; 70 ; 75 ; 38 ; 66 ; 39 . Recent diffusion and arbitrary-scale SR work similarly suggests that stronger output quality can arise from more capable inference procedures rather than from an entirely new backbone 28 ; 58 ; 53 ; 62 ; 2 ; 67 ; 54 ; 60 ; 23 ; 56 . Related evidence in adjacent restoration tasks points in the same direction: dual-branch complementary modeling has recently been explored for remote-sensing infrared SR, while data-centric training and self-ensemble remain effective levers in denoising and night-time dehazing 21 ; 4 ; 22 . Motivated by this observation, this paper proposes a training-free dual-branch output-level ensemble for SISR. The two branches are treated asymmetrically: a Hybrid attention network with TLC inference serves as the base reconstruction path, while a MambaIRv2 branch with geometric self-ensemble provides strong compensation for high-frequency detail recovery. Compensation is performed directly in the output image space via a lightweight weighted combination, without updating any model parameters or introducing an additional trainable module. The main contributions are as follows. First, we present a training-free dual-branch output-level compensation framework that upgrades an existing SR system without retraining any parameters. Second, we explicitly formulate the strong branch as a compensation source rather than a symmetric peer, improving both interpretability and deployment clarity. Third, under a unified DIV2K bicubic \times 4 evaluation on 200 images, quantitative comparison, weight sweeping, and visual analysis confirm that even a small proportion of strong-branch injection yields measurable gains. We also report our results in the NTIRE 2026 Image Super-Resolution ( \times 4 ) Challenge 10 , where our team wedream ranked 2nd , achieving 33.47 dB PSNR and 0.9105 SSIM, providing independent external validation of the effectiveness of the proposed training-free ensemble strategy. Figure 1 : Overview of the training-free output-level ensemble. The HAT + TLC branch provides the main reconstruction, while the MambaIRv2 branch contributes stronger detail recovery through self-ensemble. The final result is obtained by weighted image-space compensation. 2 Related Work 2.1 High-Performance SISR Backbones Broad surveys note that SISR progress is driven not only by larger backbones, but also by changing assumptions about efficiency and deployment 1 ; 23 . Among transformer-era methods, SwinIR and IPT established strong early baselines 36 ; 5 . Uformer, Restormer, and NAFNet then broadened the restoration design space with stronger long-range modeling and simpler optimization behavior 63 ; 69 ; 7 . Other SR-oriented models explored transformer formulations more directly, including Transformer for SISR and non-local sparse attention designs 48 ; 50 . Subsequent work focused on more specialized attention and aggregation designs. Swin2SR and HAT are representative examples of this trend 14 ; 8 . ELAN, DAT, and SRFormer further show that local-global interaction can be improved through more structured attention design 72 ; 11 ; 76 . In parallel, MambaIR and VMamba suggest that state-space modeling can serve as a viable alternative to pure Transformer scaling 25 ; 46 . MambaIRv2 strengthens this restoration-oriented state-space line even further 24 . These works collectively suggest that no single architectural family dominates every quality-efficiency tradeoff, which is precisely why combining pretrained branches remains attractive. Efficient SR offers another relevant context. Sparse inference and compact blueprint designs are clear examples 59 ; 33 . Adaptive modulation, N-Gram Swin variants, and omni aggregation continue the same lightweight direction 55 ; 12 ; 57 . Hybrid CNN-transformer designs and dynamic lightweight attention provide another branch of efficient SR research 78 ; 16 ; 20 ; 51 . Feature-distillation weighting, large-kernel attention, local-global self-attention, focused inference, and hierarchical efficient transformers further enrich