FMCE-Net++: Feature Map Convergence Evaluation and Training
Zhibo Zhu, Renyu Huang, Lei He · 2025
Read FMCE-Net++: Feature Map Convergence Evaluation and Training by Zhibo Zhu, Renyu Huang, Lei He (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-06109.txt.
Introduction
Zhibo Zhu, Renyu Huang, and Lei He train neural networks to keep their internal feature maps orderly, not just their answers right, in a 2025 paper. Networks are black boxes, and a known scoring method can grade how settled each module's features look, but it never fed back into training.
Their framework plugs a frozen scoring network into training as an auxiliary head. Its scores join the true labels in a combined loss, with a dial balancing the two pressures. Across four image benchmarks and several well-known backbones, accuracy rose by about a point with no architecture change and no extra data. The authors argue convergence-aware training lifts performance ceilings cheaply.
Catalog record
| CREATOR | Zhibo Zhu, Renyu Huang, Lei He |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-06109
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
FMCE-Net++: Feature Map Convergence Evaluation and Training Zhibo Zhu, Renyu Huang, Lei He Abstract Deep Neural Networks (DNNs) face interpretability challenges due to their opaque internal representations. While Feature Map Convergence Evaluation (FMCE) quantifies module-level convergence via Feature Map Convergence Scores (FMCS), it lacks experimental validation and closed-loop integration. To address this limitation, we propose FMCE-Net++ , a novel training framework that integrates a pretrained, frozen FMCE-Net as an auxiliary head. This module generates FMCS predictions, which, combined with task labels, jointly supervise backbone optimization through a Representation Auxiliary Loss (RAL). The RAL dynamically balances the primary classification loss and feature convergence optimization via a tunable Representation Abstraction Factor ( α \alpha ). Extensive experiments conducted on MNIST, CIFAR-10, FashionMNIST, and CIFAR-100 demonstrate that FMCE-Net++ consistently enhances model performance without architectural modifications or additional data. Key experimental outcomes include accuracy gains of + 1.16 +1.16 pp (ResNet-50/CIFAR-10) and + 1.08 +1.08 pp (ShuffleNet v2/CIFAR-100), validating that FMCE-Net++ can effectively elevate state-of-the-art performance ceilings. I Introduction Deep Neural Networks (DNNs) have emerged as essential tools across various domains, including image recognition and natural language processing. Their strength lies in the capacity to discern complex patterns within extensive datasets, achieving state-of-the-art performance levels necessary for real-world applications. Fig. 1: Accuracy progression of Baseline vs. optimized \alpha^{*} configurations on ResNet-50 and ShuffleNet v2. The \alpha^{*} curves (indigo solid and darkorange dashed) consistently overtake their baseline counterparts (crimson solid and forestgreen dashed) in later epochs, with ResNet-50 achieving +0.7 pp gain at epoch 70 and ShuffleNet v2 gaining +0.4 pp. This demonstrates FMCE-Net++’s capacity to elevate intrinsic performance ceilings without architectural modifications. However, the intricate, multi-layered structures and opaque internal processes of DNNs render their decision-making difficult to interpret, often categorizing these models as ”black boxes.” Traditional end-to-end optimization strategies assess network performance through global loss functions, neglecting detailed evaluation of individual modules within the model. While this approach achieves high accuracy, many application domains demand heightened safety and reliability, thereby necessitating transparent, interpretable, and independently evaluable intermediate modules [ 1 , 2 ] . Recent literature emphasizes the critical role of independently evaluating DNN modules to ensure improved efficiency, reliability, and explainability, especially for safety-critical applications [ 3 , 4 ] . Feature maps, pivotal intermediate representations within DNNs, encapsulate hierarchical learned features and serve as crucial indicators of network training progression. Recently introduced Feature Map Convergence Evaluation (FMCE) provides a pioneering method for assessing the convergence of these feature maps independently [ 5 ] . FMCE employs metrics such as the Feature Map Convergence Score (FMCS) and models such as the Feature Map Convergence Evaluation Network (FMCE-Net) to quantitatively analyze module-level convergence. Nevertheless, FMCE currently lacks comprehensive experimental validation and integration within a closed-loop training framework, hindering practical verification of its efficacy. To address these limitations, we propose FMCE-Net++ , a novel training framework that seamlessly integrates a pretrained, frozen FMCE-Net as an auxiliary supervisory module. FMCE-Net++ predicts FMCS values for intermediate feature maps and combines these predictions with task-specific ground truth labels to formulate a novel Representation Auxiliary Loss (RAL). This loss function dynamically balances primary task optimization and feature convergence through a tunable Representation Abstraction Factor ( \alpha ). Importantly, FMCE-Net++ requires no architectural modifications or dataset expansions, rendering it an easily deployable enhancement to existing state-of-the-art models. Extensive experiments conducted on benchmark datasets—including MNIST, CIFAR-10, FashionMNIST, and CIFAR-100—demonstrate the effectiveness of our approach. Significant accuracy improvements, such as gains of +1.16 pp (ResNet-50/CIFAR-10) and +1.08 pp (ShuffleNet v2/CIFAR-100), substantiate FMCE-Net++’s capability to elevate existing performance ceilings. The superiority of our proposed framework is further illustrated in Fig. 1 . Our primary contributions are: • Experimental validation and establishment of the reliability of FMCE as a method for independent module evaluation. • Introduction of a novel Representation Auxiliary Loss (RAL) based on FMCS predictions, and the development of the FMCE-Net++ training framework. • Comprehensive empirical evaluations on multiple datasets, demonstrating consistent performance enhancements and breaking prior limitations in image classification tasks. Fig. 2: FMCE-Net++ training pipeline and comparative baselines. (a) FMCE-Net++ integrates a frozen FMCE-Net auxiliary head alongside the standard classifier. Backbone feature maps are simultaneously routed into both branches, yielding a standard classification loss \mathcal{L}_{\mathrm{origin}} and a Feature-Map Convergence loss \mathcal{L}_{\mathrm{FMCS}} , adaptively combined by the Representation Auxiliary Loss (RAL) weighted by the Representation Abstraction Factor (RAF). (b) Baseline employs only the classifier branch. (c) Stand-alone FMCE-Net trains exclusively on the auxiliary head as an ablation study. II Related Work II-A Image Classification Optimization Image classification has emerged as a pivotal application domain for deep neural networks (DNNs). Yet the path to high accuracy is hampered by class imbalance, noisy labels, limited computational budgets, and the tendency of over‑parameterised models to overfit or converge to sharp minima that generalise poorly [ 6 ] . Consequently, recent research has shifted from purely architectural innovation to *training–time optimisation*. For example, the **mean‑ADAM** algorithm extends classical ADAM by smoothing first‑ and second‑order moments across the mini‑batch trajectory, yielding more stable updates and demonstrably higher top‑1 accuracy on ImageNet‑like benchmarks [ 7 ] . On resource‑constrained hardware, an **edge‑aware training pipeline** combines weight quantisation, aggressive data augmentation, and layer fusion to keep memory footprints below 256 MB while still matching cloud‑scale baselines [ 8 ] . Meta‑heuristic search also remains influential: **Particle Swarm Optimisation without Velocity (PSWV)** treats each candidate weight set as a particle whose position is updated by adaptive inertia and local‑best attraction—cutting total epochs in half and shortening wall‑clock training time by 30 % on mid‑sized GPUs [ 9 ] . Finally, a **runtime visual‑analytics engine** overlays feature‑map activations on low‑resolution sensor data, enabling online pruning decisions that deliver a 5.9× end‑to‑end throughput gain without extra silicon cost [ 10 ] . Together, these strands illustrate how optimiser design, hardware‑aware compression, and interactive profiling now complement architectural advances to push the frontier of image‑classification performance. II-B Evaluation and Assessment Framework Despite their impressive accuracy, DNNs remain difficult to verify because the relationship between internal activations and final predictions is opaque. To cope with this, *holistic* evaluation frameworks have emerged that quantify reliability along multiple axes—data coverage, decision consistency, and fault tolerance—rather than a single scalar metric. A recent proposal, for instance, couples dataset‑quality diagnostics with *test‑adequacy* scores to reveal blind spots in training corpora [ 11 ] . At the network level, **DeepXplore** pioneered white‑box differential testing by maximising *neuron coverage*, compelling hidden units into rarely visited regions of the activation space [ 12 ] . In safety‑critical domains such as autonomous driving, **SAMOTA** streamlines expensive road‑testing by automatically generating corner‑case scenarios whose replay cost is 40 % lower than manual scripts [ 13 ] . Complementary work leverages *scenario‑based transfer learning* to repair weakly performing sub‑modules while explicitly controlling for negative side effects [ 14 ] . Efficiency matters too: clustering neurons by functional similarity allows the tester to pick a handful of samples that stimulate entire clusters at once, cutting evaluation time by an order of magnitude [ 15 ] . Beyond empirical heuristics, **topological entropy** treats each layer as a discrete dynamical system whose complexity can be scored algebraically, providing theory‑grounded insight into whether a module is under‑ or over‑trained [ 16 ] . When model reasoning