The Comparability of Model Fusion to Measured Data in Confuser Rejection

Conor M. Flynn, Christopher Ebersole, Edmund Zelnio · 2025

Read The Comparability of Model Fusion to Measured Data in Confuser Rejection by Conor M. Flynn, Christopher Ebersole, Edmund Zelnio (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-00836.txt.

Introduction

Conor Flynn, Christopher Ebersole, and Edmund Zelnio wrote this 2025 paper on teaching radar image models with fake data. Synthetic aperture radar gives detailed images, but real samples are costly to gather, so trainers lean on simulated images made from 3D models. Simulated and real images differ enough that models trained only on fakes stumble in the field.

The team answer with numbers: they fuse many models, each trained on synthetic data, into one ensemble. The ensemble must also reject targets it was never trained on, a skill called confuser rejection, rather than force a wrong label. The paper tests how well the fused models match the behavior of models trained on measured data. The goal is radar recognition that stays honest about unknown targets.

Catalog record

CREATORConor M. Flynn, Christopher Ebersole, Edmund Zelnio
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-00836

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Comparability of Model Fusion to Measured Data in Confuser Rejection Conor M. Flynn, Christopher Ebersole, Edmund Zelnio Abstract Data collection has always been a major issue in the modeling and training of large deep learning networks, as no dataset can account for every slight deviation we might see in live usage. Collecting samples can be especially costly for Synthetic Aperture Radar (SAR), limiting the amount of unique targets and operating conditions we are able to observe from. To counter this lack of data, simulators have been developed utilizing the shooting and bouncing ray method to allow for the generation of synthetic SAR data on 3D models. While effective, the synthetically generated data does not perfectly correlate to the measured data leading to issues when training models solely on synthetic data. We aim to use computational power as a substitution for this lack of quality measured data, by ensembling many models trained on synthetic data. Synthetic data is also not complete, as we do not know what targets might be present in a live environment. Therefore we need to have our ensembling techniques account for these unknown targets by applying confuser rejection in which our models will reject unknown targets it is presented with, and only classify those it has been trained on. a]Rensselaer Polytechnic Institute, Troy, New York, USA b]Air Force Research Laboratory, WPAFB, Ohio, USA keywords Synthetic aperture radar, ensembling, confuser rejection, open set recognition, novelty detection, fusion † † authorinfo: Further author information: (Send correspondence to Christopher Ebersole) Christopher Ebersole: E-mail: [email protected] 1 Introduction High-quality data is essential for training effective deep learning models, as the performance and generalization ability of these models heavily depends on the quality, diversity, and volume of the data they are exposed to during training. However, obtaining such data can be a significant challenge especially in areas such as Synthetic Aperture Radar (SAR) [ 1 ] . The diversity of targets, observation angles, and other operating conditions required to achieve adequate generalization all exponentially increase the cost of acquisition of real (measured) data, making it difficult to train an accurate and robust model on the limited information collected. To counter the lack of measured SAR data available, we can utilize simulators using the shooting and bouncing ray (SBR) [ 2 ] method to allow for the generation of synthetic SAR data on small 3D models. While this does allow for the significantly cheaper and easier acquisition of target data, the data does not come from the same distribution as measured data taken in a live environment. Therefore, we need to create techniques which use this synthetically generated data as a supplement to our limited measured data, resulting in a highly accurate and robust model. While we can generate large quantities of synthetic data, we cannot account for all types of possible targets in a live scenario. Thus, we need to create techniques to differentiate between targets that are present in the training data and those that are not (confusers). To help determine which targets are trained on and which are confusers, we can split our dataset into three types of classes: mission targets, in-library confusers, and out-of-library confusers. Mission targets are the targets we want our system to recognize in a live setting, confidently predicting the target’s class. In-library confusers are targets that we still train on, however, we present these images to our models as confusers with an obfuscated label. This is useful in confuser rejection as it trains the models to reject classes with unknown labels, giving them low confidence when making a prediction. Finally, out-of-library confusers are used in testing to ensure that our models are confidently rejecting confusers they have never seen before, reassuring that our confuser rejection training techniques were successful. To address the issues of measured and synthetic data misalignment and confuser rejection, we use model ensembling [ 3 ] . Model ensembling trains multiple deep learning models on the same dataset independently and then combines their individual outputs to form a joint consensus. Such a system is valuable as it generates a diverse set of model weight initialization points on the loss landscape, finding different local optima that yield different outputs [ 4 , 5 ] . To review the effectiveness of ensembling in these problems, we implement common ensembling techniques and discuss their performance over singular model systems. 2 Related Works In this section we review previous work related to these problems as well as key ideas present in this paper. SAR Confuser Rejection: Casasent and Nehemiah’s work discusses the implications of using the extended maximum average correlation height distortion invariant filter to determine its ability to reject confusers in the Moving and Stationary Target Acquisition and Recognition (MSTAR) public database [ 6 , 7 ] . Chakravarthy, Ashby, and Zelnio discuss the usage of Adversarial Reciprocal Points Learning, which incorporates convolutional neural networks to minimize classification risk of out-of-sample targets [ 8 ] . Hill uses Gaussian Mixture Models on the Synthetic and Measured Paired Labeled Experiment (SAMPLE+) dataset [ 9 ] to help predict out-of-distribution data [ 10 ] . In our review we also use the SAMPLE+ dataset for testing the efficacy of our confuser rejection techniques. Model Weight Variation: Lakshminarayanan et al. and Fort et al. discuss the benefits of training various models and ensembling them [ 5 , 4 ] . By using ensembling techniques that combine internal model sampling such as Dropout [ 11 ] , as well as external model sampling referred to as Deep Ensembling by Lakshminarayanan [ 5 ] and as discussed in Section 3.2 , we are able to derive a robust model structure. Objectosphere Loss: Finally, Dhamija et al. developed the Objectosphere Loss, which is a loss function designed to push confusers towards the center of the feature space while encouraging mission targets to have large feature magnitudes, improving feature separation between mission targets and confusers [ 12 ] . This reduces confident misclassification of confusers and helps to emphasize mission target classification. We make use of this loss function and further explore it in Section 3.1.2 . 3 Methods In this section, we discuss the primary methods used in this paper to improve upon confuser rejection and mission target classification. 3.1 Confuser Rejection One of the primary draw downs of deep learning networks stems from their overconfidence when classifying previously unseen targets [ 13 ] . Such overconfidence makes it hard to determine whether a presented target has been trained on or not, as outputs for both mission targets and confusers look indistinguishable. Therefore, we need to derive methods for differentiating between mission targets and confusers. To create a robust model architecture for isolating these types of targets we use Deep Ensembling, which combines the outputs of multiple models [ 5 ] as shown in Section 3.2 . Before discussing the ensembling techniques used, we first need to define a decision statistic which will be thresholded to distinguish between mission targets and confusers. 3.1.1 Feature Magnitude Our decision statistic for confuser rejection is the feature magnitude F , in which we observe the L^{2} norm of the penultimate layer P_{m} . The penultimate layer refers to the input of the last fully-connected

Read the complete text