Is Bigger Always Better? Efficiency Analysis in Resource-Constrained Small Object Detection

Kwame Mbobda-Kuate, Gabriel Kasmi · 2026

Read Is Bigger Always Better? Efficiency Analysis in Resource-Constrained Small Object Detection by Kwame Mbobda-Kuate, Gabriel Kasmi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-02142.txt.

Introduction

Kwame Mbobda-Kuate and Gabriel Kasmi question a common belief in this 2026 vision paper: bigger models are not always better. They test small object finding under tight limits on power and data. Their case is rooftop solar panels in Madagascar, seen from above. They vary model size, data size, and image detail across many setups.

Judged by score per unit of model size, the smallest model won by a wide margin. That tiny model also earned the highest raw score of all. Sharper images helped far more than extra training data. In fact, small models with sharp images beat all rivals in both speed and score. For scarce-data field work, the lesson is to spend on image detail first.

Catalog record

CREATORKwame Mbobda-Kuate, Gabriel Kasmi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42428
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.02142

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Is Bigger Always Better? Efficiency Analysis in Resource-Constrained Small Object Detection Kwame Mbobda-Kuate, Gabriel Kasmi Abstract Scaling laws assume larger models trained on more data consistently outperform smaller ones — an assumption that drives model selection in computer vision but remains untested in resource-constrained Earth observation (EO). We conduct a systematic efficiency analysis across three scaling dimensions: model size, dataset size, and input resolution, on rooftop PV detection in Madagascar. Optimizing for model efficiency (mAP 50 per unit of model size), we find a consistent efficiency inversion: YOLO11N achieves both the highest efficiency ( 24 × 24\times higher than YOLO11X) and the highest absolute mAP 50 (0.617). Resolution is the dominant resource allocation lever ( + + 120% efficiency gain), while additional data yields negligible returns at low resolution. These findings are robust to the deployment objective: small high-resolution configurations are Pareto-dominant across all 44 setups in the joint accuracy–throughput space, leaving no tradeoff to resolve. In data-scarce EO, bigger is not just unnecessary: it can be worse. 1 Introduction Figure 1 : Small models at high resolution dominate across all deployment objectives. Detection performance (mAP 50 ) versus inference speed (FPS) for all 44 experimental configurations on the OpenStat Madagascar rooftop PV dataset 27 . Marker shape encodes input resolution (circle: 416 px, square: 640 px, triangle: 1280 px) and marker size encodes the training dataset fraction (10% to 100%). The dashed line delineates the Pareto frontier (the set of configurations for which no other configuration is superior on both axes simultaneously). YOLO11N and YOLO11S at 1280 px lie at the apex, simultaneously maximising accuracy and throughput with no accuracy–speed tradeoff to resolve. Deep learning progress in computer vision has been largely driven by scaling: larger models trained on larger datasets consistently push benchmark performance upward. This paradigm, formalized through scaling laws 15 ; 12 , has proven remarkably predictable in data-rich settings such as NLP and large-scale image classification 7 ; 40 . The implicit assumption that more parameters and more data always help has become the default prior for model selection in computer vision. Earth observation (EO) challenges this assumption on two fronts. First, EO datasets are structurally data-scarce: annotation is expensive, requires domain expertise, and is geographically uneven 6 . Second, deployment in operational settings, e.g., in developing countries where most renewable energy growth will occur 13 , imposes hard compute constraints that make large models impractical regardless of their accuracy. In this regime, the relevant criterion is not raw performance but efficiency : performance per unit of resource. Despite growing evidence that architectural innovation can match or exceed naive parameter scaling 35 ; 10 ; 31 , and that smaller models outperform larger ones below certain data thresholds 4 , no systematic analysis has jointly characterized the interplay between model size, dataset fraction, and input resolution in a data-scarce EO setting. Existing work addresses these dimensions in isolation — resolution effects 30 , data-scarce regimes 4 , or budget-aware detection 28 — but their joint optimization under operational constraints remains an open question. This paper addresses that gap through a systematic efficiency analysis of the YOLO11 14 model family on rooftop photovoltaic (PV) detection in Madagascar — a representative data-scarce, small object EO task in a developing country context. We evaluate five model variants across four dataset fractions and three input resolutions, defining efficiency as mAP 50 per unit of model size following 35 . As illustrated in Figure 1 , our analysis reveals a striking result: the smallest model (YOLO11N, 2.6M parameters) achieves both the highest absolute mAP 50 and a 24\times efficiency advantage over the largest variant — and lies at the apex of the accuracy–throughput Pareto frontier, directly contradicting the scaling intuition. We further show that resolution dominates data volume as a resource allocation lever, and that this recommendation is robust to the choice of deployment objective: small high-resolution configurations simultaneously maximize detection accuracy and inference throughput, leaving no accuracy–speed tradeoff to resolve. We provide a mechanistic explanation grounded in the bias-variance tradeoff, compute-optimal training theory 36 ; 12 , and the structural absence of domain transfer from large-scale pretraining in this setting. The key contributions of this work are: • A systematic efficiency analysis across three scaling dimensions (model size, dataset fraction, input resolution) in a data-scarce EO setting, yielding 44 training runs on a real-world rooftop PV dataset. • Evidence that smaller models dominate larger ones in both accuracy and efficiency under data scarcity, with a 24\times efficiency gap between YOLO11N and YOLO11X. • A mechanistic explanation of this inversion grounded in overparameterization theory, supported by empirical learning curves and overparameterization ratio analysis. • A practical resource allocation recommendation: prioritize input resolution over dataset volume, and select the smallest model consistent with task requirements. • A joint efficiency–throughput analysis showing that small high-resolution configurations are Pareto-dominant across all experimental setups, confirming that the resource allocation recommendation holds regardless of whether the practitioner prioritizes static efficiency or real-time deployment. 2 Related works 2.1 Scaling Laws and Model Efficiency A classical assumption underpinning the scaling paradigm is that larger models consistently outperform smaller ones across domains 15 . This assumption has driven state-of-the-art progress in NLP, where models are trained in a self-supervised manner on colossal amounts of text — a setting fundamentally different from the data-scarce, domain-specific regime we consider. Several lines of work challenge its generality in vision. The lottery ticket hypothesis shows that sparse subnetworks within large models can match full model performance 10 , suggesting substantial parameter redundancy. EfficientNet 35 demonstrated that compound scaling outperforms naive parameter scaling and introduced model efficiency , i.e., detection performance per unit of model size, as the operationally relevant criterion for resource-constrained deployment, a definition we adopt directly. Vision transformer scaling studies further reveal diminishing returns at larger scales 1 , suggesting that the relationship between model size and performance is neither monotonic nor universal. Two distinct notions of efficiency recur in this literature and are worth distinguishing explicitly. Model efficiency (mAP per unit of model size or parameters) captures the static deployment cost — the criterion relevant when memory footprint constrains model selection on edge devices. Inference throughput (mAP per unit of inference time, typically visualized as accuracy–FPS Pareto frontiers) captures the dynamic deployment cost — the criterion relevant when latency constrains real-time operation. These two notions are correlated but not equivalent: a model with a small memory footprint may not be the fastest at inference, particularly when input resolution increases GFLOPs independently of parameter count. Most prior work optimizes for one criterion implicitly without acknowledging the other; we address both explicitly and show that, in our setting, the same configurations dominate on both axes simultaneously. More directly relevant to our setting, Shi et al. 31 show that small vision models augmented with multi-scale features can surpass much larger counterparts on classification and detection tasks in terms of both model efficiency and raw accuracy, questioning the need for large models beyond a certain data regime. Through their Scaling on Scales method, they demonstrate that multi-scale feature augmentation recovers the performance gap between small and large models at a fraction of the parameter cost — a result consistent with our finding that

Read the complete text