AesCrop: Aesthetic-driven Cropping Guided by Composition
Yen-Hong Wong, Lai-Kuan Wong · 2025
Read AesCrop: Aesthetic-driven Cropping Guided by Composition by Yen-Hong Wong, Lai-Kuan Wong (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-22528.txt.
Introduction
Cropping a photo well depends on composition, the deliberate placement of elements in the frame. Yen-Hong Wong and Lai-Kuan Wong present AesCrop in 2025, a model that suggests attractive crops for uses like thumbnails and view recommendations.
Older methods either scored crops without seeing the whole picture or predicted one crop with little variety. AesCrop combines both ideas and adds guidance about photographic composition inside its attention step, which directs focus toward key regions. It outputs several ranked crops with quality scores. Extensive tests show it beats current leading methods, suggesting explicit composition cues help a model find visually strong regions.
Catalog record
| CREATOR | Yen-Hong Wong, Lai-Kuan Wong |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-22528
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AesCrop: Aesthetic-driven Cropping Guided by Composition Yen-Hong Wong, Lai-Kuan Wong Abstract Aesthetic-driven image cropping is crucial for applications like view recommendation and thumbnail generation, where visual appeal significantly impacts user engagement. A key factor in visual appeal is composition—the deliberate arrangement of elements within an image. Some methods have successfully incorporated compositional knowledge through evaluation-based and regression-based paradigms. However, evaluation-based methods lack globality while regression-based methods lack diversity. Recently, hybrid approaches that integrate both paradigms have emerged, bridging the gap between these two to achieve better diversity and globality. Notably, existing hybrid methods do not incorporate photographic composition guidance, a key attribute that defines photographic aesthetics. In this work, we introduce AesCrop, a composition-aware hybrid image-cropping model that integrates a VMamba image encoder, augmented with a novel Mamba Composition Attention Bias (MCAB) and a transformer decoder to perform end-to-end rank-based image cropping, generating multiple crops along with the corresponding quality scores. By explicitly encoding compositional cues into the attention mechanism, MCAB directs AesCrop to focus on the most compositionally salient regions. Extensive experiments demonstrate that AesCrop outperforms current state-of-the-art methods, delivering superior quantitative metrics and qualitatively more pleasing crops. 1 Introduction Image cropping is the process of removing unwanted outer areas from an image. To crop an image in a visually appealing way, a solid understanding of image composition principles is essential. These principles guide the arrangement of elements within an image, ensuring balance, focus, and aesthetic harmony, which in turn directs the viewer’s attention to the intended subject and conveys the desired message or emotion. However, without sufficient knowledge of aesthetic and photographic principles, amateurs often produce undesirable and unappealing crops. Figure 1 : AesCrop is a composition-aware, hybrid image-cropping model that incorporates cues from multiple composition classes via the Mamba Composition Attention Bias (MCAB) and performs end-to-end rank-based image cropping. To address this gap, researchers introduced automatic image cropping to make aesthetic-driven cropping more accessible. Early image cropping approaches can be categorized primarily into two paradigms: evaluation-based [ 16 , 1 , 15 , 18 , 17 , 10 ] and regression-based [ 3 , 2 , 11 , 14 , 4 ] methods. Evaluation-based approaches generate a fixed number of candidate crops using heuristic rules, evaluate their aesthetic quality, and rank them using a separate aesthetics evaluation model. Regression-based methods directly regress the best candidate crop. In particular, incorporation of explicit compositional knowledge into image-cropping methods has been proven effective in enhancing the aesthetic appeal of cropped images in both evaluation-based [ 17 ] and regression-based [ 3 , 14 ] approaches. However, both paradigms have limitations: the former lacks globality as heuristic-based crop candidates might miss the optimal choice, while the latter lacks diversity since generating a single crop may be insufficient. Recently, hybrid approaches [ 5 , 19 ] that simultaneously regress and evaluate multiple candidate crops have been proposed to achieve better diversity and globality. These methods can generate pleasing crops but none consider explicit compositional guidance, which could potentially further enhance the aesthetics quality of cropped images. In this work, we introduce AesCrop, a novel, composition-aware hybrid cropping model that incorporates explicit compositional cues to guide cropping, as illustrated in Fig. 1 . Capitalizing on the strength of Mamba’s encoder in its efficient long-range dependency modeling with linear computational complexity, we integrates a VMamba-based encoder [ 8 ] that generates rich embedding of the input image with a Conditional DETR-based transformer decoder [ 9 ] that regresses and scores multiple candidate crops using learnable anchor embeddings. To incorporate explicit compositional knowledge, we propose the Mamba Composition Attention Bias (MCAB), a novel mechanism that extracts composition cues from a VMamba-based [ 8 ] composition classifier and injects them into the transformer decoder by modulating its attention weights. MCAB guides the decoder to focus on compositionally salient regions, yielding crops that adhere to established compositional principles. In summary, our main contributions are as follows: • We present AesCrop, a novel hybrid image cropping model that incorporates explicit compositional knowledge to simultaneously achieve globality, diversity, and compositional awareness. Specifically, Mamba Composition Attention Bias (MCAB), a novel mechanism that extracts compositional cues from a Mamba-based classifier and injects them into attention weights is introduced to effectively guide the model to focus on compositionally important regions. • Comprehensive experiments and ablation studies validate our architectural design choices and demonstrate that AesCrop consistently outperforms state-of-the-art methods in generating aesthetically pleasing crops that adhere more faithfully to professional photographic composition rules. 2 Related Work Existing approaches can be broadly categorized into three paradigms: evaluation-based, regression-based, and hybrid-based methods. Evaluation-Based . In this paradigm, the majority of works follow a two-step process: (1) generating a number of candidate crops using heuristic rules, and (2) ranking each candidate crop to determine the best crops. Within this framework, several representative approaches have pushed the state of the art by improving either candidate generation or crop scoring. Yan et al . [ 16 ] proposed a method that uses regional features taking changes into account to generate candidate crops, then scores these crops with an SVM. VFN [ 1 ] assumes that web images have the best aesthetics, allowing the model to learn from large-scale pairwise ranking in an unsupervised manner. VPN [ 15 ] learns to score image crops in real-time using a novel knowledge distillation framework. GAIC [ 18 ] reduces the candidate search space using special properties of image cropping, then ranks the crops using a CNN that models the RoI and RoD. TransView [ 10 ] utilizes a transformer-based architecture to model dependencies between visual elements inside and outside the bounding box for crop ranking. CLIPCropping [ 17 ] leverages CLIP to learn aesthetic and composition concepts from dedicated image-text pairs for crop ranking. Regression-Based . In this paradigm, most approaches directly regress the coordinates of the optimal crop through a single-stage process. Within this paradigm, several methods have driven progress by refining regression strategies or by injecting domain knowledge into the prediction process. Guo et al . [ 2 ] introduced a cascaded regression method that progressively refines crop predictions through iterative adjustments. Mars [ 7 ] adapts a base model to diverse aspect ratio requirements by employing two meta-learners that dynamically generate model parameters based on target aspect ratios, enabling flexible and precise cropping across various formats. CACNet [ 3 ] utilizes Class Activation Maps (CAMs) to extract compositional features through a dedicated composition branch, which are then explicitly integrated into the cropping branch to enhance output quality. Pan et al . [ 11 ] operates on the principle that crops with similar boundaries share compositional characteristics, proposing C2C to regularize these features for boundary prediction that generalizes across both common and rare patterns. GenCrop [ 4 ] builds on the assumption that stock images exhibit optimal aesthetics, training its model on a large-scale image-crop dataset through a diffusion-based outpainting approach. Hybrid-Based . The paradigm was first introduced by Jia et al. [ 5 ] , who rethink image cropping through a hybrid method using Conditional DETR with a novel training strategy adapted from DETR. Their work introduced two label smoothing techniques to provide enhanced learning signals for crop ranking. Later, ClipCrop [ 19 ] extended this approach