CROP: Expert-Aligned Image Cropping via Compositional Reasoning and Optimizing Preference
Zhitong Dong, Chao Li, Jie Yu, Hao Chen · 2026
Read CROP: Expert-Aligned Image Cropping via Compositional Reasoning and Optimizing Preference by Zhitong Dong, Chao Li, Jie Yu, Hao Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-12545.txt.
Introduction
Dong and three colleagues recast aesthetic image cropping as a reasoning task, not a saliency hunt. Older methods lean on saliency maps or similar past cases, and both miss the composition trade-offs that human experts weigh in complex scenes. Their CROP method directs a vision-language model to think like a professional photographer, breaking a scene down by composition and taste before choosing a crop. The goal is crops that match expert choices, with reasons the model can articulate rather than blind retrieval.
Catalog record
| CREATOR | Zhitong Dong, Chao Li, Jie Yu, Hao Chen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41387 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.12545
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CROP: Expert-Aligned Image Cropping via Compositional Reasoning and Optimizing Preference Zhitong Dong, Chao Li, Jie Yu, Hao Chen Abstract Aesthetic image cropping aims to enhance the aesthetic quality of an image by improving its composition through spatial cropping. Previous methods often rely on saliency prediction or retrieval augmentation, ignoring the task’s core requirement: a deep understanding of composition and aesthetics. Consequently, saliency-based methods struggle to make compositional trade-offs in complex scenes, while retrieval-based methods blindly refer to similar cases, lacking adaptive reasoning for unique scenes. Both approaches fail to align their automated cropping results with those of human experts. To address the above issues, we propose a novel paradigm that reformulates aesthetic cropping as a multimodal reasoning task, aiming to activate the VLM’s analytical and comprehension capabilities in aesthetics. We design a C ompositional R easoning and O ptimizing P reference method (CROP) that directs the VLM to think like a professional photographer. It deconstructs a complex and subjective aesthetic problem into an “analysis-proposal-decision” process, reasoning step by step through the analysis of scene elements and compositional principles. Meanwhile, our expert preference alignment module makes the model’s decision consistent with human expert aesthetics. Extensive experiments across multiple datasets validate our method’s superiority and component effectiveness. 1 Introduction Figure 1 : Smartcrop ( 36 ) , CACNet ( 13 ) , and Cropper ( 19 ) represent three typical image cropping paradigms, each facing distinct limitations. Figure 2 : The overall architecture of our proposed CROP. The VLM first analyzes the key compositional elements of the input image and returns the results in JSON. Based on this analysis, CROP generates a vision-augmented prompt image and feed it back into the VLM. Leveraging both textual and visual cues, the VLM performs a second reasoning pass to propose candidate crops, which serve as inputs to the aesthetic decision module. The aesthetic decision module uses direct preference optimization to align with professional photography experts and produces the final crop. See supplementary materials for the complete prompts. With the rapid development of smartphone photography hardware, mobile photography has become more popular. However, good equipment alone is not enough because what matters even more is the eye behind the camera, which can be challenging for non-professionals. Aesthetic image cropping focuses on improving the composition and visual appeal of an ordinary image through spatial cropping. Compared with other image processing tasks, this task has unique photographic and aesthetic properties. The core challenge of aesthetic image cropping lies in how to align automated cropping results with manual works by human experts. Traditional methods ( 6 ; 8 ; 46 ; 26 ) rely on hand-crafted features, which lack generalization and can only provide suggestions from a single perspective. As shown in Figure 1 (a), Smartcrop ( 36 ) only focuses on the foreground, and its rigid rules lead to a lack of aesthetic appeal in the resulting composition. Saliency-based methods ( 5 ; 21 ; 39 ; 43 ) typically focus on evaluating visual saliency rather than understanding scene relationships, making it difficult to achieve true compositional balance. As shown in Figure 1 (b), when multiple competing focal points (woman and band) exist within the scene, CACNet fails to make a clear decision and instead produces a mediocre cropping result. Recent approaches ( 19 ; 45 ) retrieve visually similar images from a database, which serve as learning samples to guide the cropping decision. However, the performance of such methods heavily depends on the database’s coverage and retrieval accuracy. For example, as shown in Figure 1 (c), Cropper ( 19 ) performs retrieval using cosine similarity, which primarily captures semantic proximity (people walking on the grass) rather than correspondence in compositional structure. As a result, the model retrieves reference images that are semantically similar but compositionally different, thereby providing wrong guidance for cropping. Aesthetic image cropping is inherently a multi-stage reasoning process. A photographer first surveys the scene layout, identifies key compositional elements, and then applies photographic principles to make the framing decision. Previous methods, whether based on saliency ( 13 ; 16 ; 37 ; 49 ) or retrieval ( 19 ; 45 ) , rely on biased, single-step priors and fundamentally fail to emulate this step-by-step analytical process. To address this gap, we propose a novel paradigm for image cropping that reformulates the task as a multimodal reasoning problem. Existing VLMs struggle to effectively execute this task via instruction following. Our core idea is to guide the VLM to learn a photographer’s thought process by first analyzing the scene’s compositional elements and then reasoning toward the optimal cropping decision. To this end, we design a C ompositional R easoning P ipeline (CRP), as illustrated in Figure 2 (a). It directs the VLM to think like a professional photographer, deconstructing a complex and subjective aesthetic problem into an “analysis-proposal-decision” process, and reasoning step by step through the analysis of scene elements and compositional principles. Specifically, the VLM first performs (i) analysis on compositional elements, followed by (ii) proposal generation grounded in photographic rules. Since standard VLMs often overlook spatial context in favor of semantics, we reinforce visual signals through explicit annotations. Finally, the model makes an aesthetic (iii) decision on the candidates to yield the optimal crop. Standard Supervised Fine-Tuning (SFT) alone proves inadequate to address this complex visual reasoning task. We argue that aesthetic judgment is inherently comparative—relying on ranking compositional differences—rather than a binary classification of ‘right’ versus ‘wrong’. To address this, we introduce E xpert P reference A lignment (EPA), a comprehensive training framework that integrates SFT with Direct Preference Optimization (DPO) ( 32 ) . While the SFT stage instills preliminary aesthetic capabilities, the subsequent DPO stage aligns the model’s decisions with expert preferences. This framework strengthens the VLM’s internal aesthetic reasoning, eliminating the need for external scorers. After training, our method operates as a fully automated, standalone pipeline that requires no human intervention or external dependencies, ensuring efficient deployment. Our contributions can be summarized as follows: • We propose a novel paradigm for image cropping, which reformulates the task as a multimodal reasoning problem through the compositional reasoning pipeline. • We introduce expert preference alignment, a two-stage training framework that aligns the VLM’s cognition with human expert aesthetics. • We conduct extensive quantitative and qualitative experiments across multiple datasets to validate the superiority and generalizability of our method. Comprehensive ablation and parameter sensitivity analyses further demonstrate the effectiveness of each component. 2 Related Work 2.1 Aesthetic Image Cropping Early approaches ( 6 ; 8 ; 46 ; 26 ; 36 ) relying on hand-crafted features generalize poorly to complex scenes. Recently, deep learning methods have dominated aesthetic cropping ( 21 ; 39 ; 43 ; 22 ; 16 ; 37 ; 29 ; 35 ; 14 ; 30 ) . VFN ( 5 ) formulates the task as a viewpoint search, simulating a photographer who iteratively moves the camera. However, this approach lacks explicit modeling of aesthetics. CACNet ( 13 ) explicitly encodes photographic composition rules, but employing them merely to influence the cropping weights undermines interpretability. A major challenge for image cropping is the scarcity of annotated data, as aesthetic judgments are subjective and often require photographic expertise. Datasets such as