Trend-Aware Fashion Recommendation with Visual Segmentation and Semantic Similarity ISBN: 978-1-4503-XXXX-X/2018/06

Mohamed DJILANI, Nassim ALI OUSALAH, Nidhal Eddine CHENNI · 2025

Read Trend-Aware Fashion Recommendation with Visual Segmentation and Semantic Similarity ISBN: 978-1-4503-XXXX-X/2018/06 by Mohamed DJILANI, Nassim ALI OUSALAH, Nidhal Eddine CHENNI (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-07773.txt.

Introduction

Mohamed Djilani, Nassim Ali Ousalah, and Nidhal Eddine Chenni build a fashion recommender that follows trends while matching personal taste. Their 2025 paper combines deep image features with garment-aware segmentation, which masks out everything but the clothing. Pretrained vision networks then describe each item's look in compact form.

Fake shopping histories, shaped by each user's trendiness and by item popularity, stand in for real behavior data. A weighted score blends visual likeness, category fit, and popularity alignment to rank suggestions. On the DeepFashion dataset, one backbone network reached about sixty-five percent category similarity with the lowest popularity error. Tests confirmed that visual and popularity cues each add value.

Catalog record

CREATORMohamed DJILANI, Nassim ALI OUSALAH, Nidhal Eddine CHENNI
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-07773

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Trend-Aware Fashion Recommendation with Visual Segmentation and Semantic Similarity ISBN: 978-1-4503-XXXX-X/2018/06 Mohamed DJILANI, Nassim ALI OUSALAH, Nidhal Eddine CHENNI Abstract . We introduce a trend-aware and visually-grounded fashion recommendation system that integrates deep visual representations, garment-aware segmentation, semantic category similarity and user behavior simulation. Our pipeline extracts focused visual embeddings by masking non-garment regions via semantic segmentation followed by feature extraction using pretrained CNN backbones (ResNet-50, DenseNet-121, VGG16). To simulate realistic shopping behavior, we generate synthetic purchase histories influenced by user-specific trendiness and item popularity. Recommendations are computed using a weighted scoring function that fuses visual similarity, semantic coherence and popularity alignment. Experiments on the DeepFashion dataset demonstrate consistent gender alignment and improved category relevance, with ResNet-50 achieving 64.95% category similarity and lowest popularity MAE. An ablation study confirms the complementary roles of visual and popularity cues. Our method provides a scalable framework for personalized fashion recommendations that balances individual style with emerging trends. Our implementation is available at https://github.com/meddjilani/FashionRecommender 1. Introduction The proliferation of e-commerce platforms and online retailing has significantly transformed the fashion industry providing consumers with an unprecedented array of choices. However, navigating these vast selections to find suitable clothing items remains challenging, prompting the rise of personalized recommendation systems. Fashion recommendation systems harness advanced technologies particularly machine learning and deep learning, to suggest products aligning closely with individual preferences, styles, and contextual needs. Recent advancements in Convolutional Neural Networks (CNNs) ( O’shea and Nash 2015 ) have enabled significant improvements in fashion recommendation systems by efficiently capturing the rich visual attributes inherent in clothing images. Leveraging pretrained models such as ResNet50 ( Koonce 2021 ) , DenseNet121 ( Huang et al. 2017 ) , and VGG16 ( Simonyan and Zisserman 2014 ) , these systems extract visual embeddings that facilitate meaningful and accurate recommendations based on visual similarity. Beyond visual features, metadata such as product categories, gender, and popularity, as well as semantic relationships between fashion items, play crucial roles in refining the recommendation accuracy. This paper presents a comprehensive fashion recommendation framework that integrates pretrained CNNs for visual feature extraction with a multi-factor content-based recommendation engine. The proposed methodology simulates realistic retail environments and user behaviors through synthetic data generation, enhancing the evaluation robustness. Our approach addresses the limitations of traditional recommendation methods by combining visual similarity, item popularity, semantic category relationships, and user-specific attributes such as gender preferences and trendiness. The rest of the paper is organized as follows: Section 2 discusses relevant literature in fashion recommender systems, highlighting recent advancements and remaining challenges. Section 3 outlines the proposed methodology, including detailed descriptions of visual feature extraction, metadata simulation, synthetic user purchase generation, semantic similarity measures, and recommendation scoring. Section 4 describes the system implementation and evaluation, and Section 5 concludes the paper with a summary of findings and future research directions. 2. Related Works Recommender systems have become increasingly significant across various industries due to their capability to enhance user experience by providing personalized suggestions tailored to individual preferences. At their core, these systems analyze patterns of user interaction to suggest items that are likely to interest users. Initially, collaborative filtering emerged as a popular technique, where recommendations are generated based on similarities between user preferences, relying heavily on historical data of user-item interactions. However, collaborative filtering struggles with issues like sparse data—where many items have few interactions—and the cold-start problem, where recommendations for new users or new items are challenging due to insufficient data ( Guo 2012 ) . To overcome these limitations, content-based methods were developed. These methods utilize item-specific attributes such as descriptions, categories, and visual features, as well as user profile information, to deliver more relevant recommendations. Unlike collaborative filtering, content-based approaches can effectively manage new items since recommendations depend directly on the item’s characteristics rather than solely user interactions. Recently, the integration of multimodal representation learning—combining multiple types of data such as text and images—has shown promising results in recommender systems. For instance, Yilma and Leiva ( Yilma and Leiva 2023a ) demonstrated that combining textual descriptions and visual imagery of items could significantly enhance recommendation quality by better capturing complex relationships that single modalities might miss. Further extending this research, Yilma et al. ( Yilma and Leiva 2023b ) examined methods of integrating these multimodal features, specifically showing that early fusion strategies—where data from multiple modalities are combined at an early stage in the model—tend to outperform later fusion strategies, thereby emphasizing the advantage of joint multimodal data representation. Multistakeholder perspectives have also become a critical factor in modern recommender systems research. Typically, recommender systems primarily focus on end-users; however, Yilma et al. ( Yilma and Leiva 2024 ) proposed the MOSAIC framework, which also incorporates the objectives and preferences of additional stakeholders such as content providers, curators, and platform operators. This approach ensures that recommendations are not only satisfying for users but also beneficial for other involved parties, potentially increasing the practical usability and overall acceptance of recommender systems. In addition, the consideration of context—such as location, time, and specific environmental constraints—has gained attention due to its role in improving recommendation accuracy and relevance. Yilma et al. ( Yilma et al. 2021 ) introduced the concept of Cyber-Physical-Social Systems (CPSS), highlighting the importance of factoring in real-world contexts and constraints into the recommendation process. This helps to ensure that recommendations are not only theoretically relevant but practically appropriate and actionable within specific environments. Moreover, recommender systems have demonstrated potential beyond typical commercial applications, notably in therapeutic contexts. For instance, Yilma et al. ( Yilma et al. 2024 ) explored using personalized visual art recommendations as therapeutic interventions to enhance psychological well-being, illustrating how personalized recommendations can significantly impact emotional and mental health outcomes. Specifically within the fashion domain, recommendation systems have experienced considerable innovation. Patil et al. ( Arunkumar et al. 2024 ) employed ResNet-50, a deep learning architecture renowned for its ability to capture intricate visual patterns, to develop a recommendation system capable of discerning essential visual attributes of fashion items like color, texture, and style. Similarly, Sivaranjani et al. ( Sivaranjani et al. 2023 ) utilized Convolutional Neural Network (CNN)-based visual embeddings in conjunction with K-nearest neighbors (KNN) algorithms to enhance retrieval accuracy, surpassing traditional recommendation methods. The utilization of deep learning architectures, particularly ResNet, effectively addressed common neural network issues such as vanishing gradients, making them highly effective for image-based fashion recommendation tasks. The integration of multimodal data has further refined fashion recommendation systems. Varma et al. ( NehaVarma1 2024 ) introduced an AI-powered system, StyleSync, which classifies clothing types and colors using deep learning and provides personalized outfit recommendations tailored to specific occasions. Their approach emphasized user-friendly interfaces and continuous refinement through user feedback, significantly improving user satisfaction and system adaptability. Despite these advancements, fashion recommender systems continue to face challenges, particularly in balancing highly personalized recommendations with broader market trends and real-world constraints such as inventory availability and geographic proximity. Our proposed system seeks to address these gaps by integrating sophisticated visual feature extraction techniques, realistic user simulations, semantic similarity assessments, and geographic considerations, aiming to optimize both personalization and practical applicability in real-world scenarios. 3. Proposed Methodology We propose a content-based fashion recommendation system that leverages deep visual features, category

Read the complete text