No Trust Issues Here: A Technical Report on the Winning Solutions for the Rayan AI Contest
Ali Nafisi, Sina Asghari, Mohammad Saeed Arvenaghi, Hossein Shakibania · 2025
Read No Trust Issues Here: A Technical Report on the Winning Solutions for the Rayan AI Contest by Ali Nafisi, Sina Asghari, Mohammad Saeed Arvenaghi, Hossein Shakibania (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-01498.txt.
Introduction
Ali Nafisi and co-authors report winning entries for the Rayan AI Contest. Three tasks were set. One was image search from mixed text and image cues. One was spotting odd items with no prior cases. One was finding models that had been secretly tampered with.
Their image search tool blends visual and text cues to fetch the right image. It scored well above the next team. The report walks through all three tools step by step. Shared winning methods help other teams lift their own work on search, anomaly spotting, and model safety checks.
Catalog record
| CREATOR | Ali Nafisi, Sina Asghari, Mohammad Saeed Arvenaghi, Hossein Shakibania |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-01498
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
No Trust Issues Here: A Technical Report on the Winning Solutions for the Rayan AI Contest Ali Nafisi, Sina Asghari, Mohammad Saeed Arvenaghi, Hossein Shakibania Abstract This report presents solutions to three machine learning challenges developed as part of the Rayan AI Contest: compositional image retrieval, zero-shot anomaly detection, and backdoored model detection. In compositional image retrieval, we developed a system that processes visual and textual inputs to retrieve relevant images, achieving 95.38% accuracy and ranking first with a clear margin over the second team. For zero-shot anomaly detection, we designed a model that identifies and localizes anomalies in images without prior exposure to abnormal examples, securing second place with a 73.14% score. In the backdoored model detection task, we proposed a method to detect hidden backdoor triggers in neural networks, reaching an accuracy of 78%, which placed our approach in second place. These results demonstrate the effectiveness of our methods in addressing key challenges related to retrieval, anomaly detection, and model security, with implications for real-world applications in industries such as healthcare, manufacturing, and cybersecurity. Code for all solutions is available online. 1 1 1 https://github.com/safinal/rayan-ai-contest-solutions Keywords Compositional Retrieval \cdot Zero-Shot Anomaly Detection \cdot Backdoored Model Detection 1 Introduction Traditional machine learning systems often struggle with scenarios where data distributions shift or when input data is incomplete or noisy. This report addresses three such challenges, each focusing on improving the reliability, flexibility, and security of machine learning systems. As the demand for intelligent systems grows across industries, the need for models that can process both visual and textual data, detect anomalies in unseen distributions, and safeguard against adversarial manipulations becomes increasingly critical. The solutions detailed in this report were developed for the Rayan AI Contest 2 2 2 https://ai.rayan.global , an international competition hosted by Sharif University of Technology focused on Trustworthy AI. The contest attracted significant global participation, with over 4,600 contestants from more than 60 countries forming 730 teams during the screening phase. From this pool, 100 teams were invited to the main phase, and ultimately, more than 40 teams successfully participated with at least one valid submission. To address the competition’s objectives, we focused on three distinct tasks: compositional image retrieval, zero-shot anomaly detection, and backdoored model detection. The first task involves developing a system capable of retrieving images based on multi-modal queries. The second focuses on detecting anomalies in industrial and medical settings, and the third aims to identify security vulnerabilities, specifically backdoor attacks, in deep learning models. The evaluation of these solutions is based on a set of standard metrics, such as accuracy and F1 score, to assess both the quality and robustness of the approaches. Our team, No Trust Issues Here , secured the 1st place overall by achieving state-of-the-art performance across all three tracks. Specifically, we ranked 1st in compositional image retrieval with a score of 95.38%, 2nd in zero-shot anomaly detection with 73.14%, and 2nd in backdoored model detection with 78%. The final leaderboard ranking was determined by Total Points, calculated as: \text{Total Points}=\sum_{i=1}^{3}(101-\text{rank}_{i}) where \text{rank}_{i} denotes the team’s rank in the i -th challenge. Our cumulative 298 points placed us at the top of the final leaderboard, as shown in Table 1 . Table 1: Final leaderboard showing the top 10 teams. Rank Team Rank Total Points Compositional Image Retrieval Zero-Shot Anomaly Detection Backdoored Model Detection 1 No Trust Issues Here (Our Team) 1 2 2 298 2 Pileh 4 1 6 292 3 AI Guardians of Trust 2 6 4 291 4 AIUoK 9 3 5 286 5 red_serotonin 3 7 9 284 6 Persistence 7 11 3 282 7 GGWP 6 9 11 277 8 Tempest 11 5 13 274 9 AlphaQ 5 10 16 272 10 Cogniverse 20 13 12 258 2 Compositional Image Retrieval The objective of the Compositional Image Retrieval challenge is to develop an intelligent search system capable of processing multi-modal queries. The system must accept a reference image containing a visual scene and a textual modification description (e.g., "Remove motor and add Microwave") as input. The goal is to identify and retrieve the most relevant image from a database that reflects the visual changes described in the text. Figure 1 visualizes the compositional retrieval problem. Figure 1: An overview of the Compositional Image Retrieval problem. This task presents a unique challenge in that it requires the model to understand both the visual content of the reference image and the semantic intent of the textual instructions to perform accurate retrieval, all while adhering to strict resource constraints such as a 4GB model size limit and a prohibition on large language models or object detection models during inference. 2.1 Methodology To address the challenge of compositional retrieval without relying on prohibited heavy architectures, we propose a two-stage pipeline: Token Classification and Compositional Embedding Arithmetic . This approach provides a lightweight method for modifying visual representations using textual instructions while remaining within the competition constraints. All code associated with our implementation is available at the provided repository. 3 3 3 https://github.com/safinal/compositional-image-retrieval 2.1.1 Token Classification for Semantic Parsing The first stage of our pipeline is the Token Classification model, which is responsible for interpreting the query text and identifying specific modifications (i.e., which objects to add or remove), as illustrated in Figure 2 . This task is framed as a token classification problem where the model classifies tokens into three categories: • Positive ( pos ): Objects to be added to the scene. • Negative ( neg ): Objects to be removed from the scene. • Other: Irrelevant tokens (stopwords, punctuation, verbs). To create training data, we generated a synthetic dataset using publicly available LLM interfaces (Gemini 1.5 Pro, GPT-4o, and Claude 3.5 Sonnet). No API access was used. We built 636 template sentences containing placeholders for positive and negative objects. We additionally generated a vocabulary of 1,018 unique object names. Each template was instantiated 15 times by replacing the placeholders with random objects from the list, producing 9,540 labeled queries. Labels were assigned automatically. For a query such as “add apple and remove banana”, the sequence is annotated as <other> <positive_object> <other> <other> <negative_object>. This procedure ensures consistent detection of objects to add and remove. We fine-tuned distilbert-base-uncased ( 8 ) . DistilBERT was selected due to its small size and adequate performance for this restricted classification task. The model was trained for 20 epochs with a weight decay of 0.01 , 500 warm-up steps, and standard token-level cross-entropy. This stage outputs two sets: detected positive objects and detected negative objects. Figure 2: Overview of the token classification module. (a) Dataset curation using templated queries instantiated with LLM-generated object vocabulary. (b) Fine-tuned DistilBERT model for token-level classification into positive , negative , and other categories, using the curated dataset. 2.1.2 Compositional Embedding Arithmetic for Retrieval The second stage retrieves the target image by modifying the vector representation of the query image according to the objects identified in the query text. We evaluated multiple models from OpenCLIP ( 3 ) and selected ViTamin-L-384 ( 1 ) due to its superior performance in preliminary experiments. To remain within resource limits, we fine-tune only the visual head ( model.feature_extractor.visual.head ) while keeping the rest of the backbone fixed. We