PhishParrot: LLM-Driven Adaptive Crawling to Unveil Cloaked Phishing Sites

Hiroki Nakano 1 , Takashi Koide 1 , Daiki Chiba 1 · 2025

Read PhishParrot: LLM-Driven Adaptive Crawling to Unveil Cloaked Phishing Sites by Hiroki Nakano 1 , Takashi Koide 1 , Daiki Chiba 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-02035.txt.

Introduction

Hiroki Nakano, Takashi Koide, and Daiki Chiba build a crawler that outwits phishing sites which hide from security scanners. Their 2025 paper targets cloaking: attack pages show themselves only to victims matching a profile, while crawlers see a harmless page. Standard detection therefore misses the trap entirely.

Their system, PhishParrot, uses a large language model to read the clues a phishing campaign leaves across cases. From similar past sites it infers the victim profile the attacker expects, then tunes browser settings and network configuration to match that profile and slip past the cloak. A twenty-one-day evaluation improved detection accuracy by up to thirty-four percentage points over standard systems. The crawler generated ninety-one distinct environments, one per attacker target pattern.

Catalog record

CREATORHiroki Nakano 1 , Takashi Koide 1 , Daiki Chiba 1
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-02035

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

PhishParrot: LLM-Driven Adaptive Crawling to Unveil Cloaked Phishing Sites Hiroki Nakano 1 , Takashi Koide 1 , Daiki Chiba 1 Abstract Phishing attacks continue to evolve, with cloaking techniques posing a significant challenge to detection efforts. Cloaking allows attackers to display phishing sites only to specific users while presenting legitimate pages to security crawlers, rendering traditional detection systems ineffective. This research proposes PhishParrot, a novel crawling environment optimization system designed to counter cloaking techniques. PhishParrot leverages the contextual analysis capabilities of Large Language Models (LLMs) to identify potential patterns in crawling information, enabling the construction of optimal user profiles capable of bypassing cloaking mechanisms. The system accumulates information on phishing sites collected from diverse environments. It then adapts browser settings and network configurations to match the attacker’s target user conditions based on information extracted from similar cases. A 21-day evaluation showed that PhishParrot improved detection accuracy by up to 33.8% over standard analysis systems, yielding 91 distinct crawling environments for diverse conditions targeted by attackers. The findings confirm that the combination of similar-case extraction and LLM-based context analysis is an effective approach for detecting cloaked phishing attacks. I Introduction Fig. 1: PhishParrot is composed of 4 steps to overcome sophisticated cloaking techniques and improve phishing detection accuracy. The system takes suspicious URLs as input and outputs actual phishing content hidden by cloaking mechanisms. The system performs a preliminary access to gather information for similar attack searches ( 1 ). It extracts crawling results of similar attacks from a database using cloaking pattern similarity-based retrieval ( 2 ). It embeds this information into prompts and requests LLM analysis to determine the optimal user profile matching attacker’s targeting criteria ( 3 ). It configures the browser with this profile and accesses the URL to retrieve phishing content hidden from security crawlers ( 4 ). This content is sent to phishing detectors, enabling accurate classification impossible with conventional crawling approaches. Without PhishParrot’s adaptive approach, even sophisticated phishing detectors would fail as cloaking mechanisms prevent access to malicious content. Phishing attacks have become increasingly sophisticated, posing a serious threat to internet users worldwide. Attackers employ “cloaking” techniques to evade detection mechanisms. They display phishing content only to users who meet specific criteria, while presenting legitimate pages or error messages to security crawlers and other unwanted visitors [ 1 , 2 ] . Conventional phishing detection systems analyze features such as HTML content and screenshots using machine learning models or rule-based algorithms, with some incorporating network data like IP addresses and HTTP transactions [ 3 , 4 , 5 , 6 ] . However, these systems fundamentally depend on successfully retrieving phishing content. When attackers identify security crawlers through cloaking mechanisms, they serve non-phishing content instead, which makes accurate analysis impossible. Research analyzing security crawler profiling has demonstrated that even when simulating “typical user-like” requests, without appropriate environmental adjustments, crawlers cannot satisfy all conditions targeted by attackers [ 7 ] . Consequently, content acquisition methods dependent on fixed crawling environments have limited ability to reach phishing content. To address these limitations, a new approach capable of flexibly and accurately capturing the characteristics of phishing attacks is essential. This research proposes PhishParrot, a novel crawling environment optimization system designed to improve detection rates for cloaked phishing sites. PhishParrot adaptively adjusts browser profiles (such as HTTP headers) and network environments (e.g., country information, residential or mobile networks) based on crawling results information to satisfy attacker-defined conditions and access phishing content (Fig. 1 ). The system accumulates phishing site information (Domain Information, Network Information, HTML Information) collected from diverse environments and incorporates a mechanism to extract similar cases. Based on this information, a Large Language Model (LLM) suggests optimal user profiles (browser settings and access environments), enabling the construction of environments closely resembling those targeted by attackers, thereby bypassing cloaking to retrieve phishing content. The advanced language comprehension capabilities of LLMs enable the flexible and accurate identification of trending characteristics in the latest phishing attacks. This potentially enhances effectiveness against cloaking-based detection avoidance, a challenge for conventional fixed-environment crawling approaches. In this study, we evaluated PhishParrot’s performance using three types of LLMs on 32,487 suspicious URLs collected over a 21-day period. Results showed that the best-performing model achieved 88.0% accuracy with an average processing time of 16.69 seconds per URL. When combining PhishParrot with three different Phishing Detectors, we confirmed up to a 33.8% improvement in phishing site detection rates compared to standard analysis systems. PhishParrot also demonstrated the ability to suggest 91 optimal user profiles based on attack trends and phishing site similarities, enabling flexible environment construction tailored to attackers’ targets. These results indicate that rule-based approaches struggle to comprehensively cover the diverse user access environments targeted by attackers. In contrast, the sophisticated context analysis capabilities of LLMs enable flexible and effective crawling environment construction unachievable by other approaches. The findings of this research demonstrate that incorporating LLMs into systems is an effective strategy for addressing the challenge of detection avoidance through cloaking. II Related Work Numerous studies have been conducted on phishing site detection, with many systems proposed to identify phishing sites based on HTML content and screenshots obtained when accessing URLs [ 3 , 8 , 6 , 9 ] . Liu et al. proposed “PhishIntention,” which visually extracts both brand intention and credential-harvesting intention from webpage appearance and dynamic behavior, verifying credential-harvesting intention through interaction with the webpage [ 5 ] . Lin et al. introduced “Phishpedia,” a system that accurately recognizes brand logos from webpage screenshots and matches logo variations of the same brand, enabling high-precision identification and visual explanation of phishing sites [ 4 ] . While these studies demonstrate high detection capabilities in situations where phishing content is accessible, their detection accuracy inevitably decreases when accessing continuously from the same or known analysis environments, as cloaking techniques prevent observation of the actual phishing content. Cloaking techniques refer to technologies that display different content based on the characteristics of the access source. When a phishing URL is accessed, attackers analyze request characteristics in detail (User-agent, IP address, HTTP headers, etc.). Based on this analysis, they distinguish between “Victim Access” (access from targeted typical users) and “Non-victim Access” (access from security researchers or detection systems). According to Zhang et al. [ 2 ] , 96.52% (2,831 cases) of the 2,933 phishing kits analyzed contained cloaking techniques. IP address and User-agent based cloaking were found to be the most commonly used, with 1,983 cases (approximately 82%) implementing User-Agent verification and 1,660 cases (approximately 69%) implementing IP address verification among the 2,421 phishing kits analyzed. To address these cloaking techniques, researchers have proposed analyses of cloaking technologies embedded in phishing kits and techniques to bypass specific types of cloaking [ 10 , 2 , 11 ] . Zhang et al. proposed “CrawlPhish,” a framework for automatically detecting and classifying client-side cloaking used in phishing sites [ 1 ] . Their analysis of 112,005 phishing sites collected over 14 months from 2018 to 2019 revealed that the use of cloaking techniques increased from 23.32% to 33.70%. Acharya et al. proposed the “PhishPrint” framework, which pre-profiles the characteristics of security crawlers to identify weaknesses and uses them to evade phishing detection through cloaking attacks [ 7 ]

Read the complete text