“It Warned Me Just at the Right Moment": Exploring LLM-based Real-time Detection of Phone Scams DOI: XXXXXXX.XXXXXXX Conference: Late Breaking Work of the CHI Conference on Human Factors in Computing Systems; April 26–May 1, 2025; Yokohama, Japan ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Human-centered c
Zitong Shen, Sineng Yan, Youqian Zhang, Xiapu Luo, Grace Ngai, Eugene Yujun Fu · 2025
Read “It Warned Me Just at the Right Moment": Exploring LLM-based Real-time Detection of Phone Scams DOI: XXXXXXX.XXXXXXX Conference: Late Breaking Work of the CHI Conference on Human Factors in Computing Systems; April 26–May 1, 2025; Yokohama, Japan ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Human-centered c by Zitong Shen, Sineng Yan, Youqian Zhang, Xiapu Luo, Grace Ngai, Eugene Yujun Fu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-03964.txt.
Introduction
Zitong Shen and five co-authors built a tool that spots phone scams while the call is still live, in a 2025 paper. Phone scams stay common in the internet age and cost victims money and peace of mind. Old defenses lag behind, since scammers keep changing their scripts and tricks.
The team set up a model of how scam calls unfold, then used a large language model to judge fraud intent as the talk goes on. The tool can warn the user mid call, in time to stop harm. Tests measured how well it works and what drives its hits and misses. The authors weigh speed against recall and point to next steps for live scam defense.
Catalog record
| CREATOR | Zitong Shen, Sineng Yan, Youqian Zhang, Xiapu Luo, Grace Ngai, Eugene Yujun Fu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-03964
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
“It Warned Me Just at the Right Moment": Exploring LLM-based Real-time Detection of Phone Scams DOI: XXXXXXX.XXXXXXX Conference: Late Breaking Work of the CHI Conference on Human Factors in Computing Systems; April 26–May 1, 2025; Yokohama, Japan ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Human-centered computing CCS: Applied computing CCS: Security and privacy Usability in security and privacy Zitong Shen, Sineng Yan, Youqian Zhang, Xiapu Luo, Grace Ngai, Eugene Yujun Fu Abstract . Despite living in the era of the internet, phone-based scams remain one of the most prevalent forms of scams. These scams aim to exploit victims for financial gain, causing both monetary losses and psychological distress. While governments, industries, and academia have actively introduced various countermeasures, scammers also continue to evolve their tactics, making phone scams a persistent threat. To combat these increasingly sophisticated scams, detection technologies must also advance. In this work, we propose a framework for modeling scam calls and introduce an LLM-based real-time detection approach, which assesses fraudulent intent in conversations, further providing immediate warnings to users to mitigate harm. Through experiments, we evaluate the method’s performance and analyze key factors influencing its effectiveness. This analysis enables us to refine the method to improve precision while exploring the trade-off between recall and timeliness, paving the way for future directions in this critical area of research. 1. INTRODUCTION In recent years, numerous news reports have highlighted the devastating impact of fraudulent phone calls, which have caused victims to suffer catastrophic financial losses. For instance, an 82-year-old retiree lost $690,000 of their life savings to a phone scam ( New et al. 2024 ) . Unfortunately, such tragedies continue to occur at an alarming rate. The 2024 Global State of Scams Report ( Rogers 2024 ) reveals that phone scams siphoned off $1.03 trillion globally over the past year, highlighting the severity of this issue. The harm caused by phone scams extends beyond financial loss. Studies have shown the emotional and psychological toll on victims, including prolonged stress, anxiety, depression, and, in extreme cases, even suicide ( Hu et al. 2022 ; Hu et al. 2024 ) . Governments, industries, and academia have implemented various measures to combat of phone scams, as summarized in the taxonomy of phone scam prevention methods in Fig. 1 . Governments primarily focus on prosecuting criminal organizations and educating the public about fraud prevention ( Burke et al. 2022 ; DeLiema et al. 2020 ) . The industry has developed pre-call prevention methods, such as call-blocking applications ( True Software Scandinavia AB 2024 ) and blacklists ( Pandit et al. 2023 ) , which attempt to filter out potential scam calls before they reach users. Meanwhile, academic research has explored post-call analysis techniques, employing AI tools to retrospectively identify scam patterns in call data ( Peng and Lin 2018 ; Tseng et al. 2015 ; Chadalavada et al. 2024 ; Chang et al. 2024 ; Shen et al. 2024 ) . Despite these efforts, the effectiveness of these approaches is increasingly undermined by the adaptability of scammers. Pre-call prevention methods, such as caller ID systems and blacklists, are vulnerable to caller ID spoofing and the use of VoIP services, which allow scammers to change their phone numbers frequently and evade detection ( Mustafa et al. 2018 ; Xing et al. 2020 ) . Likewise, public education campaigns, while valuable, cannot fully prevent individuals from falling victim to scams, as scammers exploit psychological manipulation to bypass even well-educated users’ defenses ( Parti and Tahir 2023 ) . Post-call analysis, using methods such as text classification, graph analysis, and even LLM-based approaches,while useful for identifying patterns in scam calls after they occur, fails to provide timely intervention. In many cases, victims may transfer money or share sensitive information during the call itself ( Razaq et al. 2021 ) . These challenges highlight a critical gap in existing anti-scam strategies: the lack of effective real-time detection systems that can intervene during ongoing scam calls to prevent harm before it occurs. Figure 1. Taxonomy of Phone Scam Prevention Methods: A Temporal Perspective. To address this pressing gap, we propose a novel LLM-based real-time phone scam detection framework. Unlike pre-call and post-call approaches, our system analyzes phone conversations in real time during the call, enabling immediate detection of potential scams and providing timely warnings to users. This real-time capability is especially critical in situations where scammers apply psychological pressure, as early intervention can disrupt the scam process and prevent victims from making irreversible decisions. Our approach builds on recent advancements in large language models (LLMs), which have demonstrated exceptional capabilities in understanding and analyzing human language. By leveraging LLMs, our framework can detect subtle linguistic cues and conversational anomalies indicative of scam behavior. Specifically, our work aims to address the following research questions: • RQ1: How does our LLM-based real-time detection system perform in identifying phone scams? To answer this question, we evaluate the performance of our framework using publicly available datasets and investigate its ability to detect scams during live phone conversations. • RQ2: What factors influence the method’s detection performance? Through comprehensive analysis, we identify key factors that impact the system’s effectiveness. These insights guide us in improving the framework to achieve a balance between precision and recall. By answering these research questions, we aim to provide a comprehensive understanding of the capabilities and limitations of LLM-based real-time phone scam detection, optimize its performance for practical deployment, and evaluate its potential to safeguard users while delivering a seamless and effective intervention experience. 2. SYSTEM MODELING AND DETECTION METHOD Figure 2. The system consists of three components, including “Scammer”, “User”, and “LLM-based Detector”. In this section, we propose a high-level system model for phone scam detection, abstracted from reported cases/news. The model integrates our LLM-based detection method, which operates in real time to protect users during phone conversations. 2.1. System Model Below, we detail the roles, objectives, and capabilities of the three primary components of the system: the Scammer, the User, and the LLM-based Detector, as illustrated in Fig. 2 . 2.1.1. Scammer The scammer is the initiator of fraudulent calls, driven by financial gain and the exploitation of their targets. To achieve their goals, scammers employ a range of strategies, leveraging modern technology and psychological manipulation. The scammer collects personal data about a target through public social media profiles, data breaches, or other sources. This information helps scammers build credibility and gain the trust needed to manipulate their victims effectively ( Gressel et al. 2024 ) . Relying on pre-defined scripts or playbooks, scammers can extract sensitive information, financial assets, or other valuable property. Further, the scammer can enhance their deception with AI-powered technologies such as voice cloning tools which could impersonate loved ones, trusted authorities, or even political figures to manipulate victims ( Kennedy 2014 ; Cheyenne 2024 ) . The scammer’s attack vector is through phone calls, exploiting the direct voice communication to manipulate victims. Please note that in this work, we focus exclusively on audio-based phone scams and do not consider video call scams (e.g., deepfake-based attacks) as part of the system. 2.1.2. User The User is the target of the scammer and is the primary beneficiary of the scam detection method. The user’s primary objective