LLMLogAnalyzer: A Clustering-Based Log Analysis Chatbot using Large Language Models Journal: arXiv
Peng Cai, Reza Ryan, and Nickson M. Karie · 2025
Read LLMLogAnalyzer: A Clustering-Based Log Analysis Chatbot using Large Language Models Journal: arXiv by Peng Cai, Reza Ryan, and Nickson M. Karie (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-24031.txt.
Description
Peng Cai and two co-authors build LLMLogAnalyzer, a chatbot that helps organizations make sense of system logs, a backbone of cybersecurity work. Logs are vast and messy, and many teams lack the money, expertise, or time to analyze them well. Raw language models struggle here too: context windows overflow and structured log text defeats plain prompting.
The system's design routes around those limits with a modular pipeline — a router, a log recognizer, a log parser, and search tools — fronted by clustering. Tested on four domain log collections across summarization, pattern extraction, and anomaly detection, it beat leading LLM chatbots including ChatGPT, ChatPDF, and NotebookLM by thirty-nine to sixty-eight percent. Its answers were also far more consistent, with score variability cut by ninety-three percent. The authors pitch the tool for experts and non-technical users alike, aiming to make routine log analysis cheaper and more reliable.
Catalog record
| CREATOR | Peng Cai, Reza Ryan, and Nickson M. Karie |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-24031