LLMLogAnalyzer: A Clustering-Based Log Analysis Chatbot using Large Language Models Journal: arXiv

Peng Cai, Reza Ryan, and Nickson M. Karie · 2025

Read LLMLogAnalyzer: A Clustering-Based Log Analysis Chatbot using Large Language Models Journal: arXiv by Peng Cai, Reza Ryan, and Nickson M. Karie (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-24031.txt.

Description

Peng Cai and two co-authors build LLMLogAnalyzer, a chatbot that helps organizations make sense of system logs, a backbone of cybersecurity work. Logs are vast and messy, and many teams lack the money, expertise, or time to analyze them well. Raw language models struggle here too: context windows overflow and structured log text defeats plain prompting.

The system's design routes around those limits with a modular pipeline — a router, a log recognizer, a log parser, and search tools — fronted by clustering. Tested on four domain log collections across summarization, pattern extraction, and anomaly detection, it beat leading LLM chatbots including ChatGPT, ChatPDF, and NotebookLM by thirty-nine to sixty-eight percent. Its answers were also far more consistent, with score variability cut by ninety-three percent. The authors pitch the tool for experts and non-technical users alike, aiming to make routine log analysis cheaper and more reliable.

Catalog record

CREATORPeng Cai, Reza Ryan, and Nickson M. Karie
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-24031

Browse the full library · About the Tower of Babel