On-Premise SLMs vs. Commercial LLMs: Prompt Engineering and Incident Classification in SOCs and CSIRTs
Gefté Almeida 1 , Marcio Pohlmann 1 , Alex Severo 1 , Diego Kreutz 1 , Tiago Heinrich 2 , Lourenço Pereira 3 · 2025
Read On-Premise SLMs vs. Commercial LLMs: Prompt Engineering and Incident Classification in SOCs and CSIRTs by Gefté Almeida 1 , Marcio Pohlmann 1 , Alex Severo 1 , Diego Kreutz 1 , Tiago Heinrich 2 , Lourenço Pereira 3 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-14908.txt.
Description
Gefté Almeida and five co-authors compare on premise small language models with commercial large models for classifying security incidents. Security teams must sort incidents by a standard taxonomy while protecting sensitive data. Local open models promise privacy, lower cost, and data control. Commercial models still lead on raw accuracy in many tests.
The study uses anonymized real incidents and five prompt engineering techniques. Results show the accuracy gap persists, yet local models bring clear operational advantages. For many security centers, sovereignty and cost may outweigh a modest accuracy loss. The paper gives evidence for that trade off. It helps teams choose deployment models with eyes open about risks.
Catalog record
| CREATOR | Gefté Almeida 1 , Marcio Pohlmann 1 , Alex Severo 1 , Diego Kreutz 1 , Tiago Heinrich 2 , Lourenço Pereira 3 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 14 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-14908