On-Premise SLMs vs. Commercial LLMs: Prompt Engineering and Incident Classification in SOCs and CSIRTs

Gefté Almeida 1 , Marcio Pohlmann 1 , Alex Severo 1 , Diego Kreutz 1 , Tiago Heinrich 2 , Lourenço Pereira 3 · 2025

Read On-Premise SLMs vs. Commercial LLMs: Prompt Engineering and Incident Classification in SOCs and CSIRTs by Gefté Almeida 1 , Marcio Pohlmann 1 , Alex Severo 1 , Diego Kreutz 1 , Tiago Heinrich 2 , Lourenço Pereira 3 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-14908.txt.

Description

Gefté Almeida and five co-authors compare on premise small language models with commercial large models for classifying security incidents. Security teams must sort incidents by a standard taxonomy while protecting sensitive data. Local open models promise privacy, lower cost, and data control. Commercial models still lead on raw accuracy in many tests.

The study uses anonymized real incidents and five prompt engineering techniques. Results show the accuracy gap persists, yet local models bring clear operational advantages. For many security centers, sovereignty and cost may outweigh a modest accuracy loss. The paper gives evidence for that trade off. It helps teams choose deployment models with eyes open about risks.

Catalog record

CREATORGefté Almeida 1 , Marcio Pohlmann 1 , Alex Severo 1 , Diego Kreutz 1 , Tiago Heinrich 2 , Lourenço Pereira 3
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE14 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-14908

Browse the full library · About the Tower of Babel