Conventional Commit Classification using Large Language Models and Prompt Engineering
Sakib Al Hasan * H. M. Sazzad Quadir Md. Nurul Ahad Tawhid · 2026
Read Conventional Commit Classification using Large Language Models and Prompt Engineering by Sakib Al Hasan * H. M. Sazzad Quadir Md. Nurul Ahad Tawhid (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-02033.txt.
Description
H M Sazzad Quadir, Sakib Al Hasan, and Md Nurul Ahad Tawhid test whether language models can label commit messages by the conventional commits format without any training. That format improves readability, maintenance, and tools such as changelog makers. Past classifiers needed large labelled sets and task-specific models, which the authors aim to avoid.
They try zero-shot, few-shot, and chain-of-thought prompts on three open models of different sizes, using code diffs from 3,200 balanced commits in the InfluxDB project. Few-shot prompting gave the highest accuracy overall. Chain-of-thought results are compared in the paper. The study shows prompt design alone can carry much of the classification task.
Catalog record
| CREATOR | Sakib Al Hasan * H. M. Sazzad Quadir Md. Nurul Ahad Tawhid |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.02033