Do AI assistants help students write formal specifications? A study with ChatGPT and the B-Method
Alfredo Capozucca 1 , Daniil Yampolskyi 1 , Alexander Goldberg 1, Maximiliano Cristiá 2 · 2025
Read Do AI assistants help students write formal specifications? A study with ChatGPT and the B-Method by Alfredo Capozucca 1 , Daniil Yampolskyi 1 , Alexander Goldberg 1, Maximiliano Cristiá 2 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-07789.txt.
Description
Alfredo Capozucca and three co-authors test whether ChatGPT helps undergraduates write formal specifications in the B-method. Their paper appeared in two thousand twenty-five. Formal methods demand precise, checkable descriptions of software. AI help is well studied for coding, but not for this stricter craft.
Students wrote B-specifications with and without the chat model's aid. The aid did not improve the correctness of their specs. Trust mattered in a surprising way: students who trusted the output less did better. The team also spotted a pattern in how students chatted with the model that tracked spec quality. The study warns against assuming AI lifts all technical writing. For formal work, skepticism seems to be part of the skill. The findings can guide teachers of rigorous software methods.
Catalog record
| CREATOR | Alfredo Capozucca 1 , Daniil Yampolskyi 1 , Alexander Goldberg 1, Maximiliano Cristiá 2 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-07789