FACULTY OF ELECTRICAL ENGINEERING AND COMPUTING
Josip Jukić · 2025
Read FACULTY OF ELECTRICAL ENGINEERING AND COMPUTING by Josip Jukić (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-12004.txt.
Introduction
Josip Jukić wrote a 2025 thesis on making neural language models use less data and fewer settings. Models of this kind are costly to train and tune. His work studies the inner patterns these models form. Smooth patterns, he argues, help a model stay steady and cope with new inputs.
One part uses measures of pattern smoothness to calm training. A second part pairs active learning with light fine-tuning, guided by those same measures. It also adds early stopping rules that need no labeled test set. A third part uses weak labels plus in-context learning to make use of unlabeled text. Tests across language tasks showed gains in score and savings.
Catalog record
| CREATOR | Josip Jukić |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 374 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-12004