A Comprehensive Evaluation Framework of Alignment Techniques for LLMs
Muneeza Azmat, Momin Abbas, Maysa Malfiza Garcia de Macedo, Marcelo Carpinette Grave Luan Soares de SouzaTiago MachadoRogério A de PaulaRaya HoreshYixin Chen Heloisa Caroline de Souza Pereira CandelloRebecka NordenlowAminat Adebiyi IBM Research [email protected] · 2025
Read A Comprehensive Evaluation Framework of Alignment Techniques for LLMs by Muneeza Azmat, Momin Abbas, Maysa Malfiza Garcia de Macedo, Marcelo Carpinette Grave Luan Soares de SouzaTiago MachadoRogério A de PaulaRaya HoreshYixin Chen Heloisa Caroline de Souza Pereira CandelloRebecka NordenlowAminat Adebiyi IBM Research [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-09937.txt.
Description
Muneeza Azmat and eleven co-authors build a common scorecard for methods that align language models with human values, in a 2025 paper. Alignment techniques range from fine tuning on feedback to fixes applied while the model answers. With no shared ruler, comparing them is guesswork.
Their framework grades methods on four axes. It checks how well misalignment is detected and how good the aligned output is. It also weighs computing cost and sturdiness under stress. Experiments across several base models and strategies show the scorecard in action. The authors aim to guide deployment choices with evidence, not fashion.
Catalog record
| CREATOR | Muneeza Azmat, Momin Abbas, Maysa Malfiza Garcia de Macedo, Marcelo Carpinette Grave Luan Soares de SouzaTiago MachadoRogério A de PaulaRaya HoreshYixin Chen Heloisa Caroline de Souza Pereira CandelloRebecka NordenlowAminat Adebiyi IBM Research [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-09937