A Comprehensive Evaluation Framework of Alignment Techniques for LLMs

Muneeza Azmat, Momin Abbas, Maysa Malfiza Garcia de Macedo, Marcelo Carpinette Grave Luan Soares de SouzaTiago MachadoRogério A de PaulaRaya HoreshYixin Chen Heloisa Caroline de Souza Pereira CandelloRebecka NordenlowAminat Adebiyi IBM Research [email protected] · 2025

Read A Comprehensive Evaluation Framework of Alignment Techniques for LLMs by Muneeza Azmat, Momin Abbas, Maysa Malfiza Garcia de Macedo, Marcelo Carpinette Grave Luan Soares de SouzaTiago MachadoRogério A de PaulaRaya HoreshYixin Chen Heloisa Caroline de Souza Pereira CandelloRebecka NordenlowAminat Adebiyi IBM Research [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-09937.txt.

Description

Muneeza Azmat and eleven co-authors build a common scorecard for methods that align language models with human values, in a 2025 paper. Alignment techniques range from fine tuning on feedback to fixes applied while the model answers. With no shared ruler, comparing them is guesswork.

Their framework grades methods on four axes. It checks how well misalignment is detected and how good the aligned output is. It also weighs computing cost and sturdiness under stress. Experiments across several base models and strategies show the scorecard in action. The authors aim to guide deployment choices with evidence, not fashion.

Catalog record

CREATORMuneeza Azmat, Momin Abbas, Maysa Malfiza Garcia de Macedo, Marcelo Carpinette Grave Luan Soares de SouzaTiago MachadoRogério A de PaulaRaya HoreshYixin Chen Heloisa Caroline de Souza Pereira CandelloRebecka NordenlowAminat Adebiyi IBM Research [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-09937

Browse the full library · About the Tower of Babel