One for All: A General Framework of LLMs-based Multi-Criteria Decision Making on Human Expert Level

Hui Wang, Fafa Zhang, Chaoxu Mu · 2025

Read One for All: A General Framework of LLMs-based Multi-Criteria Decision Making on Human Expert Level by Hui Wang, Fafa Zhang, Chaoxu Mu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-15778.txt.

Description

Hui Wang, Fafa Zhang, and Chaoxu Mu test whether large language models can handle multi-criteria decision making at expert level, in a 2025 paper. Such choices weigh many factors at once, and older methods strain when the factor count grows. The team built a general framework that hands these problems to language models and scores them against human expert answers on three real tasks.

Off the shelf, open and commercial models reached only about sixty percent accuracy. Prompt tricks like step-by-step reasoning lifted scores to near seventy percent. A light fine-tuning method called LoRA did far better, pushing accuracy to about ninety-five percent across tasks. The gap between models nearly vanished after tuning, which the authors read as a stable edge.

Catalog record

CREATORHui Wang, Fafa Zhang, Chaoxu Mu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-15778

Browse the full library · About the Tower of Babel