LETToT: Label-Free Evaluation of Large Language Models On Tourism Using Expert Tree-of-Thought

Ruiyan Qi, Congding Wen, Weibo Zhou, Jiwei Li, Shangsong Liang, Lingbo Li · 2025

Read LETToT: Label-Free Evaluation of Large Language Models On Tourism Using Expert Tree-of-Thought by Ruiyan Qi, Congding Wen, Weibo Zhou, Jiwei Li, Shangsong Liang, Lingbo Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-11280.txt.

Description

Six authors evaluate language models on tourism without labeled data in this 2025 paper. Domain benchmarks are costly to annotate, and models also hallucinate, so the team built a judge from expert reasoning structures instead of answer keys.

Their framework refines a tree of thought built by experts, checked against general quality dimensions and expert feedback, and it beat baselines by clear margins. Applied to models from thirty-two to six hundred seventy-one billion parameters, it found that scale still helps in this domain, with the largest model on top. Smaller models with explicit reasoning closed much of the gap, and for mid sized models they were more accurate and concise.

Catalog record

CREATORRuiyan Qi, Congding Wen, Weibo Zhou, Jiwei Li, Shangsong Liang, Lingbo Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-11280

Browse the full library · About the Tower of Babel