LETToT: Label-Free Evaluation of Large Language Models On Tourism Using Expert Tree-of-Thought
Ruiyan Qi, Congding Wen, Weibo Zhou, Jiwei Li, Shangsong Liang, Lingbo Li · 2025
Read LETToT: Label-Free Evaluation of Large Language Models On Tourism Using Expert Tree-of-Thought by Ruiyan Qi, Congding Wen, Weibo Zhou, Jiwei Li, Shangsong Liang, Lingbo Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-11280.txt.
Description
Six authors evaluate language models on tourism without labeled data in this 2025 paper. Domain benchmarks are costly to annotate, and models also hallucinate, so the team built a judge from expert reasoning structures instead of answer keys.
Their framework refines a tree of thought built by experts, checked against general quality dimensions and expert feedback, and it beat baselines by clear margins. Applied to models from thirty-two to six hundred seventy-one billion parameters, it found that scale still helps in this domain, with the largest model on top. Smaller models with explicit reasoning closed much of the gap, and for mid sized models they were more accurate and concise.
Catalog record
| CREATOR | Ruiyan Qi, Congding Wen, Weibo Zhou, Jiwei Li, Shangsong Liang, Lingbo Li |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-11280