LLM-based Human Simulations Have Not Yet Been Reliable
Qian Wang, Jiaying Wu, Zichen Jiang, Zhenheng Tang, Bingqiao Luo, Nuo Chen, Wei Chen, Huacan Wang, Bingsheng He · 2025
Read LLM-based Human Simulations Have Not Yet Been Reliable by Qian Wang, Jiaying Wu, Zichen Jiang, Zhenheng Tang, Bingqiao Luo, Nuo Chen, Wei Chen, Huacan Wang, Bingsheng He (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-08579.txt.
Description
Qian Wang and eight co-authors argue, in 2025 work, that fake humans played by large language models are not yet trusty. Such stand-ins now fill studies of crowds, markets, policy, and minds. The team checked those uses end to end and found wide gaps between the fakes' acts and real human acts.
The gaps spring from two roots: flaws bred into the models, and weak build of the fake worlds they act in. Both are walked through in depth. Fixes are then framed: richer base data, stronger models, and sturdier design rules. A step-by-step plan turns the frame into a guide. A shared list of past work rounds out the paper, for teams who want sound fakes.
Catalog record
| CREATOR | Qian Wang, Jiaying Wu, Zichen Jiang, Zhenheng Tang, Bingqiao Luo, Nuo Chen, Wei Chen, Huacan Wang, Bingsheng He |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-08579