Using Large Language Models as Low-Cost Statistical Estimators for Human-Response Data
Haobo Yang · 2026
Read Using Large Language Models as Low-Cost Statistical Estimators for Human-Response Data by Haobo Yang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-30372.txt.
Description
Haobo Yang asks whether a language model can stand in for human subjects in statistical estimation, and proves when it can. Human experiments are expensive, slow, and prone to sampling bias. His framework treats a pretrained model as a statistical estimator. The target is the conditional expectation under squared loss. The claim is a restricted form of risk equivalence.
The model's estimation error splits into two parts. Representation bias captures what the model cannot express. Optimization error captures imperfect training on finite data. Under mild conditions, expected error settles at a clear floor. That floor is the population variance plus squared representation bias. A Le Cam deficiency analysis proves the equivalence claim rigorously. The forward deficiency vanishes while the reverse is exactly zero. Finite-sample bounds and a calibration protocol accompany the theory. An open-source Python tool implements the method.
Catalog record
| CREATOR | Haobo Yang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 110 KB |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.30372