LLM-Prior: A Framework for Knowledge-Driven Prior Elicitation and Aggregation
Yongchao Huang · 2025
Read LLM-Prior: A Framework for Knowledge-Driven Prior Elicitation and Aggregation by Yongchao Huang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-03766.txt.
Introduction
Yongchao Huang proposes LLM-Prior, a framework that uses large language models to set prior distributions for Bayesian inference. The 2025 paper tackles a known bottleneck: picking priors is often manual, subjective, and hard to scale. The framework turns rich context, such as text descriptions, data, or figures, into valid probability distributions.
The operator pairs a language model with an explicit tractable generative model, such as a Gaussian mixture, so the output prior keeps the math traits Bayesian work needs. A federated version pools priors from many agents by logarithmic opinion pooling, in a way robust to differences among agents. Huang presents the work as a base for tools that lower the entry bar to Bayesian modeling.
Catalog record
| CREATOR | Yongchao Huang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-03766
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
LLM-Prior: A Framework for Knowledge-Driven Prior Elicitation and Aggregation Yongchao Huang Abstract The specification of prior distributions is fundamental in Bayesian inference, yet it remains a significant bottleneck. The prior elicitation process is often a manual, subjective, and unscalable task. We propose a novel framework which leverages Large Language Models (LLMs) to automate and scale this process. We introduce LLMPrior , a principled operator that translates rich, unstructured contexts such as natural language descriptions, data or figures into valid, tractable probability distributions. We formalize this operator by architecturally coupling an LLM with an explicit, tractable generative model, such as a Gaussian Mixture Model (forming a LLM based Mixture Density Network), ensuring the resulting prior satisfies essential mathematical properties. We further extend this framework to multi-agent systems where Logarithmic Opinion Pooling is employed to aggregate prior distributions induced by decentralized knowledge. We present the federated prior aggregation algorithm, Fed-LLMPrior , for aggregating distributed, context-dependent priors in a manner robust to agent heterogeneity. This work provides the foundation for a new class of tools that can potentially lower the barrier to entry for sophisticated Bayesian modeling. 1 Introduction Bayesian inference provides a powerful and coherent paradigm for reasoning under uncertainty, formalized by Bayes’ theorem: p(\theta|D)\propto p(D|\theta)p(\theta) , where p(\theta) is the prior distribution over parameters \theta . The prior is a fundamental component of any Bayesian analysis, encoding existing knowledge and regularizing the model, especially when data D is scarce. However, the process of specifying this prior, known as prior elicitation, is a well-known challenge [ 29 , 36 ] . Traditionally, it involves a labor-intensive and subjective process of the modellor interviewing domain experts to translate their qualitative beliefs into a quantitative, valid probability density function (PDF). This process is difficult to scale, reproduce, and is susceptible to cognitive biases. The difficulty of prior elicitation represents a significant barrier to the widespread adoption of Bayesian methods. This paper introduces a framework to address this challenge by leveraging the remarkable capabilities of modern Large Language Models (LLMs). We reconceptualize the LLM not merely as a text generator, but as a ’knowledge compiler’ - a function that can translate high-level, unstructured context into formal, structured mathematical objects. This work lays the theoretical and architectural groundwork for a new generation of Bayesian modeling tools, aiming to make the specification of informative priors more systematic, scalable, and accessible. Two primary contributions are made: first, we formalize the concept of an LLMPrior operator, \mathcal{L} , which maps a flexible context C (e.g. text, data, figures) to a valid prior distribution p(z|C) . The key challenge lies in ensuring the output of the operator is a valid PDF. We solve this by proposing a ’separation of concerns’ architecture where the LLM is responsible for semantic interpretation, generating the parameters for a separate, explicit generative model (e.g. a Mixture Density Network) that guarantees validity by construction. Second, we extend this framework to a multi-agent setting, a common scenario in fields such as federated learning or expert panels where knowledge is distributed. We consider a system of N agents, each with a local context C_{i} , who independently generate a prior p_{i}(z)=\mathcal{L}(C_{i}) . We address the problem of aggregating these N priors into a single, coherent group prior, p_{\text{agg}}(z) . Drawing on opinion pooling theory, we argue for the principled use of the Logarithmic Opinion Pool over simpler heuristics, and propose a concrete algorithm, Fed-LLMPrior , for its implementation in a centralized system. 2 Related Work This work sits at the intersection of Bayesian statistics, deep generative modeling, and natural language processing. As such, we briefly refer to related work in these domains. Prior elicitation. The challenge of eliciting priors from experts has a long history in Bayesian statistics [ 29 , 36 ] . Most methods rely on structured questionnaires and expert interviews, which are difficult to scale. Our approach seeks to automate this process by treating the vast corpus of text an LLM is trained on as a proxy for expert knowledge, accessible via natural language prompts. Deep generative models. Our proposed architecture for the LLMPrior relies on deep generative models that afford a tractable density. Mixture Density Networks (MDNs) [ 6 ] , which use a neural network to output the parameters of a mixture model, are a prime candidate due to their simplicity and universal approximation properties [ 25 ] . Normalizing Flows (NFs) [ 40 , 16 ] offer another powerful alternative, constructing complex densities via invertible transformations of a simple base distribution. Our framework leverages these existing architectures in a novel way: instead of training them on data samples, we use an LLM to generate their parameters directly from a high-level context. A comparison of these architectures can be found in Table. 1 in Appendix. A . Opinion pooling. The aggregation of expert beliefs, formalized as probability distributions, is the subject of opinion pooling theory [ 45 , 24 , 14 ] . The two dominant methods are the Linear Opinion Pool (LOP) [ 15 ] and the Logarithmic Opinion Pool (LogP) [ 8 , 27 ] . In general, LOP averages and compromises, while LogP multiplies and seeks a consensus that can be more extreme than any individual belief. LOP takes a weighted linear average of the distributions and is simpler [ 27 , 10 ] . The LogP, which forms a geometric mean of densities, is ’externally Bayesian’ 1 1 1 The logarithmic opinion pool is ’externally Bayesian’, i.e. can be derived from joint probabilities using Bayes’ rule [ 8 , 27 ] . In group decision-making, an ’externally Bayesian’ group [ 31 ] is one where the group’s collective decisions appear to an outsider as if they were made by a single, rational Bayesian agent, meaning that the group’s decisions, when viewed as a whole, follow the principles of Bayes’ theorem regarding updating beliefs based on new evidence. A key property is that the final outcome remains the same regardless of the order in which the group pools information and updates beliefs. and has a strong information-theoretic justification as the distribution minimizing the KL-divergence to the individual beliefs [ 27 ] . Our framework adopts the LogP as the principled choice for prior aggregation due to its externally Bayesian, prior to posterior coherent, data independence, and log-concavity preservation properties [ 24 , 11 ] . We apply this classical theory to modern distributed systems with federated learning [ 32 ] . LLM assisted modeling. There is a growing line of work using LLMs to assist in scientific and modeling tasks. This includes work on LLM-driven symbolic regression, where models generate mathematical expressions to fit data [ 44 ] , which demonstrates the ability of LLMs to produce structured, mathematical outputs. Most relevant to our work is the concurrent development of the ’Large Language Bayes’ (LLB) framework by Domke [ 17 ] . LLB uses an LLM to generate a distribution over full probabilistic programs, p(m|t) , from a text description t . It then performs Bayesian model averaging over these LLM-generated models. LLB provides compelling empirical evidence that LLMs can automate parts of the Bayesian workflow. Our work is complementary: while LLB addresses model uncertainty for a single agent, our