Neural-Inspired Posterior Approximation (NIPA)

Babak Shahbaba, Zahra Moslemi · 2026

Read Neural-Inspired Posterior Approximation (NIPA) by Babak Shahbaba, Zahra Moslemi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22539.txt.

Introduction

Babak Shahbaba and Zahra Moslemi built NIPA, a way to mimic Bayesian inference that borrows from how brains learn. Their 2026 preprint notes that people blend three modes: planned thought, habit, and recall of past events. Each mode covers the others' blind spots.

NIPA blends the same three modes to form a fast stand-in for full posterior inference. A good stand-in gives full doubt ranges at a fraction of the cost. That trade suits health and science, where calls must show their doubt. The work is a bridge between brain science and stats.

Catalog record

CREATORBabak Shahbaba, Zahra Moslemi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-22539

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Neural-Inspired Posterior Approximation (NIPA) Babak Shahbaba, Zahra Moslemi Abstract Humans learn efficiently from their environment by engaging multiple interacting neural systems that support distinct yet complementary forms of control, including model-based (goal-directed) planning, model-free (habitual) responding, and episodic memory–based learning. Model-based mechanisms compute prospective action values using an internal model of the environment, supporting flexible but computationally costly planning; model-free mechanisms cache value estimates and build heuristics that enable fast, efficient habitual responding; and memory-based mechanisms allow rapid adaptation from individual experience. In this work, we aim to elucidate the computational principles underlying this biological efficiency and translate them into a sampling algorithm for scalable Bayesian inference through effective exploration of posterior distribution. More specifically, our proposed algorithm comprises three components: a model-based module that uses the target distribution for guided but computationally slow sampling; a model-free module that uses previous samples to learn patterns in the parameter space, enabling fast, reflexive sampling without directly evaluating the expensive target distribution; and an episodic-control module that supports rapid sampling by recalling specific past events (i.e., samples). We show that this approach advances Bayesian methods and facilitates their application to large-scale statistical machine learning problems. In particular, we apply our proposed framework to Bayesian deep learning, with an emphasis on proper and principled uncertainty quantification. Keywords Bayesian inference \cdot MCMC \cdot Decision-making 1 Introduction Bayesian inference provides a principled framework for uncertainty quantification and exploration of complex parameter spaces, but exact posterior inference is often intractable. As a result, in practice we typically rely on approximate methods, most notably Markov chain Monte Carlo (MCMC) and variational Bayes (VB). MCMC constructs Markov chains that asymptotically converge to the target distribution and is therefore unbiased. Although simple sampling methods, such as the Metropolis algorithm [ 65 ] , are often effective at exploring low-dimensional distributions, they can be very inefficient and computationally expensive for complex and high-dimensional models. To reduce the random walk behavior of Metropolis sampling, Hamiltonian Monte Carlo (HMC) [ 30 , 75 ] uses gradient information to propose samples that are distant from the current state, but nevertheless have a high probability of acceptance. However, HMC and related methods face major scalability challenges, as gradient computations over massive datasets are computationally infeasible. Stochastic-gradient-based MCMC variants [ 91 , 4 , 18 , 29 ] aim to alleviate this cost through data subsampling, but the resulting noise can degrade accuracy and hinder effective exploration [ 10 ] . Variational Bayes (VB) [ 46 , 89 ] offers a complementary alternative by framing inference as an optimization problem in which a parameterized distribution is used to approximate the posterior, trading unbiasedness for speed and scalability. To this end, VB methods minimize the Kullback–Leibler (KL) divergence between the target distribution and a parametrized approximating distribution with respect to the variational parameters. This approach has been further popularized and advanced through the development of efficient gradient-based optimization methods for variational objectives in deep learning [ 48 , 83 , 12 ] . Compared to MCMC methods, VB is typically faster but introduces approximation bias. In addition, VB methods, particularly commonly used mean-field formulations, tend to underestimate posterior uncertainty [ 11 ] . The contrast between these two common approaches naturally motivates hybrid methods that aim to combine the strengths of both paradigms [ 27 , 96 ] . When designed appropriately, such methods can achieve a better balance between computational efficiency and approximation accuracy, effectively bridging the gap between MCMC and VB. The method proposed in this paper pursues this goal by developing a general framework inspired by how humans efficiently learn to guide decision making through multiple interacting neural systems that support complementary forms of control: model-based (goal-directed) planning, which computes prospective action values using an internal model of the environment and enables flexible but computationally expensive decisions; model-free (habitual) control, which uses value estimates to learn patterns, supporting fast, efficient habitual responding; and memory-based mechanism, which enables rapid adaptation from individual experience [ 26 , 56 ] . Motivated by this perspective, we propose a general framework, called Neural-Inspired Posterior Approximation (NIPA), that comprises three corresponding components: (1) a model-based module guided by the target distribution for high quality, but computationally slow sampling; (2) a model-free module that enables fast, reflexive sampling through learned patterns in the parameter space; and (3) an episodic-control module that supports rapid one-shot sampling by recalling past experiences (i.e., previous samples). Here, we implement a specific and simplified instantiation of this framework. In the brain, although there is evidence linking model-based, model-free, and episodic control to the prefrontal cortex, striatum, and hippocampus, respectively [ 25 , 56 ] , the neural implementation of these systems is highly complex, relying on distributed networks spanning hippocampal, cortical, striatal, and prefrontal regions with substantial overlap across systems. In the following sections, we first provide a brief overview of recent advances in computational Bayesian inference. We then present our method in detail and evaluate its performance through comparisons with several state-of-the-art algorithms. In particular, we focus on uncertainty quantification in deep learning models. Our proposed approach constitutes a general framework with many possible variations, depending on the specific sampling algorithm used in the model-based module and the learning algorithm employed in the model-free component. In addition, multiple strategies can be considered for determining which module is engaged at any given point. In the Discussion section, we outline several potential directions for further enhancing and extending the framework. 2 Related Work The literature on improving the efficiency of computational methods for Bayesian inference is quite extensive. (See for example, [ 72 , 70 , 36 , 67 , 79 , 84 , 38 , 90 , 27 , 14 , 75 , 74 , 73 , 7 , 68 , 6 , 49 , 16 , 23 , 93 , 33 , 81 , 80 , 92 , 98 , 1 , 39 , 43 , 9 , 15 , 87 , 2 , 52 , 54 , 53 , 3 , 76 , 5 , 22 ] .) As mentioned above, Bayesian inference typically requires the use of MCMC algorithms to simulate samples from intractable distributions. The overall efficiency of these algorithms is judged by how fast they converge to the target distribution and generate samples that are truly representative of the underlying distribution. Although the simple Metropolis algorithm [ 65 ] is often effective at exploring low-dimensional distributions, it can be very inefficient for complex, high-dimensional distributions: successive states may exhibit high autocorrelation, due to the random walk nature of the movement. As a result, because the effective sample size (i.e., number of samples after adjustment for autocorrelation) tends to be quite low, the convergence to the true distribution is very slow. Faster explorations can be obtained using, for example, Hamiltonian Monte Carlo (HMC) [ 30 , 75 ] . HMC and its variants [ 87 , 39 , 52 ] reduce the random walk behavior of Metropolis by taking L steps of size \epsilon guided by Hamiltonian dynamics, which uses gradient information, to propose states that are distant from the current state, but nevertheless have a high probability of acceptance. The main bottleneck of these MCMC algorithms, especially in high-dimensional

Read the complete text