One if by Land, Two if by Sea, Three if by Four Seas, and More to Come — Values of Perception, Prediction, Communication, and Common Sense in Decision Making

Aolin Xu · 2026

Read One if by Land, Two if by Sea, Three if by Four Seas, and More to Come — Values of Perception, Prediction, Communication, and Common Sense in Decision Making by Aolin Xu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-06077.txt.

Introduction

What is information worth to a decision maker? Aolin Xu defines that value rigorously in a 2026 paper covering perception, prediction, communication, and common sense. The definitions are decision-theoretic, meaning they measure how much each source improves choices, not just how much data it carries.

The quantities share key properties with Shannon entropy and mutual information, and reduce to them in special settings. One striking result: perception without prediction can have negative value, while prediction alone never does. The measures answer practical design questions for autonomous systems, such as which agent to observe first and how much it matters. Xu also notes possible insight for cognitive and neural science.

Catalog record

CREATORAolin Xu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-06077

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

One if by Land, Two if by Sea, Three if by Four Seas, and More to Come — Values of Perception, Prediction, Communication, and Common Sense in Decision Making Aolin Xu Abstract This work aims to rigorously define the values of perception, prediction, communication, and common sense in decision making. The defined quantities are decision-theoretic, but have information-theoretic analogues, e.g., they share some simple but key mathematical properties with Shannon entropy and mutual information, and can reduce to these quantities in particular settings. One interesting observation is that, the value of perception without prediction can be negative, while the value of perception together with prediction and the value of prediction alone are always nonnegative. The defined quantities suggest answers to practical questions arising in the design of autonomous decision-making systems. Example questions include: Do we need to observe and predict the behavior of a particular agent? How important is it? What is the best order to observe and predict the agents? The defined quantities may also provide insights to cognitive science and neural science, toward the understanding of how natural decision makers make use of information gained from different sources and operations. † † Honda Research Institute US. Email: [email protected] 1 Introduction 1.1 Motivation The design of autonomous decision-making systems motivates us to formulate and answer the following questions. • What is the value of observing the world, including any agent in it, when making decisions, compared to not observing the world at all? • When only part of the world can be observed but the rest can be predicted, what is the value of predicting the unobserved part of the world? • When there are multiple agents in the world to be considered in decision making, how important is it for the decision maker to observe and predict the behavior of each agent? • What is the best order to perform perception and prediction on these agents? Answering the first two questions can help us quantify the importance of the perception and prediction subsystems in a decision-making system. The latter two questions are of particular interest when the limited computational resource is a concern in the design of the decision-making system. In this work, we attempt to find a rigorous path to formalize the above questions and derive answers to them. We define the values of key operations for decision making, including perception and prediction, and extend to communication and reasoning with common sense; we also extend these definitions to decision-making problems with multiple agents. One interesting observation is that, the value of perception without prediction can be negative, while the value of perception together with prediction and the value of prediction alone are always nonnegative. We analyze the mathematical properties of these values and draw connections to information-theoretic measures. The defined quantities may also provide insights to cognitive and neural sciences, toward the understanding of how natural decision makers make use of information gained from different sources and operations. 1.2 Related works Value of information The formal study of the value of information in decision making can be traced back at least to Blackwell’s work on the comparison of experiments through the reduction of expected loss in the binary hypothesis setup [ 1 , 2 ] . Lindley [ 16 ] applied Shannon’s notion of mutual information to measure the informativeness of experiments in the setup of general Bayesian parameter estimation. DeGroot [ 4 ] considered general Bayesian decision making and generalized the notions of Shannon entropy and mutual information through arbitrary loss functions. Further theoretical developments of this concept include Howard [ 13 ] , Grünwald and Dawid [ 7 ] , and Xu and Raginsky [ 24 ] with applications in economics, robust decision making, and machine learning. This work can be viewed as an extension of the above line of research. We further generalize the notion of entropy and mutual information through the analysis of the value, or the reduction of minimum achievable expected loss, of various operations in decision making. In those earlier works, the “value of information” can be viewed as the special case of the value of perception together with prediction as defined in this work. We also extend the discussion to cover common sense and communication as well. There is no dedicated study in the literature on the values of the fine-grained and diverse operations considered in this work yet. The decision-making problem considered here is also more general, due to the more general form of the loss function we use. The loss function we use takes both the observable and unobservable states of the world, as well as the action into consideration, which enables the setup to cover a wide range of decision-making, estimation, and even game-playing problems. Information consumption in perception-prediction-action loop A potentially striking insight from the definitions proposed in this work is that the narrow value of perception without prediction can be negative, whereas the value of perception together with prediction and the value of prediction alone are provably nonnegative. In other words, just having sensory data without properly incorporating its significance can, in some cases, worsen decision quality. A real-world myopic driving example is provided to illustrate this fact. This fact resonate the concept of rational inattention proposed by Sim [ 22 , 23 ] : if an agent cannot process the information, potentially due to limited “prediction” capability, then acquiring raw data might not be worthwhile. Empirical studies of human perception and decision making also reflect the importance of the ability to consume the information than merely acquiring the information [ 3 , 17 , 11 , 18 , 8 ] . Recently, common sense reasoning in perception, prediction, and planning also becomes a trending topic in machine learning and AI research [ 12 , 14 ] . Further, the formulation of artificial general intelligence may also be carried out in a value-communication based framework [ 10 ] . Gaining a principled understanding of the importance of values of information in decision making helps to advance the related research with a solid foundation. Agent importance and prioritization The identification of importance of agents in machine learning and decision making become an important problem as more autonomous or AI systems get more involved in people’s daily life. This problem is more critical when the computation power becomes a bottleneck for simultaneously tracking or paying attention to all agents involved in decision making. Example works in this topic include [ 20 , 6 , 25 , 15 ] in the area of autonomous driving. Those works are mostly based on machine learning methods which require human labels on the importance of the agents, or based on rules from human knowledge. The results in this work can potentially be used to provide ground truth labels of agent importance to be used by the learning-based methods, e.g. the data-driven approach proposed in [ 21 ] . 2 Definitions of values of different operations 2.1 A generic decision-making problem This study considers a generic decision-making problem, where a decision maker needs to take an action u from action space {\mathsf{U}} in order to minimize the expectation \mathbb{E}[\ell(X,Y,u)] of a loss function \ell:{\mathsf{X}}\times{\mathsf{Y}}\times{\mathsf{U}}\rightarrow\mathbb{R} , where X is a random observable state,

Read the complete text