Decision-making trades off learned and perceived information Authors: Tal Nahari, Boaz Rosenberg, Yoni Pertzov, Eran Eldar Published: 2026 ABSTRACT AbstractA fundamental question in cognitive science is how information from internal memory is combined with external sensory input when making decisions. We hypothesized that previously learned and currently perceived information trade-off against each other, such that information from one source reduces the gathering and usage of information from the other. To test this hypothesis, we designed a two-armed bandit task where each arm is composed of both learned and perceived elements. We monitored participants’ gathering of perceptual information using eye tracking. Participants’ choices and gaze deployment showed a trade-off between the impact of learned and perceived information. The more a participant utilized internally stored learned information, the less they gathered perceptual information, and vice versa. To understand the factors underlying the trade-off, we developed a computational model of participants’ information gathering. This showed that the trade-off results from the faster gathering of learned information, which makes it less valuable to invest effort in gathering additional perceptual information. Preliminary findings also suggested that an individual's tendency to primarily rely on one source of information is a stable individual trait. These findings contribute to the understanding of how humans use learning and perception in forming decisions. How do humans balance what they already know with what they can see in the moment? Here, we show that decision-making involves a systematic trade-off between using learned information stored in memory and gathering new perceptual evidence. Using a novel eye-tracking task, we found that when people relied more on learned information they sampled less perceptual information, and vice versa. Computational modeling revealed that learned information is accessed rapidly, guiding eye movements and curbing further sampling. These results reveal how humans combine multiple information sources and show how each decision firstly involves a meta-decision—whether to seek additional information or act on what is already known. Introduction The many decisions we make every day may rely on information from the environment that we perceive using our senses (e.g. deciding whether to take an umbrella by looking outside to see whether it is cloudy), and on previously learned information that we gather from within our minds (e.g. recollecting whether it normally rains at this time of the year (1)). Prior research extensively examined how people use either source of information in separate, yet it remains unclear how people integrate information from both sources (2). Answering this question is difficult not only due to a lack of empirical data but also because research on perceptual and learning-based decisions has largely relied on divergent modeling frameworks (3). Perceptual decision-making has most prominently given rise to models of gradual evidence accumulation where the proclivity to take one or another decision evolves over time during the decision process (4–6). Conversely, learning-based decisions have mostly been studied through the lens of reinforcement learning (7–11), which explains how preferences change from decision to decision, but not during the decision process. That said, substantial research has shown how learning-based decisions may also form gradually, through the accumulation of internally sampled information (12–16). Perceptual and learning-based decision-making may therefore share a common algorithmic form, and potentially require overlapping cognitive resources. One key difference, however, is that visual stimuli are typically sampled progressively via eye movements (17), whereas the gathering of learned information is limited only by the speed of neurons. If these two sources of information are gathered at comparable speeds, the trade-off between them can be expected to be symmetric, such that gathering more information from one source means gathering less of the other. However, if learned information is gathered faster, as it does not require operating ocular muscles, learning could enable faster decisions and reduce the residual value of investing additional time in gathering perceptual information. Thus, here we ask whether there is a trade-off between the use of learned and perceived information in making decisions, and if there is, whether it is symmetric or directional. To answer this question, we designed a decision-making task that required jointly utilizing learned and perceived information to maximize reward (preregistered at https://osf.io/78vqu). Importantly, sensory information was collected by participants by shifting their gaze, as consistent with how such information is gathered in the wild. This also enabled us to precisely monitor the gathering process via eye tracking. As anticipated, we found that the two sources of information traded off against each other. However, the trade-off was directional—learned information influenced the amount of perceptual information that was gathered to reach a decision. Joint modeling of choices and eye movements revealed that the more participants acquired learned information, the less they gathered perceptual information. Preliminary evidence also indicated that the tendency to rely on either learned or perceived information is a stable individual trait. Results Eighty-eight individuals completed the task, out of which 72 provided full eye tracking data. In each trial, participants chose between two stimuli, each composed of two elements (Fig. 1A and B): a colored circle and a surrounding ring of 12 Landolt Cs, each facing either upward or downward. The colored circle was associated with a fixed probability of reward that could only be learned through trial and error. In contrast, with regards to the surrounding Landolt Cs, participants were informed that the probability of reward scales linearly with the number of Cs that face upward. Thus, whereas the colored circle could be instantaneously identified using peripheral vision but required consulting learned information to estimate associated reward probability, the Landolt Cs required protracted perceptual processing to identify, but their associated reward probabilities were precisely known. Importantly, participants were made aware that the color of the circle and the number of Cs facing upward bore equal weights in determining reward probability associated with each stimulus, and thus both learned and perceived information were equally important for maximizing reward. Participants used both color and Cs to make decisions. A) Timeline of two trials. In each trial, participants chose either the left or right stimulus, and subsequently received or did not receive a reward (gold coin). B) Probability of reward as a function of color and number of upward facing Landolt Cs. The probabilities associated with the colors could be learned by trial and error, whereas those associated with the Landolt Cs were instructed. In the first two blocks, there were also trials where stimuli were composed of Cs only or colors only (see Methods). C) Participants tended to choose stimuli with higher combined reward probability, more so than they tended to choose stimuli with more upward-facing Cs or higher color-associated reward probability. Error bars indicate SEM. **P < 0.01, ***P < 0.001. D) Bayesian information criteria for three regression models explaining participants’ choices. The model utilizing both the number of Landolt Cs and colors’ assigned reward probabilities fitted choices better than models using either source of information alone. E) Classification of participants’ fixations based on the nearest Landolt C they landed next to. Participants jointly used learned and perceived information We first validated that participants utilized both perceived and learned information when making a decision. To test that, we compared participants’ tendency to choose the stimulus with the higher total reward probability, accounting for both Cs and colors, to their tendency to simply choose the stimulus with the more upward-facing Cs (t87=3.19,P=0.002), and to their tendency to choose the color with the higher assigned reward probability (t87=15.47,P<0.001). The results confirmed that participants accounted for both sources of information in making their choices (Fig. 1C). In addition, to determine whether the use of both Cs and color explained participants’ choices better than either the Cs or the color separately, we compared three regression analyses explaining participants’ choices by (i) the difference between the two available stimuli in the number of upward Cs; (ii) the difference between the stimuli in the reward probability associated with the color; and (iii) both. A χ2 test showed that the Cs and color together explained choices better than either one separately χ2(4) of combined vs. Cs: 1,241.2, P < 0.001; χ2(4) of combined vs. color: 4,332.4, P < 0.001). Additionally, both Cs and color predictors were significant (βCs=1.54,z=55.5,P<0.001; βcolor=0.73,z=28.3,P<0.001). Lastly, the same conclusion was also obtained by comparing the regression models using the Bayesian information criterion (BIC; Fig. 1D). Trade-off between learned and perceived information within participants Having verified that participants used both learned and perceived information to make their choices, we next tested whether a trade-off existed between them within participants, such that when a participant used more learned information, they gathered less perceived information, and vice versa. For this purpose, we leveraged the monitoring of participants’ perceptual information gathering via eye tracking. We first confirmed that the Cs participants fixated on, as identified by eye tracking, explained participants’ choices better than accounting for all the Cs that appeared on the screen (Table S2). Then, we regressed participants’ choices on: (i) the difference between the two choice options in the number of upward minus downward Cs participants fixated on (ΔVCsobserved); (ii) the difference between the choice options in the reward probability associated with the stimuli colors (ΔV color); and (iii) the trade-off between using the colors and looking at Cs—an interaction between the color predictor and the total number of all Cs the participant fixated on during the trial regardless of whether they pointed upward or downward, denoted ΔVcolor×ΣNCs. We did not include here the total number of Cs participants fixated on as a predictor outside of the interaction because we did not expect it to have a direct effect on choice, as confirmed in a supplementary analysis (Fig. S1). We found that both Cs and colors influences choice, and most importantly, the interaction was negative, meaning that the more participants used learned information the less they gathered perceived information (Figs. 2A and B, S1). Trade-off between color use and looking at Cs. *P < 0.05. ***P < 0.001. A) Regression coefficients of a mixed logistic model explaining choices based on the Cs participants fixated on (upward facing minus downward facing, right minus left stimulus), the reward probability associated with the colors (right minus left stimulus), and an interaction between the color predictor and the total number of Cs participants fixated on. Error bars indicate SEs across participants. ***P < 0.001. B) The difference between the reward probabilities associated with colors of the right and left stimuli as a function of which stimulus was chosen and the total number of Cs participants fixated on. When participants made fewer fixations, they exhibited a stronger tendency to choose the more rewarding color. Lines represent SE across participants. C) Mean choice time as a function of trial type. Lines depict the three quartiles (0.25, 0.50, and 0.75) of each distribution, and numbers denote the mean. D) Mean total number of Cs fixated on per trial as a function of trial type. Fewer Cs were fixated on in the trials combining both colors and Cs, relative to Cs only trials. Lines depict the three quartiles (0.25, 0.50, and 0.75) of each distribution. E) The use of color relative to Cs as inferred from participants’ choices correlated with participants’ own ratings at the end of the experiment as to which source of information they relied more on. The relative use of color and Cs was calculated based on choices as (βcolor−βc)/(|βc|+|βcolor|) using the regression coefficients derived from the combined color and Cs regression in Fig. 1D. F) Choice time in combined minus Cs only trials as a function of individual differences in the use of color relative to Cs in choosing between stimuli. G) The number of Cs participants fixated on in combined minus Cs only trials as a function of individual differences in the use of color relative to Cs in choosing between stimuli. Next, we ruled out that this interaction was due to the higher strength of evidence that a higher number of Cs could offer in favor of one or the other stimulus. According to this alternative interpretation, the trade-off results because participants use the colors less when the strength of perceptual evidence is higher. We tested this interpretation by adding to the previous regression another interaction—between the color predictor and the strength of perceptual evidence, that is, the absolute difference between stimuli in the upward- minus downward-facing Cs that participants fixated on (denoted: |ΔVCsobserved|×ΔVcolor). In this expanded regression, we only found a significant effect for the interaction with the total number of Cs participants observed and not with the strength of the evidence these Cs offered (βΔVCsobserved=1.31,z=19.7,P<0.001,βΔVcolor=1.56, z=0.34, P<0.001, βΔVcolor×ΣNCs=−0.22,z=−7.94,P<0.001, β|ΔCsobserved×ΔVcolor|=−0.03,z=−0.69,P=0.48). Thus, the use of learned information for making choices traded off specifically against the amount of perceptual information gathered. To determine whether the trade-off primarily reflected the gradual accumulation of color information as trials progressed, we parsed each block of trials into first and second halves, and tested the interaction between the two halves of each block and the influence of colors and Cs on choices (as obtained in Fig. 1C). This analysis revealed that participants indeed used the learned information more in the second halves of the blocks (βcolor×block=0.17,P=0.001), but there was no corresponding reduction in the use of perceptual information (βcs×block=0.03,P=0.54), suggesting that the trade-off also reflected finer trial-to-trial variations. Learned information reduces sampling of perceptual information Next, we asked why a trade-off exists between the use of perceived and learned information. A natural suggestion is that the trade-off is caused by the fact that gathering each of the two kinds of information requires time and uses overlapping cognitive resources, such that it is slower to gather both of them simultaneously. If this is the case, we may expect the time it takes to gather both kinds of information to be longer than the time it takes to gather each of them separately. However, comparing choice times on trials where stimuli consisted of either Cs alone, color alone, or both showed that the addition of color to the Cs made participants reach decisions faster, not slower (combined vs. Cs only: t87=2.21,P=0.03; Fig. 2C), despite the fact that to choose between combined stimuli optimally, both Cs and color needed to be consulted, and participants had plenty of time left in the trial to do so (they were given 4 s to make a choice but did so on average within 1.91 s, ±0.26). Examination of the choice times also revealed that participants were substantially faster in choosing between colors than between Cs (t87=19.45,P<0.001). This raised the possibility that the trade-off that was evident in the combined trials was the result of fast gathering of learned information, reducing the need to invest further effort in gathering perceptual information to reach a decision. If this was the case, we may expect to see that participants fixated on fewer Cs in combined trials, compared to the Cs-only trials. The data showed this was indeed the case (t71=8.7,P<0.001; Fig. 2D). Moreover, both this effect and the shorter choice time in combined trials correlated with the degree to which participants prioritized colors over Cs in making their choices, as inferred from participants’ choices (ΣCobserved: r = −0.4, t70=3.66,P<0.001; Fig. 2G; choice time: r = −0.39, t86=−4,P<0.001, Fig. 2F), and validated by participants’ self-reports concerning their use of Cs and colors (r = 0.55, P<0.001, Fig. 2E). Considering the trial duration and the global average of about three fixations per second, one might expect participants to fixate on more Cs before making a choice. However, the marginal utility of sampling more Cs decreases as a function of Cs and color information already gathered, such that beyond a certain number of Cs and amount of color information, participants may have been content to save effort and make choices that are probably correct. The finding that participants were faster to choose when stimuli also involved color put into question the assumption that gathering information about the color takes substantial time, similarly to the gathering of the perceptual information. To explicitly test this, we added to our logistic regression model of choice an interaction between the color predictor and choice time, while still controlling for the association of color use with fewer observed Cs. The results did not provide evidence that using the colors took additional time. In fact, the interaction of color use and choice time was negative (βRTXcolor=−0.09,z=−2.6,P=0.009). Possibly, this result reflects that the better the color reward probabilities were learned, the faster it was to use them. A computational model of perceptual and learned information gathering The results thus far establish a trade-off between the use of learned and perceived information, and suggest that this trade-off results because fast, initial gathering of learned evidence gets people closer to a decision threshold, and thus reduces the amount of perceptual information they need to gather in order to reach a decision. To formally test this hypothesis, we leveraged the traceability and discreteness of perceptual information gathering in our task to form a computational model of the task. Thus, the model predicted not only the choices participants made, but also the sequence of fixations that would lead them to each choice (see Methods for full model specification). At each time point, the model first decides whether to gather more perceptual information or already make a choice. This decision can lead to a trade-off between perceptual and learned information because, among other factors, it is based on the absolute difference in the currently estimated values of the colors of the stimuli (ΔVcolor): Specifically, a trade-off would result if βΔcolor is negative. Other factors influencing this decision are the absolute value difference according to the observed Cs (ΔVCs), the model's general tendency to gather or not gather perceptual information (αgather), and its urgency to make a decision as time goes by from trial onset (trial-t). Here, τ∈[0,1] determines how quickly urgency grows with time. If the model decides to gather additional perceptual information, it then chooses whether to look at the right or left stimulus’ Cs: This choice is based on a general bias to look in one or another direction (αlook-right), the values of the right versus left stimuli, and where the model last looked at (since it is less effortful to saccade within a stimulus). Here, I(lookedright) is coded as +1 if the model last looked right, and −1 if the model last looked left. When the model decides to stop gathering perceptual information, it chooses either the right or the left stimulus, based on their estimated values: where βchoose is an inverse temperature parameter, and ΔV accounts for both colors and Cs: where ωcolor weights the relative impact of the colors on choice. Lastly, the value of a stimulus based on its observed Cs is computed as a mean of the expected reward for 3, 6, or 9 upward-facing Cs, each multiplied by the likelihood that there were this number of upward-facing Cs given the observed Cs (as per the binomial probability mass function). And the value added due to the stimulus having a particular color is learned on a trial-by-trial basis from the observed rewards (see Methods). To account for the fact that retrieving the learned color values could take time, for instance due to a process of sampling from stored memory (15), the effective value used for making choices increasingly approaches the learned value as time within a trial progresses: with the rate of increase determined by τcolor. Learned values impact perceptual information gathering Fitting the model to participants’ actual gaze choices (fixations) and stimulus choices showed that choices of whether to continue gathering information, and choices of where to sample from, were influenced by both Cs and color information. Thus, the best-fitting model according to integrated Bayesian Inference Criteria (18, 19) (iBIC = 182,139.3) incorporated learned color information in both the decision of whether to continue gathering information and the decision of where to sample. This full model outperformed models that included learned color information only in the gather-versus-choose decision (iBIC = 182,435.46) or only in the sampling location decision (iBIC = 182,207.92; Fig. 3B). Further, we found that with respect to the gather-versus-choose decision, the data were most consistent with independent influences of Cs and color values, as opposed to a joint influence of their combination so as to account for their congruency (iBIC = 182,337.6, Fig. S2). Modeling results. A) The plots show the fitted distributions of group-level mean parameters. Top: Parameters governing the decision of whether to choose a stimulus or to look for more information. The general tendency of participants is to look for more information (left plot). This decision, however, also depends on the absolute difference between the currently estimated values of both colors and Cs. The higher the differences, the more participants are likely to stop gathering information and choose (middle plot). Participants were also less likely to continue gathering perceptual information as time passed (right plot). Bottom: Parameters governing the decision of where to look and what to choose. In choosing a stimulus, participants favored stimuli with higher total value, but gave only partial weight to the color in computing this value (left plots). The decision of where to look was consistently governed by a perseverance factor (βlook-stay) and by the value associated with the stimuli's color (right plots). B) Comparison of integrated Bayesian Inference Criteria between models excluding color information either from the decision of whether to sample more information or to choose, or from the decision of where to sample from, showing that the best-fitting model is the one that incorporates colors in both. C) Color value gathered as a function of fixation number, showing the majority of participants gathered over 90% of the color value within two fixations. Thin lines depict individuals; thick line is group average. Examining the parameter values that best fitted participants’ choices and gaze fixations showed that the decision to continue gathering perceptual information was negatively influenced by the color values—the higher the absolute difference between the color values, the lower the probability of continuing to gather perceptual information. Moreover, color values were gathered very rapidly by the model, on average reaching 94.6% of the learned color value already in the second fixation (Fig. 3C). Thus, mirroring the model-independent results, the modeling indicated that the trade-off between learned and perceived information resulted from a fast retrieval of learned information that suppressed further gathering of perceptual information. To confirm that the model captured participants’ behavior well, we compared it to the actual data in terms of both stimulus choices and decisions to continue looking. With regards to stimulus choices, we examined the probability of choosing the right or left stimulus as function of the reward probabilities associated with the stimuli's color and Cs. This showed an adequate correspondence between participants (Fig. 4A) and model (Fig. 4E). With regards to decisions to continue looking, we examined the probability of gathering additional perceptual information following each additional fixation. This measure too showed a good correspondence between participants (Fig. 4B; β = −0.06, t = 29.4, P < 0.001, mixed regression) and model (Fig. 4F; β = −0.07, t = 148.8, P < 0.001, mixed regression). Finally, we examined measures that stem from the trade-off between learned and perceived information: the reduced tendency to continue looking at more Cs the higher the absolute differences between the color values. This reduced tendency was evident in the number of Cs observed (Fig. 4C; β = −0.36, t = 7.28, P < 0.001, mixed regression) and the time it took participants to stop looking and choose a stimulus (Fig. 4D; β = −0.07, t = 3.66, P < 0.001, mixed regression). These measures aligned well with the number of Cs observed by the model (Fig. 4G; β = −0.009, t = 6.5, P < 0.001, mixed model) and the model's probability of continuing to look (Fig. 4H; β = −0.018, t = 12.01, P < 0.001, mixed regression). Correspondence between modeling results and data. A) Participants’ probability of choosing the right stimulus as a function of the difference in the reward probability associated with the stimuli's colors, and the difference in number of Cs pointing upward (indicated by the colors). Error bars indicate participants-level SE. B) The probability of looking at another C given the number of previous fixations on Cs. Each dot represents a participant. Line represents group average. C) Participants looked at fewer Cs when the absolute difference between stimulus color values was larger. Total Cs observed are centered within participants; each dot represents a participant. D) Participants chose faster when the absolute difference between stimulus color values was larger. RT is centered within participants; each dot represents a participant. E) The model's probability of choosing the right stimulus as a function of the difference in color value (indicated by the x-axis), and in the value of the observed Cs (indicated by the colors), between the stimuli. F) The model's probability of choosing to continue sampling as a function of fixation index. G) The number of Cs observed by the model was lower when the absolute difference between the color values was larger. H) The model's probability of continuing to sample changed as a function of the absolute difference between the color values. Individual differences and reliability in the use of learned and perceived information We finally asked whether a trade-off also exists between individuals, such that the more a person relies on one source of information, the less they rely on the other. To test this, we examined the correlation between the regression coefficients quantifying the degree to which each participant used the Cs and the colors to make choices as obtained from Fig. 1D. This planned analysis showed a weak nonsignificant negative correlation (r = −0.16, P = 0.14; Fig. 5A), suggesting that our measures might not be sensitive enough given the present sample size. Thus, we next examined the same theoretical idea while utilizing the benefits of the detailed eye gaze behavior to determine the Cs actually observed, that is, using the regression from Fig. 2A. Indeed, this correlation was significantly negative (r = −0.33, P = 0.004, Fig. 5B), consistent with a trade-off between Cs and color information. between-participant trade-off. *< 0.05, **<0.01. Each point represents a single participant. A) The relationship between the use of assigned color and number of Cs as obtained from the regression coefficient (shown in Fig. 1D). B) Significant negative correlation between the reward probabilities associated with color and the number of Cs observed obtained from the regression coefficient (shown in Fig. 2A). C) Significant negative correlation between the baseline tendency of participants to gather Cs and the weight given to color as derived from the modeling analysis. We next repeated the correlation analysis replacing the regression coefficients with the parameter values representing participants gathering and use of Cs and color as derived from the modeling of participants’ choices and fixations. The modeling more specifically quantifies participants’ baseline tendency to gather Cs (αgather) and their usage of color information to which they were exposed (ωcolor). We found again a significant negative correlation across participants between the two parameters, such that the more participants used the color information the less they gathered information about the Cs and vice versa (r = −0.23, P = 0.04; Fig. 5C). We further note that these results likely underestimate the true magnitude of the trade-off because they may reflect a superposition of two correlations, one negative due to a trade-off and another positive due to individual differences in general performance, for instance due to motivation, which could make both coefficients higher or lower simultaneously. In addition, we wanted to examine whether participants’ tendency to prioritize perceived or learned information in making choices is a stable and valid individual trait. For this purpose, we first examined the correlation between the color-Cs relative coefficient measure (Fig. 2C) in two separate sessions of the experiment, each with different colors, that participants completed in two different days (between 2 and 175 days apart, mean 79±63). A positive correlation (n = 27, r = 0.6, P < 0.001) indicated moderate test–retest reliability suggesting some degree of stability in individuals’ tendency to use perceived versus learned information in our task (Fig. 6C). Individual differences in the use of perceived versus learned information. *P < 0.05. ***P < 0.001. Each point represents a single participant. Subscripts of the correlation coefficients reflect degrees of freedom. A) The relationship between the self-reported ratings of the degree to which participants relied on color versus Cs in making choices, to the ratio of choices-derived regression coefficients ((βcolor−βCs)/(|βCs|+|βcolor|); see Fig. 2). B) The relationship between choices-derived regression coefficients and the ratio of information gathering/usage parameters from the model ωcolor/αgather. The number of participants is lower here because modeling required valid eye tracking data not available for all participants. C) Reliability of information gathering style in the task, quantified as in (A), across two sessions of the experiment performed at least 2 days apart. D) Trait Extraversion as a function of information gathering style in the task, quantified using the model as in (B). The number of participants is lower here because not all participants filled the questionnaire. To test the validity of these individual differences, we next examined whether they correlated with participants’ own ratings of how much they used the colors and the Cs. This showed a significant positive relationship (Fig. 6A), indicating a correspondence between the task measure and participants’ self-reports. We next tested the validity of the task measure for explaining behavior outside the task, specifically, by assessing its correspondence with personality self-reports (Big 5 (20)). We hypothesized that greater use of perceived, relative to learned, information would be associated with trait extraversion and openness to experience. We found a trend-level correlation with extraversion (r = 0.21, P = 0.057) but not with openness to experience (0.15, P = 0.33; all correlations appear in Table S1). We thus repeated the analysis with respect to extraversion using the more specific task measures derived from the modeling, which were moderately correlated with the measures derived from a regression analysis of choices (Fig. 6B). This showed a significant correlation (r = −0.24, P = 0.04, Fig. 6D), such that more extraverted participants gathered more perceptual information relative to their usage of learned information. Discussion Using a preregistered experiment that required participants to jointly use learned and perceived information to form decisions, we demonstrated integration of, and a trade-off between, the use of learned information and the gathering of perceptual information, both within and between participants. The data indicated that people use both sources of information (21, 22) but that learned information is fast to gather, reducing the need for the effortful gathering of additional perceptual information. Moreover, learned information directs the gathering of perceptual information toward higher-value options (16, 23–29), and thus leads one to gather perceptual information that is more likely to generate a decision. This work illustrates how humans integrate internal and external sources of information to flexibly adapt their exploratory strategies. It shows how the information individuals already have in hand influences their decision as to whether to seek additional information. The findings are particularly relevant for understanding ecological human behavior, where information seeking is not an isolated event but a continuous, multidimensional process that underpins adaptive action in complex environments (2, 11, 26, 30–41). Prior work has primarily considered similarities between the gathering of externally perceived and internally stored information (2, 42–47), suggesting that attention gathers information from our senses, while working memory does so from within the mind (2). Indeed, comparable patch-like information structures and search behaviors were found in both domains. Thus, principles drawn from research about foraging (45, 48) have been used to explain how we retrieve semantic information from memory (49–51), do creative search (52), or shift our gaze to areas rich in semantically or visually rich information (29). Here we extend prior work by showing how the two sources of information compete in influencing decision-making. To inform a more mechanistic understanding of the nature of the trade-off, it is worth considering previous evidence that points toward a shared resource pool between external and internal information acting as a bottleneck and creating competition between the different sources (53, 54). These studies primarily examined the costs of shifting attention between perceptual and memory-based contents—either across successive trials or via sequential reorienting within a combined task. In contrast, our study focuses on trials in which perceptual and learned information are both relevant to the same judgment, such that their competition is expressed within the decision itself. This allows us to go beyond demonstrating a switch cost and instead infer the relative weighting and integration of external and learned information on each trial, thereby providing direct evidence for a trade-off. Other studies have examined more broadly how attention to particular sources of information shapes trial and error learning (55, 56), and how it is in turn shaped by previously learned information (57). Dynamic trade-offs have been identified between different learning systems that rely on the same information but use it to generate different value estimates (58). Future work could build on these previously characterized mechanisms to offer a more mechanistic model of how attention, learning, and uncertainty interact in the arbitration between learned and perceived information (57, 58). Importantly, our findings emerged within an experimental design in which perceptual information could only be accessed through eye movements. This requirement reflects a naturalistic feature of decision-making, but the precise time cost of eye movements is likely to vary across contexts, raising the possibility that the strength of the trade-off we observed may itself adapt to environmental demands (59). In our study, the trade-off was primarily evident across decisions. However, a different task design in which learned and perceived information are acquired at comparable speeds could test whether individuals dynamically arbitrate between learned and perceived information during each decision process. In addition to the trade-off within individuals, participants’ overall tendency to prioritize one source of information over the other emerged as a stable individual trait across two separate sessions of the experiment. This characteristic was reflected in the modeling results and had a marginally significant correlation with trait extraversion. These results suggest a stable latent individual preference for relying on either internally gathered or externally sampled information, with the latter associated with extraverted behavior. Indeed, trait extraversion has been associated with a greater sensitivity to external stimuli and a preference for externally sourced information (60). Here, we characterize how this personality tendency may manifest in learning and decision-making. Given our marginally significant result, further research employing larger samples is necessary to establish our conclusions regarding trait differences. Future work could also examine relationships with additional traits that potentially originate from a preference for gathering perceptual information. One such trait is emotional temperament, in particular, proneness to depression which is known to be associated with a tendency to ruminate internally while avoiding activities that can expose one to new external information (61). Another promising avenue for further research concerns the information provided by each source. In our experiment, learned and perceived information provided the same amount and kind of information—probability of reward. This feature of our task can be manipulated, for instance, by having one source of information convey reward probability and the other reward magnitude, which could potentially serve to reduce the trade-off between them. In conclusion, our findings extend current understanding of how humans combine newly perceived and previously learned information (62) by establishing a trade-off between these two sources of information in guiding decisions, highlighting that beneath each choice lies a more fundamental decision about which source of information to consult. Methods Participants The sample included 90 university students with normal or corrected-normal vision (62 women; 66 with right dominant eye; average age 23.5, SD 3.03), all scoring 70 or above in the Ishihara color blindness test. We based our sample size on a power analysis as preregistered in https://osf.io/78vqu and detailed below. Two participants were removed from behavioral data analyses because their performance in combined color-Cs trials, measured as the proportion of choices of stimuli associated with the higher probability of reward, was not higher than chance level (50%). Valid eye tracking data (>75% valid samples) were obtained from 72 participants (see exclusion criteria under eye tracking) and inserted into the eye movements analysis. To test the reliability of task measures, 29 participants were invited back for another session of the experiment, out of which 27 met the performance criterion. All participants signed an informed consent before the experiment, approved by the Ethics review board of the Hebrew University of Jerusalem. They were granted either course credit or 40 NIS (∼10$), in addition to 0.3 NIS (∼0.01$) for each reward obtained in the experiment. Power analysis We performed a power analysis to determine the required sample size for the across-participants trade-off analyses, as such analyses require larger sample sizes. We expected a medium effect size, which entails a correlation of ∼0.3, and required a power of 0.8 at a significance level of P = 0.05. This necessitated a sample size of at least 84 participants. For testing whether the prioritization of internal or external information is a reliable disposition, we expected a large effect size of at least r = 0.5 in a test–retest correlation across participants. For this analysis, a power of 0.8 at significance of P = 0.05 necessitated a sample size of at least 28 participants. Procedure Participants were first familiarized with the experimental stimuli and instructed that reward probability scales with the number of upward-facing Cs, which could be either 3, 6, or 9. Additionally, participants were told that the reward probability associated with the colors can be learned by trial and error. To maximize their reward, participants were instructed to give equal weights to both Cs and colors in choosing between combined stimuli, because the contributions of the two components of the stimuli to predicting reward are additive. The experiment started with at least 10 practice trials of each type—Cs only, color only, and their combination—each of which continued until the participant reached at least 80% accuracy. Then, participants played three blocks. The first and second block each introduced three colors, associated with different reward probabilities (0, 0.5, and 1). The colors associated with each probability were counter-balanced across participants. To ensure participants learned about the colors and understood the Cs trials properly, 36 combined stimuli trials were interleaved with 18 Cs-only trials and 18 color-only trials. In the third block, participants faced all six colors they had already learned about. Since no new colors were introduced in this phase, this block consisted of 162 combined trials only. Following every 30 trials, participants rated how they felt on valence and arousal on visual analog scales. At the end of the experiment, participants reported the reward probability associated with each color and rated the degree to which they relied on the Cs versus the color in making their choices on a visual-analog scale, used to calculate the ratings in Figs. 2B and 6A. Finally, participants were requested to fill out a curiosity and personality questionnaire—big5 and ATQ (20, 63). Due to dropout and participants returning rates, only 68 filled the big5 questionnaire and 51 filled the ATQ questionnaire. Eye tracking The experiment began with a standard 9-point calibration and validation procedure provided by Eyelink 1000+ (SR Research Ltd, Mississauga, Ontario, Canada). The eye-tracking measures are based on EyeLink's standard parser configuration: samples were defined as a saccade when the deviation of consecutive samples exceeded 30°/s velocity or 8,000°/s2 acceleration. Samples gathered from time intervals between saccades were defined as fixations. The eye tracking data was parsed into fixation reports, and interest areas were defined around each of the Cs (see Fig. 1E). We discarded any fixations outside these interest areas. We discarded repeat fixations (fixations on a C that has already been fixated on in the same trial) from further analysis, assuming that if another fixation was made to the same location it means that the subjects did not register its orientation the first time. We then calculated for each participant how many of each stimulus’ Cs the participant has already fixated on at each time point, and how many of these faced upward or downward. Participants with poor eye movement data, with >25% of their gaze samples removed were not considered in the eye movement analysis, but did contribute to the behavioral one. Regression models Several mixed regression models were run using the lme4 package in R. To validate that participants use both Cs and color, we compared three regression analyses explaining participants’ choices. The difference between the two available stimuli in the number of upward Cs (Cs):Choice∼Cs+(1+Cs|subject) The difference between the two available stimuli in the number of upward Cs (Cs):Choice∼Cs+(1+Cs|subject) The difference between the stimuli in the reward probability associated with the color (color):Choice∼color+(1+color|subject) The difference between the stimuli in the reward probability associated with the color (color):Choice∼color+(1+color|subject) Both:Choice∼Cs+color+(1+color+Cs|subject) Both:Choice∼Cs+color+(1+color+Cs|subject) To assess the hypothesized trade-off between the use of Cs and color to make choices, we examined the interaction between the use of color and the overall number of Cs participants fixated on: where ΔVCsobserved encodes how many upward-facing minus downward-facing Cs participants fixated on during the trial for the right minus left stimulus, ΣNCsobserved is the overall number of Cs the participant fixated on, and Δp(reward|color) is the difference between the stimuli in the reward history of their colors, that is, the proportion of times that choosing a stimulus with the color was rewarded. Then, to test whether retrieving the reward history of a color required time, we added the reaction time (RT) as another moderator of the color predictor: We also examined whether the trade-off was due to learning by examining the first and second halves of each block: All predictors were normalized within participants. Modeling The computational models were fit to the data using a custom iterative importance sampling algorithm, implemented in python. This allowed us to extract max-likelihood estimates both for the hyper parameters and for participant-level parameters. The major part of the model is described in the text. Here, we complement the description by specifying additional components. Value of color (Vcolor) The value associated with each color was updated by a temporal difference learning algorithm: where the prediction error, δ, is computed as: and the learning rate ηt adapts based on the number of prior observations for each color stimuli: Here, ϵ is a free parameter, and the number of observed outcomes is divided by 2 because each outcome is only half attributable to the color. Value of C (VCs) The value of Cs is determined by the number of Cs pointing upward, with three possible values: nine Cs are associated with a reward probability of 0.75, six Cs with a reward probability of 0.5, and three Cs with a reward probability of 0.25. Since participants were made aware of the three possibilities, the value of the observed Cs for a given stimulus can be computed as the expected value of these three possibilities, each weighted by its probability: The three probabilities, p(s-Cs-up=n|observedCs), are each computed as proportional to the corresponding likelihood of observing the actually observed Cs: That is, by normalizing the likelihoods such they sum to 1. This suitably assumes equal prior probability for 3, 6, and 9 upward-facing Cs. The likelihoods, in turn, are computed as the probability of observing the actually observed upward- and downward-facing Cs given that there are n upward-facing Cs. This is achieved using a binomial probability density function: where n/12 is the probability of observing an upward-facing C, and the exponents are the counts of upward and downward-facing Cs actually observed. Cs-only trials For Cs-only trials, color predictors were set to zero, and the expected value of a stimulus was computed as Vs−Cs)Eq. 9). Color-only trials For color-only trials, Cs predictors were set to zero. Thus, choice probabilities were modeled as a logistic function of βchooseωcolor(Vright−Vleft). Hyper priors All β and α parameters were each drawn for each participant from a separate group-level normal distribution, with a mean of 0 and a SD of 1. The prior distribution for the ωcolor, τ, and τcolor parameters were specified as approximately uniform distribution ranging [0, 1]. To achieve this normally distributed values (μ = 0, σ = 1) were transformed using the cumulative distribution function of the normal distribution. This approach ensured that parameter values remained constrained to [0, 1], while allowing the distribution to adapt during the fitting process. For the parameter ϵ, we specified a lognormal prior with mean 2 and SD 2, chosen as a weakly informative, wide prior. Supplementary Material