Authors: Valerie F. Reyna, Silke M. Müller, Sarah M. Edelson
Categories: Special Issue/Uncertainty, Adolescent brain, Ambiguity, Decision neuroscience, Risk, Temporal discounting, Uncertainty
Source: Cognitive, Affective & Behavioral Neuroscience
Authors: Valerie F. Reyna, Silke M. Müller, Sarah M. Edelson
Uncertainty permeates decisions from the trivial to the profound. Integrating brain and behavioral evidence, we discuss how probabilistic (varied outcomes) and temporal (delayed outcomes) uncertainty differ across age and individuals; how critical tests adjudicate between theories of uncertainty (prospect theory and fuzzy-trace theory); and how these mechanisms might be represented in the brain. The same categorical gist representations of gains and losses account for choices and eye-tracking data in both value-allocation (add money to gambles) and risky-choice tasks, disconfirming prospect theory and confirming predictions of fuzzy-trace theory. The analysis is extended to delay discounting and disambiguated choices, explaining hidden-zero effects that similarly turn on categorical distinctions between some gain and no gain, certain gain and uncertain gain, gain and loss, and now and later. Bold activation implicates dorsolateral prefrontal and posterior parietal cortices in gist strategies that are not just one tool in a grab-bag of cognitive options but rather are general strategies that systematically predict behaviors across many different tasks involving probabilistic and temporal uncertainty. High valuation (e.g., ventral striatum; ventromedial prefrontal cortex) and low executive control (e.g., lateral prefrontal cortex) contribute to risky and impatient choices, especially in youth. However, valuation in ventral striatum supports reward-maximizing and gist strategies in adulthood. Indeed, processing becomes less “rational” in the sense of maximizing gains and more noncompensatory (eye movements indicate fewer tradeoffs) as development progresses from adolescence to adulthood, as predicted. Implications for theoretically predicted “public-health paradoxes” are discussed, including gist versus verbatim thinking in drug experimentation and addiction.
“Our new constitution is now established, and has an appearance that promises permanency; but in this world nothing can be said to be certain, except death and taxes.” Benjamin Franklin, November 13, 1789
Uncertainty permeates our lives and influences decisions ranging from the trivial (whether to order seafood in a steak restaurant) to the profound (whether voting for one candidate rather than another will increase the likelihood that the U.S. constitution endures). Uncertainty comes in different varieties, and we focus on two of uncertainty about outcomes because they are probabilistic (i.e., outcomes fluctuate), and uncertainty about outcomes because they occur in the future. We discuss how tolerance for uncertainty of these two types varies across individuals and across the lifespan; how two types of critical tests adjudicate between major theories of decision making under uncertainty (prospect theory and fuzzy-trace theory); and how different mechanisms underlying decision-making might be represented in the brain.
Implications for risk reduction and addiction are also briefly discussed, including what we call a “public health paradox” (Reyna and Farley, 2006). That is, precise tradeoffs of risk and reward often promote risk-taking (when probability of harm is low and magnitude of reward is high for single acts, a common scenario in public health), but healthy adults typically avoid such tradeoffs. This theoretically predicted public health paradox applies to trying opioids, HIV-AIDS transmission from unprotected sex, driving without a seat belt, and not taking risk-reduction measures during the COVID-19 pandemic, among other behaviors (Table 1). For example, among individuals who experimented with opioids for nonmedical use, only approximately 7% progressed to addiction (Boyd et al., 2009; McCabe et al., 2007). Accordingly, the probability of becoming addicted from trying opioids is relatively low (although greater at earlier onset; McCabe et al., 2007) while the pleasure is high, paradoxically favoring a decision to try opioids from a rational choice (risk-reward tradeoff) perspective. However, healthy adults typically do not engage in this trade-off thinking but apply gist principles which protects them from unlikely but substantial harm. Thus, the “right” choice from a rational choice perspective can be the “wrong” choice from a policy or psychological perspective, as delineated in fuzzy-trace theory, a position supported by the surprising (but predicted) direction of certain developmental differences and by health and medical outcomes, as explained below.Table 1Fuzzy trace theory predicts a common public health examples of precise risk-reward tradeoffs that promote risk-taking and gist thinking that avoids themVerbatim: trading-off favors taking the riskGist: not trading-off favors avoiding the riskScenarioLow probability of high harmHigh probability of high rewardTrading-off favors…Categorical gistTherefore, I will avoid risk and…OpioidsApproximately 0.7% chance of dying from overdose and/or 7% chance of getting addicted^1^Feeling highTrying opioidsIt only takes once to overdose or get addicted from trying opioids.Not try opioidsHIV-AIDS transmissionApproximately 0.08% chance of contracting the virus per encounter^2^Pleasure from unprotected sexHaving unprotected sexThere is no cure for the virus so avoid risk.Use a condomDriving safetyApproximately 0.0001% chance of being in a fatal crash per 100 miles driven^3^Freedom and convenience of not using a seatbeltDriving without a seatbeltWhy risk dying in a car accident?Put on my seatbeltPrevaccine COVID-19 transmissionApproximately 2.4% chance of dying from the virus^4^Having fun being social without masksNot socially distance and not wear a maskBefore vaccine Social distancing and wearing masks are the only protection against a “real possibility” of dying.Socially distance and wear a maskScientific estimates are included to illustrate the paradox that trading off ironically often promotes unhealthy risk-taking in common public health contexts. Laypeople may not know exact risks but they usually know that bad outcomes are rare and pleasure (reward) is virtually certain for a single decision to take a risk. For these examples, precise (verbatim) thinking involves taking the amount of risk (low) into account and trading it off against the amount of reward (high) in deciding whether to take a risk. Categorical gist thinking, in contrast, emphasizes meaningful qualitative distinctions, such as between curable and incurable, alive and dead (e.g., from a car accident or overdose), and addicted or not. Thus, effective risk reduction involves searching for categorical pivot points in decisions and communicating these “bottom lines.” Because information about precise probabilities and magnitudes of harm/reward is hard to find in real life, fuzzy gist thinking makes it possible to make decisions despite uncertainty^1^Chance of dying from overdose is calculated by the number of people who died from a drug overdose in 2019 out of the number of people who misused opioids in 2019 (U.S. Department of Health and Human Services, 2022). See Boyd et al. (2009) and McCabe et al. (2007) for chance of getting addicted^2^Male to female transmission in high income countries (Boily et al., 2009)^3^Insurance Institute for Highway Safety (2022)^4^Calculated as the number of deaths divided by the number of cases as of November 1, 2020 (The COVID Tracking Project, n.d.)
Other behavioral theories take the opposite perspective, that magnitudes of risk and reward should determine risk-reduction behavior (e.g., for a review, see Reyna, Broniatowski, and Edelson, 2021b). Fuzzy-trace theory does not suggest that magnitudes are irrelevant to decision making (see Pirrone et al., 2022), but they are only one input and what matters more is the qualitative bottom-line gist that integrates inputs. In particular, the focus of this article is evidence for mental representations of the simplest gist that governs decision-making in brain and behavior alongside precise categorical representations.
The first type of uncertainty—probabilistic—is tapped when people decide between options that vary in risk, such as choosing between receiving 2,000 (otherwise nothing). The second type of uncertainty—temporal—is tapped when people decide between options that vary in time, such as choosing between receiving 2,000 in a year. A third type of uncertainty undergirds the first two ambiguity. Although experimenters often present choices with known probabilities (e.g., fully specified lotteries), probabilities in the real world are typically suffused with uncertainty (Levy and Schiller, 2021). For example, despite an “infodemic” of readily accessible information about COVID-19 (World Health Organization, 2020), individuals do not know the probability that they will die from COVID-19 if they choose to not wear a mask (e.g., Sinclair et al., 2021). Instead, these probabilities are fuzzy, which matters for decision making, and theories of brain and behavior must take this fuzziness into account.
Decisions that involve temporal delays also are uncertain. The fuzzy ambiguity of time is illustrated in maps that forecast the potential paths of a hurricane (with varying success; Padilla et al., 2020). As shown in Fig. 1, the current position of a hurricane is the point of origin, but as simulated time passes, the possible paths of the hurricane diverge. As these maps illustrate, time itself introduces uncertainty, because the future can play out in different ways. Similarly, the promised $2,000 prize mentioned above can fail to materialize in a year, not just because payers might have nefarious intentions (i.e., they are untrustworthy), but because events intervene (e.g., bankruptcy of the payer). Rather than converging on a preordained future, uncertainty grows with distance from the present, particularly when time periods span developmental stages, such as childhood to adulthood, because the self and the self’s preferences change (Bartels and Rips, 2010; Hershfield, 2011; Reyna and Farley, 2006).Fig. 1Tracking forecast for Hurricane Sandy from the U.S. National Oceanic and Atmospheric Administration depicting growing uncertainty over time in the potential path of the hurricane, generated by mathematical models (see also Padilla et al., 2020). Because neither the size nor severity of the hurricane is depicted, this map can only be used to determine whether one is at-risk (and therefore need to evacuate) or not, consistent with categorical gist. This image is in the public domain because it contains materials that originally came from the U.S. National Oceanic and Atmospheric Administration, taken or made as part of an employee's official duties (forecast for October 28, 2012)
Hence, because of inherent ambiguity, a wise decision-maker should embrace vagueness in mental representations of probabilistic or temporal choices, such as those described above. Outcomes might not turn out precisely on the nose of predictions, probabilities fluctuate as conditions change, and changing contexts are not simply sources of bias, but, rather, they allow the meaning of information about probabilities and outcomes to be interpreted and revised (see discussion of the contextual relativity of gist in Reyna, Brainerd et al., 2021a). Moreover, in our approach, useful mental representations are not vague simply to cut mental corners, but because they distill what matters, which often is the qualitative even categorical (i.e., the simplest) gist of decision options. As fuzzy-trace theory outlines descriptively and prescriptively, adaptive decision making emphasizes getting the big picture of decision options (integrating facts and details into a meaningful bottom-line whole) and applying core values to that mental representation of the big those values that are simple, fundamental, and enduring.
Reasons beyond ambiguity also support advantages of using fuzzy “gist” representations in decision making, including that memory for gist endures longer than verbatim memory for details, an important consideration evolutionarily before the invention of writing (Reyna and Mills, 2007). Gist processing is generally easier under stress, high arousal, or disruptive interference compared with verbatim processing (Rivers et al., 2008; Venkatraman et al., 2011). Most important, gist representations capture essential meaning rather than arbitrary details (the latter are captured in verbatim representations), scaffolding decision-making that consequently reflects an appreciation of the meaning of facts. Preferences involving time and probability derive from mental representations of meaning grounded in different backgrounds and experiences (Croote et al., 2020; Edelson and Reyna, 2021). This approach motivates such questions as what does “waiting” or “a long time” or “rewards” mean in a given cultural context, and how do different scenarios translate into these meanings?
Despite the fluidity of meaning in context, once decision scenarios are translated, core values can be remarkably similar across people. Thinking about probabilistic and temporal decisions in their starkest “gisty” terms, all else equal, most people prefer receiving certain rather than uncertain positive outcomes. They prefer rewards now and for sure, not later and maybe. Psychologically, these are categorical distinctions. However, these preferences are traditionally assessed by using tasks in which continuous trading off of the magnitude of outcomes against either time or probability is assumed theoretically (Glimcher, 2022). For example, decision-makers are described as discounting later, larger rewards relative to sooner, smaller rewards, yielding a discount rate. This is traditionally a smooth function over outcome magnitudes and time intervals. Correspondingly, risk aversion is characterized by using continuous nonlinear functions (e.g., negatively accelerated subjective valuation of objective outcome magnitudes) in traditional expectancy value theories, such as expected utility or prospect theory (Kahneman and Tversky, 1979; Trepel et al., 2005). These functions can be flatter due to emotion or other factors (Rottenstreich and Hsee, 2001; but see Levine, 2019), but decision dimensions still trade off and discounting or risk aversion are generally treated as a matter of degree (quantitative differences) not of kind (qualitative differences).
However, in both probabilistic and temporal decisions, there are psychological discontinuities at zero risk and zero delay, referred to as the certainty effect and present bias (immediacy effect), respectively (as well as at other categorical boundaries; Kahneman and Tversky, 1979; Laibson and Maxted, 2022). Receiving a reward now is psychologically distinct from receiving it very, very soon, although the literal difference between now and very, very soon (what we call “verbatim” differences) could be miniscule. An “instantaneous-gratification agent” is inside all of us. Analogously, “soon” can occur over a fuzzy horizon of minutes to days, but it is psychologically distinct from “later” (e.g., McClure et al., 2007; Augenblick and Rabin, 2019). Figure 2 illustrates these categorical discontinuities between no risk and some risk and between no delay and some delay, as well as continuous changes in probabilistic and temporal dimensions.Fig. 2Uncertainty resulting from (increasing) delay and (growing) variability of outcomes or risk
According to fuzzy-trace theory, people encode these categorical distinctions (categorical gist), more fine-grained ordinal distinctions, and continuous or precise distinctions in parallel (cf. DeKay, Rubinchik et al., 2022), but they rely on the simplest distinctions that allow them to accomplish a task (e.g., the task of making a choice between two options or of providing a monetary value that they are willing to pay for an option; Reyna, 2012). Naturally, making a choice often requires lower resolution in mental representations than providing an exact monetary value, a principle called task calibration in fuzzy-trace theory that explains classic preference reversals (Corbin et al., 2015; Fischer and Hawkins, 1993).
Fuzzy-trace theory does not make ad hoc assumptions about differences in attention or weighting, although it is compatible with such claims. Instead, it explains why those phenomena are observed by using underlying psychological and neural mechanisms that have been independently verified. For instance, the theory explains that distinguishing between no risk and some risk (or low risk and high risk) is not arbitrary but must reflect the qualitative meaning of this distinction embedded in understanding what differences matter, regardless of their objective size. A seemingly tiny 1% prevalence of COVID-19 in the early stages of the pandemic was “high” (Reyna, Broniatowski et al. 2021b). The theory explains known effects that other theories describe, such as certainty effects and present bias effect, but as we discuss in the next section, it predicts effects that disconfirm those theories, too. In this connection, we focus on two tasks that provide critical tests of prospect theory and fuzzy-trace theory.
In 1991, Reyna and Brainerd introduced a manipulation with three variations, all presenting choices, such as those described above with a sure option versus a gamble, as tests of prospect theory and fuzzy-trace theory (for reviews of independent replications of predicted effects, see Reyna, 2012, and Kühberger and Tanner, 2010). One variation is just the standard version of these choices with fully specified gambles (50% chance of 0). The prospect theory explanation of preference for the sure option when options are phrased as gains—switching to preference for the gamble when options are phrased as losses—turns on posited nonlinear perceptions of outcomes and For example, a 50% chance of a discounted 1,000 for sure, favoring the sure option for gains (greater gains are better) and the gamble for losses (lower losses are better) (Tversky and Kahneman, 1986; Wakker, 2010). Fuzzy-trace theory, in contrast, predicts that multiple literal (verbatim) and gist representations are extracted and the simplest categorical gist determines choices because of (a) a gist-processing preference observed and predicted in many cognitive tasks, and (b) both ordinal gist (less money with higher chance ≈ more money with lower chance) and literal expected value are indeterminate (expected 2,000 + 0.5 x $0).
Therefore, in another variation designed to emphasize the categorical gist representation, the gamble was truncated by deleting the part concerning a 50% chance of $2,000 from the body of the problem. That deleted information was given to decision-makers as background information that preceded the options. Thus, for gains, the decision boiled down to a categorical contrast between gaining something for sure versus possibly gaining nothing, which accentuated preference for the sure option for gains. For losses, the same manipulation of deleting the nonzero part of the gamble accentuated preference for the gamble. Thus, this manipulation induced a categorical gist perspective on the decision that produced classic gain-loss framing effects, indeed, exaggerated them, consistent with the explanation that categorical gist causes framing effects. (Similar effects were obtained by substituting the qualitative categories “some” and “none” for all numerical outcomes in decision problems, another test of the categorical gist hypothesis.)
Conversely, in yet another variation designed to emphasize verbatim representations, deleting the part of the gamble concerning a 50% chance of gaining or losing nothing eliminated framing effects, because there was no longer a categorical contrast between options. Note that prospect theory predicts identical framing effects when the zero part is deleted, because that part multiplies out to be zero in the theory; all of the action in the theory involves nonlinear perceptions of the nonzero part of the gamble (Kühberger and Tanner, 2010). In sum, prospect theory’s predictions have been disconfirmed and fuzzy-trace theory’s predictions have been confirmed using deletion (aka truncation) manipulations, the latter through assuming simple representations of something versus nothing and preferences that respect simple differences in affective valence (something good is better than nothing and something bad is worse than nothing).
Other simplifying approaches have been offered for these tasks, but their motivation is often empirical rather than mechanism-driven; they make predictions that have been repeatedly falsified; and the claims are different from those of fuzzy-trace theory (e.g., simple-minded mental shortcuts due to working capacity limitations). Specifically, we do not discuss the priority heuristic (Brandstätter et al., 2006) and other accounts that involve simplifying representations, because data from the tasks that we review disconfirm those explanations (Venkatraman et al., 2014). However, it is possible that these accounts could be integrated using fuzzy-trace theory’s parallel cognitive architecture. For example, coding efficiency in the brain (Glimcher, 2022) is a simplification process that is likely to influence ordinal gist representations because they are inherently comparative (i.e., less-more; Broniatowski and Reyna, 2018). In this connection, we note that fuzzy-trace theory reconciles prior contradictory findings (e.g., Glöckner and Herbold, 2011; Johnson et al., 2008) in that it predicts that people engage in noncompensatory and compensatory automatic processes roughly simultaneously but rely more on the former.
Notably, “simplification” strategies differ in fuzzy-trace theory (they are meaningful and a cognitively advanced type of processing) compared with other simplification approaches (e.g., impulsive or lazy processing, Pennycook and Rand, 2019, which are separate parameters in fuzzy-trace theory); also see Gaissmaier and Schooler (2008); Raoelison, Thompson, and De Neys (2020). Strategy selection, or more precisely strategy emphasis, is driven by predicted individual and developmental differences (Broniatowski and Reyna, 2018; Reyna and Brainerd, 2011; Reyna and Brust-Renck, 2020). The stimulus is the source of both verbatim and gist representations and they both influence responses, but they operate in parallel as demonstrated in double-dissociation effects and other strong model tests that go beyond automatic-controlled, reason-emotion, or bad-good reasoning dichotomies (e.g., Keren and Schul, 2009; Li et al., 2017; Melnikoff and Bargh, 2018). Thus, fuzzy-trace theory and Sloman’s (1996) dual-processes model are precursors of current parallel processing approaches to cognitive biases, such as framing effects (De Neys, 2018; Pennycook, in press; Trippas, Thompson, and Handley, 2017).
Some theorists have explained framing (Kühberger, 1995) and truncation effects (Mandel, 2014) as due to ambiguity about outcomes. Consider the classic dread-disease problem in which people choose between saving 200 people (of 600 expected to die) versus a one-third chance that 600 people will be saved; otherwise none will be saved (losses are phrased as the number who die). The gain frame that mentions 200 (of the 600 people) saved might raise the question—what happened to the other 400 people? The sure option could be ambiguous. To account for framing effects, the ambiguity has to be resolved optimistically; at least 200 people will be saved and possibly more, so the sure option is preferred. For the loss frame, the ambiguity has to be resolved pessimistically to account for effects; at least 400 die and maybe more, so the risky option is preferred. Thus, the ambiguity hypothesis requires two different assumptions to account for two data points, which is not parsimonious. Contrary to some arguments, these ambiguous readings of framing problems are not predicted by conversational implicatures but, rather, violate them; for example, if more than 200 people could be saved, the normal pragmatic assumption is that the speaker would have said so. The ambiguity hypothesis also requires that people ignore wording and instructions, such as “exact estimate” and “exactly” 200 people are saved.
However, Mandel (2014) and Kühberger and Tanner (2010) among others have generated evidence suggesting that ambiguity accounts for variance in framing effects. Mandel found, for example, that introducing the word “exactly” eliminated framing effects and adding “at least” to the sure option produced framing effects. But the effects of adding the word “exactly” have not replicated consistently (Chick et al., 2016; Simmons and Nelson, 2013). For example, framing effects are routinely observed when the words “exact” or “exactly” are used in problem information (for meta-analyses, see Broniatowski and Reyna, 2018, and Steiger and Kühberger, 2018). Moreover, experiments that provide instructions to avoid these hypothesized interpretations and explicit tests of how decision makers then interpret framing problems have shown that most pass ambiguity tests (i.e., they do not make the posited inferences about missing numbers, not conforming to the ambiguity hypothesis in any of several versions) and yet show framing effects (Chick et al., 2016; Reyna et al., 2021a).
One broad rationale for the ambiguity hypothesis is that exact numbers are unrealistic, an argument we also made earlier in this article (Geurts, 2013; Kühberger, 1995; Mandel, 2001; Teigen, 2011). However, this does not imply that numbers are interpreted as meaning “at least” as opposed to “at most” or other asymmetric interpretations. Mandel (2014) asserts that “‘at least n’ and ‘exactly n’ should both have the same gist (viz., some),” but this is not true. Fuzzy means that saving 200 people is construed as “about” 200 and that, in one type of representation (the least precise one and thus the favored representation), this amounts to the qualitative category of saving “some people” when it contrasts with the possibility of saving none (Reyna et al., 2021a). “At least” (e.g., 200 or more) or “at most” (e.g., 200 or less) each change the balance of expected values (the literal representations), but they also change meaning in context. This meaning has been distinguished from some versus none in research on numerical quantities in fuzzy-trace theory (Brainerd and Gordon, 1994; Reyna and Brust-Renck, 2020; Thompson and Siegler, 2010).
Part of the difficulty could be misinterpreting the explanation that framing effects depend crucially on categorical gist to mean that only categorical gist is processed. At least three levels of representation are processed—categorical, ordinal, and interval for numbers and inferences, paraphrases, and literal words for sentences—and they each “vote” in determining responses. This assumption explains why responses change predictably when the wording of options changes (e.g., as in the Allais paradox), namely, because different representations discriminate options differently (see Table 1 in Broniatowski and Reyna, 2018, and Figs. 1 and 2 in Reyna, 2012). When categorical representations do not discriminate options, decision makers “revert to” more precise representations in the sense that they then become determinative (Mar and Liu, 2022; Reyna, 2012).
Thus, it is not the case that either verbatim (e.g., numerical) or gist (e.g., nonnumerical) processing occurs. Kühberger and Luger-Bazinger (2016) point out that “In framed gambles, all relevant information is presented—outcomes and their respective probabilities—leaving no ambiguities” and that “everybody knows that exact numerical outcomes are the essence of gambl[ing for money]” (p. 948). They concluded that this implies that gist extraction is unlikely for gambles. However, gist extraction occurs routinely in numerical tasks, as demonstrated in many experiments on the independence of verbatim and gist representations (for a review, Reyna, 2012).
However, there is another important manipulation that has been interpreted as resolving ambiguity that changes framing effects, which concerns us. That “disambiguation” manipulation involves filling in the complementary amount in the sure option (Kühberger, 1995; Kühberger and Tanner, 2010; Mandel, 2001). “Saving 200 people” becomes “saving 200 people and not saving 400 people”; “400 dying” becomes “400 dying and 200 not dying.” As other research suggests, this information is often not unknown (the definition of ambiguity); most people pass tests indicating that they realize that 200 saved implies that 400 are not saved. The “implied” information also is sometimes explicitly given in instructions; thus, it is not uncertain (Chick et al., 2016). Framing becomes attenuated, because this manipulation changes the gist (see Table 1 in Broniatowski and Reyna, 2018).
That is, instead of saving some people (good news), the “sure” option becomes a wishy-washy “good news” and “bad news” saving some people and not saving some people. This option now stacks up as pretty much equivalent to the gamble, which also contains good news and bad news. Naturally, these assumptions apply analogously to decision problems with losses. The roots of fuzzy-trace theory go back to classic findings in psycholinguistics demonstrating similar effects of verbal descriptions (Clark and Clark, 1977). The effects of descriptions also demonstrate the value of distinguishing between literal facts, which do not change across the various transformations of problems that we have discussed (extensional or informational equivalence), and gist representations of those facts that involve interpretation (cf. Fisher, 2022; that construal of semantic features shifts falls out of this approach; Fisher, 2021). Memory research shows that people extract independent verbatim and gist representations of the same stimulus, the ultimate example of informational equivalence (Reyna, 2012).
With framing effects accounted for, and several variations that manipulate the expression of verbatim and gist representations in responses, we now turn to another task that was invented independently (Payne, 2005) and yet elicits the same categorical gist processing. To preview, although gist and affective valence have been mentioned in publications on this task, this article is the first in which these publications are brought together and shown to be critical tests not only of prospect theory (as previously argued) but of fuzzy-trace theory. Indeed, fuzzy-trace theory predicts value-allocation results for choices, ratings, and eye movements and developmental differences between adults and adolescents. We then integrate behavioral results into a preliminary neural model and explore its implications for addiction and other kinds of unhealthy risk-taking.
In the value-allocation task, decision-makers are presented with a series of multiple-outcome gambles (e.g., Venkatraman et al., 2014). Each gamble consists of a large gain outcome, a large loss outcome, and an intermediate outcome that is one of the a small gain, 45, 0.33; 65, 0.33) and in other variations they are unequal (e.g., +15, 0.26; −$80, 0.38). In the latter, adding money to the intermediate outcome has lower expected value than adding money to one of the extreme outcomes (because the intermediate outcome has lower probability). Before value allocation (e.g., before adding money), participants rate the desirability of the gambles (from “least preferred” to “most preferred”), which ensures that they are able to process differences in expected value.
Value allocation occurs in a subsequent phase in which participants choose how to allocate different fixed amounts (e.g., 15 to the intermediate outcome above (to the 45, 0.33; 65, 0.33) increases the probability of winning some money as opposed to no money, which differ categorically, but it does not maximize the amount of gains (Gmax: allocating the 45 option) or minimize the amount of losses (Lmin: allocating the 65 option). The former strategy of winning some money rather than none is noncompensatory and is called Pwin or Pmax, whereas the other two strategies are compensatory, as assumed in prospect and other utility theories. Consistent with fuzzy-trace theory, adults across different experiments preferred the Pwin strategy (e.g., 69% in Venkatraman et al., 2014). The greatest preference for the Pwin strategy occurred when allocations created categorical changes in outcomes from no gain to gain, from loss to no loss, and, most dramatically, from loss to gain. As Venkatraman et al. (2014) explain, “The Pwin heuristic represents a computational simplification for complex gambles that ignores payoff (value) magnitude information and focuses on the ‘gist’ (gain versus loss) of an outcome value” (p. 75), but the connection to theory that predicts this is not made.
As further predicted by fuzzy-trace theory (and described above for framing problems), when the Pwin strategy was not available—when adding money to the intermediate outcome did not increase the chance of winning “something”—choices of that outcome for allocation declined (e.g., from 69% to 41%) and Lmin increased (e.g., from 23% to 44%) (Venkatraman et al., 2014). That is, strategy selection reverted to more precise processing, as exemplified in the compensatory Lmin strategy in which the amount of losses mattered. As in framing problems, when expected values were unequal and thus verbatim representations competed with the Pwin gist strategy, choices of the intermediate outcome declined (e.g., to 52%) but remained substantially higher (favoring gist processing) than the next preferred Lmin strategy (e.g., 36%). (See Table 2 for detailed examples and predictions.) In addition, there were individual differences in gist and verbatim processing that echo those in fuzzy-trace theory studies of decision-making (Reyna and Brainerd, 2011; Reyna and Brust-Renck, 2020; Reyna et al., 2018).Table 2Examples of problems in the value allocation task when expected values of allocation choices are equalI: Core problem pitting fuzzy trace theory’s prediction (Pwin) against cumulative prospect theory’s prediction (Lmin)OutcomeProbabilityChoose one of two allocationsStrategyCategorical gist representationCategorical gist principle350.20**15 = 250.20−15 = −750.20+90GmaxSome gain to some gain.No categorical not preferred.00.20+15PwinNo gain to some gain.Some gain is better than no gain.−750.20III: Pwin unavailable problem indicating fuzzy trace theory’s predictions (Lmin and problem I differs from III) and cumulative prospect theory’s predictions (Lmin and problem I is virtually identical to III)OutcomeProbabilityChoose one of two allocationsStrategyCategoricalgist representationCategorical gist principle350.2015 = 250.20−15 = −60****Lmin;****Problem I differed from Problem III****Some loss to some Revert to more precise representations; see Allais Problem 2 in Reyna & Brainerd,** 2011; **Reyna & Brust-Renck,** 2020.**Losses hurt more than gains feel good (CPT).**IV: Pwin exaggerated problem indicating fuzzy trace theory’s prediction (exaggerated Pwin) and cumulative prospect theory’s prediction (Lmin)Outcome (only total shown)ProbabilityChoose one of two allocationsStrategyCategorical gist representationCategorical gist principle75 + 1450.2070 = 0 + 700.20+85Reference outcome (former Pwin)Some gain to some gain.No categorical not preferred.−70 = 75 + 50.20****+10FTT: Pwin+CPT: LminSome loss to some Gamblebecomes certain gain (possible loss eliminated).****Some gain is better than some loss.****Categorical preferred.**Modal observed preference indicated by bolding (see text). According to fuzzy-trace theory (FTT), uncertainty at the categorical gist level of representation means that an option presents more than one qualitatively different no gain vs. gain, no loss vs. loss, and gain vs. loss. Contrary to Venkatraman et al. (2009, p. 9), the categorical gist explanation here does “apply to risky choice problems that involve only ‘pure’ gain or loss options,” introduced in Reyna and Brainerd (1991). Pwin unavailable problems also rule out expected value and expected utility theory because a small amount added or subtracted from the intermediate outcome does not appreciably change overall value or utility, and yet large differences in preference are observed (per FTT). Additionally, Cumulative Prospect Theory (CPT) predicts that preferences should not change as a function of whether adding money to the intermediate outcome changes its valence (e.g., improving from −10 to 30 to −$10) due to the rank-dependent transformations applied to the extreme outcomes (as long as intermediate outcomes are not higher in probability; Venkatraman et al., 2014, p. 75). However, when the intermediate probability is lowered (not shown), and thus the expected value of the allocation is lower compared with the other option (Gmax or Lmin), Pwin should be avoided according to expected value, expected utility, and CPT, whereas FTT predicts that Pwin remains most preferred though at a smaller margin because of the competing expected value (verbatim) representation (see Allais Problem 1 in Broniatowski & Reyna, 2018; Reyna & Brust-Renck, 2020). Eye tracking and developmental differences further differentiate FTT’s and CPT’s predictions, supporting FTT and ruling out CPT (e.g., Kwak et al., 2015; Payne, 2005; Venkatraman et al., 2014)
The results we have described were comparable to those of a second and third experiment reported by Venkatraman et al. (2014), as well as those of Payne (2005), Venkatraman et al. (2009, 2011), and Kwak et al. (2015), and are reflected in multiple outcome measures used to diagnose strategies, including eye movements. The “huge bias” (p. 85, Venkatraman et al., 2014) toward Pwin choices in Pwin-available trials that was not present in the Pwin-unavailable trials cannot be accounted for by prospect theory, even by tinkering with parameter values to capture individual differences. Evidence from eye tracking also ruled out prospect theory, regardless of assumed parameter values, as well as other attribute-based, noncompensatory, or similar simplification approaches (e.g., the priority heuristic). Together, these results provide evidence of a gist-processing preference that is central to fuzzy-trace theory but which is otherwise a mysterious empirically observed violation of extant decision theories.
The prior section summarized results indicating that most adults prefer a gist processing strategy in the value allocation task, extending fuzzy-trace theory to three-outcome and five-outcome gambles. Not only do adults apparently rely on gist in these tasks but they rely on the same types of categorical gist representations and principles as implicated in critical tests of framing effects and the Allais paradox (some gain is better than no gain, no loss is better than some loss, and some gain is better than some loss; Broniatowski and Reyna, 2018; Reyna, 2012). Kwak et al. (2015) administered the valuation allocation task discussed above to a group of adolescents and a group of young adults. Developmental theories, ranging from the neoPiagetian tradition to contemporary information processing and dual-process approaches, generally predict that the ability to engage in compensatory processing (e.g., computing expected value in which probability and outcomes trade off) increases from childhood to adulthood (Reyna and Farley, 2006). Therefore, most theories suggest that adults would be more (or perhaps equally) likely to engage in compensatory processing (e.g., Lmin) than adolescents but certainly not less likely. Kwak et al. (2015) found the opposite.
Adolescents were significantly more likely to choose in accordance with the compensatory Lmin strategy than adults. Although the Pwin categorical gist strategy was the most popular for both age groups, it was more popular among adults than adolescents. Contrary to most developmental theories, adolescents with higher cognitive capacity were more likely to choose in accordance with Pwin (see Kogut and Slovic, 2016, for a similar result). Moreover, analyses of eye movements confirmed and expanded this account. Consistent with predictions and prior findings of fuzzy-trace theory (e.g., comparing children to early adolescents, Reyna and Ellis, 1994, and adolescents to adults, Reyna et al., 2011), Kwak et al. (2015) found that adolescents processed more information and processed it more deliberatively (e.g., greater number, more evenly distributed, and longer fixations). The patterns of fixations for adolescents—but not adults—were compatible with prospect theory and other utility theories (i.e., adolescents had a higher “Payne index” indicative of expected value processing). This developmental finding of objectively superior performance in younger (children and adolescents) compared with older samples (young and middle-aged adults) has been dubbed “developmental reversal” in fuzzy-trace theory, because it reverses typical developmental expectations, reflecting the growth in gist processing with development (Reyna et al., 2014). Thus, adolescents are likely sensitive to rewards, but their risk-taking in real life is not attributable to overvaluing rewards by itself (Edelson and Reyna, 2021) but rather the all-too-rational combination of risk (which is in fact low in many common circumstances) and reward (which is in fact high in those circumstances). Indeed, as we discuss below, brain and behavioral results buttress the hypothesis that adolescents are more sensitive to these risk-reward tradeoffs in decision-making than adults are.
We begin this section by briefly reviewing the neural substrates of the distinct types of processing that we have just discussed in adults and adolescents. We then integrate these findings with those concerning decision-making generally into a preliminary neural framework and develop its implications for addiction and other problem behaviors. To be sure, our conclusions oversimplify a more complex picture. Although it has been widely acknowledged that differential activation takes a snapshot of a dynamic system and this neural characterization is incomplete, an often-overlooked shortcoming of neuroscientific data is the inability to connect specific strategies to specific patterns of activation because of task confounds (see Edelson and Reyna, 2021). Shortcomings go beyond adding process measures, such as eye tracking or EEG, although they help. Too much inference from brain to behavior is a problem but so is not enough inference. We attempted to rectify that imbalance with a provisional framework, because understanding the behavioral functions of the brain is indispensable for basic science and applied goals, such as addressing addiction. We dwell on process assumptions, because they are the key to making scientific progress in this area.
In traditional approaches to decision neuroscience, the focus is generally on tradeoffs because the expected utility model—that defines preferences in terms of tradeoffs—is For probabilistic uncertainty, a safer lower-value option is typically pitted against a riskier higher-value option. For temporal uncertainty, a sooner lower-value option is typically pitted against a later higher-value option. Activation in brain regions is associated with choices in probabilistic paradigms. As examples, increased activation in the anterior insula follows risk-averse choices (Paulus et al., 2003; Preuschoff et al., 2008) and increased activation in the ventromedial prefrontal cortex (VMPFC) and striatum predicts risk-seeking choices (Kuhnen and Knutson, 2005; Reyna and Huettel, 2014; Tobler et al., 2007). Risk-seeking choices necessarily involve higher reward values in tradeoff designs, which implicates reward processing. VMPFC and ventral striatum (VS) encode positive values, such as reward magnitude, with increasing activation, and VMPFC, orbitofrontal cortex (OFC) and posterior parietal cortex (PPC) encode negative values, more aversive values, with decreasing activation. Lateral prefrontal and parietal regions support executive control processes associated with risky decisions, risk evaluation, risk propensity, and judgments about probability and value (Barraclough et al., 2004; Glimcher, 2022; Huettel et al., 2005; Paulus et al., 2001; Sanfey et al., 2003). Individual differences in risk preferences vary with resting-state EEG during wakefulness (Gianotti et al., 2009; Studer et al., 2013) and with slow-wave activation during sleep, both over the right prefrontal cortex (Studler et al., 2022).
Using functional magnetic resonance imaging (fMRI), Venkatraman et al. (2009) studied an incentive-compatible version of the value allocation task, which as we noted above, identifies three types of decision maximizing the magnitude of gains (Gmax), minimizing the magnitude of losses (Lmin), and changing losses or nothing to wins (Pwin). Gmax and Lmin choices reflect compensatory choices, as they increase the magnitude of the largest possible gain or decrease the magnitude of the largest possible loss, respectively, increasing overall subjective value. In cumulative prospect theory, a further wrinkle is added in that extreme outcomes (those that rank best and worst) are given greater weight and extreme losses are especially aversive, favoring the Lmin strategy in this task. (Rank dependence matters when probabilities of each potential outcome are equal.) Rank dependence is consistent with neural activation data. High activation for both high rewards and high punishments is thought to be encoded in “salience” representations. The salience network includes the ventral striatum, dorsal anterior cingulate cortex, anterior insula, temporoparietal junction, and the amygdala (Kahnt et al., 2014; Levy and Schiller, 2021). However, crucially, cumulative prospect theory does not accommodate the Pwin strategy.
In contrast to compensatory tradeoffs, as discussed, Pwin choices follow a gist-based simplifying strategy to increase the chances of a gain compared to a loss irrespective of reward magnitude. In addition, some problems—Pwin-exaggerated—allow for conversion of uncertain wins to certain wins (and certain losses to uncertain losses). Following the same gist-based rationale per our earlier discussion of uncertainty, a certain win is categorically better than an uncertain win and an uncertain loss is categorically better than a certain loss. Ergo, most adults are predicted to forgo maximizing utility in order to achieve these gist-based categorical conversions (as observed). Expected utility (or expected value) is computed in parallel and, especially for individuals high in numeracy and in literal processing, can offset gist strategies as options become more disparate (but the size of numerical differences is generally not the ultimate arbiter; Broniatowski and Reyna, 2018; Reyna and Brainerd, 2011; Reyna and Brust-Renck, 2020).
Ad hoc (auxiliary) assumptions about regret are not required to explain the prevalence of gist-based phenomena, such as the Pwin strategy (memory, reasoning, and psycholinguistic research support it). Assumptions about aspiration levels are not required, but hypotheses about aspiration level might be profitably combined with gist representations to produce novel predictions (e.g., Coricelli et al., 2018). Contrary to Payne (2005), Venkatraman et al. (2009), and others, the Pwin strategy is an important part of “a general-purpose model of risky choice that is consistently applied across all conditions and contexts” (p. 75). The order of emphasis of strategies—emphasizing the least precise (categorical) distinctions and relying on more precise distinctions if needed (e.g., in Pwin-unavailable trials)—is the opposite of other cognitive theories (i.e., they assume precise processing as a default, which breaks down under cognitive load). This fuzzy-processing principle explains the otherwise theoretically unmotivated Pwin decision-makers focus on categorical gist and “if no option improves the overall probability of winning or not losing, individuals should shift to other [more precise] strategies to decide between the alternatives.” (Venkatraman et al., 2014, p. 75).
Supporting this process analysis, Venkatraman et al. (2009) found greater activation for compensatory choices (Gmax and Lmin) in the anterior insula (greater for Lmin) and VMPFC (greater for Gmax), areas associated with affective evaluation of decision outcomes. In contrast, Pwin choices resulted in increased activation in the dorsolateral prefrontal cortex (DLPFC) and PPC, which were significantly greater than those for Gmax and Lmin. These regions (DLPFC and PPC) are typically associated with executive functions and decision making. Interestingly, the behavioral data showed that Pwin choices were associated with faster response times (Venkatraman et al., 2009), which contradicts classical assumptions of effortful prefrontal control. Also arguing against a cognitive effort explanation, sleep deprivation did not increase Pwin strategies but rather increased Gmax, consistent with other studies showing increased risk taking (and reward chasing) after sleep deprivation (Venkatraman et al., 2011). Interestingly, consistent with a less-sleep-less-gist hypothesis, other research on gist representations in memory show that gist processes are reduced after sleep deprivation (i.e., sleep increased false recall of meaning-consistent words; Payne et al., 2009; Pardilla-Delgado and Payne, 2017).
Using functional connectivity analyses, Venkatraman et al. (2009) also showed that, when individuals made Pwin choices, connectivity with DMPFC increased in DLPFC and PPC, whereas when individuals made compensatory choices, connectivity with DMPFC increased in the anterioir insular (and amygdala), although not in VMPFC. Moreover, the relative strength of the connectivity between DMPFC and these regions was significantly associated with individual differences in strategy preferences across individuals. Overall, activation in the DMPFC did not predict either type of choice, but it predicted decisions that were inconsistent with the preferred decision strategy, typically shifts from a noncompensatory Pwin strategy to a compensatory Lmin strategy.
Venkatraman et al. (2009) also examined whether a neural substrate of reward processing could predict strategic preferences. At the end of the scanning session, each participant viewed some of their “improved” gambles, which were resolved to actual monetary gains or losses. While participants were anticipating the outcome of each gamble, there was increased activation in the ventral striatum (VS)—a brain region commonly implicated in expectation and processing of positive and negative rewards (e.g., Speer et al., 2021). Then, when the outcome was experienced, VS activation increased to gains but decreased to losses. Paradoxically from traditional perspectives, those individuals who showed the greatest VS increases to gains and decreases to losses preferred the simplifying Pwin strategy. Their brains indicated that they were more sensitive to magnitudes of rewards, compared with others, and yet they eschewed choices that maximized rewards. These results are consistent with fuzzy-trace theory’s tenet that the use of gist-based simplifying strategies is accompanied by application of values (social, moral, and monetary) that reflect affective valence (Broniatowski and Reyna, 2018; Reyna, 2021). That is, the gist representation of options—gaining some money versus either gaining some money or gaining nothing—requires applying simple values, such as “gaining money is good” to elicit a preference, apparently a response supported by the VS.
As discussed earlier, developmental differences also offer an opportunity to examine strategic variations in mental representations—verbatim and gist—as well as changes in reward processing over time. Table 3 presents illustrative findings concerning adolescent decision and reward processing, and comparisons to children and adults in some studies. The studies vary in methodology and analyses, thus making conclusions preliminary (see also Defoe and Romer, 2022, summarizing a recent special issue on developmental differences in risky decision making). Many studies echo the results that we have reviewed thus far with respect to the brain, including sensitivity to risk (e.g., activation in DMPFC and insula), sensitivity to overall subjective value (e.g., activation in VMPFC and OFC), and heightened sensitivity among adolescents to reward (e.g., activation in VS or a subarea of VS, the nucleus accumbens, or caudate, but see Bjork and Paldini, 2015). DLPFC seems again to reflect executive function, including learning, and subjective value (although inconsistently).Table 3Illustrative developmental neuroscience findings about decision and reward processing under uncertaintyStudySampleTaskMain findingsvan Duijvenvoorde et al. (2015)n = 72 after exclusions, ages 8-35 yrfMRI version of Columbia Card Task: in each round, 6 to 16 cards shown face-down. Participants explicitly told total number of cards, number of loss cards (from 1-8), gain amount for each gain card (from 1-30), and loss amount for turning over loss card (from −5 to −100). Running total of points shown. Each round participant makes a series of binary decisions to turn over another card or not. Game ends when participant decides to stop turning over cards or turns over a loss card. Probability and amounts vary per round. Task performed in and out of scanner.Return (EV) = gain probabilitygain amount + loss probabilityloss amountRisk (SD) = sqrt(gain probability*[gain amount – EV] ^2^ + loss probability*[loss amount - EV]^2^)Included risk and return as parametric regressors and gain and loss outcomes and discrete regressors. Age-related changes in neural activation with parametric gains also evaluated.Behavioral Adolescents and adults took fewer cards as risk increased.Children, adolescents, and adults took more cards as returns increased.fMRI whole brain For risk, adolescent peak in activation in right anterior insula into inferior frontal gyrus and DMPFC; also bilateral caudate.Risk-related activation in thalamus and superior frontal gyrus for all age groups and de-activation in left prefrontal and bilateral parietal areas.Adolescents behavioral risk sensitivity negatively associated with neural activation in DMPFC and insula.Return-related activation in VMPFC increased linearly with age, as did medial OFC and subcallosal ACC and posterior cingulate cortex (PCC). Adolescent-specific activation in visual cortex and right superior parietal cortex.Higher return-sensitivity from behavioral session associated with greater VMPFC and PCC activation as well as superior parietal cortex.For gain > baseline, thalamus and striatal activation increased with increasing gains.Barkley-Levenson & Galván (2017)n = 51, 25 adolescents and 26 young adultsEye blink rate as proxy for striatal dopamine receptor function.Roulette Game, a novel version of value allocation task. “Wheel” (pie chart) gambles with a 1/3 probability of gaining money (ranging from +8), a 1/3 probability of losing money (ranging from −8.50) and a 1/3 probability of receiving 1 to 0.20 / −1.00 / −15). 24 blocks (each block was either high or low stakes) presented randomly; for each choice, 1.5 s to decide and feedback for 1 s.fMRI • Gain magnitude high vs. low (+0.20): bilateral VS (nucleus accumbens), dorsal striatum (caudate). For age trend—no regions significant for linear or quadratic predictors but for exploratory analyses using striatum mask, linear trend revelated—greater magnitude tracking in younger participants within right caudate, decreased with age.• Loss magnitude high vs. low (−0.10): right insula, right frontal pole, right middle frontal gyrus, bilateral cingulate, bilateral thalamus. For age trend, inverted-U (though in mid-adolescence)—significant activity in right anterior insula.• Reward gains vs. losses (collapsing over magnitude): ventral striatum (nucleus accumbens), dorsal striatum (caudate and putamen), cingulate, OFC, precuneus. No regions significant for age-related trends.Schreuders, Braams et al. (2018)n = 287, 8-29 yr(part of “Braintime”)Looked at adolescents younger than aged 16 yr and aged 16 yr and olderHeads-or-tails gambling gameGuessed heads or tails on each trial; correct guess = win coins, incorrect guess = lose coins. Always 50% chance of winning. Incentive compatible.From participants start with 10 coins. Could win 3 or lose 3; win 5 or lose 3; win 2 or lose 5.No sure option.Other BIS/BAS and pleasure from winning/losing.Used anatomical mask for NAccAge-related NAcc activation for win > lose peaked around age 15.Pleasure from winning – losing declined linearly with age.For BAS subscales, mainly cubic trend (except linear increase for females with BAS drive).For younger adolescents (under 16), stronger BAS drive scores associated with greater activation in NAcc in Win > Lose.For older adolescents (16 and older), more pleasure from winning vs. losing associated with greater activation in NAcc in Win > Lose.Blankenstein & van Duijvenvoorde (2019)n = 188 (after exclusions)[part of “Braintime”]fMRI: Wheel of Fortune task same as above.Behavioral: version of wheel of fortune task but more probabilities (0.125, 0.25, 0.375, 0.5, 0.625, 0.75) and amounts (5€, 8€, 20€, 50€) and different ambiguity levels (0%, 25%, 50%, 75%, 100%). Used model-based estimation of risk and ambiguity attitudes. No decision outcomes provided. 24 risk trials, 16 ambiguity trials (both presented twice = 80 total trials). Power utility function used to estimate risk and ambiguity attitudes.Participants did fMRI task first, then behavioral task.Subjective value under risk and ambiguity in fMRI task calculated based on risk and ambiguity attitudes from behavioral task.Model-based risk and ambiguity risk seeking increased with age, no age effects observed for ambiguity. Risk and ambiguity attitudes not correlated.Behavior in fMRI no age effects for gambling in risky or ambiguous situations.Risk seeking attitude (from behavioral task) positively correlated with gambling under risk and ambiguity in fMRI task. Ambiguity seeking attitude positively correlated with gambling under ambiguity in fMRI task.fMRI • Subjective value under Increased activation in bilateral VS, bilateral superior parietal cortex, postcentral gyrus, mid-cingulate cortex, and SMA with increasing subjective value. Decreased activation with DMPFC and right inferior parietal lobe with increasing subjective value.• Subjective value under decreased activation in DMPFC, bilateral DLPFC, right superior temporal gyrus, and bilateral IPL with increasing subjective value.• Conjunction analysis – decreasing activation in DMPFC with subjective value (both risk and ambiguity).• Greater activation in DLPFC and parietal cortex for subjective value under risk than ambiguity.• No effects of age parametric tracking of subjective expected value under risk and ambiguity.Compare with Levy et al. (2010)—striatum and medial PFC represented subjective value under risk and ambiguity. (n = 22, ages 19-35 yr); different task.Korucuoglu et al. (2020)n = 256 (after exclusions) adolescents (aged 12-15 yr)Adjusted BART• Out-of-scanner earn 0.05; for 12^th^ pump, 89.6% chance of exploding and 5.15 reward).“Risk” defined as increasing probability of balloon popping AND increasing potential reward (probability of loss and reward confounded).Choosing to inflate balloon (“risky decisions”) associated with regions in salience, dorsal attention, and frontoparietal networks but only insula sensitive to increasing “risks” (increasing probability of popping and increasing magnitude of reward) in parametric analyses.Similar networks covaried with level of risk for risk-averse decisions (cashing out).Dorsal striatum engaged when choosing to inflate and cash out; not sensitive to level of “risk.”ROI, not whole brain, approach used for fMRI analyses.Blankenstein, Telzer et al. (2020)*n* = 210 at T3, 8-29 yr(part of “Braintime”)Structural MRI (no task). ROIs: NACC and MPFC (superior frontal, rostral anterior cingulate, caudal anterior cingulate)Other ARQ rebelliousness subscale, Prosocial behavior, BIS/BAS, Interpersonal Reactivity Index, Intention to ComfortProsocial behavior and ARQ rebellious behavior at T3 positively correlated. BAS fun seeking predicted both behaviors.Greater reductions in MPFC volume associated with lower levels of ARQ rebellious behavior at T3 (effect remained significant when prosocial behavior added to model).Braams, Davidow, & Somerville (2021)*n* = 65 after exclusions, 14-22 yrChoice between 5 for sure or a risky lottery that was either low or high magnitude (chance of 3 to $76). Chance of winning in lottery varied from 20 to 80%.Ambiguity by covering party of lottery bar; varied between 0 and 80% covered proportionally based on change of winning.Risk tolerance and ambiguity aversion estimates for each participant derived through computational modeling framework. Choices presented in solo or peer condition (social safe or social risky).108 trials presented in scanner (ambiguity levels 0%, 40%, and 80%); 72 additional trials presented outside scanner (ambiguity levels 20% and 60%).On some trials participants saw choices of “peers.” Risky peer made 75% risky choices and 25% safe; Safe peer made 75% safe choices and 25% risky.Unequal expected value; lottery had higher EV in 70% of trials.Behavioral participants chose risk option more in social risky compared with solo and less in social safe compared with solo.Computational increased risk tolerance in social risky condition and decreased risk tolerance in social safe condition; changes in risk tolerance not related to age.For ambiguity aversion, not impacted by social condition and no age-related differences.fMRI Social > solo whole activation in temporoparietal junction and precuneus.• Increased activation with increased riskiness in VS and ACC• Increased activation with decreased riskiness in occipital cortex.• Increased activation with increased ambiguity in precuneus, superior frontal gyrus.• Increased activation with decreased ambiguity in temporal pole and supramarginal gyrus.Social risky > activation in left MPFC higher for participants who showed higher difference in risk tolerance between social risk and solo.Publications are ordered chronologically. fMRI = functional magnetic resonance imaging; VS = ventral striatum; NAcc = nucleus accumbens; ACC = anterior cingulate cortex; PCC = posterior cingulate cortex; PPC = posterior parietal cortex; IPL = inferior parietal lobe; VMPFC = ventromedial prefrontal cortex; DLPFC = dorsolateral prefrontal cortex; SMA = supplemental motor area; ARQ = Adolescent Risk Questionnaire; BIS = Behavioral Inhibition Scale; BAS = Behavioral Activation Scale
Summarized in Table 3, Barkley-Levenson and Galván (2017) used a modified version of the critical value allocation task, which allows some differentiation of strategies. Eye blink rate was used as a proxy for striatal dopamine receptor function (but see Dang et al., 2017). Consistent with the adolescent ventral striatum’s hypersensitivity to reward observed with neuroimaging, eye blink rate was associated with increased use of the compensatory Gmax (reward seeking) strategy for adolescents—but not for adults. Indeed, adolescents were more sensitive to increases in gains than adults were, replicating findings for expected value in neuroimaging research (Barkley-Levenson and Galván, 2014) as well as the behavioral results reviewed earlier (e.g., Kwak et al., 2015).
Although sensitivity to reward is a hallmark of neural imbalance theories of adolescent risky decision making, the theory does not predict that adults would be less deliberative and less likely to use compensatory strategies compared with adolescents. Fuzzy-trace theory predicts the latter effects (see also Niebaum et al., 2022) and accounts for linear developmental trends in risk preference observed in meta-analyses (Defoe et al., 2015). In this view, VS “provide[s] cost and benefit signals necessary for verbatim-based processing engaged more heavily in adolescence; greater EBR [eye-blink rate] in this model could reflect greater reliance on verbatim-based relative to gist-based processing and would therefore correlate with increased focus on reward magnitude” (Barkley-Levenson and Galván, 2017, p. 8). In this role, VS would reflect reward valuation as opposed to salience.
As van den Bos et al. (2015) argue, impatient or impulsive choices in the delay discounting task can result from valuing immediacy of rewards (present bias) or discounting the future. The VS seems to reflect what is in this instance, not the larger reward as in probabilistic decision making but the immediate reward. In this connection, van den Bos et al. (2015) report that adolescents are more impatient than adults, but this was not tied to reward valuation directly (“hedonism”). As development proceeded from adolescence to adulthood, falling discount rates reflected increased structural connectivity with DLPFC and increased functional connectivity (negative coupling) between DLPFC and VS. Thus, developmental differences were attributed to maturation of executive functions, such as cognitive control and greater future orientation.
More generally, when rewards are offered immediately, a single value-related signal has been identified at two the ventral striatum (VS) and the ventromedial prefrontal cortex (VMPFC) (McClure et al., 2004). Later rewards do not easily elicit this reward-related signal. When decision-makers take longer to respond, thought to reflect patient choosing, activation has been observed in the DLPFC and the PPC. This work has been interpreted as evidence for a beta (impatient) module and an independent delta (patient) module predicted by theory. However, independence has been challenged by findings that increasing rewards in the later option elicited activation in regions partial to immediacy, VS and the VMPFC (Kable and Glimcher, 2007).
As we argued at the outset, and as suggested by the brain activations associated with each, probabilistic uncertainty and temporal uncertainty seem to share processing components. The effects of manipulating the presence or absence of zero (or “nothing”) to induce shifts in gist (categorical “something vs. nothing” contrasts in decision problems) or verbatim processing (computing expected value or utility) has been used in both probabilistic decision making and temporal discounting tasks (Reyna et al., 2014, 2021; Zhang and Slovic, 2018). For example, in temporal discounting tasks, making hidden zeros explicit increases a sooner smaller reward but nothing later versus a larger later reward but nothing now (Rahimi-Golkhandan et al., 2017). This good-news/bad-news explication seems to create more decision conflict for impulsive choosers than an objectively identical formulation without the explicit zeros that may be processed at a more fine-grained level.
Consistent with this framework, repeated Transcranial Magnetic Stimulation (rTMS) to the DLPFC (which takes that region offline temporarily) in a delay discounting task had two different kinds of effects (Ballard et al., 2018). Large magnitudes (presumably because they make the delayed option differentially attractive relative to the immediate option) and explicit zero manipulations (presumably because they change the gist) reduced discounting (choosing the sooner option) relative to control groups. However, rTMS to DLPFC reduced both the magnitude effect relative to baseline and reduced the hidden zero effect relative to baseline; the latter effect was “unanticipated” by Ballard et al. (2018). These effects are consistent with the idea that DLPFC encompasses both gist representations as found by Venkatraman et al. (2009) and other higher order mental functions, such as cognitive control and associated inhibition (Ballard et al., 2018; Figner et al., 2010).
Figure 3 brings together many of the components that we have reviewed (and others we have not). A major novel aspect of the framework is combining fuzzy-trace theory with research from alternative theories, including major decision theories, such as prospect theory and similar expected utility approaches. The implications of the framework can be illustrated by the example of addiction. Addiction often is initiated in adolescence or young adulthood and is thought to reflect heightened attraction to reward and immature cognitive control systems (including impulsivity and delay discounting, Amlung et al., 2017). As shown in the figure, these factors are likely to play a role in initiation that has been documented, although confounds plague this literature due to the difficulties of pulling apart factors, such as risk opportunity, risk preference, reward valuation, impatience/impulsivity, and underdevelopment of cognitive control and inhibition (Romer, Reyna, and Satterthwaite, 2017).Fig. 3Provisional integrative framework for probabilistic and temporal uncertainty. Black text = probabilistic uncertainty and valuation tasks. Blue text = temporal uncertainty tasks. Red text = tasks that discriminate gist strategies Badre & Wagner, 2004; Ballard & Knutson, 2009; Canessa et al., 2013; Cooper et al., 2013; Cox et al., 2019; Dixon & Christoff, 2014; Dorris & Glimcher, 2004; Droutman et al., 2015; Figner et al., 2010; Frost & McNaughton, 2017; Hare et al., 2009; He et al., 2016; Jocham et al., 2014; Kable & Glimcher, 2007, 2010; Kahnt et al., 2011; Knoch et al., 2006; Kolling et al., 2012; Liston et al., 2006; Ludwig et al., 2015; Mahler et al., 2009; Manuel et al., 2019; Massar et al., 2015; McClure et al., 2004, 2007; Monterosso et al., 2007; Peters & Büchel, 2009, 2010, 2011; Pochon et al., 2008; Reyna & Huettel, 2014; Rodriguez et al., 2015; Rushworth et al., 2012; Schonberg et al., 2011; Schüller et al., 2019; Sellitto et al., 2016; Singer et al., 2009; Steinbeis et al., 2012; Venkatraman et al., 2009; Wittmann et al., 2007; Wood et al., 2014; Zalocusky et al., 2016
The core brain areas associated with probabilistic and intertemporal decisions largely overlap with those assumed to play a crucial role in the development and maintenance of addictive disorders (Brand, 2022; Volkow and Baler, 2015). Volkow and Baler (2015) proposed the so-called “NOW vs. LATER circuits” crucially involved in addiction and other pathologies. Consistent with our framework, cortical regions, especially DLPFC, MPFC, VMPFC, OFC, and ACC, and subcortical regions, especially dorsal and ventral striatum are assumed to be involved in NOW vs. LATER decisions. Main processes are driven by tonic dopamine signals in the DLPFC (favoring choices for later rewards) and phasic dopamine signals triggering VMPFC and ventral striatum leading to choices of immediate rewards (but see Kable and Glimcher, 2010). Several signals from other regions, including OFC, insula, and amygdala, interact with the circuits and mediate through the processing of internal states, experiences, and information/estimation about possible alternative options and their associated levels of uncertainty. It is assumed that repeatedly choosing immediate gratifications (e.g., drugs, instant lotteries, or highly processed food) can reinforce preexisting vulnerabilities in the two circuits.
Research on substance related and nonsubstance related addictions as well as animal models suggest that, during the development of addiction, there is a shift from involvement of ventral to dorsal striatum related circuits (Brand et al., 2019; Fineberg et al., 2010; Zhou et al., 2018). Brand (2022) assumes the ventral striatum to be especially involved in early stages of the addiction process as part of the so-called “feels better” path characterized by positive and negative reinforcement mechanisms and related reward expectancies. In later stages, the dorsal striatum is assumed to be more and more involved as part of the additional “must do” path associated with compulsive, habitual behaviors. The DLPFC and other regions associated with self-control are engaged in the “stop now” process, which is assumed to counteract the two paths (Brand, 2022).
Clinical implications mostly point to the importance to reduce discounting by improving self-control and reducing impulsivity. However, there might be other routes to reduce vulnerability to addiction (addressing similar networks, but less effortful strategies) as we discuss below. The DLPFC may play a crucial role here. As stated earlier, this region is not only involved in inhibition and other higher-order cognitive control, but it also is associated with decisions reflecting gist representations and affectively valenced principles. Accordingly, simple gist-based strategies could counteract the driving paths to addiction (also on a neural level) and support health-promoting choices.
From this fuzzy-trace-theory based foundation, various practical implications can be derived, including implications for interventions and public health communications (e.g., Reyna and Farley, 2006; Reyna, 2018; Wolfe et al., 2015). Principles of fuzzy-trace theory can be used to design the content of prevention and intervention programs by presenting (additional) information in a gist-promoting way (supporting avoidance of unhealthy risks) that is consistent with people’s preexisting values, thereby reducing reliance on policy mandates. For example, following up on Reyna and Mills (2014) on interventions for reducing sexual risk, addiction prevention programs could add information on the basic bottom-line meaning of decision options in addition to the exact numbers on risks. At the policy level, it can be inferred that instead of dictating “right” choices or trying to change people’s values, another path can be taken to promote healthy choices. Presenting the gist of possible options in an accurate and understandable way can enable individuals to link the decision to their own relevant values, which in turn promotes (self-generated) advantageous decisions and sustainable positive impact on behavioral outcomes.
An important factor that we have not discussed in detail is that adolescence and young adulthood are periods of exploration in which risky behaviors are initiated despite ambiguity (Tymula et al., 2012). That is, adolescents are primed to approach ambiguity rather than to be averse to it, an attraction to uncertainty that is not typical of other stages of life. Initiation of substance use seems to be a function of such willingness to approach despite uncertainty, plus reward and control factors, but also because of the public health paradox to which young people are more susceptible. As we have discussed, adolescents are more likely to weigh risk against reward and to process them using compensatory strategies. This “rationality bias” makes them vulnerable to normatively rare but individually catastrophic outcomes, such as addiction.
Additionally, in adolescence there is a peak in sensation seeking and reward sensitivity (Galván, 2013; Reyna et al., 2011; but see Insel and Somerville, 2018; van Duijvenvoorde et al., 2014), which may lead to (the subjective value of) the experience of immediate reward outweighing the uncertainty caused by potential risks. Ambiguity seeking also could trigger experimenting with drugs, because one does not know what (possibly very rewarding event) one is missing. However, neither reward seeking nor ambiguity seeking is sufficient by themselves to explain developmental differences in risk preference. Major developmental trends and prediction of risky behavior are linked to increasing emphasis with development on categorical gist in risky decision making—such as it only takes once to get HIV-AIDS. What begins in experimentation can progress to addiction much like a bullet fired in Russian roulette, a low probability event. It is low probability, because most adolescents escape the phase of experimentation, especially if they have mitigating factors, such as higher levels of cognitive control or lower levels of attraction to reward.
Our framework suggests that there is another System—a System 3 approach to reducing vulnerability to addiction, including inducing categorical gist thinking about risk, that is distinct from the difficult tasks of trying to modify either System 1 unthinking attraction to reward or System 2 deliberation and cognitive control (Reyna and Mills, 2014). This approach harnesses gist-based intuition as advanced but automatic cognition; grounded in research on learning and memory, it suggests methods for recognizing gist and encouraging retrieval of relevant values in context, processes that can operate largely unconsciously. We see enormous potential in bringing together the process mechanisms of fuzzy-trace theory with etiological process models of addiction for deriving more effective prevention and intervention programs. This approach would not necessarily seek to change the level of perceived risk in a verbatim sense, but it should decrease risk-taking when probabilities of adverse events are low and uncertain but outcomes are catastrophic—bridging a predictable gap in risk communication between policymakers and the public.
In this view, the processes of the DLPFC may consist of more than white-knuckled self-control but, rather, reappraising risky situations and connecting them more clearly to salient affective valence (simple good-bad signals) and social values. Results also suggest that what is rewarding undergoes reappraisal with development and experience, so that what is patient and in the future becomes more highly valued.
More generally, it is time to reevaluate traditional ways of thinking about uncertainty whether probabilistic or temporal. Evidence about anomalies in choice and valuation need to be integrated with major theories of decision-making to better develop interventions that preserve well-being. The meaningful categorical gist of decisions is not a one-off strategy for solving toy problems but is how mature decision-makers approach most decision problems by default. Communicating effectively with those decision makers requires understanding their perspective.