Orbital prefrontal cortex and guidance of instrumental behavior of rats by visuospatial stimuli predicting reward magnitude

The orbital prefrontal cortex (OPFC) is part of a circuitry mediating the perception of reward and the initiation of adaptive behavioral responses. We investigated whether the OPFC is involved in guidance of the speed of instrumental behavior by visuospatial stimuli predictive of different reward magnitudes. Unoperated rats, sham-lesioned rats, and rats with bilateral lesions of the OPFC by N-methyl-D-aspartate (NMDA) were trained in a visuospatial discrimination task. The task required a lever press on the illuminated lever of two available to obtain a food reward. Different reward magnitudes were permanently assigned to lever presses to respective sides of the operant chamber; that is, responses to one lever (e.g., the left one) were always rewarded with one pellet and responses to the other lever with five pellets. On each trial, the position of the illuminated lever was pseudorandomly determined in advance. Results revealed that OPFC lesions did not impair acquisition of the task, as the speed of conditioned responses was significantly shorter with expectancy of a high reward magnitude. In addition, during reversal, shift and reshift of lever position–reward magnitude contingencies and under extinction conditions, performance of the OPFC-lesioned and control groups did not differ. It is concluded that the OPFC in rats might not be critical for adapting behavioral responses to changes of stimulus–reward magnitude contingencies signaled by visuospatial cues.     

Parallel acquisition of awareness and trace eyeblink classical conditioning

Trace eyeblink conditioning (with a trace interval ≥500 msec) depends on the integrity of the hippocampus and requires that participants develop awareness of the stimulus contingencies (i.e., awareness that the conditioned stimulus [CS] predicts the unconditioned stimulus [US]). Previous investigations of the relationship between trace eyeblink conditioning and awareness of the stimulus contingencies have manipulated awareness or have assessed awareness at fixed intervals during and after the conditioning session. In this study, we tracked the development of knowledge about the stimulus contingencies trial by trial by asking participants to try to predict either the onset of the US or the onset of their eyeblinks during differential trace eyeblink conditioning. Asking participants to predict their eyeblinks inhibited both the acquisition of awareness and eyeblink conditioning. In contrast, asking participants to predict the onset of the US promoted awareness and facilitated conditioning. Acquisition of knowledge about the stimulus contingencies and acquisition of differential trace eyeblink conditioning developed approximately in parallel (i.e., concurrently).     

Operant modulation of low-level attributes of rule-governed behavior by nonverbal contingencies

A low-level and nonsalient attribute of behavior (i.e., speed of pressing) was subjected to differential nonverbal operant reinforcement when rules governed a high-level attribute of that behavior (i.e., counting by means of key presses). Unknown to the subjects, reinforcers depended on reduced (slow group) or increased (fast group) speed of pressing rather than on the correct number of presses. The reinforced attribute was modulated according to the arranged speed contingencies independently of the instructed task and independently of subjects' awareness of the critical contingency. A control group receiving random reinforcers demonstrated no systematic speed changes. Possible mechanisms related to behavior changes of this type were examined and discussed, and it was concluded that the behavior changes observed in this situation could be attributed to operant conditioning. The results substantiate the assumption that nonverbal operant contingencies may modulate low-level and nonsalient attributes of rule-governed behavior.     

Processing of probabilistic information in weight perception and motor prediction

We studied the effects of probabilistic cues, i.e., of information of limited certainty, in the context of an action task (GL: grip-lift) and of a perceptual task (WP: weight perception). Normal subjects (n = 22) saw four different probabilistic visual cues, each of which announced the likely weight of an object. In the GL task, the object was grasped and lifted with a pinch grip, and the peak force rates indicated that the grip and load forces were scaled predictively according to the probabilistic information. The WP task provided the expected heaviness related to each probabilistic cue; the participants gradually adjusted the object’s weight until its heaviness matched the expected weight for a given cue. Subjects were randomly assigned to two groups: one started with the GL task and the other one with the WP task. The four different probabilistic cues influenced weight adjustments in the WP task and peak force rates in the GL task in a similar manner. The interpretation and utilization of the probabilistic information was critically influenced by the initial task. Participants who started with the WP task classified the four probabilistic cues into four distinct categories and applied these categories to the subsequent GL task. On the other side, participants who started with the GL task applied three distinct categories to the four cues and retained this classification in the following WP task. The initial strategy, once established, determined the way how the probabilistic information was interpreted and implemented.     

Selection of gait parameters during constrained walking

It is commonly thought that at prescribed speeds humans choose gait parameters that minimize the cost of transportation. However, it is unclear whether and how the relationship between step length and step frequency is affected by the additional physiological factors caused by constraints. We performed a series of experiments to understand the selection of gait parameters under different constraints from a probabilistic perspective. First, we show that the effect of constraining step length on step frequency (i.e., monotonically decrease, Experiment I) is different from the effect of constraining step frequency on step length (i.e., inverted-U, Experiment II). Using the results from Experiment I and II, we summarized the marginal distribution of step length and step frequency and built their joint distribution in a probabilistic model. The probabilistic model predicts the selection of gait parameters by achieving the maximum probability of joint distribution of step length and step frequency. In Experiment III, the probabilistic model could well predict gait parameters at prescribed speeds, and it is similar to minimizing the cost of transportation. Finally, we show that the distribution of step length and step frequency were completely different between constrained and non-constrained walking. We argue that constraints in walking are major factors determining how humans choose gait parameters due to their involvement of mediators, i.e., attention or active control. Using the probabilistic model to account for gait parameters has an advantage compared with fixed-parameter models in that it can still include the effect of hidden mechanical, neurophysiological, or psychological variables by grouping them into distribution curves.     

The effects of response cost in the treatment of aberrant behavior maintained by negative reinforcement

Positive reinforcement contingencies can sometimes be used to decrease problem behavior maintained by negative reinforcement (e.g., escape). In the current study, we evaluated the extent to which response cost (i.e., contingent removal of a preferred stimulus) would compete with the negative reinforcer maintaining destructive behavior. The response cost contingency reduced destructive behavior by 87% from baseline levels even though the negative reinforcement contingency (i.e., escape) remained in place.     

Insight and strategy in multiple-cue learning

In multiple-cue learning (also known as probabilistic category learning) people acquire information about cue-outcome relations and combine these into predictions or judgments. Previous researchers claimed that people can achieve high levels of performance without explicit knowledge of the task structure or insight into their own judgment policies. It has also been argued that people use a variety of suboptimal strategies to solve such tasks. In three experiments the authors reexamined these conclusions by introducing novel measures of task knowledge and self-insight and using "rolling regression" methods to analyze individual learning. Participants successfully learned a four-cue probabilistic environment and showed accurate knowledge of both the task structure and their own judgment processes. Learning analyses suggested that the apparent use of suboptimal strategies emerges from the incremental tracking of statistical contingencies in the environment.     

Nudges and signposts: The effect of smart defaults and pictographic risk information on retirement saving investment choices

The authors tested two interventions to improve retirement savings investment decisions. In an incentive‐compatible experiment, 459 participants engaged in a task simulating their working life. Periodically during the simulation, participants chose between different investment options. The authors examined the effectiveness of a “nudge” by manipulating the default option and the effectiveness of a “signpost” by manipulating the display of a pictograph summarizing the expected return of each option. Participants often followed the default option, particularly when it was “smart” (i.e., became more conservative as retirement approached) and when presented together with dynamic pictographs (i.e., updated each year assuming the investment was held until retirement). Those most likely to make optimal choices (i.e., consistent with the life cycle model) were presented with a smart default or dynamic pictographs. These findings reveal how different choice architecture interventions can be used to positively influence behavior. Retirement funds and regulators can support retirement savings decisions by the provision of smart defaults and better risk information in the form of pictographs.     

Switching or sharing in dual-task line-length discrimination?

In two experiments, we tested whether subjects switched or shared attention between two simultaneously relevant line-length discrimination tasks. Switching models that allowed within- as well as between-trial switching were considered. In the first experiment, stimulus duration was varied randomly from trial to trial. With varied durations, many switching models predict negative contingencies: for a given duration and attentional allocation, accurate responses on one task should be associated with inaccurate responses on the other task. The results, however, showed no negative contingencies, which is consistent with sharing models. In the second experiment, stimulus duration was reduced to 20 msec, yet responses were more than 75% correct overall. This implies that information was obtained about both of the tasks within single trials, contradicting those switching models which predict that information can be obtained from, at most, one task within a period of 20 msec or less. In short, the results of both experiments support sharing models.     

The ultimate sampling dilemma in experience-based decision making

Computer simulations and 2 experiments demonstrate the ultimate sampling dilemma, which constitutes a serious obstacle to inductive inferences in a probabilistic world. Participants were asked to take the role of a manager who is to make purchasing decisions based on positive versus negative feedback about 3 providers in 2 different product domains. When information sampling (from a computerized database) was over, they had to make inferences about actual differences in the database from which the sample was drawn (e.g., about the actual superiority of different providers, or about the most likely origins of negatively valenced products). The ultimate sampling dilemma consists in a forced choice between 2 search strategies that both have their advantages and their drawbacks: natural sampling and deliberate sampling of information relevant to the inference task. Both strategies leave the sample unbiased for specific inferences but create errors or biases for other inferences.     

Discounting of food,sex, and money

Discounting is a useful framework for understanding choice involving a range of delayed and probabilistic outcomes (e.g., money, food, drugs), but relatively few studies have examined how people discount other commodities (e.g., entertainment, sex). Using a novel discounting task, where the length of a line represented the value of an outcome and was adjusted using a staircase procedure, we replicated previous findings showing that individuals discount delayed and probabilistic outcomes in a manner well described by a hyperbola-like function. In addition, we found strong positive correlations between discounting rates of delayed, but not probabilistic, outcomes. This suggests that discounting of delayed outcomes may be relatively predictable across outcome types but that discounting of probabilistic outcomes may depend more on specific contexts. The generality of delay discounting and potential context dependence of probability discounting may provide important information regarding factors contributing to choice behavior.     

Musical space synesthesia: Automatic,explicit and conceptual connections between musical stimuli and space

In musical–space synesthesia, musical pitches are perceived as having a spatially defined array. Previous studies showed that symbolic inducers (e.g., numbers, months) can modulate response according to the inducer’s relative position on the synesthetic spatial form. In the current study we tested two musical–space synesthetes and a group of matched controls on three different tasks: musical–space mapping, spatial cue detection and a spatial Stroop-like task. In the free mapping task, both synesthetes exhibited a diagonal organization of musical pitch tones rising from bottom left to the top right. This organization was found to be consistent over time. In the subsequent tasks, synesthetes were asked to ignore an auditory or visually presented musical pitch (irrelevant information) and respond to a visual target (i.e., an asterisk) on the screen (relevant information). Compatibility between musical pitch and the target’s spatial location was manipulated to be compatible or incompatible with the synesthetes’ spatial representations. In the spatial cue detection task participants had to press the space key immediately upon detecting the target. In the Stroop-like task, they had to reach the target by using a mouse cursor. In both tasks, synesthetes’ performance was modulated by the compatibility between irrelevant and relevant spatial information. Specifically, the target’s spatial location conflicted with the spatial information triggered by the irrelevant musical stimulus. These results reveal that for musical–space synesthetes, musical information automatically orients attention according to their specific spatial musical-forms. The present study demonstrates the genuineness of musical–space synesthesia by revealing its two hallmarks—automaticity and consistency. In addition, our results challenge previous findings regarding an implicit vertical representation for pitch tones in non-synesthete musicians.     

Object-based attention: strength of object representation and attentional guidance

Two or more features belonging to a single object are identified more quickly and more accurately than are features belonging to different objects--a finding attributed to sensory enhancement of all features belonging to an attended or selected object. However, several recent studies have suggested that this "single-object advantage" may be a product of probabilistic and configural strategic prioritizations rather than of object-based perceptual enhancement per se, challenging the underlying mechanism that is thought to give rise to object-based attention. In the present article, we further explore constraints on the mechanisms of object-based selection by examining the contribution of the strength of object representations to the single-object advantage. We manipulated factors such as exposure duration (i.e., preview time) and salience of configuration (i.e., objects). Varying preview time changes the magnitude of the object-based effect, so that if there is ample time to establish an object representation (i.e., preview time of 1,000 msec), then both probability and configuration (i.e., objects) guide attentional selection. If, however, insufficient time is provided to establish a robust object-based representation, then only probabilities guide attentional selection. Interestingly, at a short preview time of 200 msec, when the two objects were sufficiently different from each other (i.e., different colors), both configuration and probability guided attention selection. These results suggest that object-based effects can be explained both in terms of strength of object representations (established at longer exposure durations and by pictorial cues) and probabilistic contingencies in the visual environment.     

Verbalization of Decision Strategies in Multiple‐Cue Probabilistic Inference

In multiple‐cue probabilistic inference, people choose between alternatives based on several cues, each of which is differentially associated with an alternative's overall value. Various strategies have been proposed for probabilistic inference (e.g., weighted additive, tally, and take‐the‐best). These strategies differ in how many cue values they require to enact and in how they weight each cue. Do decision makers actually use any of these strategies? Ways to investigate this question include analyzing people's choices and the cues that they reveal. However, different strategies often predict the same decisions, and search behavior says nothing about whether or how people use the information that they acquire. In this research, we attempt to elucidate which strategies participants use in a multiple‐cue probabilistic inference task by examining verbal protocols, a high‐density source of process data. The promise of verbal data is in their utility for testing detailed information processing models. To that end, we apply protocol analysis in conjunction with computational simulations. We find converging evidence across outcome measures, search measures, and verbal reports that most participants use simplifying heuristics, namely take‐the‐best. Copyright © 2015 John Wiley & Sons, Ltd.     

Mice and rats fail to integrate exogenous timing noise into their time-based decisions

Endogenous timing uncertainty results in variability in time-based judgments. In many timing tasks, animals need to incorporate their level of endogenous timing uncertainty into their decisions in order to maximize the reward rate. Although animals have been shown to adopt such optimal behavioral strategies in time-based decisions, whether they can optimize their behavior under exogenous noise is an open question. In this study, we tested mice and rats in a task that required them to space their responses for a minimum duration (DRL task) in different task conditions. In one condition, the minimum wait time was fixed, whereas in other conditions minimum wait time was a Gaussian random variable. Although reward maximization entailed waiting longer with added exogenous timing variability, results indicated that both mice and rats became more impulsive and deviated from optimality with increasing levels of exogenous noise. We introduce a reward-rate-dependent sampling function to SET to account for optimal performance in noiseless and suboptimal performance in noisy environments.     

Imminent Danger? Probabilistic Classification Learning of Threat-Related Information in Obsessive-Compulsive Disorder

A tendency to overestimate threat has been shown in individuals with OCD. We tested the hypothesis that this bias in judgment is related to difficulties in learning probabilistic associations between events. Thirty participants with OCD and 30 matched healthy controls completed a learning experiment involving 2 variants of a probabilistic classification learning task. In the neutral weather-prediction task, rainy and sunny weather had to be predicted. In the emotional task danger of an epidemic from virus infection had to be predicted (epidemic-prediction task). Participants with OCD were as able as controls to improve their prediction of neutral events across learning trials but scored significantly below healthy controls on the epidemic-prediction task. Lower performance on the emotional task variant was significantly related to a heightened tendency to overestimate threat. Biased information processing in OCD might thus hamper corrective experiences regarding the probability of threatening events.     

Do tests facilitate decision‐making performance on a transfer task?

Testing can improve later recall of information. However, much less is known about the potential use of testing in promoting the transfer of learning. In this study, we investigated whether testing improves decision‐making performance on a transfer task in a sample of 98 university students using a between‐subjects design. After studying several statements about a fictional disease under different learning conditions (restudy, free recall, and multiple‐choice), participants were asked to recall this information and subsequently make medical decisions concerning the fictional disease (i.e., the transfer task). The present study found no advantage of testing conditions over restudy condition on the 30‐min delayed memory task. However, participants in the active retrieval practice (i.e., free recall) group performed significantly better on the transfer task over those in both restudy and multiple‐choice groups. These results suggest free‐recall tests promote the transfer of learning.     

Biased information search in homogeneous groups: confidence as a moderator for the effect of anticipated task requirements

When searching for information, groups that are homogeneous regarding their members' prediscussion decision preferences show a strong bias for information that supports rather than conflicts with the prevailing opinion (confirmation bias). The present research examined whether homogeneous groups blindly search for information confirming their beliefs irrespective of the anticipated task or whether they are sensitive to the usefulness of new information for this forthcoming task. Results of three experiments show that task sensitivity depends on the groups' confidence in the correctness of their decision: Moderately confident groups displayed a strong confirmation bias when they anticipated having to give reasons for their decision but showed a balanced information search or even a dis confirmation bias (i.e., predominately seeking conflicting information) when they anticipated having to refute counterarguments. In contrast, highly confident groups demonstrated a strong confirmation bias independent of the anticipated task requirements.