Reinforcement,Rationality, and Intentions: How Robust Is Automatic Reinforcement Learning in Economic Decision Making?

Reinforcement learning is often observed in economic decision making and may lead to detrimental decisions. Because of its automaticity, it is difficult to avoid. In three experimental studies, we investigated whether this process could be controlled by goal intentions and implementation intentions. Participants' decisions were investigated in a probability‐updating task in which the normative rule to maximize expected payoff (Bayes' rule) conflicted with the reinforcement heuristic as a simple decision rule. Some participants were asked to set goal intentions designated to foster the optimization of rational decision making, while other participants were asked to furnish these goal intentions with implementation intentions. Results showed that controlling automatic processes of reinforcement learning is possible by means of goal intentions or implementation intentions that focus decision makers on the analysis of decision feedback. Importantly, such beneficial effects were not achieved by simply instructing participants to analyze the feedback, without defining a goal as the desired end state from a first‐person perspective. Regarding intentions supposed to shut down reinforcement processes by controlling negative affect, effects were more complex and depended on the specified goal‐directed behavior. The goal intention to suppress the disappointment elicited by negative feedback was not effective in controlling reinforcement processes. Furnishing this goal with an implementation intention even backfired and strengthened unwanted reinforcement processes. In contrast, asking participants to keep cool in response to negative decision outcomes through the use of goal intentions or implementation intentions increased decisions in line with Bayes' rule. Copyright © 2017 John Wiley & Sons, Ltd.     

Fruitful plans: adding targeted mental imagery to implementation intentions increases fruit consumption

Forming implementation intentions ('If I encounter situation X, then I will perform behaviour Y!') increases the probability of carrying out goals. This study tested the hypothesis that mental imagery targeting key elements of implementation intentions further increases goal achievement. The residents of a student residence were assigned the goal of consuming extra portions of fruit every day for 7 days and randomly assigned to one of four conditions: control (active rehearsal), implementation intentions, goal intention mental imagery or mental imagery targeted to the implementation intentions. Among low fruit consumers, but not high fruit consumers, fruit consumption at follow-up was higher in the targeted mental imagery group than in the other group, with the lowest fruit consumption in the control group. The findings suggest that it may be beneficial to use targeted mental imagery when forming implementation intentions.     

Effects of implementation intentions on the self-reported frequency of drivers' compliance with speed limits

This study tested the efficacy of implementation intentions in the context of drivers' speeding behavior. Participants (N = 300) completed self-report measures of goal intention and behavior, and they were randomly assigned to an experimental condition, which required them to specify an implementation intention, or a control condition. One month post-baseline, self-reported compliance with speed limits significantly increased for experimental participants but not for control participants. The effects of specifying an implementation intention on behavior increased with the strength of drivers' goal intentions. Finally, analysis of participants' implementation intentions revealed that specifying more behavioral strategies increased the frequency with which participants reported complying with the speed limit. Implications of the findings are discussed in relation to enhancing road safety interventions.     

政策执行偏差严重程度对公众地方政府责任判断的影响机制

为探讨地方政府政策执行偏差严重程度对公众地方政府责任判断的影响机制。采用问卷法对728名社会公众进行调查,结果显示：（1）公众地方政府有意性判断和公众地方政府可控归因中介了政策执行偏差严重程度与公众地方政府责任判断之间的关系。（2）政策执行偏差严重程度还通过公众地方政府有意性判断→公众地方政府可控归因的中介链作用于公众地方政府道德责任判断。并对研究的实践启示进行了讨论。     

目标性意图与执行性意图调节情绪反应的效果比较

目标性意图和执行性意图作为目标的不同形式,对情绪调节的影响有待探讨。本研究试图考察目标性意图和执行性意图与表达抑制相结合之后,在调节情绪反应方面的作用。实验采用主观报告和生物反馈的方法对58名大学生进行测试。结果发现：（1）执行性意图组被试在观看负性和中性图片时对自身情绪唤醒度的评价均显著低于目标性意图组,在观看负性图片时其情绪唤醒度也显著低于控制组。（2）执行性意图组被试在各项生理反应指标上均显著低于目标性意图组和控制组,主要表现为形成执行性意图的个体在皮肤电导增加量、皮温降低量和指脉增加量上均显著低于形成目标性意图或不形成任何意图的个体。上述结果表明,相较于仅仅给出情绪体验下调目标的目标性意图,与表达抑制结合在一起的执行性意图能有效下调个体的负性情绪反应。     

When planning is needed: Implementation intentions and attainment of approach versus avoidance health goals

OBJECTIVE: This study tested whether forming implementation intentions is an effective strategy for attaining health goals focused on trying to avoid a negative state. DESIGN: Participants chose to either eat more healthy snacks (i.e., an approach goal) or eat fewer unhealthy snacks (i.e., an avoidance goal) over two weeks and were randomly assigned to create an implementation intention to do this or not. MAIN OUTCOME MEASURES: The authors measured fat and calorie intake after one week and after two weeks. RESULTS: After two weeks, the participants who ate most unhealthily were those who pursued an avoidance goal and did not form an implementation intention. CONCLUSION: These results suggest that forming implementation intentions for avoidance goal pursuit can help people attain important health goals.     

The implications of counterfactual mind-sets for the functioning of implementation intentions

Two experiments explored how counterfactual mind-sets interact with implementation intentions and affect their flexibility. Participants engaged in a subtractive mind-set, an additive mind-set, or a control condition and were subsequently given either goal intentions or implementation intentions that facilitated cue detection (Experiment 1) or the goal-directed response (Experiment 2). Dependent variables were the number of targets specified in the intentions and the legitimate alternatives to the targets (flexibility measure). In Experiment 1, the implementation intention (versus goal intention) group were better at detecting specified cues, but worse on alternatives, regardless of mind-set. In Experiment 2, an interaction emerged. For both specified and alternative responses, the subtractive mind-set paired with an implementation intention versus goal intention performed better. This pattern was reversed for additive mind-set conditions. Hence, how counterfactual mind-sets affect the flexibility of planning is dependent on the particular mind-set used and the specific operations of plan.     

The effect of implementation intention on speeding and acceleration overtime: A simulator study

Speeding is considered a major risk factor for road safety. In this study, implementation intention, which is a type of cognitive intervention, was designed to reduce speeding. Implementation intentions are self-regulatory ‘if-then’ plans, which are the subordinate concepts of goal intentions. Additionally, the type of goal was considered as a factor that could contribute to the subsequent behavior. An approach-type goal aims to achieve a behavior, whereas avoidance-type goals aim to avoid a negative, undesirable outcome. Following this idea, the present study has two aims: (i) to manipulate intentions towards speeding by using implementation intentions, and second (ii) to manipulate goal types (approaching vs. avoidance) of the intentions towards speeding. At the baseline level, participants in the experimental group were manipulated through implementation intentions by using a volitional help sheet, in which they matched critical items with the appropriate responses, whereas participants in the control group received an irrelevant filler task. After a two-week time interval, a follow-up study was conducted. In order to investigate the first aim, simulated driving behaviors of experimental and control groups were compared at the baseline and follow-up levels. For the second aim, the experimental group was divided into two subgroups, namely, approach-type and avoidance-type goals. The repeated measures mixed-model ANOVA results showed a significant difference between experimental and control conditions, yet the goal type (approaching vs. avoidance) did not differ significantly from one another. The results of the present study revealed that implementation intentions do not reduce speeding, however, they do prevent increased speeding. The results were discussed in the context of the related literature.     

Effects of Implementation Intentions Linking Suppression of Alcohol Consumption to Socializing Goals on Alcohol‐Related Decisions

This article investigates the effects of implementation intentions that connect the suppression of alcohol consumption to socializing goals on the decision to accept an offer of a free alcoholic drink. Participants were university students (N = 48) who were randomly assigned to an implementation intention condition or a control condition. The results show that participants who formed implementation intentions were less likely to accept the offer of a free alcoholic drink than were participants who did not form implementation intentions. In addition, the results demonstrate that the implementation intention effect held among habitual alcohol drinkers. The results of the present study suggest that implementation exercises can successfully suppress habitual alcohol consumption.     

Implementation Intentions and Facilitation of Prospective Memory

Forming detailed implementation intentions for a future behavior can increase the probability that the behavior is actually completed. We investigated whether this intention effect could be used to improve prospective memory in older adults. As expected, participants who formed an implementation intention were more than twice as likely to self-initiate the intended behavior (writing down the day of the week on every sheet of paper received during the experiment) compared with participants who either were merely instructed to do so or actively rehearsed the instruction. Forming an implementation intention, however, did not improve performance on a task that required a response to salient cues. We conclude that detailed implementation intentions facilitate prospective memory on tasks that lack salient cues and require self-initiation.     

行为执行意向的理论观点及其相关研究

执行意向是指个体以行动目标为导向,通过连接情景线索和目标导向反应,建立行为意向和实际行为之间联系的中介变量。通过梳理执行意向的概念、心理联系及应用研究,发现执行意向主要与行为意向、自我协调、合作性、计划提醒、自觉性、人格等变量产生心理联系;形成执行意向的人具有克服困难,达到既定目标的积极心理状态。然而,执行意向并不总是发挥其积极效应,其与具体情景、个体差异性等有关。最后,文章从四个方面对今后研究的热点与方向进行了展望。     

Goals need implementation intentions: The model of action phases tested in the applied setting of continuing education

In the present study, the model of action phases (Heckhausen & Gollwitzer, 1987) was applied to the area of continuing education. A subsample of 136 East German participants in the larger study "Active Actions in a Radical Change Situation" rated the expected value of further education, indicated whether they had taken a decision to continue their education (goal intention) and whether they were planning goal-directed actions (implementation intention). Two years later, it was ascertained whether participants had initiated vocational retraining. Findings support the core assumptions of the model. Postdecisional participants endorsed the positive aspects of further education more strongly (implemental mindset) than predecisional participants, who looked at its pros and cons impartially (deliberative mindset). Second, participants were more successful in initiating vocational retraining when they had a goal intention that was additionally furnished with an implementation intention. Findings are discussed with respect to theoretical and practical implications of the distinction between goal setting and goal implementation.     

Overcoming the planning fallacy through willpower: effects of implementation intentions on actual and predicted task‐completion times

Previous work has shown that people often underestimate their task‐completion times (Buehler, Griffin, & Ross, 1994 ). The present research examined whether this optimistic bias may be reduced through the formation of implementation intentions. In an experimental study, participants were requested to complete an assignment within a specified time period. Half of these participants made implementation intentions about where and when they would complete the assignment. The remaining participants were simply given the goal of completing the assignment. The results showed that furnishing participants' goals with implementation intentions led to (a) more optimistic completion predictions, (b) an even greater increase in actual rates of goal completion, and, consequently, (c) a significant reduction in optimistic bias in completion predictions. Furthermore, the reduction in optimistic bias among implementation–intention participants was found to be mediated by a smaller number of interruptions while working on the assignment. Together, these findings attest to the importance of implementation planning in overcoming unrealistic optimism in task‐completion predictions. Copyright © 2000 John Wiley & Sons, Ltd.     

大学生的主动性与创业意向的关系:创业知识的中介作用

为探讨大学生的主动性、创业知识与创业意向之间的关系, 采用主动性人格量表(PPS)、创业知识问卷和大学生创业意向量表调查了1208名大一至大四年级学生。结果表明:男大学生的创业目标意向水平显著高于女大学生;大学生的主动性越强, 其创业目标意向和创业执行意向水平越高;创业资源知识在主动性与创业意向之间起到部分中介作用, 具体讲, 大学生的主动性越强, 其创业资源知识越丰富, 那么大学生的创业目标意向和创业执行意向水平越高。创业理论知识在主动性与创业执行意向之间起到部分中介作用, 具体而言, 大学生的主动性越强, 其创业理论知识越丰富, 那么大学生的创业执行意向水平越低。     

Blocked goals, persistent action: Implementation intentions engender tenacious goal striving

Research on goal attainment has demonstrated that people are more likely to reach their goals when they form implementation intentions. Three experiments tested whether implementation intentions lead to tenacious goal striving following blockage of an initial attempt to reach the goal. In all three experiments some participants were instructed to form an implementation intention and other participants were not. Subsequently, the initial goal-directed attempt of all participants was unexpectedly blocked. Experiment 1 found that implementation intentions resulted in more attempts to realize one’s goal. Experiment 2 showed that when participants formed an implementation intention their repeated attempt was acted out as intensely as their first, blocked attempt. Experiment 3 found that implementation intentions still allow people to seize an alternative, more onerous means to realize their intention. These results imply that implementation intention conserve self-regulatory strength. After goal blockage, the remaining strength can be used to continue goal-directed action.     

Evidence that implementation intentions reduce drivers’ use of mobile phones while driving

Implementation intentions are IF-THEN plans that have the potential to reduce mobile phone use while driving and thus contribute towards the prevention of road traffic crashes. We tested whether an intervention, designed to promote the formation of implementation intentions, could reduce drivers’ use of mobile phones. A randomized controlled design was used. The participants (N = 136) were randomised to an implementation intention or a control condition. Self-report questionnaires were administered to all participants at both pre- and one-month post-intervention to measure the use of mobile phones while driving, goal intentions and the theoretically derived motivational pre-cursors of goal intentions (attitudes, subjective norm and perceived behavioural control). Immediately following the pre-intervention questionnaire, the participants in the implementation intention condition (n = 67) were given a volitional help sheet, which asked them to form implementation intentions by specifying target driving situations that tempted them the most to use a mobile phone and linking them with goal-directed responses that could be used to resist the temptation. The participants in the control condition (n = 69) were asked to specify target situations that tempted them the most to use a mobile phone while driving and to generally try to avoid using a mobile phone in those situations. One-month post-intervention, the participants in the implementation intention condition reported using a mobile phone less often while driving in their specified target driving situations than did the participants in the control condition. As expected, no differences were found between the conditions in the reported frequency of mobile phone use in unspecified driving situations, goal intentions or any motivational pre-cursor of goal intentions. The implementation intention intervention that was tested in this study is a potentially effective tool for reducing mobile phone use while driving in target driving situations, where behaviour-change is most needed.     

The use of implementation intentions and the decision balance sheet in promoting exercise behaviour

Although increasing exercise and fitness has often been associated with positive health outcomes, infrequent exercise participation has remained a problem. Since two distinct motivational and volitional phases to goal pursuit have been proposed, a combined motivational (decision balance sheet, DBS) and volitional (implementation intentions) intervention was predicted to be more effective in increasing exercise behaviour than a control or either strategy alone. A total of 86 students were randomly assigned to one of the four conditions, and were all asked to try to exercise two more times a week than they currently did, over a four week period. Their fitness levels were measured through fitness tests conducted pre- and post-intervention. A priori orthogonal contrasts indicated that the experimental strategies produced a greater increase in exercise frequency and total time spent exercising per week and accordingly showed greater fitness improvements than the control group. Moreover, the volitional groups taken together produced greater increase in time spent exercising and a marginally greater improvement in frequency than the DBS alone. The combined intervention led to improvements in fitness and marginal increases in frequency over the implementation intention alone group. It is proposed that for the combined group the DBS may have aided recall of the implementation intention or increased commitment to it, as remembering and then acting on the plan, in the stated place and time, mediated the implementation intention–behaviour relationship. The combined intervention produced the greatest fitness improvements, indicating that this strategy can lead to important health benefits.     

Using Mental Imagery to Enhance the Effectiveness of Implementation Intentions

Past research shows that forming implementation intentions increases the probability of carrying out goals. The present research proposes that mental imagery can strengthen the effects of implementation intentions on goal achievement. Participants were assigned a mundane goal and were randomly assigned to one of two conditions: implementation intentions only or implementation intentions plus mental imagery. Results support the hypothesis that using mental imagery when forming implementation intentions leads to higher rates of goal achievement.     

Implementation intentions facilitate prospective memory under high attention demands

An implementation intention is a planning technique that involves specifying a situation for initiating an intended action and linking these specific cues to the intention. In two experiments with young adults, we found significant increases in prospective memory with implementation intentions. With an implementation intention, but not with standard instructions, prospective memory performance was maintained under demanding attentional conditions (Experiment 2). Ongoing task performance did not decline, however, in relation with a no prospective memory control. Positive effects were not observed when the imagery component of the implementation intention was isolated from the verbal component. We suggest that implementation intention planning (relative to standard instructions) increases the likelihood that people will encode a robust associative link between the target cue and the intended action, thereby promoting reflexive triggering of the intended action on presentation of the target cue.