The S-R issue: its status in behavior analysis and in Donahoe and Palmer''s learning and complex behavior.

The central focus of this essay is whether the effect of reinforcement is best viewed as the strengthenng of responding or the strengthening of the environmental control of responding. We make the argument that adherence to Skinner's goal of achieving a moment-to-moment analysis of behavior compels acceptance of the latter view. Moreover, a thoroughgoing commitment to a moment-to-moment analysis undermines the fundamental distinction between the conditioning process instantiated by operant and respondent contingencies while buttressing the crucially important differences in their cumulative outcomes. Computer simulations informed by experimental analyses of behavior and neuroscience are used to illustrate these points.     

Stimulus-driven and goal-driven effects on Pavlovian associative reward learning

It has been shown that pure Pavlovian associative reward learning can elicit value-driven attentional capture. However, in previous studies, task-irrelevant and response-independent reward-signalling stimuli hardly competed for visual selective attention. Here we put Pavlovian reward learning to the test by manipulating the extent to which bottom-up (Experiment 1) and top-down (Experiment 2) processes were involved in this type of learning. In Experiment 1, the stimulus, the colour of which signalled the magnitude of the reward given, was presented simultaneously with another randomly coloured stimulus, so that it did not capture attention in a stimulus-driven manner. In Experiment 2, observers performed an attentionally demanding RSVP-task at the centre of the screen to largely tax goal-driven attentional resources, while a task-irrelevant and response-independent stimulus in the periphery signalled the magnitude of the reward given. Both experiments showed value-driven attentional capture in a non-reward test phase, indicating that the reward-signalling stimuli were imbued with value during the Pavlovian reward conditioning phases. This suggests that pure Pavlovian reward conditioning can occur even when (1) competition prevents attention being automatically allocated to the reward-signalling stimulus in a stimulus-driven manner, and (2) attention is occupied by a demanding task, leaving little goal-driven attentional resources available to strategically select the reward-signalling stimulus. The observed value-driven attentional capture effects appeared to be similar for observers who could and could not explicitly report the stimulus–reward contingencies. Altogether, this study provides insight in the conditions under which mere stimulus–reward contingencies in the environment can be learned to affect future behaviour.     

不同类型反馈对儿童学习效果的影响及性别差异

儿童阶段是对外部反馈最敏感的阶段。以往研究发现,不同类型反馈（积极/消极反馈）和不同性质的强化物（物质/社会性强化）对儿童学习效果存在交互作用,并且对不同性别儿童的影响有所不同。本研究通过两个实验,采用联结学习范式以考察不同类型反馈对8~10岁儿童学习效果的影响。首先考察了积极反馈和消极反馈对儿童学习效果的影响,进而在积极、消极反馈的基础上加入了物质、社会性强化物,探究物质、社会性强化条件下积极、消极反馈对儿童学习效果影响的性别差异。结果表明,对于8~10岁儿童来说,消极反馈比积极反馈对儿童学习效果的影响更大。并且,物质、社会性强化物对儿童反馈学习效果的影响存在性别差异,对于男孩来说,在物质性强化条件下,消极反馈更能促进其学习;而对于女孩来说,在社会性强化物下,消极反馈更能促进她们的学习。该研究为如何运用反馈促进儿童学习提供了实证依据。     

普萘洛尔修复即刻消退产生的二次创伤

恐惧消退能力的受损是创伤后应激障碍(posttraumatic stress disorder, PTSD)的标志之一。以往的研究表明, 相较于延迟消退, 恐惧获得后短时间内进行的消退训练不能形成长时程的消退记忆, 这一现象被称为即刻消退缺损。然而, 目前并不清楚这种缺损是一次性的, 还是会继续影响其后的重消退。实验1中, 大鼠在恐惧习得后1小时(即刻消退)或24小时(延迟消退)开始进行消退训练, 24小时后进行重消退, 再24小时后进行消退记忆的测试。结果显示, 与延迟消退相比, 即刻消退效果缺损, 并引起第二天的重消退也出现效果缺损。实验2中, 恐惧获得后立即给予大鼠盐水或β-肾上腺素受体阻断剂普萘洛尔(10 mg/kg, i.p.), 然后测试即刻消退和重消退的效果。结果显示, 普萘洛尔虽没有阻止即刻消退的缺损, 但避免了重消退出现缺损。总之, 严重创伤后的即刻消退不但无法有效抑制恐惧反应, 还可能造成二次创伤, 会损害恐惧消退能力, 而普萘洛尔可修复即刻消退引起的重消退缺损。这些结果将有助于我们加深对PTSD病理机制和早期干预后果的认识。     

Using hippocampal‐dependent eyeblink conditioning to predict individual differences in spatial reorientation strategies in 3‐ to 6‐year‐olds

The hippocampus is a subcortical structure in the medial temporal lobe involved in cognitive functions such as spatial navigation and reorientation, episodic memory, and associative learning. While much is understood about the role of hippocampal function in learning and memory in adults, less is known about the relations between the hippocampus and the development of these cognitive skills in young children due to the limitations of using standard methods (e.g., MRI) to examine brain structure and function in developing populations. This study used hippocampal‐dependent trace eyeblink conditioning (EBC) as a feasible approach to examine individual differences in hippocampal functioning as they relate to spatial reorientation and episodic memory performance in young children. Three‐ to six‐year‐old children (N = 50) completed tasks that measured EBC, spatial reorientation, and episodic memory, as well as non‐hippocampal‐dependent processing speed abilities. Results revealed that when age was held constant, individual differences in EBC performance were significantly related to individual differences in performance on the spatial reorientation test, but not on the episodic memory or processing speed tests. When the relations between hippocampal‐dependent EBC and different reorientation strategies were explored, it was found that individual differences in hippocampal function predicted the use of geometric information for reorienting in space as opposed to a combined strategy that uses both geometric information and salient visual cues. The utilization of eyeblink conditioning to examine hippocampal function in young populations and its implications for understanding the dissociation between spatial reorientation and episodic memory development are discussed.     

Children's implicit attitude acquisition: Evaluative statements succeed,repeated pairings fail

From the earliest ages tested, children and adults show similar overall magnitudes of implicit attitudes toward various social groups. However, such consistency in attitude magnitude may obscure meaningful age‐related change in the ways that children (vs. adults) acquire implicit attitudes. This experiment investigated children's implicit attitude acquisition by comparing the separate and joint effects of two learning interventions, previously shown to form implicit attitudes in adults. Children (N = 280, ages 7–11 years) were taught about novel social groups through either evaluative statements (ES; auditorily presented verbal statements such as ‘Longfaces are bad, Squarefaces are good’), repeated evaluative pairings (REP; visual pairings of Longface/Squareface group members with valenced images such as a puppy or snake), or a combination of ES+REP. Results showed that children acquired implicit attitudes following ES and ES+REP, with REP providing no additional learning beyond ES alone. Moreover, children did not acquire implicit attitudes in four variations of REP, each designed to facilitate learning by systematically increasing verbal scaffolding to specify (a) the learning goal, (b) the valence of the unconditioned stimuli, and (c) the group categories of the conditioned stimuli. These findings underscore the early‐emerging role of verbal statements in children's implicit attitude acquisition, as well as a possible age‐related limit in children's acquisition of novel implicit attitudes from repeated pairings.     

Functional analysis and operant treatment of food guarding in a pet dog

The present study extended functional analysis (FA) methodology to human-directed resource guarding in a dog in an in-home setting. The subject underwent four conditions including control, attention, escape, and tangible, arranged in a modified FA. The results indicated multiply controlled resource guarding (i.e., escape, attention, and tangible functions). The experimenter then conducted a treatment evaluation involving three function-based treatments in a concurrent multiple baseline design. Resource guarding decreased to zero levels in treatments for each maintaining contingency. Treatment effects were maintained when the subject was tested with an owner, with an untrained handler, a highly preferred treat, in an untrained setting, as well as after 2 weeks in the absence of training. Behavior analytic techniques may hold promise for lasting behavior change for resource guarding in domestic dogs, and should be examined in other populations and with other canine problem behavior.     

Affective-Evaluative Learning in Humans: A Form of Associative Learning or Only an Artifact?

The status of evaluative conditioning (EC) as a distinct form of associative learning was called in question by Field and Davey (1997, 1998, 1999), who argued that in the typical visual EC paradigm, nonassociative visual concept learning is responsible for the evaluative changes observed. Especially, the use of only within-subject control conditions instead of independent control groups was criticized. The present three experiments show (a) that EC effects can be demonstrated within another sensory modality than visual perception and (b) that EC effects are demonstrable in a between-subject design (including a successful replication attempt). A further result was that these EC effects do not require participants' conscious awareness. The data provide no support for an artifactual account of EC but suggest an interpretation of EC as a form of associative learning.     

Differential Conditioning Based on a Difference in the Predictability of Reinforcement

A Pavlovian procedure containing a set of several alternative reliable trial stimuli and a set of several alternative unreliable trial stimuli was used to determine if reliability of outcome, per se, would differentially condition additional trial stimuli that either preceded or followed those original trial stimuli in a serial conditioning paradigm. The reinforcing effectiveness of the antecedent stimuli themselves was later tested in a higher-order conditioning design. It was found that different rates could be established to the different antecedent stimuli in the absence of a difference in the probability of reinforcement. Further, stimuli paired with those antecedent stimuli in the higher-order conditioning test also exhibited a difference in rate. It was concluded that a combination of a stimulus that is always followed by food and another that is never followed by food are, in net, a more effective reinforcer than a common stimulus that has the same overall probability of reinforcement but which is followed by both outcomes.     

Revisiting the learning-without-awareness question in human pavlovian autonomic conditioning: Focus on extinction in a dichotic listening paradigm

Numerous studies have indicated that, consistent with current “cognitive” accounts of information processing, human Pavlovian autonomic discrimination acquisition cannot occur without awareness of the CS-US relationship. However, extinction studies have suggested that awareness is not necessary, findings that, in information-processing terms, have been explained by assuming that the processing by the extinction stage is parallel (automatic) rather than serial (controlled). This explanation was tested in an 80-subject study. The first, acquisition phase was a standard semantic differential conditioning arrangement with a 96-db white noise as US, and a “long” CS-US interval of 8 s, with ten trials each of CS+ (paired with US) and CS− (unpaired) trials. In extinction (USs omitted), in order to obtain non-autonomic indices of processing and thereby test the information-processing account of “unaware” autonomic conditioning during extinction, a dichotic listening task was implemented, with the CSs presented in the unattended channel (ear), while the subject had to perform a semantic differential reaction task in an attended-to channel (other ear). In early extinction, the electrodermal response occurring at an interval of 9–15 s after CS onset (i.e., following placement of the US during acquisition) and the finger-pulse-volume response occurring at an interval of 4–11 s after CS onset both showed reliable conditioning, but reaction-time and subjective-report data for the recognized critical words indicated serial rather than parallel processing of the CSs during extinction.