Enhancement of conditioned reinforcement by uncertainty

Pigeons were trained in three conditions. In the baseline condition, the birds responded on a fixed-interval schedule with the response key white. When the interval was completed, the key turned either red or green for a delay interval that was terminated by a grain presentation dependent on no key pecks during the final 2 sec. In the uncertainty condition, no grain was presented at the end of the delay periods when the key was red. In the certainty condition, the white light appeared only on occasions when pecking would turn the key green and produce food. Otherwise, the key was illuminated red throughout the total time period. The highest response rate in white occurred in the uncertainty condition, the next highest in the certainty condition, and the lowest in baseline. The results suggest that uncertainty facilitated responding, although uncertainty is not a necessary condition for conditioned reinforcement.     

Gasoline conservation: a procedure for measuring and reducing the driving of college students

The study sought to motivate college students to reduce the number of miles they drove each day and thus save gasoline. Students in two psychology classes were divided by class into two groups. The experimental group was offered various combinations of prizes such as cash, a tour of a mental-health facility, car servicing, and a university parking sticker for reducing driving. The value of the prize received was scaled in terms of per cent reduction in driving. The contrast group received no inducements. The condition in which the experimental group's mileage reduction was reinforced was counterbalanced by two baseline conditions. Several special recording procedures were used to reduce and detect the possibility of subjects altering their odometers, the source of the driving data. Experimental subjects reduced their average daily mileage by 20% relative to the initial baseline; the contrast group did not change. During the one-month reinforcement condition, the 12 experimental subjects saved some 170 gallons (worth $102) of gasoline.     

Signal/noise ratios for domain-referenced tests

Using the assumption of randomly parallel tests and concepts from generalizability theory, three signal/noise ratios for domain-referenced tests are developed, discussed, and compared. The three ratios have the same noise but different signals depending upon the kind of decision to be made as a result of measurement. It is also shown that these ratios incorporate a definition of noise or error which is different from the classical definition of noise typically used to characterize norm-referenced tests. Part of the work leading to this paper was accomplished while the authors were assistant professors at the State University of New York at Stony Brook.     

Relevance of physical environment influences for toddler temperament

The present study investigated the relation of the physical environment to toddler and parent temperament. Measurement of the physical environment offers a unique way of disentangling environmental influences on temperament from child influences on the environment. Subjects were 82 12-month-old toddlers. The physical environment was assessed during six separate home observations, using codes from the Purdue Home Stimulation Inventory. Toddler temperament was measured by the Toddler Temperament Scale, and maternal temperament was assessed with the revised Dimensions of Temperament Scale. Results indicated that measures of crowding and availability of objects and visual stimuli were most consistently related to specific dimensions of toddler temperament. Relations between physical environment and maternal temperament were inconsistent. Partialling out maternal temperament did not substantially change observed relations between the physical environment and toddler temperament. Implications of these findings for our understanding of environmental contributions to the expression of temperament are discussed.     

Similarities in the rate-altering effects of white noise and cocaine.

The effects of white noise and cocaine on squirrel monkeys' fixed-interval responding were compared to determine whether the presentation of an exteroceptive stimulus could produce rate-altering effects of the type typically observed following drug administration. To investigate the relationship between control response rate and response rate in the presence of drug or noise, the monkeys were trained under a fixed-interval 300-s stimulus-shock termination schedule in order to generate a wide range of local response rates. A light illuminated the experimental chamber during the interval and, after 300 s elapsed, a lever press during a 3-s period terminated the light and precluded the occurrence of a harmless electrical stimulus that otherwise was delivered at the end of the 3-s period. Each interval was followed by a 30-s timeout during which the chamber was darkened and responses had no consequences. Following intramuscular administration of cocaine, different rates of responding characteristic of control performance converged toward a common rate and, at an appropriately high dose, response rate during the fixed interval became more uniform. When white noise was presented continuously during a given session, different response rates also converged toward a common rate and, at an appropriate intensity, response rate became more uniform. Interactions were obtained when cocaine and white noise were presented together, indicating the possibility of a common behavioral mechanism of action. The results suggest that rate-altering drug effects may be, in part, a result of the ability of drugs to produce nonspecific stimulus effects similar to those observed for exteroceptive stimuli.     

Uncertainty reduction, conditioned reinforcement, and observing

In a concurrent-chains procedure, pigeons chose between equivalent mixed and multiple fixed-interval schedules of reinforcement. In the first experiment, preference for the multiple schedule was higher when the probability of the shorter fixed interval was less than .50 than for complementary points, an outcome consistent with the delay-reduction hypothesis of conditioned reinforcement and observing, but inconsistent with the uncertainty-reduction hypothesis which requires symmetrical preferences with a maximum when the two intervals are equiprobable. A second experiment assessed preference for equivalent mixed and multiple schedules when each choice outcome resulted in two reinforcements, one on the longer and one on the shorter fixed interval. The order of the two fixed intervals was determined probabilistically. Pigeons again preferred multiple to mixed schedules, although multiple-schedule preference did not vary systematically with the likelihood of the shorter fixed interval occurring first. The results from these choice procedures are consistent with those from the observing-response literature in suggesting that the strength of a stimulus cannot be well described as a function of the degree of uncertainty reduction the stimulus provides about reinforcement.     

Avoidance based on shock intensity reduction with no change in shock probability

Rats were trained on a free-operant avoidance procedure in which shock intensity was controlled by interresponse time. Shocks were random at a density of about 10 shocks per minute. Shock probability was response independent. As long as interresponse times remained less than the limit in effect, any shocks received were at the lower of two intensities (0.75 mA). Whenever interresponse times exceeded the limit, any shocks received were at the higher intensity (1.6 mA). The initial limit of 15 seconds was decreased in 3-second steps to either 6 or 3 seconds. All animals lever pressed to avoid higher intensity shock. As the interresponse time limit was reduced, the response rate during the lower intensity shock and the proportion of brief interresponse times increased. Substantial warmup effects were evident, particularly at the shorter interresponse-time limits. Shock intensity reduction without change in shock probability was effective in the acquisition and maintenance of avoidance responding, as well as in differentiation of interresponse times. This research suggests limitations on the generality of a safety signal interpretation of avoidance conditioning.     

Effect of unpleasant loud noise on hippocampal activities during picture encoding: an fMRI study

The functional link between the amygdala and hippocampus in humans has not been well documented. We examined the effect of unpleasant loud noise on hippocampal and amygdaloid activities during picture encoding by means of fMRI, and on the correct response in humans. The noise reduced activity in the hippocampus during picture encoding, decreased the correct response and increased the activity of the amygdala. A path diagram using structural equation modeling suggested that hippocampus activity might be depressed by high amygdala activity. Therefore, noise should diminish memory by reducing hippocampal activity, which might be depressed by high amygdala activity.     

Uncertainty about the rest of the sentence

A word-by-word human sentence processing complexity metric is presented. This metric formalizes the intuition that comprehenders have more trouble on words contributing larger amounts of information about the syntactic structure of the sentence as a whole. The formalization is in terms of the conditional entropy of grammatical continuations, given the words that have been heard so far. To calculate the predictions of this metric, Wilson and Carroll's (1954) original entropy reduction idea is extended to infinite languages. This is demonstrated with a mildly context-sensitive language that includes relative clauses formed on a variety of grammatical relations across the Accessibility Hierarchy of Keenan and Comrie (1977). Predictions are derived that correlate significantly with repetition accuracy results obtained in a sentence-memory experiment (Keenan & Hawkins, 1987).     

Does threatening imagery sensitize distress during contaminant exposure?

Prominent models of fear focus on the role of cognition in the development and maintenance of maladaptive responses. Little research, however, has evaluated the impact of cognition on distress reduction. The current study uses an experimental design to examine the effect of different types of imagery (moving harm, static harm, and safety) on reduction of distress associated with a contaminating stimulus in a normal university sample. Results indicate that use of moving harm imagery sensitizes distress during a 30-min exposure, whereas static harm and safety imagery reduce distress. These findings demonstrate that cognitive factors can moderate affective response during exposure. Clinical implications for the treatment of anxiety disorders are discussed.