Choice of extinction-signalling stimuli by rats

Rats in a two-lever situation were exposed to alternating periods of intermittent reinforcement and extinction. Extinction periods were either unsignalled or were signalled by a response-produced stimulus. The signal was sometimes a stimulus paired with food delivery in the reinforcement periods and sometimes a stimulus that occurred only in extinction periods. Both kinds of signal accelerated extinction relative to the unsignalled condition. When the signal was the stimulus paired with food in reinforcement periods, the rats tended to prefer the lever that gave that signal even though the signal accelerated extinction. There was no comparable effect for the stimulus that occurred only in extinction periods; when this signal was contingent on only one of the two levers, the rats either avoided it (Experiment 3) or were indifferent (Experiment 4). It is concluded that a stimulus can be a “secondary reinforcer” as measured by preference, even though it decreases resistance to extinction; the implications are discussed with reference to formal theories of choice behavior.