Pictorial similarity judgments and the organization of visual memory in the rhesus monkey

The organization of visual memory for pictures was studied in the rhesus monkey. Two monkeys were tested in a same/different task in which sequentially presented pictures were compared to each other in a pair-wise fashion. The resulting confusion matrixes were analyzed using a multidimensional scaling procedure to obtain two- and three-dimensional graphic representations of the stimulus space. In Experiment 1, the monkeys' confusion errors caused pictures of human and rhesus monkey faces to fall in the same region of multidimensional space, which suggested that the monkeys categorized facial stimuli. A similar effect was found for pictures of different types of fruit. Experiment 2 replicated the categorization of faces with a more diverse collection of human and nonhuman primate faces. Experiment 3 explored the fruit category by varying stimulus attributes orthogonally. The results from this experiment showed that both monkeys encoded the pictures in this category by type of fruit (apples or grapes) and color (red or yellow). Taken together, these studies indicate that rhesus monkeys will treat some classes of pictorial stimuli categorically in visual memory.     

The Impact of Semantic Relevance and Heterogeneity of Pictorial Stimuli on Individual Brainstorming: An Extension of the SIAM Model

Drawing upon the Search for Ideas in Associative Memory (SIAM) model as the theoretical framework, the impact of heterogeneity and topic relevance of visual stimuli on ideation performance was examined. Results from a laboratory experiment showed that visual stimuli increased productivity and diversity of idea generation, that relevance to the topic and homogeneity among visual stimuli increased productivity, whereas homogenous but topic irrelevant stimuli suppressed both productivity and idea diversity. The findings show that the SIAM model applies to visual, as well as to textual, stimuli, and extend the model's arguments with respect to cognitive interference and fixation effects.     

A comparison of visual and auditory short-term memory in monkeys (Cebus apella)

Using a visual and an acoustic sample set that appeared to favour the auditory modality of the monkey subjects, in Experiment 1 retention gradients generated in closely comparable visual and auditory matching (go/no-go) tasks revealed a more durable short-term memory (STM) for the visual modality. In Experiment 2, potentially interfering visual and acoustic stimuli were introduced during the retention intervals of the auditory matching task. Unlike the case of visual STM, delay-interval visual stimulation did not affect auditory STM. On the other hand, delay-interval music decreased auditory STM, confirming that the monkeys maintained an auditory trace during the retention intervals. Surprisingly, monkey vocalizations injected during the retention intervals caused much less interference than music. This finding, which was confirmed by the results of Experiments 3 and 4, may be due to differential processing of “arbitrary” (the acoustic samples) and species-specific (monkey vocalizations) sounds by the subjects. Although less robust than visual STM, auditory STM was nevertheless substantial, even with retention intervals as long as 32 sec.     

Conditional fear,anxiety, and morphine-seeking behavior

TwoCebus albifrons monkeys were given discriminative operant conditioning with visual stimuli, with Sidman avoidance and punishment as the components. The instrumental response was an unelicited increase in skin conductance. Both animals had surgically implanted catheters for automatic injection of morphine into the heart. After autonomic conditioning, the animals were given the opportunity to self-administer the morphine by touching the primate press panel that displayed the visual stimuli. One contingency-free segment per session was used for morphine injection, while the contingencies remained in force during the other segments. One of the monkeys made significantly more skin conductance responses during avoidance than during punishment, and this monkey received ten times as many shocks in punishment. This monkey also made more responses overall and had a much higher heart rate than the other animal. The other monkey did not differentiate significantly autonomically and received equal numbers of shocks in avoidance and punishment. The monkey that showed autonomic differentiation made significantly (and increasingly) more panel-presses during punishment than during avoidance. The other animal showed hardly any tendency at all to panel-press.     

Central Fixations are Inadequately Controlled by Instructions Alone: Implications for Studying Cerebral Asymmetry

A fundamental concern when using visual presentations to study cerebral asymmetry is to ensure that stimuli are presented with the same degree of retinal eccentricity from a central fixation point in either visual field. However, a widely used procedure intended to control fixation location merely instructs participants to fixate appropriately without any other means of ensuring that central fixations actually occur. We assessed the validity of assuming that instructions alone ensure central fixation by using the traditional R VF advantage for words and either (a) only instructions to fixate centrally, or (b) an eye-tracking device that ensured central fixation on every trial. Experiments 1 and 2 found that when only instructions were given, the vast majority of fixations were not central, and more occurred to the right of centre than to the left. Moreover, the prevalence of non-central fixations was otherwise disguised by the finding that both fixation procedures produced similar R VF advantages in overt performance. The impact of typical non-central fixations on performance was revealed by systematically manipulating fixation location in Experiment 3, where deviations in fixation of only 0.25 from centre had a reliable impact on visual field effects. Implications of these findings for studies of cerebral asymmetry are discussed.     

Rate of response as a visual social stimulus

In Exp. 1, a high rate of responding (chain pulling) of a stimulus monkey was established as a visual positive discriminative stimulus for the operant behavior (bar pressing) of an observer monkey. The terminal performance of the observer under conditions in which a high rate of response of the stimulus monkey alternated in a variable temporal arrangement with a zero rate of response of the stimulus monkey (negative discriminative stimulus) was essentially the same as when nonbehavioral stimuli are correlated with the availability of reinforcement. By manipulating the schedule of reinforcement to change the rate of responding of the stimulus subject without changing its rate of reinforcement, Exp. 2 showed that the effective behavioral stimulus for the observer was the rate of chain pulling by the stimulus subject. A novel intermediate rate of responding by the stimulus monkey resulted in an intermediate rate (generalization) on the part of the observer during an extinction test. These experiments demonstrated that the rate of responding of one organism can function as a discriminative stimulus to control the rate of responding of another organism; and that the rate of responding is similar to other physical stimuli in terms of discrimination and generalization.     

On the limits of the matching concept in monkeys (Cebus apella).

Two cebus monkeys, with many years of experience matching a variety of static visual stimuli (forms and colors) within a standard matching-to-sample paradigm, were trained to press a left lever when a pair of displayed static stimuli were the same and to press a right lever when they were different. After learning the same/different task, the monkeys were tested for transfer to dynamic visual stimuli (flashing versus steady green disks), with which they had no previous experience. Both failed to transfer to the dynamic stimuli. A third monkey, also with massive past experience matching static visual stimuli, was tested for transfer to the dynamic stimuli within our standard matching paradigm, and it, too, failed. All 3 subjects were unable to reach a moderate acquisition criterion despite as many as 52 sessions of training with the dynamic stimuli. These results provide further evidence that, in monkeys, the matching (or identity) concept has a very limited reach; they consequently do not support the view held by some theorists that an abstract matching concept based on physical similarity is a general endowment of animals.     

视网膜离心率影响空间注意梯度分布

采用同步判断(Simultaneous judgment, SJ)的研究范式探讨空间注意梯度是否受到视网膜离心率的影响。实验中给被试呈现两个目标刺激, 调节它们的呈现距离和间隔时间, 让被试进行不限时的同步判断, 计算出各种距离上的主观等同点(Point of Subjective Simultaneous, PSS)变化情况。实验中对比了注视点和注意点重合与分离的两种状态。其中注视点和注意点分离的状态是指使用反向掩蔽后的线索刺激将注意点内隐地引导到外周。通过控制似动等影响因素, 发现在注意点和注视点分离的状态下存在距离效应—— 也就是随着距离的增长主观等同点变化越大, 但是在重合的状态下则没有。结果表明分离状态下存在传统意义上的注意梯度效应, 而重合时, 注意易化梯度受到一个抑制梯度的影响。这说明, 注意梯度分布受到视网膜离心率的影响, 而影响方式符合注意点为中心的易化梯度场和注视点为中心的抑制梯度场的双梯度场理论。     

Infants' recognition memory for a series of visual stimuli

The tendency of infants to distribute attention selectively to novel and familiar visual stimuli was employed to study infants' recognition memory for a series of visual targets. Infants 5 months of age demonstrated an unequal distribution of visual fixation to novel and familiar stimuli, with more attention to the novel, on both immediate and delayed stimulus-recognition tests for each of three novelty problems administered during a single testing session. The degree of differential fixation to novel targets exhibited no reliable decline from immediate to delayed testing and was not significantly altered by the serial order which the problem occupied during immediate recognition testing.     

Investigating the effects of inversion on configural processing with an audiovisual temporal-order judgment task

Research has shown that inversion is more detrimental to the perception of faces than to the perception of other types of visual stimuli. Inverting a face results in an impairment of configural information processing that leads to slowed early face processing and reduced accuracy when performance is tested in face recognition tasks. We investigated the effects of inverting speech and non-speech stimuli on audiovisual temporal perception. Upright and inverted audiovisual video clips of a person uttering syllables (experiments 1 and 2), playing musical notes on a piano (experiment 3), or a rhesus monkey producing vocalisations (experiment 4) were presented. Participants made unspeeded temporal-order judgments regarding which modality stream (auditory or visual) appeared to have been presented first. Inverting the visual stream did not have any effect on the sensitivity of temporal discrimination responses in any of the four experiments, thus implying that audiovisual temporal integration is resilient to the effects of orientation in the picture plane. By contrast, the point of subjective simultaneity differed significantly as a function of orientation only for the audiovisual speech stimuli but not for the non-speech stimuli or monkey calls. That is, smaller auditory leads were required for the inverted than for the upright-visual speech stimuli. These results are consistent with the longer processing latencies reported previously when human faces are inverted and demonstrates that the temporal perception of dynamic audiovisual speech can be modulated by changes in the physical properties of the visual speech (ie by changes in orientation).     

Fragmentation of fixated line stimuli as a function of gravitational orientation

The differential propensity of fixated line stimuli to fragment and disappear from view was studied as a function of the gravitational orientation of the stimuli. The propensity to fragment was measured in terms of three intercorrelated dependent variables: the number of fragmentations per fixation period, the total duration of fragmentation per fixation period, and the latency to the first fragmentation. Unlike some anisotropic visual phenomena, which may reflect orientation-independent aspects of pattern perception, the observed anisotropy of propensity to fragment can be attributed overwhelmingly to the retinal orientation of the stimuli. Accordingly, this property of fragmentation need nof be ascribed to higher order aspects of pattern perception.     

A methodological investigation of the Intermodal Preferential Looking paradigm: Methods of analyses,picture selection and data rejection criteria

The Intermodal Preferential Looking paradigm provides a sensitive measure of a child's online word comprehension. To complement existing recommendations (Fernald, Zangl, Portillo, & Marchman, 2008), the present study evaluates the impact of experimental noise generated by two aspects of the visual stimuli on the robustness of familiar word recognition with and without mispronunciations: the presence of a central fixation point and the level of visual noise in the pictures (as measured by luminance saliency). Twenty-month-old infants were presented with a classic word recognition IPL procedure in 3 conditions: without a fixation stimulus (No Fixation – noisiest condition), with a fixation stimulus before trial onset (Fixation, intermediate), and with a fixation stimulus, a neutral background and equally salient images (Fixation Plus – least noisy). Data were systematically analyzed considering a range of data selection criteria and dependent variables (proportion of looking time towards the target, longest look, and time-course analysis). Critically, the expected pronunciation and naming interaction was only found in the Fixation Plus condition. We discuss the impact of data selection criteria and the dependent variable choice on the modulation of these effects across the different conditions.     

Measuring the effect of multiple eye fixations on memory for visual attributes.

Because of limited peripheral vision, many visual tasks depend on multiple eye fixations. Good performance in such tasks demonstrates that some memory must survive from one fixation to the next. One factor that must influence performance is the degree to which multiple eye fixations interfere with the critical memories. In the present study, the amount of interference was measured by comparing visual discriminations based on multiple fixations to visual discriminations based on a single fixation. The procedure resembled partial report, but used a discrimination measure. In the prototype study, two lines were presented, followed by a single line and a cue. The cue pointed toward one of the positions of the first two lines. Observers were required to judge if the single line in the second display was longer or shorter than the cued line of the first display. These judgments were used to estimate a length threshold. The critical manipulation was to instruct observers either to maintain fixation between the lines of the first display or to fixate each line in sequence. The results showed an advantage for multiple fixations despite the intervening eye movements. In fact, thresholds for the multiple-fixation condition were nearly as good as those in a control condition where the lines were foveally viewed without eye movements. Thus, eye movements had little or no interfering effect in this task. Additional studies generalized the procedure and the stimuli. In conclusion, information about a variety of size and shape attributes was remembered with essentially no interference across eye fixations.     

Measuring the effect of multiple eye fixations on memory for visual attributes

Because of limited peripheral vision, many visual tasks depend on multiple eye fixations. Good performance in such tasks demonstrates that some memory must survive from one fixation to the next. One factor that must influence performance is the degree to which multiple eye fixations interfere with the critical memories. In the present study, the amount of interference was measured by comparing visual discriminations based on multiple fixations to visual discriminations based on a single fixation. The procedure resembled partial report, but used a discrimination measure. In the prototype study, two lines were presented, followed by a single line and a cue. The cue pointed toward one of the positions of the first two lines. Observers were required to judge if the single line in the second display was longer or shorter than the cued line of the first display. These judgments were used to estimate a length threshold. The critical manipulation was to instruct observers either to maintain fixation between the lines of the first display or to fixate each line in sequence. The results showed an advantage for multiple fixations despite the intervening eye movements. In fact, thresholds for the multiple-fixation condition were nearly as good as those in a control condition where the lines were foveally viewed without eye movements. Thus, eye movements had little or no interfering effect in this task. Additional studies generalized the procedure and the stimuli. In conclusion, information about a variety of size and shape attributes was remembered with essentially no interference across eye fixations.     

Do working memory-driven attention shifts speed up visual awareness?

Previous research has shown that content representations in working memory (WM) can bias attention in favor of matching stimuli in the scene. Using a visual prior-entry procedure, we here investigate whether such WM-driven attention shifts can speed up the conscious awareness of memory-matching relative to memory-mismatching stimuli. Participants were asked to hold a color cue in WM and to subsequently perform a temporal order judgment (TOJ) task by reporting either of two different-colored circles (presented to the left and right of fixation with a variable temporal interval) as having the first onset. One of the two TOJ circles could match the memory cue in color. We found that awareness of the temporal order of the circle onsets was not affected by the contents of WM, even when participants were explicitly informed that one of the TOJ circles would always match the WM contents. The null effect of WM on TOJs was not due to an inability of the memory-matching item to capture attention, since response times to the target in a follow-up experiment were improved when it appeared at the location of the memory-matching item. The present findings suggest that WM-driven attention shifts cannot accelerate phenomenal awareness of matching stimuli in the visual field.     

Stimulus novelty and cognitive-related ERP components of the infant brain

This study recorded visual fixation performance and event-related brain potentials (ERPs) to examine processing of novel visual information in 6- to 7-mo.-old infants as well as to test attention- or memory-related hypotheses of the functional significance of the Nc-ERP component. Separate groups of infants were presented two versions of a novelty-probe task with three types of visual stimuli: (a) a frequent face on 70% of the trials, (b) an oddball face on 15% of the trials, and (c) novel probe stimuli on the remaining 15% of the trials. The novelty probes were faces in one group and irregular shapes in the second group. Analysis showed longer fixations and Nc responses of greater amplitude occurred to oddball and novel stimuli. It was concluded that Nc reflects a top-down, controlled processing mechanism that flexibly allocates attentional resources.     

Perceptual interference and hemispheric specialization

Two experiments evaluated the effect of stimuli presented at fixation on the recognition of faces or random shapes presented to the left or right visual half-field (VF). Increasing the processing demands of the center stimulus produced a large, linear decrease in recognition from both VFs for both faces and shapes. Recognition of random shapes was decreased more in the right visual field by center digits and in the left VF by center faces and shapes. In addition, interference was found between the VF faces and the center digits to the left of fixation. It was concluded that differences in the processing capacity of the two hemispheres are a function of the verbal-nonverbal nature of the stimuli at a later stage in processing but that the two hemispheres may also differ along other perceptual dimensions at an earlier stage of visual recognition.     

Individual differences in object-examining duration: do they reflect the use of different encoding strategies?

Much evidence has shown that individual differences in the duration of visual fixation in infancy are related to processing of wholistic versus featural properties of the stimuli. In the present study, an object-examining technique was used with 8-month-old infants to test the hypothesis that infants who display differential attention durations to visuo-manually presented stimuli will vary in their processing of wholistic versus featural aspects of the stimuli. The results confirmed the hypothesis, indicating that, after being familiarized with an object comprised of both global and local properties, long examiners attended more to an object comprised of new-local rather than new-global aspects, whereas short examiners attended more to the new-global rather than the new-local object. These findings provide support to the contention of the existence of close similarities between visual fixation and object-examining measures as indexes of infant information processing, extending the convergences between the two measures to the domain of individual differences.     

A perceptual-economy account for the inverted-optimal viewing position effect

In reading, fixation durations are longer when the eyes fall near the center of words than when fixation occurs toward the words' ends-the inverted-optimal viewing position (I-OVP) effect. This study assessed whether the I-OVP effect was based on the fixation position in the word or the fixation position in the visual stimulus. In Experiments 1-3, words were presented at variable locations within longer strings of symbols. On trials with short fixation durations, there were effects of fixation position in the string. When long fixations were made, there were effects of fixation position in the word. In Experiment 4, an I-OVP effect was found for meaningless number strings, and its strength depended on the task's processing demands. The findings show that (a) the I-OVP effect is unrelated to orthographic informativeness and (b) the eyes are not constrained to spend more time at the center of visual stimuli. These results support a perceptual-economy account: Fixations are held longer when the eyes are estimated to be at locations in words/stimuli in which greater amounts of information are anticipated. Implications for eye movements in reading are discussed.     

Conserved evolutionary history for quick detection of threatening faces

Humans quickly recognize threats such as snakes and threatening faces, suggesting that human ancestors evolved specialized visual systems to detect biologically relevant threat stimuli. Although non-human primates also detect snakes quickly, it is unclear whether primates share the efficient visual systems to process the threatening faces of their conspecifics. Primates may not necessarily process conspecific threats by facial expressions, because threats from conspecifics in natural situations are often accompanied by other cues such as threatening actions (or attacks) and vocal calls. Here, we show a similar threat superiority effect in both humans and macaque Japanese monkeys. In visual search tasks, monkeys and humans both responded to pictures of a threatening face of an unfamiliar adult male monkey among neutral faces faster than to pictures of a neutral face among threatening faces. However, the monkeys’ response times to detect deviant pictures of a non-face stimulus were not slower when it was shown among threat faces than when it was shown among neutral faces. These results provide the first evidence that monkeys have an attentional bias toward the threatening faces of conspecifics and suggest that threatening faces are evolutionarily relevant fear stimuli. The subcortical visual systems in primates likely process not only snakes, but also more general biological threat-relevant stimuli, including threatening conspecific faces.