Dynamic stereo displays for research on the recovery of three-dimensional structure

Research issues that can be addressed by combining stereoscopic and kinetic depth displays include cue conflict and recalibration, mutual constraints, specialization of cues, and differential effects of disparity and kinetic depth on other perceptions, such as size constancy. Methods of producing dynamic stereoscopic displays are reviewed, especially displays combining stereoscopic with orthographic projections of rotation in depth. A sample personal computer program in Pas-cal is provided.     

The interactive effects of facial expressions of emotion and verbal messages on perceptions of affective meaning

The influence of facial expressions of emotion on perceptions of affective sentence meaning was investigated by pairing happy, angry, suprised, and sad faces of “teachers” with sentences of varying affective tone. Ninety-five students judged the overall meaning communicated by these paired stimuli. The design allowed exploration of unique facial-verbal combination effects, overall cue integration effects, and sex differences. Clear effects of cue combinations emerged. Perceived sincerity was found to be a function of the consistency of evaluative (positivity) but not dominance cues. Perceived positivity was an interactive function of both evaluative cues and dominance cues. Perceived dominance was affected by the interaction of evaluative cues. The subtleties of cue combination were clarified through open-ended dependent measures. Also, as expected, females were found to be more sensitive than males to verbal-nonverbal cue conflict in perceptions of sincerity. However, no other sex differences were found. The findings were discussed with regard to the need for a firm empirical base upon which to integrate verbal and nonverbal research traditions in the communication of affective meaning.     

Surprising depth cue captures attention in visual search

A substantial amount of evidence indicates that surprising events capture attention. The present study was primarily intended to investigate whether expectancy discrepant depth information also is able to capture attention immediately and—more specifically—whether cues that are relatively closer or farther differentially modulate behavior. For this purpose, participants had to identify one of two target letters in a search display. Stimulus positions were initially cued by uninformative placeholders. After half of the trials, the cue at the target position was suddenly and unexpectedly (critical trial) displayed closer to or farther from the observer. In line with previous research, both depth cues captured attention on their very first appearance. Performance in the critical trial was superior to the error rates in the trials without depth cue and was even above the performance in subsequent trials that included depth cue. This effect was only observed when the cue preceded the target by 400 ms. Using a shorter cue-stimulus interval of 100 ms, only a delayed improvement was observed, which denotes a typical feature of surprise capture. Moreover, response times were faster in trials comprising a depth cue, and this was already true for the critical trial. Apart from that, no other marked differences between near and far depth cues were observed. Therefore, the present results emphasize that surprising depth information indeed captures attention. However, in contrast to other perceptual tasks, search performance was not considerably influenced by relative position in depth.     

Dominance as a function of cue similarity: A test of the intrinsic cue dominance model

A nonselective model postulating intrinsic cue dominance was tested in simultaneous discrimination tasks involving reversal on one dimension. In this procedure two dimensions are relevant throughout training; however, following initial discrimination training the reward contingency is reversed for one dimension but maintained for the other. Cue dominance was assessed following acquisition of reversal by the use of opposed-cues test trials, and was defined as a greater number of choices of the test compound containing the positive cue of the reversed dimension than of the test compound containing the positive cue of the maintained dimension. In Experiment I, brightness cues dominated orientation cues. In Experiment II, which employed two different sets of relevant cues, more disparate brightness cues dominated the orientation cues for one set and orientation cues dominated less disparate brightness cues for the other. From this, it was concluded that dominance is a function of relative cue similarity.     

Bayesian integration of spatial information

Spatial judgments and actions are often based on multiple cues. The authors review a multitude of phenomena on the integration of spatial cues in diverse species to consider how nearly optimally animals combine the cues. Under the banner of Bayesian perception, cues are sometimes combined and weighted in a near optimal fashion. In other instances when cues are combined, how optimal the integration is might be unclear. Only 1 cue may be relied on, or cues may seem to compete with one another. The authors attempt to bring some order to the diversity by taking into account the subjective discrepancy in the dictates of multiple cues. When cues are too discrepant, it may be best to rely on 1 cue source. When cues are not too discrepant, it may be advantageous to combine cues. Such a dual principle provides an extended Bayesian framework for understanding the functional reasons for the integration of spatial cues.     

Cue enhancement as a function of task set

The hypothesis was tested that the intention to use a particular cue relation would enhance the effectiveness of that particular cue in determining the resulting perception. For this purpose, a situation was presented in which the apparent depth position of an object in a configuration of objects would differ depending upon which of two possible cue relations (size cues) were used. The results support the conclusion that the perceived depth position of the object differed in the expected directions as a function of the task set. The data of the study are discussed with respect to the “adjacency principle” which states that cue efficiency is determined by the relative adjacency of objects between which the cues occur. Although the effect of cue set upon the perception seems to be small compared with that of adjacency, it cannot completely be ignored.     

Territorial prior residence,size asymmetry,and escalation of aggression in convict cichlids (Cichlasoma nigrofasciatum Günther)

The present study was designed to assess the effects of resident versus intruder size differences upon the territorial prior-residence effect and level of territorial aggression in convict cichlids. Prior to a direct territorial dominance encounter, pairs of fish were randomly composed for one of three experimental treatment conditions: 1) the resident having a body-length 20–30% larger than that of the intruder, 2) the intruder having a body-length 20–30% larger than the resident, or 3) the combatants' body-lengths differing by no more than 5%. After a 3-day territorial acclimation period in their individual territories, the subject designated as the intruder was introduced to the resident's territory. For each encounter the pairmember that attacked first and the one that ultimately established dominance were recorded. Also measured during the encounter were the total number of bites, resident bites, intruder bites, and jaw-locking frequency and duration. The results revealed that there was a significant resident advantage in the resident-larger group. The intruder-larger group resulted in a significant intruder dominance advantage. However, no significant dominance advantage occurred in the same-size group. As predicted by game theory, there was significantly less escalation of aggression in contests in which one combatant held both designated asymmetric cues (prior residence, size) than in contests in which one combatant had prior residence, or when these two asymmetric cues were divided between the pairmembers. The size asymmetry is more important in determining dominance than the prior-residence asymmetry, for the particular size-difference range selected in the present study.     

The effect of overtraining on transfer between tasks involving the same stimulus dimension

Two experiments are reported in which transfer effects between two discrimination tasks are examined following differing amounts of training on the first task. The two tasks were a conditional (successive) discrimination involving black/white cues, and a simultaneous brightness discrimination involving the same black/white cues.

In Experiment I the conditional task was presented first and in Experiment II the simultaneous task was presented first. The results of Experiment I show overall negative transfer which is not directly related to the amount of training. The results of Experiment II, however, reveal positive transfer although again the amount of training produced no significant effect. These seemingly discrepant findings are explained in terms of the difficulty of the conditional task and the development of rigid position stereotypes. It is argued that the concept of frustration-instigated behaviour is necessary to account for the results.     

Factors affecting the magnitude of the Ponzo perspective illusion among the Baganda

The magnitude of the Ponzo perspective illusion, utilizing stimuli with varying amounts of context, was determined for a population of Ugandan villagers. The subjects were classified as two-dimensional, three-dimensional, or mixed perceivers based upon their verbal responses to photographs portraying symbolic depth cues. The illusion magnitude among those subjects classified as three-dimensional was similar to that of college observers who demonstrate an increase in illusion magnitude with increasing background context. The two-dimensional observers’ responses were similar to those of villagers tested previously, showing no significant increase for the same conditions. The role of two-dimensional flatness cues was eliminated on the basis of a control experiment. The data are interpreted as reflecting the operation of a. cognitive factor determining responsiveness to symbolic depth cues in two-dimensional reproductions.     

The aftereffects of ventriloquism: are they sound-frequency specific?

Exposing different sense modalities (like sight, hearing or touch) to repeated simultaneous but spatially discordant stimulations generally causes recalibration of localization processes in one or both of the involved modalities, which is manifested through aftereffects. These provide opportunities for determining the extent of the changes induced by the exposure. Taking the so-called ventriloquism situation, in which synchronized sounds and light flashes are delivered in different locations, we examine if auditory recalibration produced by exposing tones of one frequency to attraction by discordant light flashes generalizes to different frequencies. Contrary to an earlier report, generalization was obtained across two octaves. This result did not depend on which modality attention was forced on through catch trials during exposure. Implications concerning the functional site of recalibration are briefly discussed.     

The effect of semantic context on prospective memory performance

The current study provides evidence for spontaneous processing in prospective memory (PM) or memory for intentions. Discrepancy-plus-search is the spontaneous processing of PM cues via disruptions in processing fluency of ongoing task items. We tested whether this mechanism can be demonstrated in an ongoing rating task with a dominant semantic context. Ongoing task items were manipulated such that the PM cues were members of a semantic category (i.e., Body Parts) that was congruent or discrepant with the dominant semantic category in the ongoing task. Results showed that participants correctly responded to more PM cues when there was a category discrepancy between the PM cues and ongoing task items. Moreover, participants' identification of PM cues was accompanied by faster ongoing task reaction times when PM cues were discrepant with ongoing task items than when they were congruent. These results suggest that a discrepancy-plus-search process supports PM retrieval in certain contexts, and that some discrepancy-plus-search mechanisms may result from the violation of processing expectations within a semantic context.     

Discrimination of possible and impossible objects in infancy

Adults can use pictorial depth cues to infer three-dimensional structure in two-dimensional depictions of objects. The age at which infants respond to the same kinds of visual information has not been determined, and theories about the underlying developmental mechanisms remain controversial. In this study, we used a visual habituation/novelty-preference procedure to assess the ability of 4-month-old infants to discriminate between two-dimensional depictions of structurally possible and impossible objects. Results indicate that young infants are sensitive to junction structures and interposition cues associated with pictorial depth and can detect inconsistent relationships among these cues that render an object impossible. Our results provide important insights into the development of mechanisms for processing pictorial depth cues that allow adults to extract three-dimensional structure from pictures of objects.     

Further consideration of size illusions in random dot stereograms.

It has been suggested that many geometric illusions are caused by the application of depth or size constancy rules to an image which does not have sufficient cues to establish that the elements lie in a flat plane. Thus, converging lines are taken as depth cues, and the attributed depth provides the basis for adjusting the perceived size of stimulus elements. It this is the case, one should not see a distortion of relative size if the disparity cues provide for strong statification, i.e., localization in depth of the linear perspective cues. This expectation is challenged by demonstrations that show distortions of relative size using random-dot stereograms. In 1971 Julesz provided such examples but did not comment on the implications for theories of depth. Here we redemonstrate these distortion of length and size in autostereograms which contain the Ponzo and Corridor configurations. The illusory distortions can be seen in the cyclopean view even though the linear perspective elements are well stratified. We suggest that the processing of binocular disparity cues, as required for judgments of absolute distance, may involve the dorsal stream of vision, i.e., activity passing into and including the parietal lobe. Pictorial cues, on the other hand, are likely passed through the ventral stream into the temporal lobe. The analysis of depth by this system provides for size constancy and, possibly, the calibration of relative motion.     

Adaptation to auditory-visual discordance and ventriloquism in semirealistic situations

While “recalibration by pairing” is now generally held to be the main process responsible for adaptation to intermodal discordance, the conditions under which pairing of heteromodal data occur in spite of a discordance have not been studied systematically. The question has been explored in the case of auditory-visual discordance. Subjects pointed at auditory targets before and after exposure to auditory and visual data from sources 20° apart in azimuth, in conditions varying by (a) the degree of realism of the context, and (b) the synchronization be-tween auditory and visual data. In Experiment 1, the exposure conditions combined the sound of a percussion instrument (bongos) with either the image on a video monitor of the hands of the player (semirealistic situation) or diffuse light modulated by the sound (nonrealistic situation). Experiment 2 featured a voice and either the image of the face of the speaker or light modulated by the voice, and in both situations either sound and image were exactly syn-chronous or the sound was made to lag by 0.35 sec. Desynchronization was found to reduce adaptation significantly, while degree of realism failed to produce an effect. Answers to a question asked at the end of the testing regarding the location of the sound source suggested that the apparent fusion of the auditory and visual data—the phenomenon called “ventriloquism”— was not affected by the conditions in the same way as adaptation. In Experiment 3, subjects were exposed to the experimental conditions of Experiment 2 and were asked to report their impressions of fusion by pressing a key. The results contribute to the suggestion that pairing of registered auditory and visual locations, the hypothetical process at the basis of recalibration, may be a different phenomenon from conscious fusion.     

Stereopsis loses dominance over relative size as target separation increases

Binocular disparity produces less stereoscopic depth if the targets are separated by several degrees. It is thus possible that separation decreases the influence of stereopsis as a relative depth cue. Here, four experiments tested the strength of disparity in determining the direction of relative depth in the face of strongly conflicting relative size for a range of target separations. Under conditions of natural fixation-permitting sequential stereopsis-disparity dominated completely at small separations (0.42 degrees) but gradually gave way to relative size domination at large separations. However, when brief presentations prevented changes in fixation, disparity completely dominated at a separation of 0.5 degrees while relative size mostly dominated by 0.75 degrees - 1 degrees of separation. By varying target separation at different retinal eccentricities, we showed that separation per se was the critical factor in the dominance switch. Stereoacuity as a function of target separation for the same observers did not predict the switch from disparity to relative size. Stereoscopic dominance was found for the same small separations that are immune to stereoscopic reversals (Gillam, 1993 Perception 22 1025-1036). Our results suggest that relative disparity has a compulsory influence on perceived depth at small separations, suggesting a different mechanism from the one operating at larger separations.     

Discrimination learning during the first year: stimulus and positional cues

In four studies, 3-, 6-, and 9-month-old human infants were tested in a discrimination learning task in which visual fixation to a particular stimulus or lateral position was reinforced with an auditory stimulus. In Experiment 1, all age groups exhibited acquisition, extinction, and reinstatement of fixation to the reinforced target or position. Experiment 2 revealed that 3-month-olds retained the positional discrimination but not the stimulus discrimination after a 5-min delay between acquisition and extinction; older infants retained both types of discriminations. In Experiments 3 and 4 we investigated a possible developmental shift in the dominance of positional versus stimulus cues by training infants on displays in which stimulus and position were confounded and then by dissociating the cues on test trials. Results from both experiments indicated positional cue dominance for young infants and stimulus cue dominance for older infants. The findings are discussed in terms of differences in the attentional demands elicited by proprioceptive versus exteroceptive cues.     

Influence of display type and cue format on task-cuing effects: Dissociating switch cost and right-left prevalence effects

In previous studies of task switching and of the right-left prevalence effect, researchers have used a procedure in which the stimulus on each trial occurs in one of four quadrants, and responses are made by pressing one of two diagonally arranged response keys. Across these studies, discrepant effects of cuing interval have been reported. These discrepancies need clarification because cue-based preparation effects are frequently interpreted as reflecting cognitive control processes. In Experiment 1, we compared performance with display formats used by Meiran (1996; Meiran, Chorev, & Sapir, 2000; small display, cues located at sides of quadrants and displayed until response) to study task switching and by Proctor and colleagues (Proctor, Koch, & Vu, 2006; large display, cues located at center of display and shown until target onset) to study right-left prevalence. We found a decrease in task-switch cost with increasing cuing interval with the Meiran display, but not with the Proctor display, but the right-left prevalence effect was of similar size for the two display formats and was relatively unaffected by cuing interval. To determine the basis of the discrepant task-switch results, we used small and large displays in Experiments 2 and 3, respectively, with cue type and cue offset varied. With the side cues, the task-switch cost decreased in all cases at the longer cuing interval, but with the centered cues, it decreased only when the display size was small. Thus, the effects of cuing interval on switch costs are sensitive to variations of display characteristics, whereas cuing interval and display characteristics have little influence on the right-left prevalence effect, suggesting that prevalence effect is due to processes that are independent from those producing the switch cost.     

The role of spatial attention and other processes on the magnitude and time course of cueing effects

We are quite often exposed to multiple objects present in the visual scene, thus attentional selection is necessary in order to selectively respond to the relevant information. Objects can be selected on the basis of the location they occupy by orienting attention in space. In this paper, we review the evidence showing that attention can be oriented in space either endogenously, on the basis of central cues, predictive of the relevant location, or exogenously, automatically triggered by the salient properties of visual stimuli (peripheral cues). Several dissociations observed between orienting on the basis of the two types of cues have led to the conclusion that they do not represent just two modes of triggering the orienting of the very same attentional mechanism, but rather they modulate processing differently. We present a theoretical framework according to which endogenous predictive cues facilitate target processing by orienting attention, thus amplifying processing at the attended location. In contrast, apart from attentional orienting, peripherally presented discrepant cues might trigger additional cue-target event-integration and event-segregation processes, which modulate processing in a different way, thus leading to cueing effects that are exclusively triggered by peripheral cues.     

Cue interactions in flavor preference learning: a configural analysis

Four experiments showed that the preference normally established to a neutral flavor cue that was paired with maltodextrin was attenuated when that cue was conditioned in compound with another flavor--overshadowing. Furthermore, two experiments showed that the preference for a neutral flavor conditioned as part of a compound was further attenuated if the other element in that compound was separately paired with the reinforcer--blocking. These results stand in contrast to a number of previous compound flavor preference conditioning experiments, which have not revealed reliable cue competition effects. These discrepant findings are discussed in terms of the effects of within-compound associations and a configural perspective on potentiation. Modeling of this configural perspective predicts that a compound of two separately trained cues will elicit a similar response to the individual cues themselves--absence of summation. Two experiments confirmed this prediction.     

The sounds of dominance.

A study was conducted to determine the effects of vocal cues on judgements of dominance in an interpersonal influence context. Physical measures of human vocal cues and participant ratings of dominance were obtained from videotapes of actors delivering short influence messages. After controlling for linguistic and visual content of messages, results indicated that mean amplitude and amplitude standard deviation were positively associated with dominance judgments, whereas speech rate was negatively associated with dominance judgments. An unexpected interaction revealed that mean fundamental frequency (F₀) was positively associated with dominance judgments for male speakers but not significantly associated with dominance judgments for female speakers. F₀ standard deviation was not significantly associated with dominance judgments. Results support the conclusion that dominance judgments are inferred from multiple sources of information and that some vocal markers of dominance are more influential than others.