The colors seen behind transparent filters

How do the colors and lightnesses of surfaces seen to lie behind a transparent filter depend on the chromatic properties of the filter? A convergence model developed in prior work (D'Zmura et al, 1997 Perception 26 471-492; Chen and D'Zmura, 1998 Perception 27 595-608) suggests that the visual system interprets a filter's transformation of color in terms of a convergence in color space. Such a convergence is described by a color shift and a change in contrast. We tested the model using an asymmetric matching task. Observers adjusted, in computer graphic simulation, the color of a surface seen behind a transparent filter in order to match the color of a surface seen in plain view. The convergence model fits the color-matching results nearly as well as a more general affine-transformation model, even though the latter has many more parameters. Other models, including von Kries scaling, did not perform as well. These results suggest that the color constancy revealed in this task is described best by a model that takes into account both color shifts and changes in contrast.     

Perceptual transparency in neon color spreading displays

In neon color spreading displays, both a color illusion and perceptual transparency can be seen. In this study, we investigated the color conditions for the perception of transparency in such displays. It was found that the data are very well accounted for by a generalization of Metelli's (1970) episcotister model of balanced perceptual transparency to tristimulus values. This additive model correctly predicted which combinations of colors would lead to optimal impressions of transparency. Color combinations deviating slightly from the additive model also looked transparent, but less convincingly so.     

Motion transparency: making models of motion perception transparent

In daily life our visual system is bombarded with motion information. We see cars driving by, flocks of birds flying in the sky, clouds passing behind trees that are dancing in the wind. Vision science has a good understanding of the first stage of visual motion processing, that is, the mechanism underlying the detection of local motions. Currently, research is focused on the processes that occur beyond the first stage. At this level, local motions have to be integrated to form objects, define the boundaries between them, construct surfaces and so on. An interesting, if complicated case is known as motion transparency: the situation in which two overlapping surfaces move transparently over each other. In that case two motions have to be assigned to the same retinal location. Several researchers have tried to solve this problem from a computational point of view, using physiological and psychophysical results as a guideline. We will discuss two models: one uses the traditional idea known as ‘filter selection’ and the other a relatively new approach based on Bayesian inference. Predictions from these models are compared with our own visual behaviour and that of the neural substrates that are presumed to underlie these perceptions.     

On noticing transparent states: A compatibilist approach to transparency

According to the transparency thesis, some conscious states are transparent or “diaphanous”. This thesis is often believed to be incompatible with an inner-awareness account of phenomenal consciousness. In this article, I reject this incompatibility. Instead, I defend a compatibilist approach to transparency. To date, most attempts to do so require a rejection of strong transparency in favor of weak transparency. In this view, transparent states can be attended to by attending (in the right way) to the presented world: that is, they are merely translucent. Here, I first argue that this understanding of transparency is too weak to qualify as a compatibilist view. Drawing on insights from Franz Brentano, I then describe a middle road between strong and weak transparency. The crucial idea is that, although transparent states cannot be attended to, they can be noticed (under suitable conditions). This view, I submit, allows supporters of inner awareness to commit themselves to a more interesting understanding of transparency—moderate transparency—that preserves the initial intuition underlying the transparency metaphor.     

Flank transparency: the effects of gaps,line spacing,and apparent motion

We analyze the properties of a dynamic color-spreading display created by adding narrow colored flanks to rigidly moving black lines where these lines fall in the interior of a stationary virtual disk. This recently introduced display (Wollschl?ger et al, 2001 Perception 30 1423-1426) induces the perception of a colored transparent disk bounded by strong illusory contours. It provides a link between the classical neon-color-spreading effect and edge-induced color spreading as discussed by Pinna et al (2001 Vision Research 41 2669-2676). We performed three experiments to quantitatively study (i) the enhancing influence of apparent motion; (ii) the degrading effect of small spatial discontinuities (gaps) between lines and flanks; and (iii) the spatial extent of the color spreading. We interpret the results as due to varying degrees of objecthood of the dynamically specified disk: increased objecthood leads to increased surface visibility in both contour and color.     

Illusions of size change in dynamic displays

A line of constant width viewed against an expanding or contracting grating appears to become narrower or wider, respectively. This effect was studied using a computer-controlled video system with a motorized zoom lens. The magnitude of the illusory size (width) change with a vertical line did not differ when viewed against a horizontal or an oblique background, and the size change was not due to static size contrast between the line and the background. The illusory narrowing observed with an expanding background was equivalent to the widening observed with a contracting background. The apparent change in the width of lines that actually expanded was consistently underestimated, either on a similarly changing background or when viewed against a gray field. Although the transformation of the background and line produced changes in their perceived distance, this did not occur for a constant line against a transforming background, even though this condition induced the perceived size change.     

Age-related differences in visual search in dynamic displays

The authors examined the ability of younger and older adults to detect changes in dynamic displays. Older and younger adults viewed displays containing numerous moving objects and were asked to respond when a new object was added to the display. Accuracy, response times, and eye movements were recorded. For both younger and older participants, the number of eye movements accounted for a large proportion of variance in transient detection performance. Participants who actively searched for the change performed significantly worse than did participants who employed a passive or covert scan strategy, indicating that passive scanning may be a beneficial strategy in certain dynamic environments. The cost of an active scan strategy was especially high for older participants in terms of both accuracy and response times. However, older adults who employed a passive or covert scan strategy showed greater improvement, relative to older active searchers, than did younger adults. These results highlight the importance of individual differences in scanning strategy in real-world dynamic, cluttered environments.     

Inhibition of return in static and dynamic displays

Inhibition of return (IOR) causes people to be slower to return their attention to a recently attended object (object-based IOR) or location (location-based IOR). In attempts to separately measure the two components, moving stimuli have been used that permit the dissociation of the attended object from its location when it was attended. The implicit assumption has been that both object- and locationbased components of IOR will operate whenever the cued object and cued location are identical. We show here that although this assumption may be true in a static display, it appears to be unwarranted when moving stimuli are involved: Very little IOR is observed when a cued object moves away from, and then subsequently returns to, its initial location. Thus, the processes that underlie IOR operate very differently in static versus dynamic scenes.     

Attentional tracking and inhibition of return in dynamic displays

Seven experiments were conducted to replicate, and extend, a finding by Tipper, Driver, and Weaver (1991). They reported evidence for dynamic, object-centered inhibition of return (IOR)—that is, coding of inhibition following a peripheral cue in coordinates that move with the previously cued object, providing a dynamic bias against reattending to that object. The present experiments used a variation of Posner and Cohen’s (1984) spatial cuing paradigm. Subjects responded manually (simple reaction time) to a luminance increment in one of two peripheral boxes, one of which had previously been cued (brightened). Experiments 1, 2, and 5 replicated the standard (environmental) IOR effect when the display was stationary. IOR was more marked for right-side targets than for left-side targets and tended to be affected by the compatibility between response hand and (cued) target position. However, when the boxes moved around the display center (Experiments 1, 2, 3, 4, 6, and 7), contrary to Tipper et al., there was no evidence of dynamic, object-centered IOR. Rather, there was strong evidence of attentive tracking of whatever box happened to move from left to right, irrespective of the direction of its motion (clockwise or counterclockwise) and whether it was more likely to contain the target than the other (right-to-left moving) box. There was a tendency for left-to-right tracking to be more marked with right-hand responses, pointing to the existence of a dynamic stimulus-response compatibility effect. The implications of the present findings for the role of attentive tracking and IOR in dynamic scenes are discussed.     

Perception of American sign language in dynamic point-light displays

Perception of dynamic events of American Sign Language (ASL) was studied by isolating information about motion in the language from information about form. Four experiments utilized Johansson's technique for presenting biological motion as moving points of light. In the first, deaf signers were highly accurate in matching movements of lexical signs presented in point-light displays to those normally presented. Both discrimination accuracy and the pattern of errors were similar in this matching task to that obtained in a control condition in which the same signs were always represented normally. The second experiment showed that these results held for discrimination of morphological operations presented in point-light displays as well. In the third experiment, signers were able to accurately identify signs of a constant handshape and morphological operations acting on signs presented in point-light displays. Finally, in Experiment 4, we evaluated what aspects of the motion patterns carried most of the information for sign identifiability. We presented signs in point-light displays with certain lights removed and found that the movement of the fingertips, but not of any other pair of points, is necessary for sign identification and that, in general, the more distal the joint, the more information its movement carries.     

Understanding dynamic and static displays: using images to reason dynamically

We examined expert meteorologists as they created a weather forecast while working in a naturalistic environment. We examined the type of external representation they chose to examine (a static image, a sequence of static images, or a dynamic display) and the kind of information they extracted from those representations (static or dynamic). We found that even though weather is an extremely dynamic domain, expert meteorologists examined very few animations, examining primarily static images. However, meteorologists did extract large amounts of dynamic information from these static images, suggesting that they reasoned about the weather by mentally animating the static images rather than letting the software do it for them.     

The effect of movement velocity on form perception: geometric illusions in dynamic displays

We investigated the effects of movement velocity on the perception of simple geometric trajectories. We show that when an ellipse is traced by the continuous displacement of a spot against an empty background, the subjective aspect ratio (R = vertical axis/horizontal axis) of the figure depends on the law of motion of the spot. If the tangential velocity of the spot is constant, very large and subject-specific biases emerge in the perception of the aspect ratio. If the tangential velocity of the spot is made equal to that of an elliptic motion with aspect ratio R less than 1, and resulting from the vectorial composition of two harmonic functions (Lissajous motion) there is a general trend to perceive the ellipse as being flatter than in reality. The effect, however, is not symmetric: when the velocity follows a Lissajous modulation with R greater than 1, highly significant biases are still present in most subjects, but no common trend emerges from the experimental population. The results are discussed in the context of recent findings on the relationship between form and kinematics in spontaneous human movements.     

Recognizing people seen in events via dynamic "mug shots"

This study examined effects of an event and dynamic mug shots on facial recognition. Witnesses saw either a film of a liquor store holdup staged by six perpetrators, slides of the same targets, or freeze-framed views from the filmed event. Slides of different facial views of targets among 12 foils, or dynamic 180 degrees mug shots of the same men, or multiple static views were administered 24 hr later in yes-no recognition tests. Recognition (d') was poorer for the same men seen in the event than in slides, but better for dynamic than for static mug shots. Nondynamic event characteristics were responsible for poor recognition of people seen in events, whereas dynamic aspects of facial transformations, not multiple views, seemed responsible for the superiority of dynamic mug shots. The implications of these results for issues of ecological validity of traditional face recognition methodology and for static feature models vs. dynamic transformation models of face recognition are discussed.     

Training older adults to search more effectively: scanning strategy and visual search in dynamic displays

The authors examined the ability of older adults to modify their search strategies to detect changes in dynamic displays. Older adults who made few eye movements during search (i.e., covert searchers) were faster and more accurate compared with individuals who made many eye movements (i.e., overt searchers). When overt searchers were instructed to adopt a covert search strategy, target detection performance increased to the level of natural covert searchers. Similarly, covert searchers instructed to search overtly exhibited a decrease in target detection performance. These data suggest that with instructions and minimal practice, older adults can ameliorate the cost of a poor search strategy.     

Emotion perception from dynamic and static body expressions in point-light and full-light displays

Research on emotion recognition has been dominated by studies of photographs of facial expressions. A full understanding of emotion perception and its neural substrate will require investigations that employ dynamic displays and means of expression other than the face. Our aims were: (i) to develop a set of dynamic and static whole-body expressions of basic emotions for systematic investigations of clinical populations, and for use in functional-imaging studies; (ii) to assess forced-choice emotion-classification performance with these stimuli relative to the results of previous studies; and (iii) to test the hypotheses that more exaggerated whole-body movements would produce (a) more accurate emotion classification and (b) higher ratings of emotional intensity. Ten actors portrayed 5 emotions (anger, disgust, fear, happiness, and sadness) at 3 levels of exaggeration, with their faces covered. Two identical sets of 150 emotion portrayals (full-light and point-light) were created from the same digital footage, along with corresponding static images of the 'peak' of each emotion portrayal. Recognition tasks confirmed previous findings that basic emotions are readily identifiable from body movements, even when static form information is minimised by use of point-light displays, and that full-light and even point-light displays can convey identifiable emotions, though rather less efficiently than dynamic displays. Recognition success differed for individual emotions, corroborating earlier results about the importance of distinguishing differences in movement characteristics for different emotional expressions. The patterns of misclassifications were in keeping with earlier findings on emotional clustering. Exaggeration of body movement (a) enhanced recognition accuracy, especially for the dynamic point-light displays, but notably not for sadness, and (b) produced higher emotional-intensity ratings, regardless of lighting condition, for movies but to a lesser extent for stills, indicating that intensity judgments of body gestures rely more on movement (or form-from-movement) than static form information.     

Searching for two categories of target in dynamic visual displays impairs monitoring ability

Target onsets in dynamically changing displays can be predicted when contingencies exist between different stimulus states over time. In the present study, we examined predictive monitoring when participants searched dynamically changing displays of numbers and colored squares for a color target, a number target, or both. Stimuli were presented in both contiguous and discrete spatial configurations. Response time (RT) and accuracy were recorded, and evidence of predictive monitoring was assessed via first fixations and refixations of target‐predictive stimuli. RTs to target onsets and evidence of predictive monitoring were reduced in dual‐target, relative to single‐target, conditions. Further, predictive monitoring did not speed RTs but was influenced by display configuration. In particular, discrete displays impaired monitoring for number targets in the dual‐target condition. Implications exist for real‐world visual tasks involving multiple target categories and for visual display design.     

The reward of a good joke: neural correlates of viewing dynamic displays of stand-up comedy

Humor is enjoyable, yet few studies to date have reported that humor engages brain regions involved in reward processing (i.e., the mesolimbic reward system). Even fewer have investigated socially relevant, dynamic displays of real actors telling jokes. Instead, many studies have focused on responses to static cartoons or written jokes in isolation. In the present investigation, we used functional magnetic resonance imaging (fMRI) to examine brain activation in response to video clips of comedians performing stand-up comedy, a more socially relevant task than reading jokes or cartoons in isolation. Participants watched video clips of eight stand-up comedians, half female/half male, that were prerated by a separate group of participants from the same population as eliciting either high or low levels of amusement, thereby allowing us to control for comedian attributes and comedic style. We found that high-funny clips elicited more activation in several brain regions involved with reward responses, including the nucleus accumbens, caudate, and putamen. A regression with participants’ own ratings of humor revealed similar activity in reward areas as well as in regions involved in theory of mind. These findings indicate that dynamic social displays of humor do engage reward responses. The rewarding nature of humor may help explain why it is so valued socially.     

Conventional displays: Evidence for socially mediated costs of threat displays in a lizard

Threat displays are used to settle the vast majority of contests between green anoles (Anolis carolinensis). While these displays have been the subject of a number of studies, very little is understood about the information they convey. Theoretical models divide displays into several types of signals, based on the mechanism that stabilizes their use: 1) performance signals, 2) handicapping signals, or 3) conventional displays. The existence of performance displays has excellent empirical support, as do models of their use. Handicapped signalling models, especially those relating to mate‐choice, have been highly influential, though little evidence suggests that threat displays are, in fact, handicapping. Most threat displays appear to be conventional, but little empirical work documents conventional signalling systems. This study investigated the use of headbob, pushup, and lateral compression displays, and concluded that headbob cadence, a discrete signal with three alternative rhythms, is a conventional display indicating impending escalation. Pushups and lateral compression displays appear not to be handicaps, since neither indicates impending escalation, and they do not correlate with fighting ability or condition. Aggr. Behav. 30:326–341, 2004. © 2004 Wiley‐Liss, Inc.     

Modal completion: critical variables in apparent transparency

Conditions for perceptual modal completion are investigated using a stimulation pattern consisting of a figure moving behind a black opaque strip. This configuration leads, depending on conditions, either to the amodal Michotte tunnel effect, or to modal completion, ie the apparent transparency phenomenon. Four experiments are reported in which an attempt was made to define the critical variables of this latter effect. The results show that modal completion is not typically related to luminance interactions, ie to assimilation, but depends on the figural dominance of the filled-in object, this being determined by structural factors such as figure-ground relationship and stimulation change. The effect also depends strongly on the complexity of the spatiotemporal integration needed to maintain phenomenal identity of the object. No significant effect was found for the two other variables investigated, ie formal complexity of the figure and depth between the figure and the strip. The data are discussed in relation to those on moving visual phantoms.     

Everyday speechreading: understanding seen speech in action

How does speechreading (lipreading) work at the cognitive and neurobiological level? In this review I summarise work over the last fifteen years that has used everyday speechreading in hearing participants to illuminate issues of cerebral localisation and cognitive function. The implications of this work for deepening our understanding of speechreading in a remedial context are highlighted.