When does grouping happen?

Recent research on perceptual grouping is described with particular emphasis on identifying the level(s) at which grouping factors operate. Contrary to the classical view of grouping as an early, two-dimensional, image-based process, recent experimental results show that it is strongly influenced by phenomena related to perceptual constancy, such as binocular depth perception, lightness constancy, amodal completion, and illusory contours. These findings imply that at least some grouping processes operate at the level of phenomenal perception rather than at the level of the retinal image. Preliminary evidence is reported showing that grouping can affect perceptual constancy, suggesting that grouping processes must also operate at an early, preconstancy level. If so, grouping may be a ubiquitous, ongoing aspect of visual organization that occurs for each level of representation rather than as a single stage that can be definitively localized relative to other perceptual processes.     

Searching for the minimal essential information for skilled perception and action

Summary A common concern for both cognitive/computational and ecological/dynamical models of human motor control is the isolation of the minimal essential information needed to support skilled perception and action. In perception isolating essential features of the optic flow field, which are reliably informative regarding the nature of current events, from nonessential features provides a valuable step towards understanding how the computational complexity of perceptual information processing may be reduced to manageable levels and how relatively direct linkages of low dimensionality may be established between information and control variables. Likewise, in the study of action, discrimination of the movement features that remain immutable (invariant?) across changes in task conditions from the variables that are situationally determined provides a principled insight into the structural framework upon which skilled movement is built. Controversy abounds, however, in the study of perception and action as to whether features isolated as informative and immutable are centrally represented (in the form of a template or program) or are rather directly picked up (in the case of perceptual variables) or are simply an emergent consequence of the underlying dynamics (in the case of action variables). In this paper some examples of putative minimal essential information sources in perception and action are provided, strategies for uncovering such sources are discussed, and attention is directed, with the use of some recent data collected on natural skills, to some systematic expert-novice differences in the utilization of essential information and control variables. Expert-novice differences are highlighted because of the insight they may provide regarding the nature of perceptual-motor skill acquisition.     

The relation of perception and motor action: ideomotor compatibility and interference in divided attention

Ideomotor theory is one variation of the general position that perception and motor action are related. According to this theory, a perceptual representation of the goal of a response must be generated prior to response initiation. Ideomotor theory can be extended by assuming that generation of this representation, which usually is required prior to motor action, is not needed if the stimulus itself corresponds to the response goal, that is, if the stimulus and response are ideomotor compatible. Because processing to generate the response representation is not needed with ideomotor compatibility, it should be possible to control two responses simultaneously without mutual interference if at least one stimulus-response relation is ideomotor compatible. Although supported in previous work involving discrete responses, this prediction of perfect time-sharing was found not to hold in the experiments reported here. These experiments, unlike those showing perfect time-sharing, involved continuous responses. We propose an alternative version of ideomotor compatibility, in which perfect time-sharing can occur if an integrated stimulus is provided to match the continuous and integrated response.     

具身概念表征的研究及理论述评

具身认知强调认知在本质上是具身的, 身体在认知的实现中发挥着关键作用。传统的符号加工理论认为, 概念表征独立于主体的知觉运动系统并以抽象符号的形式储存于语言记忆中。概念表征的具身理论则认为, 概念表征与知觉运动系统具有共同的神经基础, 概念在本质上是主体经验客体时知觉与运动体验的神经记录, 而概念加工的基本形式则是身体经验的模拟与还原。关于该理论的实证研究主要集中于概念加工引发的知觉动作变化、身体动作对概念加工的影响、抽象概念加工的具身特征等领域。今后的研究应关注符号加工理论与具身理论的整合等。     

Embodied inference and spatial cognition

How much about our interactions with--and experience of--our world can be deduced from basic principles? This paper reviews recent attempts to understand the self-organised behaviour of embodied agents, like ourselves, as satisfying basic imperatives for sustained exchanges with the environment. In brief, one simple driving force appears to explain many aspects of perception, action and the perception of action. This driving force is the minimisation of surprise or prediction error, which--in the context of perception--corresponds to Bayes-optimal predictive coding (that suppresses exteroceptive prediction errors) and--in the context of action--reduces to classical motor reflexes (that suppress proprioceptive prediction errors). In what follows, we look at some of the phenomena that emerge from this single principle, such as the perceptual encoding of spatial trajectories that can both generate movement (of self) and recognise the movements (of others). These emergent behaviours rest upon prior beliefs about itinerant (wandering) states of the world--but where do these beliefs come from? In this paper, we focus on the nature of prior beliefs and how they underwrite the active sampling of a spatially extended sensorium. Put simply, to avoid surprising states of the world, it is necessary to minimise uncertainty about those states. When this minimisation is implemented via prior beliefs--about how we sample the world--the resulting behaviour is remarkably reminiscent of searches seen in foraging or visual searches with saccadic eye movements.     

Segregated in perception,integrated for action: Immunity of rhythmic sensorimotor coordination to auditory stream segregation

Auditory stream segregation can occur when tones of different pitch (A, B) are repeated cyclically: The larger the pitch separation and the faster the tempo, the more likely perception of two separate streams is to occur. The present study assessed stream segregation in perceptual and sensorimotor tasks, using identical ABBABB … sequences. The perceptual task required detection of single phase-shifted A tones; this was expected to be facilitated by the presence of B tones unless segregation occurred. The sensorimotor task required tapping in synchrony with the A tones; here the phase correction response (PCR) to shifted A tones was expected to be inhibited by B tones unless segregation occurred. Two sequence tempi and three pitch separations (2, 10, and 48 semitones) were used with musically trained participants. Facilitation of perception occurred only at the smallest pitch separation, whereas the PCR was reduced equally at all separations. These results indicate that auditory action control is immune to perceptual stream segregation, at least in musicians. This may help musicians coordinate with diverse instruments in ensemble playing.     

On the Perception of Structure

Many of the objects that we perceive have an important characteristic: When they move, they change shape. For instance, when you watch a person walk across a room, her body constantly deforms. I suggest that we exercise a type of perceptual constancy in response to changes of this sort, which I call structure constancy. In this paper I offer an account of structure constancy. I introduce the notion of compositional structure, and propose that structure constancy involves perceptually representing an object as retaining its compositional structure over time. I argue that compositional structure is represented in visual phenomenology, and I also assemble empirical evidence in support of the claim that compositional structure is recovered by the visual system. Finally, I draw out consequences of this account. I argue that structure constancy has implications for the predictive capacities of perception, and that the phenomenon places important constraints on viable accounts of both the format and reference frame of visual experience.     

Odour perception: an object-recognition approach

Object recognition is a crucial component of both visual and auditory perception. It is also critical for olfaction. Most odours are composed of 10s or 100s of volatile components, yet they are perceived as unitary perceptual events against a continually shifting olfactory background (i.e. figure-ground segregation). We argue here that this occurs by rapid central adaptation to background odours combined with a pattern-matching system to recognise discrete sets of spatial and temporal olfactory features-an odour object. We present supporting neuropsychological, learning, and developmental evidence and then describe the neural circuitry which underpins this. The vagaries of an object-recognition approach are then discussed, with emphasis on the putative importance of memory, multimodal representations, and top-down processing.     

Accuracy of perceptual processes subserving different perception-action systems

The accuracy of perceptual processes subserving different perception-action systems was evaluated by presenting subjects (N = 17) with similar optic flow patterns, while requiring different actions from them. Squash balls were dropped along a fixed trajectory, and subjects were asked to (a) hit the ball using their own arm, (b) release an artificial arm to hit the ball, and (c) indicate when the ball was at the point of contact of conditions (a) and (b). The variability of the temporal initiation point of the actions, which served as an operationalization of perceptual accuracy, was compared under all three conditions. The results indicated that the variability of the temporal initiation point was smallest under the natural arm condition, even though movement time was more variable here than under the artificial arm condition. It is argued that, because perception and action are intimately interwoven components of a perceiving/acting system, it is not an extrinsically (experimenter-) determined simplicity of perceptual and/or motor aspects of the task, but the intrinsic make-up of this overarching system that determines which couplings lead to a more accurate performance.     

Time for action versus action in time: time estimation differs between motor preparation and execution

Theories relating to time perception and motor performance predict very different temporal distortions depending on the synchronisation or succession of temporal processing and motor behaviour. However, our knowledge about the temporal difference between motor preparation and execution is still scarce. In order to expand on prior studies, two different time reproduction tasks were utilised to measure motor preparation and motor execution. We found that motor preparation of a planned action allows participants to complete the time reproduction task more accurately and, in short duration trials, less variably than for motor execution. Furthermore, under-reproduction was found in motor preparation compared to motor execution, which may be caused by increased temporal information processing. According to the attentional gate theory, more attention allocated to time processing and reduced motor distraction leads to less temporal distortion in the motor preparation. The findings are also important for designing to study consciousness, temporal and visual processing.     

Perceptual and cognitive processes in time-to-contact estimation: Analysis of prediction-motion and relative judgment tasks

Three classes of task appear to involve time-to-contact (TTC) information: coincidence anticipation (CA) tasks, relative judgment (RJ) tasks, and interceptive actions (IAs). An important type of CA task used to study the perception of TTC is the prediction-motion (PM) task. The question of whether it is possible to study the perceptual processes involved in the timing of IAs using PM and RJ tasks is considered. A revised version of the tau hypothesis is proposed as an account of the perceptual information processing involved in the control of fast IAs. This draws on the distinction between “motor” and “cognitive” visual systems. It is argued that task variables affect whether “cognitive” information processing is involved in performance and can determine whether TTC information is used at all. Evidence is reviewed that suggests that PM and RJ tasks involve cognitive processing. It is argued that target viewing time, TTC at response initiation, amount of practice, and whether there is a period between target disappearance and response are task variables that determine whether cognitive processing will influence responding.     

Bad things come easier to the mind but harder to the body: Evidence from brain oscillations

An intriguing finding of research on emotional processing is a discrepancy between perception and behavior. Perceptually, a robust finding is that negative stimuli are processed faster and more efficiently than positive stimuli. Behaviorally, a similarly robust finding is that response times are slower for negative than for positive stimuli. We proposed and tested a novel account to explain this still unexplained discrepancy, on the basis of the assumption that negative valence narrows perceptual processes to the benefit of speeded perception, but broadens motor processes at the cost of slowed responding. Participants performed a valence judgment task in which they responded with their left or right hand to negative and positive stimuli that were presented on the left or right, and we measured the activation of relevant/deactivation of irrelevant perceptual and motor processes, as revealed by the lateralization of electroencephalographic brain oscillations. Stimulus-related lateralization of alpha activity (8–12 Hz) over perceptual areas was increased for negative stimuli, indicating more efficient perceptual processing. By contrast, response-related lateralization of beta activity (20–25 Hz) over motor areas was decreased for negative stimuli, indicating less efficient response activation. Consistent with our predictions, more detailed analyses showed that both lateralization effects were caused by dynamics at the level of inhibiting irrelevant processes. For negative as compared to positive stimuli, the inhibition of irrelevant perceptual processes was increased, but the inhibition of irrelevant motor processes was decreased. These findings indicate that the discrepancy between perception and behavior in emotional processing may stem from asymmetrical effects of emotional valence on the breadth of cortical activations in perceptual and motor networks.     

Tracking without perceiving: a dissociation between eye movements and motion perception

Can people react to objects in their visual field that they do not consciously perceive? We investigated how visual perception and motor action respond to moving objects whose visibility is reduced, and we found a dissociation between motion processing for perception and for action. We compared motion perception and eye movements evoked by two orthogonally drifting gratings, each presented separately to a different eye. The strength of each monocular grating was manipulated by inducing adaptation to one grating prior to the presentation of both gratings. Reflexive eye movements tracked the vector average of both gratings (pattern motion) even though perceptual responses followed one motion direction exclusively (component motion). Observers almost never perceived pattern motion. This dissociation implies the existence of visual-motion signals that guide eye movements in the absence of a corresponding conscious percept.     

The time of consciousness and vice versa

The temporal granularity of consciousness may be far less fine than the real-time information processing mechanisms that underlie our sensitivity to small temporal differences. It is suggested that conscious time perception, like space perception, is subject to errors that belie a unitary underlying representation. E. R. Clay's (The Alternative: A Study in Psychology, 1882) concept of the "specious present," an extended moment represented in consciousness, is suggested as an alternative to the more common notion of instantaneous experience that underlies much reasoning based on the "time of arrival" in consciousness.     

On the perception of shape from shading

The extraction of three-dimensional shape from shading is one of the most perceptually compelling, yet poorly understood, aspects of visual perception. In this paper, we report several new experiments on the manner in which the perception of shape from shading interacts with other visual processes such as perceptual grouping, preattentive search (“pop-out”), and motion perception. Our specific findings are as follows: (1) The extraction of shape from shading information incorporates at least two “assumptions” or constraints—first,that there is a single light source illuminating the whole scene, and second, that the light is shining from “above” in relation to retinal coordinates. (2) Tokens defined by shading can serve as a basis for perceptual grouping and segregation. (3) Reaction time for detecting a single convex shape does not increase with the number of items in the display. This “pop-out” effect must be based on shading rather than on differences in luminance polarity, since neither left-right differences nor step changes in luminance resulted in pop-out. (4) When the subjects were experienced, there were no search asymmetries for convex as opposed to concave tokens, but when the subjects were naive, cavities were much easier to detect than convex shapes. (5) The extraction of shape from shading can also provide an input to motion perception. And finally, (6) the assumption of “overhead illumination” that leads to perceptual grouping depends primarily on retinal rather than on “phenomenal” or gravitational coordinates. Taken collectively, these findings imply that the extraction of shape from shading is an “early” visual process that occurs prior to perceptual grouping, motion perception, and vestibular (as well as “cognitive”) correction for head tilt. Hence, there may be neural elements very early in visual processing that are specialized for the extraction of shape from shading.     

The Theory of Event Coding (TEC): a framework for perception and action planning

Traditional approaches to human information processing tend to deal with perception and action planning in isolation, so that an adequate account of the perception-action interface is still missing. On the perceptual side, the dominant cognitive view largely underestimates, and thus fails to account for, the impact of action-related processes on both the processing of perceptual information and on perceptual learning. On the action side, most approaches conceive of action planning as a mere continuation of stimulus processing, thus failing to account for the goal-directedness of even the simplest reaction in an experimental task. We propose a new framework for a more adequate theoretical treatment of perception and action planning, in which perceptual contents and action plans are coded in a common representational medium by feature codes with distal reference. Perceived events (perceptions) and to-be-produced events (actions) are equally represented by integrated, task-tuned networks of feature codes--cognitive structures we call event codes. We give an overview of evidence from a wide variety of empirical domains, such as spatial stimulus-response compatibility, sensorimotor synchronization, and ideomotor action, showing that our main assumptions are well supported by the data.     

Configural coding of facial expressions: The impact of inversion and photographic negative

In previous research we used the composite paradigm (Young, Hellawell, & Hay, ) to demonstrate that configural cues are important for interpreting facial expressions. However, different configural cues in face perception have been identified, including holistic processing (i.e., perception of facial features as a single gestalt) and second‐order spatial relations (i.e., the spatial relationship between individual features). Previous research has suggested that the composite effect for facial identity operates at the level of holistic encoding. Here we show that the composite effect for facial expression has a similar perceptual basis by using different graphic manipulations (stimulus inversion and photographic negative) in conjunction with the composite paradigm. In relation to Bruce and Young's () functional model of face recognition, a suitable level for the composite effect is a stage of front‐end processing referred to as structural encoding, that is common to both facial identity and facial expression perception.     

The development of object-permanence: Some studies of existence constancy

Object permanence or existence constancy was one of the phenomena which greatly exercised the philosophical fathers of experimental psychology. The topic has been little studied since. Michotte has described the psychophysics of existence constancy, while Piaget has studied its development. Michotte’s work was restricted to adults while Piaget’s notably lacked careful psychophysical control. The aim of the present study was to bridge the gap between the two, to study the psychophysics of existence constancy in infants. Results showed that there is remarkably little difference between infant and adult as far as psychophysical control is concerned. The major difference seems to be a rate of processing difference. However, changes in processing rate will not account for the development of the concept of object permanence. What seems to be learned is a rule which can override perceptual constancy and nonconstancy in some situations.     

On the perception of shape from shading.

The extraction of three-dimensional shape from shading is one of the most perceptually compelling, yet poorly understood, aspects of visual perception. In this paper, we report several new experiments on the manner in which the perception of shape from shading interacts with other visual processes such as perceptual grouping, preattentive search ("pop-out"), and motion perception. Our specific findings are as follows: (1) The extraction of shape from shading information incorporates at least two "assumptions" or constraints--first, that there is a single light source illuminating the whole scene, and second, that the light is shining from "above" in relation to retinal coordinates. (2) Tokens defined by shading can serve as a basis for perceptual grouping and segregation. (3) Reaction time for detecting a single convex shape does not increase with the number of items in the display. This "pop-out" effect must be based on shading rather than on differences in luminance polarity, since neither left-right differences nor step changes in luminance resulted in pop-out. (4) When the subjects were experienced, there were no search asymmetries for convex as opposed to concave tokens, but when the subjects were naive, cavities were much easier to detect than convex shapes. (5) The extraction of shape from shading can also provide an input to motion perception. And finally, (6) the assumption of "overhead illumination" that leads to perceptual grouping depends primarily on retinal rather than on "phenomenal" or gravitational coordinates. Taken collectively, these findings imply that the extraction of shape from shading is an "early" visual process that occurs prior to perceptual grouping, motion perception, and vestibular (as well as "cognitive") correction for head tilt. Hence, there may be neural elements very early in visual processing that are specialized for the extraction of shape from shading.     

无意识信息加工中的“完型”——无意识捆绑假说的新证据

采用连续闪烁范式(Continuous Flash Suppression,CFS)考察了无意识状态下完型能否发生.研究通过2(线条完整性)×2(意义破坏)×2(熟悉性)的被试内实验设计考察了8种条件下图片的突破抑制时间(Suppression Time,ST).结果发现:线条完整和意义未破坏的图片能更快地克服噪音图片的抑制进入意识;熟悉性不影响突破抑制时间.重要的是,不完整的图片也可以出现意义破坏效应.这表明即使在被抑制的状态下,不完整图形的信息也能够传达至与完型相关的高级视觉区域形成客体表征.研究为无意识捆绑假说(The Unconscious Binding Hypothesis)提供了新的实验证据.