Perception-action dissociations of a walkable Müller-Lyer configuration

These studies examined the role of spatial encoding in inducing perception-action dissociations in visual illusions. Participants were shown a large-scale Müller-Lyer configuration with hoops as its tails. In Experiment 1, participants either made verbal estimates of the extent of the Müller-Lyer shaft (verbal task) or walked the extent without vision, in an offset path (blind-walking task). For both tasks, participants stood a small distance away from the configuration, to elicit object-relative encoding of the shaft with respect to its hoops. A similar illusion bias was found in the verbal and motoric tasks. In Experiment 2, participants stood at one endpoint of the shaft in order to elicit egocentric encoding of extent. Verbal judgments continued to exhibit the illusion bias, whereas blind-walking judgments did not. These findings underscore the importance of egocentric encoding in motor tasks for producing perception-action dissociations.     

Altering the balance of recollection and familiarity influences the revelation effect

The revelation effect occurs when recognition test probes are more likely to be called "old" if they are preceded by a verbal processing task. Two experiments examined the role of familiarity and recollection in producing this effect. Each experiment tested the hypothesis that decreasing recollection would heighten the magnitude of the revelation effect. In Experiment 1, the revelation effect increased by delaying the recognition test. In Experiment 2, the revelation effect increased when the presentation rate of the study words was reduced. These results are discussed in terms of the variables that produce the revelation effect in episodic and nonepisodic memory judgments.     

Dissociations between vision for perception and vision for action depend on the relative availability of egocentric and allocentric information

In three experiments, we scrutinized the dissociation between perception and action, as reflected by the contributions of egocentric and allocentric information. In Experiment 1, participants stood at the base of a large-scale one-tailed version of a Müller-Lyer illusion (with a hoop) and either threw a beanbag to the endpoint of the shaft or verbally estimated the egocentric distance to that location. The results confirmed an effect of the illusion on verbal estimates, but not on throwing, providing evidence for a dissociation between perception and action. In Experiment 2, participants observed a two-tailed version of the Müller-Lyer illusion from a distance of 1.5 m and performed the same tasks as in Experiment 1, yet neither the typical illusion effects nor a dissociation became apparent. Experiment 3 was a replication of Experiment 1, with the difference that participants stood at a distance of 1.5 m from the base of the one-tailed illusion. The results indicated an illusion effect on both the verbal estimate task and the throwing task; hence, there was no dissociation between perception and action. The presence (Exp. 1) and absence (Exp. 3) of a dissociation between perception and action may indicate that dissociations are a function of the relative availability of egocentric and allocentric information. When distance estimates are purely egocentric, dissociations between perception and action occur. However, when egocentric distance estimates have a (complementary) exocentric component, the use of allocentric information is promoted, and dissociations between perception and action are reduced or absent.     

Inhibition of response mode in task switching

Task inhibition was explored in two experiments that employed a paradigm in which participants switched among three tasks. Two tasks required manual choice responses based on numerical judgment (parity or magnitude), whereas a third task required an unconditional double-press of both response keys. Both experiments showed that switching to a just-abandoned task (n-2 task repetition) generally leads to a performance cost relative to switching to another task. Specifically, this task inhibition effect also occurred for the double-press task, suggesting inhibition of response mode. Prolonging the task-cuing interval showed that advance task preparation reduced only inhibition of the double-press task but not of the choice tasks (Experiment 1). Prolonging the response-cue interval led to a decrease of the inhibition effect in all tasks (Experiment 2), suggesting a time-based release of task inhibition. Together, the experiments support the notion of a response-related component of task inhibition.     

Psychophysical test for the independence of perception and action

Research has suggested that perception and action are independent (see M. A. Goodale & A. Haffenden, 1998). The authors used the Ebbinghaus illusion to test this hypothesis in 2 experiments. Verbal reports of perceived size were compared with maximum grip aperture during grasping (Experiment 1) and manual reports of perceived size (Experiment 2). A multidimensional signal detection analysis was used to distinguish among the possible interactions between the two processes in each experiment (H. Kadlec & J. T. Townsend, 1992a, 1992b). In Experiment 1, the percepts were independent, and there were no interactions between processes for verbal and visuomotor responses. In Experiment 2, the percepts associated with verbal and manual reports were independent, but the processes interacted at the levels of the stimulus information and the decision rules used to transform each percept into a response.     

The effect of emergent features on judgments of quantity in configural and separable displays

Two experiments investigated effects of emergent features on perceptual judgments of comparative magnitude in three diagrammatic representations: kiviat charts, bar graphs, and line graphs. Experiment 1 required participants to compare individual values; whereas in Experiment 2 participants had to integrate several values to produce a global comparison. In Experiment 1, emergent features of the diagrams resulted in significant distortions of magnitude judgments, each related to a common geometric illusion. Emergent features are also widely believed to underlie the general superiority of configural displays, such as kiviat charts, for tasks requiring the integration of information. Experiment 2 tested the extent of this benefit using diagrams with a wide range of values. Contrary to the results of previous studies, the configural display produced the poorest performance compared to the more separable displays. Moreover, the pattern of responses suggests that kiviat users switched from an integration strategy to a sequential one depending on the shape of the diagram. The experiments demonstrate the powerful interaction between emergent visual properties and cognition and reveal limits to the benefits of configural displays for integration tasks.     

Beyond words: evidence for automatic language–gesture integration of symbolic gestures but not dynamic landscapes

Understanding actions based on either language or action observation is presumed to involve the motor system, reflecting the engagement of an embodied conceptual network. We examined how linguistic and gestural information were integrated in a series of cross-domain priming studies. We varied the task demands across three experiments in which symbolic gestures served as primes for verbal targets. Primes were clips of symbolic gestures taken from a rich set of emblems. Participants responded by making a lexical decision to the target (Experiment 1), naming the target (Experiment 2), or performing a semantic relatedness judgment (Experiment 3). The magnitude of semantic priming was larger in the relatedness judgment and lexical decision tasks compared to the naming task. Priming was also observed in a control task in which the primes were pictures of landscapes with conceptually related verbal targets. However, for these stimuli, the amount of priming was similar across the three tasks. We propose that action observation triggers an automatic, pre-lexical spread of activation, consistent with the idea that language–gesture integration occurs in an obligatory and automatic fashion.     

The role of part—whole information in reasoning about relative size

Models of comparative judgment have assumed that relative magnitude is computed from knowledge about absolute magnitude rather than retrieved directly. In Experiment 1, participants verified the relative size of part-whole pairs (e.g., tree-leaf) and unrelated controls (e.g., tree-penny). The symbolic distance effect was much smaller for part-whole pairs than for unrelated controls. In two subsequent experiments, participants determined either which of two objects was closer in size to a third object or which of two pairs had a greater difference in the size of its constituents. In contrast to the paired comparison task in Experiment 1, judgments of part-whole items were more sensitive to the influence of symbolic distance than were unrelated controls. The fact that the part-whole relation attenuates the effects of symbolic distance in a paired comparison task but not in tasks that require an explicit comparison of size differences suggests that the part-whole relation provides a source of information about relative magnitude that does not depend on knowledge about absolute magnitude.     

Investigating the role of response in spatial context learning

Recent research has shown that simple motor actions, such as pointing or grasping, can modulate the way we perceive and attend to our visual environment. Here we examine the role of action in spatial context learning. Previous studies using keyboard responses have revealed that people are faster locating a target on repeated visual search displays (“contextual cueing”). However, this learning appears to depend on the task and response requirements. In Experiment 1, participants searched for a T-target among L-distractors and responded either by pressing a key or by touching the screen. Comparable contextual cueing was found in both response modes. Moreover, learning transferred between keyboard and touch screen responses. Experiment 2 showed that learning occurred even for repeated displays that required no response, and this learning was as strong as learning for displays that required a response. Learning on no-response trials cannot be accounted for by oculomotor responses, as learning was observed when eye movements were discouraged (Experiment 3). We suggest that spatial context learning is abstracted from motor actions.     

Affordance Judgments and Nonlocomotor Body Movement

In 2 experiments, participants made judgments of their own maximum sitting height. During judgments, participants stood normally or on 10 cm blocks attached to their feet. The blocks increased participants' actual maximum sitting height. For many participants, judgments changed over trials, becoming more accurate, despite the absence of practice at sitting, or feedback about judgment accuracy. Learning was observed not only when participants wore the blocks but also when they stood normally. In Experiment 2, we measured motion of the head and torso. We identified changes in body motion that corresponded to engagement in the judgment task: Across trials, sway variability was stable during judgments but increased during the intervals between judgments. Other changes in sway were limited to participants whose judgments improved over trials; that is, sway was specifically associated with learning about maximum sitting height. We discuss the results in the context of perception–action and the learning of affordances.     

Investigating the role of response in spatial context learning

Recent research has shown that simple motor actions, such as pointing or grasping, can modulate the way we perceive and attend to our visual environment. Here we examine the role of action in spatial context learning. Previous studies using keyboard responses have revealed that people are faster locating a target on repeated visual search displays ("contextual cueing"). However, this learning appears to depend on the task and response requirements. In Experiment 1, participants searched for a T-target among L-distractors and responded either by pressing a key or by touching the screen. Comparable contextual cueing was found in both response modes. Moreover, learning transferred between keyboard and touch screen responses. Experiment 2 showed that learning occurred even for repeated displays that required no response, and this learning was as strong as learning for displays that required a response. Learning on no-response trials cannot be accounted for by oculomotor responses, as learning was observed when eye movements were discouraged (Experiment 3). We suggest that spatial context learning is abstracted from motor actions.     

Effects of visual illusions on grasping

In 2 experiments, the Muller-Lyer illusion (F. C. Muller-Lyer, 1889; N = 16) and the parallel-lines illusion (W. Wundt, 1898; N = 26) clearly affected maximum preshape aperture in grasping (both ps < .001). The grasping effects were similar but not perfectly equal to the perceptual effects. Control experiments show that these differences can be attributed to problems in matching the perceptual task and the grasping task. A model is described stating the assumptions that are needed to compare the grasping effects and the perceptual effects of visual illusions. Further studies on the relationship between perception and grasping are reviewed. These studies provide no clear evidence for a dissociation between perception and grasping and therefore do not support the action versus perception hypothesis (A. D. Milner & M. A. Goodale, 1995).     

Two routes for the processing of verbal numbers: evidence from the SNARC effect

The functional locus of the semantic system is an important issue in number processing. In the present article, the necessity of addressing a central semantic magnitude system in the processing of printed verbal number words is evaluated by looking at the presence of a spatial-numerical association of response codes or SNARC effect. This effect consists of an association of number magnitude and response-preference (preferred responses to small numbers with the left hand and to large numbers with the right hand) and reflects semantic access. Two experiments were run. In Experiment 1, participants performed a parity judgment task which requires access to number semantics. A SNARC effect was observed. In Experiment 2 a phoneme monitoring task was used, which can, in principle, be performed through direct asemantic transcoding. No SNARC effect occurred. Apparently, written number words access the semantic system only if this is necessary for correct task completion. Hence, a semantic and an asemantic route can be postulated for the processing of word numerals. These observations contrast with the processing of Arabic numerals for which semantic effects are omnipresent. Implications of this explicit demonstration of a dissimilarity between the processing of digits and of number words are discussed. Received: 25 October 2000 / Accepted: 21 May 2001     

特征整合与加工深度对道德概念容器隐喻联结的影响

提出了隐喻提取假说将隐喻联结的形成和提取进行分离, 并通过3个实验探究了道德概念与容器空间的隐喻联结及其受知觉加工深度和特征整合程度的影响。实验1采用空间Stroop范式, 实验2a和实验2b均采用启动范式, 实验3a和实验3b均采用加入任务要求的Stroop范式。结果发现：(1)在经典Stroop范式中未发现道德概念与容器空间的隐喻联结; (2)在启动范式中发现, 较深知觉加工深度下道德概念与容器空间存在较弱的隐喻联结; (3)在较高特征整合程度的Stroop任务中, 道德概念与容器空间存在较强的隐喻联结。结果表明：道德概念与容器空间存在道德为内、不道德为外的隐喻联结, 这种隐喻联结在映射上表现为双向性, 并且受到特征整合程度和知觉加工深度的影响, 同时也为隐喻提取假说提供了证据支持。     

The effect of working memory load on the SNARC effect: Maybe tasks have a word to say

We investigated the effect of working memory load on the SNARC (spatial–numerical association of response codes) effect under different number judgment tasks (parity judgment and magnitude comparison), using a novel dual task. Instead of exerting load over the whole block of number judgment trials, in this dual task, number judgment trials were inserted into each interstimulus interval of an n-back task, which served as the working memory load. We varied both load type (verbal and spatial) and amount (1-load, 2-load, and 3-load). The results indicated that the SNARC effect disappeared even under the 1-load condition for a parity judgment, regardless of the type of load. However, during the magnitude comparison task, the SNARC effect increased with increasing load amounts under spatial load conditions; under verbal load conditions, the SNARC effect decreased with increasing amounts of load, and disappeared during the 3-load task. The difference between the parity and magnitude tasks was not attributable to the interval stimuli or task switching. These findings confirm that different spatial–numerical associations for comparing numerical magnitudes and judgments of parity have different needs with respect to working memory resources.     

Intersensory conflict between vision and touch: the response modality dominates when precise, attention-riveting judgments are required

In four experiments, reducing lenses were used to minify vision and generate intersensory size conflicts between vision and touch. Subjects made size judgments, using either visual matching or haptic matching. In visual matching, the subjects chose from a set of visible squares that progressively increased in size. In haptic matching, the subjects selected matches from an array of tangible wooden squares. In Experiment 1, it was found that neither sense dominated when subjects exposed to an intersensory discrepancy made their size estimates by using either visual matching or haptic matching. Size judgments were nearly indentical for conflict subjects making visual or haptic matches. Thus, matching modality did not matter in Experiment 1. In Experiment 2, it was found that subjects were influenced by the sight of their hands, which led to increases in the magnitude of their size judgments. Sight of the hands produced more accurate judgments, with subjects being better able to compensate for the illusory effects of the reducing lens. In two additional experiments, it was found that when more precise judgments were required and subjects had to generate their own size estimates, the response modality dominated. Thus, vision dominated in Experiment 3, where size judgments derived from viewing a metric ruler, whereas touch dominated in Experiment 4, where subjects made size estimates with a pincers posture of their hands. It is suggested that matching procedures are inadequate for assessing intersensory dominance relations. These results qualify the position (Hershberger & Misceo, 1996) that the modality of size estimates influences the resolution of intersensory conflicts. Only when required to self-generate more precise judgments did subjects rely on one sense, either vision or touch. Thus, task and attentional requirements influence dominance relations, and vision does not invariably prevail over touch.     

Embodied Information in Cognitive Tasks: Haptic Weight Sensations Affect Task Performance and Processing Style

Research in the field of embodied cognition showed that incidental weight sensations influence peoples’ judgments about a variety of issues and objects. Most studies found that heaviness compared to lightness increases the perception of importance, seriousness, and potency. In two experiments, we broadened this scope by investigating the impact of weight sensations on cognitive performance. In Experiment 1, we found that the performance in an anagram task was reduced when participants held a heavy versus a light clipboard in their hands. Reduced performance was accompanied by an increase in the perceived effort. In Experiment 2, a heavy clipboard elicited a specific response heuristic in a two-alternative forced-choice task. Participants showed a significant right side bias when holding a heavy clipboard in their hands. After the task, participants in the heavy clipboard condition reported to be more frustrated than participants in the light clipboard condition. In both experiments, we did not find evidence for mediated effects that had been proposed by previous literature. Overall, the results indicate that weight effects go beyond judgment formation and highlight new avenues for future research.     

Interaction of Perception and Action in Discrete and Continuous Rapid Aiming Tasks

Previously, we have shown that discrete and continuous rapid aiming tasks are governed by distinct visuomotor control mechanisms by assessing the combined visual illusion effects on the perceived and effective index of difficulty (ID). All participants were perceptually biased by the combined visual illusion before they performed the rapid aiming tasks. In the current study, the authors manipulated the order of performing perceptual and motor tasks to examine whether perceptual or motor experience with the illusory visual target would influence the subsequent perceived and effective ID in discrete and continuous tapping tasks. The results supported our hypothesis showing that perceptual experience with the illusory visual target in the discrete condition reduced the effective ID in the subsequent discrete tapping task, and motor experience with the illusory visual target in the continuous condition reduced the illusion effects on the perceived ID in the subsequent perceptual judgment task. The study demonstrates the coinfluence of perception and action, and suggests that perception and action influence one another with different magnitude depending on the spatial frame of reference used to perform the perceptuomotor task.     

The effects of local and global processing demands on perception and action

The line-bisection task, adapted to utilise a wooden rod as the bisection stimulus, has revealed that patients with visuo-spatial neglect may be more accurate at bisection when asked to pick up the rod, compared to pointing to its centre. We recently reported that neurologically intact participants show a similar dissociation on this task-demonstrating a rightward bias when pointing to the centre, which was not present when grasping the rod by the centre. The current paper examined how pointing and grasping responses were affected by adapted rod-bisection tasks that emphasised local or global processing. In Experiment 1, 26 participants completed four rod-bisection tasks. The rods were compound stimuli and the participants directed to focus on either the local or global level. The results demonstrated that when participants focused on the global level, the previous dissociations found for pointing and grasping conditions were evident. However, the perception of centre did change when participants focused on the local level: both the pointing and grasping responses were rightward biased. In Experiment 2, 42 participants completed three bisection tasks which again emphasised either the local or global level, but in different sets of stimuli. The results of this task further support the findings in Experiment 1: the rightward bias in the local-bisection task was again evident and in addition, the global-bisection task resulted in no bias and no difference between the pointing and grasping bisections. These results demonstrate how task demands can similarly affect the pointing and grasping responses, and indicate that local and global processing may be involved in perception/action dissociations on rod bisection.     

自我参照和环境参照整合过程中的主方位判断

通过三个实验证明,自我参照和环境参照转化与整合过程中的主方位判断受拍摄方向和目标位置的影响。二者对主方位判断的作用模式不会随主方位判断任务的改变而改变,拍摄方向效表现为：朝北效应（匹配效应）和主方位效应,体现的是自我参照和环境参照整合过程中环境参照对主方位的影响;目标位置效应的认知加工时间模式可表示为：前-后轴<左-右轴<其他位置,体现的是自我参照和环境参照整合过程中自我参照对主方位的影响。本文以规范轴和规范方向为框架对数据结果进行了分析和解释。