The role of attention in the affordance effect: can we afford to ignore it?

It has been established that the task-irrelevant orientation of an object's graspable handle produces a stimulus-response compatibility effect, resulting in faster reaction times when the location of the response corresponds to that of the object's handle. There is ongoing debate whether to attribute this affordance effect to motoric or to attentional components. In an attempt to reconcile these two viewpoints, we employed a novel experimental approach for investigating the relationship between attention and affordance. Using 3-D positional sound, auditory spatial attention was manipulated in order to explore its effects on affordance. Subjects were presented images of everyday graspable objects and had to respond bimanually (left or right) whether the object (featuring a leftward or rightward handle) was presented upright or upside-down. Prior to each affording object, sound localization cues were manipulated so as to orient auditory attention to the left, or to the right of the interaural axis (control). We obtained a peculiar pattern of results, which not only appears to provide support for an attention-shift account of affordance but does so in a cross-modal context.     

Visual representation of malleable and rigid objects that deform as they rotate

Most studies and theories of object recognition have addressed the perception of rigid objects. Yet, physical objects may also move in a nonrigid manner. A series of priming studies examined the conditions under which observers can recognize novel views of objects moving nonrigidly. Observers were primed with 2 views of a rotating object that were linked by apparent motion or presented statically. The apparent malleability of the rotating prime object varied such that the object appeared to be either malleable or rigid. Novel deformed views of malleable objects were primed when falling within the object's motion path. Priming patterns were significantly more restricted for deformed views of rigid objects. These results suggest that moving malleable objects may be represented as continuous events, whereas rigid objects may not. That is, object representations may be "dynamically remapped" during the analysis of the object's motion.     

On the relations between action planning, object identification, and motor representations of observed actions and objects

Recent evidence suggests that viewing a static prime object (a hand grasp), can activate action representations that affect the subsequent identification of graspable target objects. The present study explored whether stronger effects on target object identification would occur when the prime object (a hand grasp) was made more action-rich and dynamic. Of additional interest was whether this type of action prime would affect the generation of motor activity normally elicited by the target object. Three experiments demonstrated that grasp observation improved the identification of grasp-congruent target objects relative to grasp-incongruent target objects. We argue from this data that identifying a graspable object includes the processing of its action-related attributes. In addition, grasp observation was shown to influence the motor activity elicited by the target object, demonstrating interplay between action-based and object-based motor coding.     

Motor inhibition associated with the affordance of briefly displayed objects

Research has demonstrated that left- and right-hand responses are facilitated when they are performed with the hand compatible with the orientation of a viewed object. This suggests that graspable objects automatically activate the motor representations that correspond to their orientation. It has recently been proposed that similar positive stimulus–response compatibility effects (PCE) may turn into negative compatibility effects (NCE) when a prime object is displayed very briefly. These NCEs are suggested to reflect motor inhibition mechanisms—motor activation triggered by briefly viewed objects may be treated by the motor system as unwanted, and thus it is rapidly inhibited. We examined whether the motor activation triggered by the orientation of a task-irrelevant object is similarly inhibited when the object is displayed briefly. In Experiment 1, a NCE was observed between the orientation of an object and the responding hand when the object was displayed for 30 or 70 ms. The effect turned into a PCE when the object was displayed for 370 ms. Experiment 2 confirmed that this motor inhibition effect was produced by the handle affordance of the object rather than some abstract visual properties of the object.     

Motor inhibition associated with the affordance of briefly displayed objects

Research has demonstrated that left- and right-hand responses are facilitated when they are performed with the hand compatible with the orientation of a viewed object. This suggests that graspable objects automatically activate the motor representations that correspond to their orientation. It has recently been proposed that similar positive stimulus-response compatibility effects (PCE) may turn into negative compatibility effects (NCE) when a prime object is displayed very briefly. These NCEs are suggested to reflect motor inhibition mechanisms--motor activation triggered by briefly viewed objects may be treated by the motor system as unwanted, and thus it is rapidly inhibited. We examined whether the motor activation triggered by the orientation of a task-irrelevant object is similarly inhibited when the object is displayed briefly. In Experiment 1, a NCE was observed between the orientation of an object and the responding hand when the object was displayed for 30 or 70 ms. The effect turned into a PCE when the object was displayed for 370 ms. Experiment 2 confirmed that this motor inhibition effect was produced by the handle affordance of the object rather than some abstract visual properties of the object.     

The role of visual attention in action priming

It has been demonstrated that the task-irrelevant left-right orientation of an object is capable of facilitating left-right-hand responses when the object is orientated towards the responding hand. We investigated the role of attention in this orientation effect. Experiment 1 showed that object orientation facilitates responses of the hand that is compatible with the object's orientation, despite the entire object being irrelevant. However, when a task-relevant fixation point was displayed over the prime object in Experiment 2, the effect was not observed. Together Experiments 1 and 2 suggest that the orientation information of viewed objects primes the action selection processes even when the object is irrelevant, but only when attention is not allocated to a competing stimulus during the prime presentation. Experiment 3 suggested that the elimination of the effect in Experiment 2 could not be attributed to the elimination of an attentional shift to the graspable part of the prime. Finally, Experiment 4 showed that object orientation can evoke an abstract response code, influencing the selection of finger responses.     

Seeing and doing: ability to act moderates orientation effects in object perception

We investigated whether the impact of an object's orientation on a perceiver's actions (an orientation effect) is moderated by the perceiver's ability to act on the object in question. To do this, we manipulated the physical location of presented objects (Experiment 1) and the perceiver's action capacity (Experiment 2). Regardless of the physical distance of the object, manual responses were sensitive to the object's orientation (the orientation effect) when the object was within the participant's action range but not when the object was outside of the action range. These results support an embodied view of object perception and shed light on peripersonal space representation.     

Kids observing other kids' hands: visuomotor priming in children

We investigated motor resonance in children using a priming paradigm. Participants were asked to judge the weight of an object shortly primed by a hand in an action-related posture (grasp) or a non action-related one (fist). The hand prime could belong to a child or to an adult. We found faster response times when the object was preceded by a grasp hand posture (motor resonance effect). More crucially, participants were faster when the prime was a child's hand, suggesting that it could belong to their body schema, particularly when the child's hand was followed by a light object (motor simulation effect). A control experiment helped us to clarify the role of the hand prime. To our knowledge this is the first behavioral evidence of motor simulation and motor resonance in children. Implications of the results for the development of the sense of body ownership and for conceptual development are discussed.     

Viewpoint costs occur during consolidation: evidence from the attentional blink

Do the viewpoint costs incurred when naming rotated familiar objects arise during initial identification or during consolidation? To answer this question we employed an attentional blink (AB) task where two target objects appeared amongst a rapid stream of distractor objects. Our assumption was that while both targets and distractors undergo initial identification only targets are consolidated in a form that allows overt report. We presented line drawings of objects with a usual upright canonical orientation, and separately manipulated the orientation of targets and distractors. In two experiments, targets were defined by colour, whereas in a third experiment they were defined by semantic category. Target 1 orientation influenced the AB, with objects rotated by 90 degrees causing a larger second target deficit than upright and upside-down objects. However, distractor orientation did not affect the magnitude of the second target deficit, regardless of whether targets were defined by colour or semantic category. Taken together, these findings suggest that the visual representations involved in the preliminary recognition of familiar objects are viewpoint-invariant and that viewpoint costs are incurred when these objects are consolidated for report.     

Imagining and naming rotated natural objects

The present experiment examined whether subjects can form and store imagined objects in various orientations. Subjects in a training phase named line drawings of natural objects shown at six orientations, named objects shown upright, or imagined upright objects at six orientations. Time to imagine an upright object at another orientation increased the farther the designated orientation was from the upright, with faster image formation times at 180° than at 120°. Similar systematic patterns of effects of orientation on identification time were found for rotated objects. During the test phase, all subjects named the previously experienced objects as well as new objects, at six orientations. The orientation effect for old objects seen previously in a variety of orientations was much reduced relative to the orientation effect for new objects. In contrast, substantial effects of orientation on naming time were observed for old objects for subjects who had previously seen the objects upright only or upright but imagined at different orientations. The results suggest that the attenuation of initially large effects of orientation with practice cannot be due to imagining and forming representations of objects at a number of orientations.     

Reference frame and effects of orientation on finding the tops of rotated objects.

Effects of stimulus orientation across trial blocks and the spatial reference frame were investigated with a task in which Ss, with their head upright or tilted, judged a dot to be near the top or the bottom of rotated line drawings of objects. Objects used in this task were also named. Response times from the first block of trials increased linearly for objects rotated from 0 degrees to 120 degrees from the upright. Across blocks, orientation effects diminished for naming but remained the same for top-bottom discriminations. Practice with top-bottom discriminations diminished orientation effects when the same objects were subsequently named. The spatial reference frame for top-bottom discriminations was midway between retinal and environmental coordinates. Specifying the location of object features is of greater importance for top-bottom discriminations than for naming and underlies orientation effects in these tasks.     

Identification of disoriented objects: effects of context of prior presentation

Half of the subjects in the training phase of Experiment 1 named objects shown in a number of orientations, whereas the other half named objects shown upright only. All subjects named objects seen in a number of different orientations in the transfer phase. Half of the objects in the transfer phase were the ones they had seen in the training phase (old objects), whereas the other half were objects they had not seen before (new objects). Mean naming time in the transfer phase increased more as the objects were rotated further from the upright for new objects than for old objects when the old objects had been seen in a variety of orientations. In contrast, a substantial and equivalent orientation effect on identification time was obtained for old and new objects when the old objects had been seen upright only. These results suggest that the extraction and use of orientation-invariant attributes to identify objects is not a "default" identification strategy employed by the human visual system. In Experiment 2, half of the objects named in the training phase were shown upright only, whereas the other half were shown in a number of orientations. Both types of objects (upright vs. rotated) were presented in a mixed fashion from trial to trial. The results revealed that prior naming of the objects in this context resulted in equivalent reductions in the magnitude of the orientation effect on identification time for both sets of objects (upright and rotated). Together, the results of these two experiments suggest that markedly different representations of objects are encoded, depending on the context in which objects are seen. Implications for models of pattern recognition are discussed.     

Turning objects on their heads: the influence of the stored axis on object individuation

We used repetition blindness (RB) as a measure of object recognition and compared the pattern of RB obtained for objects with a well-established upright orientation (mono-oriented objects) and those without a usual upright orientation (polyoriented objects), when the critical objects were either in identical orientations or differed by 30 degrees, 60 degrees, 90 degrees, or 180 degrees. Overall, we found robust RB despite differences in orientation, consistent with the idea that object recognition, as indexed by RB, is largely independent of orientation. However, whereas for polyoriented objects RB was obtained in all orientation conditions, for mono-oriented objects there was no RB between upright and upside-down versions of the stimuli. These findings suggest that the usual orientation of an object-when it exists-is stored in memory and can facilitate orientation processing when the principal axis of a viewed object is aligned with the stored axis orientation. This, in turn, allows for more rapid and successful construction of distinct episodic representations of an object, thus alleviating RB.     

The influence of perceived rotary motion on the recognition of rotated objects

Subjects either named rotated objects or decided whether the objects would face left or right if they were upright. Response time in the left-right task was influenced by a rotation aftereffect or by the physical rotation of the object, which is consistent with the view that the objects were mentally rotated to the upright and that, depending on its direction, the perceived rotary motion of the object either speeded or slowed mental rotation. Perceived rotary motion did not influence naming time, which suggests that the identification of rotated objects does not involve mental rotation.     

The role of axes of elongation and symmetry in rotated object naming

Many theorists have postulated that axes of elongation and/or symmetry play an important role in the recognition of objects. In this paper, evidence is presented that mitigates this claim from independent assessments of the effects of axes of elongation or symmetry on the time to name rotated line drawings of common objects. This conclusion was further supported in a stronger test in which both of these variables were orthogonally controlled, the aspect ratio of elongation was manipulated,and only objects that were completely geometrically symmetrical or asymmetrical were used. In all the experiments, objects were named for several blocks to determine the influence of these variables on effects of orientation with practice. Symmetry was found to diminish the effects of orientation after practice in naming the object set, and the effects of the most extreme orientation tested (120 degrees from upright) were diminished when both axes defined the same orientation, relative to when they defined different orientations. Contrary to many theories, these findings relegate the axes of symmetry and elongation to relatively minor roles during object identification.     

Asymmetric response time functions during left-/right-facing discriminations of rotated objects: The short and the long of it

When deciding if a rotated object would face to the left or to the right, if imagined at the upright, mental rotation is typically assumed to be carried out through the shortest angular distance to the upright prior to determining the direction of facing. However, the response time functions for left- and right-facing objects are oppositely asymmetric, which is not consistent with the standard explanation. Using Searle and Hamm’s individual differences adaption of Kung and Hamm’s Mixture Model, the current study compares the predicted response time functions derived when assuming that objects are rotated through the shortest route to the upright with the predicted response time functions derived when assuming that objects are rotated in the direction they face. The latter model provides a better fit to the majority of the individual data. This allows us to conclude that, when deciding if rotated objects would face to the left or to the right if imagined at the upright, mental rotation is carried out in the direction that the objects face and not necessarily in the shortest direction to the upright. By comparing results for mobile and immobile object sets we can also conclude that semantic information regarding the mobility of an object does not appear to influence the speed of mental rotation, but it does appear to influence pre-rotation processes and the likelihood of employing a mental rotation strategy.     

Prospective and retrospective effects in human motor control: planning grasps for object rotation and translation

People pick up objects in ways that reflect prospective as well as retrospective control. Prospective control is indicated by planning for end-state comfort such that people grasp a cylinder to be rotated or translated with a hand orientation or at a height that affords a comfortable final posture. Retrospective control is indicated when people reuse a remembered grasp rather than using a new grasp that would ensure end-state comfort. Here, we asked whether these manifestations of prospective and retrospective control co-occur. We did so by having healthy young-adult participants grasp a cylinder to rotate and translate it between a horizontal position and a vertical position at each of five heights. We found that participants planned for comfortable final hand orientations for first moves but relied on recall for subsequent hand orientations. The results suggest that motor planning is sensitive to computational as well as physical demands and that object rotation and translation are not dissociable features of motor control, at least as reflected in their contributions to grasp selection. The latter result is consistent with the hypothesis that movements constitute holistic body changes between successive goal postures.     

Electrophysiological examination of embodiment in vision and action

A wealth of behavioral data has shown that the visual properties of objects automatically potentiate motor actions linked with them, but how deeply are these affordances embedded in visual processing? In the study reported here, we used electrophysiological measures to examine the time course of affordance resulting from the leftward or rightward orientation of the handles of common objects. Participants were asked to categorize those objects using a left- or right-handed motor response. Lateralized readiness potentials showed rapid motor preparation in the hand congruent with the affordance provided by the object only 100 to 200 ms after stimulus presentation and up to 400 ms before the actual response. Examination of event-related potentials also revealed an effect of handle orientation and response-hand congruency on the visual P1 and N1 components. Both of these results suggest that activity in the early sensory pathways is modulated by the action associations of objects and the intentions of the viewer.     

Orientation-specific effects in picture matching and naming

In two experiments, subjects made timed decisions about the second of two sequentially presented rotated drawings of objects. When the two objects were physically identical, response times to decide whether the two drawings depicted the same object varied as a function of the shortest distance between the orientation of the second drawing and either the orientation of the previous drawing or the upright. This was found for both short (250-msec) and long (2-sec) interstimulus-intervals. The result was also obtained when subjects named the second drawing after deciding whether the first drawing faced left or right. Following repeated experience with the drawings in the left/right task over four blocks of trials, time to name the second drawing in the same-object sequences was independent of orientation. These results suggest that, initially, object- and orientation-specific representations can be formed following a single presentation of a rotated object and subsequently used to identify drawings of the same object at either the same or different orientations. Alignment of the second drawing with either the canonical representation or the new representation at the previous orientation is achieved by normalization through the shortest path. Following experience with the objects, orientation-invariant representations are formed.     

Response interference between functional and structural actions linked to the same familiar object

Viewing objects with the intention to act upon them may activate task-irrelevant motor responses. Many manufactured objects are associated with two action classes: grasping in accordance with object structure and skillful use consistent with object function. We studied the potential for within-object competition during action selection by comparing initiation latencies for “conflict” objects (with competing structure and function responses) to “non-conflict” objects (with a single response). We demonstrated a novel pattern of within-object interference wherein actions involving conflict objects were slowed when participants skillfully used those objects (grasp-on-use interference) as well as a second pattern of interference when conflict objects were grasped after skillfully using the same objects in previous blocks (long-term use-on-grasp interference). These data suggest that actions to common objects are influenced by competition between rapid but briefly maintained grasp responses and slower but longer-lasting use responses, and advance our understanding of the process and neural substrates of selection for action.