Binocular vision enhances a rapidly evolving affordance priming effect: Behavioural and TMS evidence

Extensive research has suggested that simply viewing an object can automatically prime compatible actions for object manipulation, known as affordances. Here we explored the generation of covert motor plans afforded by real objects with precision (‘pinchable’) or whole-hand/power (‘graspable’) grip significance under different types of vision. In Experiment 1, participants viewed real object primes either monocularly or binocularly and responded to orthogonal auditory stimuli by making precision or power grips. Pinchable primes facilitated congruent precision grip responses relative to incongruent power grips, and vice versa for graspable primes, but only in the binocular vision condition. To examine the temporal evolution of the binocular affordance effect, participants in Experiment 2 always viewed the objects binocularly but made no responses, instead receiving a transcranial magnetic stimulation pulse over their primary motor cortex at three different times (150, 300, 450 ms) after prime onset. Motor evoked potentials (MEPs) recorded from a pinching muscle were selectively increased when subjects were primed with a pinchable object, whereas MEPs from a muscle associated with power grips were increased when viewing graspable stimuli. This interaction was obtained both 300 and 450 ms (but not 150 ms) after the visual onset of the prime, characterising for the first time the rapid development of binocular grip-specific affordances predicted by functional accounts of the affordance effect.     

Conceptual and physical object qualities contribute differently to motor affordances

Priming studies have demonstrated that an object’s intrinsic and extrinsic qualities (size, orientation) influence subsequent motor behavior thus suggesting that these object qualities ‘afford’ actions that are congruent with the prime. We present four experiments that aim to evaluate the relative effect of conceptual and physical object qualities on action priming. In Experiment 1 equally graspable known and unknown tools are presented as primes. In Experiment 2 the primes depict high versus low graspable unfamiliar tools, and in Experiments 3 and 4 we present simple graspable shapes versus high graspable unfamiliar or familiar tools respectively. In all experiments the (unrelated) task consists of a timed motor response to the direction of a centrally placed arrow that is superimposed on the prime. Whereas tool familiarity reveals no significant difference on reaction time (Exp 1), responses to high graspable unfamiliar tools (Exp 2) and simple graspable shapes (Exps 3 and 4) are significantly faster. We conclude that motor affordances are most readily determined by object qualities that depend on the object’s physical appearance provided by visual information. Conceptual information about the stimuli, such as semantic category or stored knowledge about its function and associated movements, does not appear to produce detectable effects of action priming in this paradigm.     

The Sound of Grasp Affordances: Influence of Grasp‐Related Size of Categorized Objects on Vocalization

Previous research shows that simultaneously executed grasp and vocalization responses are faster when the precision grip is performed with the vowel [i] and the power grip is performed with the vowel [ɑ]. Research also shows that observing an object that is graspable with a precision or power grip can activate the grip congruent with the object. Given the connection between vowel articulation and grasping, this study explores whether grasp‐related size of observed objects can influence not only grasp responses but also vowel pronunciation. The participants had to categorize small and large objects into natural and manufactured categories by pronouncing the vowel [i] or [ɑ]. As predicted, [i] was produced faster when the object's grasp‐related size was congruent with the precision grip while [ɑ] was produced faster when the size was congruent with the power grip (Experiment 1). The effect was not, however, observed when the participants were presented with large objects that are not typically grasped by the power grip (Experiment 2). This study demonstrates that vowel production is systematically influenced by grasp‐related size of a viewed object, supporting the account that sensory‐motor processes related to grasp planning and representing grasp‐related properties of viewed objects interact with articulation processes. The paper discusses these findings in the context of size–sound symbolism, suggesting that mechanisms that transform size‐grasp affordances into corresponding grasp‐ and articulation‐related motor programs might provide a neural basis for size‐sound phenomena that links small objects with closed‐front vowels and large objects with open‐back vowels.     

Motor inhibition associated with the affordance of briefly displayed objects

Research has demonstrated that left- and right-hand responses are facilitated when they are performed with the hand compatible with the orientation of a viewed object. This suggests that graspable objects automatically activate the motor representations that correspond to their orientation. It has recently been proposed that similar positive stimulus–response compatibility effects (PCE) may turn into negative compatibility effects (NCE) when a prime object is displayed very briefly. These NCEs are suggested to reflect motor inhibition mechanisms—motor activation triggered by briefly viewed objects may be treated by the motor system as unwanted, and thus it is rapidly inhibited. We examined whether the motor activation triggered by the orientation of a task-irrelevant object is similarly inhibited when the object is displayed briefly. In Experiment 1, a NCE was observed between the orientation of an object and the responding hand when the object was displayed for 30 or 70 ms. The effect turned into a PCE when the object was displayed for 370 ms. Experiment 2 confirmed that this motor inhibition effect was produced by the handle affordance of the object rather than some abstract visual properties of the object.     

Motor inhibition associated with the affordance of briefly displayed objects

Research has demonstrated that left- and right-hand responses are facilitated when they are performed with the hand compatible with the orientation of a viewed object. This suggests that graspable objects automatically activate the motor representations that correspond to their orientation. It has recently been proposed that similar positive stimulus-response compatibility effects (PCE) may turn into negative compatibility effects (NCE) when a prime object is displayed very briefly. These NCEs are suggested to reflect motor inhibition mechanisms--motor activation triggered by briefly viewed objects may be treated by the motor system as unwanted, and thus it is rapidly inhibited. We examined whether the motor activation triggered by the orientation of a task-irrelevant object is similarly inhibited when the object is displayed briefly. In Experiment 1, a NCE was observed between the orientation of an object and the responding hand when the object was displayed for 30 or 70 ms. The effect turned into a PCE when the object was displayed for 370 ms. Experiment 2 confirmed that this motor inhibition effect was produced by the handle affordance of the object rather than some abstract visual properties of the object.     

The role of visual attention in action priming

It has been demonstrated that the task-irrelevant left–right orientation of an object is capable of facilitating left–right-hand responses when the object is orientated towards the responding hand. We investigated the role of attention in this orientation effect. Experiment 1 showed that object orientation facilitates responses of the hand that is compatible with the object's orientation, despite the entire object being irrelevant. However, when a task-relevant fixation point was displayed over the prime object in Experiment 2, the effect was not observed. Together Experiments 1 and 2 suggest that the orientation information of viewed objects primes the action selection processes even when the object is irrelevant, but only when attention is not allocated to a competing stimulus during the prime presentation. Experiment 3 suggested that the elimination of the effect in Experiment 2 could not be attributed to the elimination of an attentional shift to the graspable part of the prime. Finally, Experiment 4 showed that object orientation can evoke an abstract response code, influencing the selection of finger responses.     

The role of visual attention in action priming

It has been demonstrated that the task-irrelevant left-right orientation of an object is capable of facilitating left-right-hand responses when the object is orientated towards the responding hand. We investigated the role of attention in this orientation effect. Experiment 1 showed that object orientation facilitates responses of the hand that is compatible with the object's orientation, despite the entire object being irrelevant. However, when a task-relevant fixation point was displayed over the prime object in Experiment 2, the effect was not observed. Together Experiments 1 and 2 suggest that the orientation information of viewed objects primes the action selection processes even when the object is irrelevant, but only when attention is not allocated to a competing stimulus during the prime presentation. Experiment 3 suggested that the elimination of the effect in Experiment 2 could not be attributed to the elimination of an attentional shift to the graspable part of the prime. Finally, Experiment 4 showed that object orientation can evoke an abstract response code, influencing the selection of finger responses.     

Dissociating Simon and affordance compatibility effects: Silhouettes and photographs

When a graspable object’s handle is oriented to the same side as the response hand, responses are quicker and more accurate than when it is oriented to the opposite side. This effect has been attributed to the affordance of the object’s handle (Tucker & Ellis, 1998). Recent findings suggest this effect results instead from an abstract spatial response code (i.e., Simon effect; Cho & Proctor, 2010). However, the stimuli used in these previous studies differ in the amount of object and environmental depth information they contain, which may be critical to conveying an affordance. This information could explain these disparate findings as well as dissociate Simon and affordance compatibility effects. Four experiments demonstrate that the Simon effect results from the absence of this information, as in a silhouette, and the affordance effect results from its presence, as in a photograph. A fifth experiment confirmed that modifying information associated with the affordance, rather than the modification itself, produced the effects observed in the previous experiments. These findings support the following: (a) the internal details of an object and environmental depth can dissociate Simon and affordance compatibility effects, (b) this information is necessary to convey the object’s graspable affordance, and (c) the outer shape of the object is not sufficient to elicit an affordance effect. These findings are discussed in relation to the theory of embodied cognition.     

Binocular vision and spatial perception in 4- and 5-month-old infants

Four experiments investigated the relation between the development of binocular vision and infant spatial perception. Experiments 1 and 2 compared monocular and binocular depth perception in 4- and 5-month-old infants. Infants in both age groups reached more consistently for the nearer of two objects under binocular viewing conditions than under monocular viewing conditions. Experiments 3 and 4 investigated whether the superiority of binocular depth perception in 4-month-olds is related to the development of sensitivity to binocular disparity. Under binocular viewing conditions in Experiment 3, infants identified as disparity-sensitive reached more consistently for the nearer object than did infants identified as disparity-insensitive. The two groups' performances did not differ under monocular viewing conditions. These results suggest that, binocularly, the disparity-sensitive infants perceived the objects' distances more accurately than did the disparity-insensitive infants. In Experiment 4, infants were habituated to an object, then presented with the same object and a novel object that differed only in size. Disparity-sensitive infants showed size constancy by recovering from habituation when viewing the novel object. Disparity-insensitive infants did not show clear evidence of size constancy. These findings suggest that the development of sensitivity to binocular disparity is accompanied by a substantial increase in the accuracy of infant spatial perception.     

Playing on the typewriter, typing on the piano: manipulation knowledge of objects

Two experiments investigated sensory/motor-based functional knowledge of man-made objects: manipulation features associated with the actual usage of objects. In Experiment 1, a series of prime-target pairs was presented auditorily, and participants were asked to make a lexical decision on the target word. Participants made a significantly faster decision about the target word (e.g. ‘typewriter’) following a related prime that shared manipulation features with the target (e.g. ‘piano’) than an unrelated prime (e.g. ‘blanket’). In Experiment 2, participants' eye movements were monitored when they viewed a visual display on a computer screen while listening to a concurrent auditory input. Participants were instructed to simply identify the auditory input and touch the corresponding object on the computer display. Participants fixated an object picture (e.g. “typewriter”) related to a target word (e.g. ‘piano’) significantly more often than an unrelated object picture (e.g. “bucket”) as well as a visually matched control (e.g. “couch”). Results of the two experiments suggest that manipulation knowledge of words is retrieved without conscious effort and that manipulation knowledge constitutes a part of the lexical-semantic representation of objects.     

The time course of object encoding

Four experiments examined the effects of encoding time on object identification priming and recognition memory. After viewing objects in a priming phase, participants identified objects in a rapid stream of non-object distracters; display times were gradually increased until the objects could be identified (Experiments 1-3). Participants also made old/new recognition judgments about previously viewed objects (Experiment 4). Reliable priming for object identification occurred with 150 ms of encoding and reached a maximum after about 300 ms of encoding time. In contrast, reliable recognition judgments occurred with 75 ms of encoding and continued to improve for encoding times of up to 1200 ms. These results suggest that recognition memory may be based on multiple levels of object representation, from rapidly activated representations of low-level features to semantic knowledge associated with the object. In contrast, priming in this object identification task may be tied specifically to the activation of representations of object shape.     

Effect of ecological viewing conditions on the Ames' distorted room illusion

Ecological theory asserts that the Ames' distorted room illusion (DRI) occurs as a result of the artificial restriction of information pickup. According to Gibson (1966, 1979), the illusion is eliminated when binocular vision and/or head movement are allowed. In Experiment 1, to measure the DRI, we used a size-matching technique employing discs placed within an Ames' distorted room. One hundred forty-four subjects viewed the distorted room or a control apparatus under four different viewing conditions (i.e., restricted or unrestricted head movement), using monocular and binocular vision. In Experiment 2, subjects viewed binocularly and were instructed to move freely while making judgments. Overall, the main findings of this study were that the DRI decreased with increases in viewing access and that the DRI persisted under all viewing conditions. The persistence of the illusion was felt to contradict Gibson's position.     

Precision and power grip priming by observed grasping

The coupling of hand grasping stimuli and the subsequent grasp execution was explored in normal participants. Participants were asked to respond with their right- or left-hand to the accuracy of an observed (dynamic) grasp while they were holding precision or power grasp response devices in their hands (e.g., precision device/right-hand; power device/left-hand). The observed hand was making either accurate or inaccurate precision or power grasps and participants signalled the accuracy of the observed grip by making one or other response depending on instructions. Responses were made faster when they matched the observed grip type. The two grasp types differed in their sensitivity to the end-state (i.e., accuracy) of the observed grip. The end-state influenced the power grasp congruency effect more than the precision grasp effect when the observed hand was performing the grasp without any goal object (Experiments 1 and 2). However, the end-state also influenced the precision grip congruency effect (Experiment 3) when the action was object-directed. The data are interpreted as behavioural evidence of the automatic imitation coding of the observed actions. The study suggests that, in goal-oriented imitation coding, the context of an action (e.g., being object-directed) is more important factor in coding precision grips than power grips.     

Grasping the pain: Motor resonance with dangerous affordances

Two experiments, one on school-aged children and one on adults, explored the mechanisms underlying responses to an image prime (hand vs. control object) followed by graspable objects that were, in certain cases, dangerous. Participants were presented with different primes (a male, a female and a robotic grasping-hand; a male and a female static-hand; a control stimulus) and objects representing two risk levels (neutral and dangerous). The task required that a natural/artifact categorization task be performed by pressing different keys. In both adults and children graspable objects activated a facilitating motor response, while dangerous objects evoked aversive affordances, generating an interference-effect. Both children and adults were sensitive to the distinction between biological and non-biological hands, however detailed resonant mechanisms related to the hand-prime gender emerged only in adults. Implications for how the concept of “dangerous object” develops and the relationship between resonant mechanisms and perception of danger are discussed.     

示能性:基于镜像神经元视角的理解

示能性(affordance)概念解释了人的行为与物体功能之间互动、互补的关系。但是,有关示能性生理基础却很少被提及。镜像神经元的发现为示能性生理基础提供了可能的解释。文章根据研究将示能性分为结构示能性和功能示能性,探讨了不同示能性和镜像神经元之间的关系,并提出不同神经通路中的镜像神经元是示能性生理基础的结论。背-背侧分流中的镜像神经元是结构示能性的神经基础,而腹-背侧分流中的镜像神经元是功能示能性的神经基础。     

Viewing objects and planning actions: on the potentiation of grasping behaviours by visual objects

How do humans interact with tools? Gibson (1979) suggested that humans perceive directly what tools afford in terms of meaningful actions. This “affordances” hypothesis implies that visual objects can potentiate motor responses even in the absence of an intention to act. Here we explore the temporal evolution of motor plans afforded by common objects. We presented objects that have a strong significance for action (pinching and grasping) and objects with no such significance. Two experimental tasks involved participants viewing objects presented on a computer screen. For the first task, they were instructed to respond rapidly to changes in background colour by using an apparatus mimicking precision and power grip responses. For the second task, they received stimulation of their primary motor cortex using transcranial magnetic stimulation (TMS) while passively viewing the objects. Muscular responses (motor evoked potentials: MEPs) were recorded from two intrinsic hand muscles (associated with either a precision or power grip). The data showed an interaction between type of response (or muscle) and type of object, with both reaction time and MEP measures implying the generation of a congruent motor plan in the period immediately after object presentation. The results provide further support for the notion that the physical properties of objects automatically activate specific motor codes, but also demonstrate that this influence is rapid and relatively short lived.     

Action priming by briefly presented objects

Three experiments investigated how visual objects prime the actions they afford. The principal concern was whether such visuomotor priming depends upon a concurrent visual input--as would be expected if it is mediated by on-line dorsal system processes. Experiment 1 showed there to be essentially identical advantages for making afforded over non-afforded responses when these were made to objects still in view and following brief (30 or 50 ms) object exposures that were backward masked. Experiment 2 showed that affordance effects were also unaffected by stimulus degradation. Finally, Experiment 3 showed there to be statistically equal effects from images of objects and their names. The results suggest that an active object representation is sufficient to generate affordance compatibility effects based on associated actions, whether or not the object is concurrently visible.     

Misalignment effects in 3-D versions of Poggendorff displays

Strong misalignment effects are found in three-dimensional (3-D) versions of Poggendorff displays viewed binocularly. The components of the standard 2-D Poggendorff figure—the parallels and the oblique segments—were presented in 3-D depth as a flat rectangular object with occluding edges and an oblique line situated behind the object. Three experiments investigated the misalignment effects under three different observation instructions: Subjects were told to look at the oblique (Experiment 1), at the rectangle (Experiment 2), or at the background (Experiment 3). Experiments 1 and 2 examined the effects on judgments of alignment of varying the distance in depth that separates the oblique from the rectangle. Experiment 3 examined the effects of varying the distance between the fixated background and the 3-D Poggendorff figure. Both standard and reversed misalignment effects were obtained. When the viewing condition produces crossed disparity for the oblique, perceived misalignment occurs in the usual Poggendorff direction, but it is reversed with uncrossed disparity. Moreover, the amount of misalignment is related to the amount of disparity, and it can be much stronger than is usual in the 2-D versions of the Poggendorff. The misalignment effects can be explained by binocular integration to produce a single cyclopean image.     

Masked cross-modal priming turns on a glimpse of the prime

We examined if cross-modal priming (print to speech) was greater for participants who were aware of the presence of letters in the experiment. Experiment 1 determined that word primes displayed at 47 ms were adequately masked. In Experiment 2 (a, b) with primes displayed at 47 ms masked priming occurred for within-mode printed targets but not for spoken ones. Experiment 3, with spoken targets, presented primes at two different durations (59, 71 ms) and priming was found for participants who reported seeing letters but not for those who did not. The results are discussed in terms how the link between prime and target representations might be strengthened even by cursory awareness of the prime and what this tells us about priming.     

Simon-like and functional affordance effects with tools: The effects of object perceptual discrimination and object action state

In the present study two separate stimulus–response compatibility effects (functional affordance and Simon-like effects) were investigated with centrally presented pictures of an object tool (a torch) characterized by a structural separation between the graspable portion and the goal-directed portion. In Experiment 1, participants were required to decide whether the torch was red or blue, while in Experiment 2 they were required to decide whether the torch was upright or inverted. Our results showed that with the same stimulus two types of compatibility effect emerged: one based on the direction signalled by the goal-directed portion of the tool (a Simon-like effect as observed in Experiment 1), and the other based on the actions associated with an object (a functional affordance effect as observed in Experiment 2). Both effects emerged independently of the person's intention to act on the stimulus, but depended on the stimulus properties that were processed in order to perform the task.