Conflict in object affordance revealed by grip force

Viewing objects can result in automatic, partial activation of motor plans associated with them—“object affordance”. Here, we recorded grip force simultaneously from both hands in an object affordance task to investigate the effects of conflict between coactivated responses. Participants classified pictures of objects by squeezing force transducers with their left or right hand. Responses were faster on trials where the object afforded an action with the same hand that was required to make the response (congruent trials) compared to the opposite hand (incongruent trials). In addition, conflict between coactivated responses was reduced if it was experienced on the preceding trial, just like Gratton adaptation effects reported in “conflict” tasks (e.g., Eriksen flanker). This finding suggests that object affordance demonstrates conflict effects similar to those shown in other stimulus–response mapping tasks and thus could be integrated into the wider conceptual framework on overlearnt stimulus–response associations. Corrected erroneous responses occurred more frequently when there was conflict between the afforded response and the response required by the task, providing direct evidence that viewing an object activates motor plans appropriate for interacting with that object. Recording continuous grip force, as here, provides a sensitive way to measure coactivated responses in affordance tasks.     

Separate Pathways for the Processing of Affordance of Neutral and Dangerous Object

Previous studies have shown that observation of object automatically elicits the activation of a reach-to-grasp response specifically directed to interact with the object, which is termed affordance. Recent findings provide evidences that even dangerous objects can evoke aversive affordances. However, these studies only focused on avoidance effect emerged with dangerous objects. It remains unclear whether the neutral object and dangerous object share a common mechanism for the processing of affordance information. The affordance effect is considered to be a type of conflict between the afforded response and the response required by the task. In a symbol judgment task, we simultaneously presented the neutral object and dangerous object to investigate whether the congruency sequence effects (congruency effects following incongruent trials are smaller than those following congruent trials) occurred across the two types of affordance conflict, which is typically assumed that such flexible adjustments can only be observed between the same conflict types. It was found that congruency sequence effects were only generated between the same types of affordance conflict (e.g., neutral object or dangerous object), but not between two different affordance conflict types (e.g., neutral object and dangerous object). These results indicate there may be two different pathways for the processing of affordance of the neutral and dangerous object.     

Viewing objects and planning actions: on the potentiation of grasping behaviours by visual objects

How do humans interact with tools? Gibson (1979) suggested that humans perceive directly what tools afford in terms of meaningful actions. This “affordances” hypothesis implies that visual objects can potentiate motor responses even in the absence of an intention to act. Here we explore the temporal evolution of motor plans afforded by common objects. We presented objects that have a strong significance for action (pinching and grasping) and objects with no such significance. Two experimental tasks involved participants viewing objects presented on a computer screen. For the first task, they were instructed to respond rapidly to changes in background colour by using an apparatus mimicking precision and power grip responses. For the second task, they received stimulation of their primary motor cortex using transcranial magnetic stimulation (TMS) while passively viewing the objects. Muscular responses (motor evoked potentials: MEPs) were recorded from two intrinsic hand muscles (associated with either a precision or power grip). The data showed an interaction between type of response (or muscle) and type of object, with both reaction time and MEP measures implying the generation of a congruent motor plan in the period immediately after object presentation. The results provide further support for the notion that the physical properties of objects automatically activate specific motor codes, but also demonstrate that this influence is rapid and relatively short lived.     

Motor inhibition associated with the affordance of briefly displayed objects

Research has demonstrated that left- and right-hand responses are facilitated when they are performed with the hand compatible with the orientation of a viewed object. This suggests that graspable objects automatically activate the motor representations that correspond to their orientation. It has recently been proposed that similar positive stimulus-response compatibility effects (PCE) may turn into negative compatibility effects (NCE) when a prime object is displayed very briefly. These NCEs are suggested to reflect motor inhibition mechanisms--motor activation triggered by briefly viewed objects may be treated by the motor system as unwanted, and thus it is rapidly inhibited. We examined whether the motor activation triggered by the orientation of a task-irrelevant object is similarly inhibited when the object is displayed briefly. In Experiment 1, a NCE was observed between the orientation of an object and the responding hand when the object was displayed for 30 or 70 ms. The effect turned into a PCE when the object was displayed for 370 ms. Experiment 2 confirmed that this motor inhibition effect was produced by the handle affordance of the object rather than some abstract visual properties of the object.     

Binocular vision enhances a rapidly evolving affordance priming effect: Behavioural and TMS evidence

Extensive research has suggested that simply viewing an object can automatically prime compatible actions for object manipulation, known as affordances. Here we explored the generation of covert motor plans afforded by real objects with precision (‘pinchable’) or whole-hand/power (‘graspable’) grip significance under different types of vision. In Experiment 1, participants viewed real object primes either monocularly or binocularly and responded to orthogonal auditory stimuli by making precision or power grips. Pinchable primes facilitated congruent precision grip responses relative to incongruent power grips, and vice versa for graspable primes, but only in the binocular vision condition. To examine the temporal evolution of the binocular affordance effect, participants in Experiment 2 always viewed the objects binocularly but made no responses, instead receiving a transcranial magnetic stimulation pulse over their primary motor cortex at three different times (150, 300, 450 ms) after prime onset. Motor evoked potentials (MEPs) recorded from a pinching muscle were selectively increased when subjects were primed with a pinchable object, whereas MEPs from a muscle associated with power grips were increased when viewing graspable stimuli. This interaction was obtained both 300 and 450 ms (but not 150 ms) after the visual onset of the prime, characterising for the first time the rapid development of binocular grip-specific affordances predicted by functional accounts of the affordance effect.     

Binocular vision enhances a rapidly evolving affordance priming effect: Behavioural and TMS evidence

Extensive research has suggested that simply viewing an object can automatically prime compatible actions for object manipulation, known as affordances. Here we explored the generation of covert motor plans afforded by real objects with precision (‘pinchable’) or whole-hand/power (‘graspable’) grip significance under different types of vision. In Experiment 1, participants viewed real object primes either monocularly or binocularly and responded to orthogonal auditory stimuli by making precision or power grips. Pinchable primes facilitated congruent precision grip responses relative to incongruent power grips, and vice versa for graspable primes, but only in the binocular vision condition. To examine the temporal evolution of the binocular affordance effect, participants in Experiment 2 always viewed the objects binocularly but made no responses, instead receiving a transcranial magnetic stimulation pulse over their primary motor cortex at three different times (150, 300, 450 ms) after prime onset. Motor evoked potentials (MEPs) recorded from a pinching muscle were selectively increased when subjects were primed with a pinchable object, whereas MEPs from a muscle associated with power grips were increased when viewing graspable stimuli. This interaction was obtained both 300 and 450 ms (but not 150 ms) after the visual onset of the prime, characterising for the first time the rapid development of binocular grip-specific affordances predicted by functional accounts of the affordance effect.     

Modulation of the affordance effect through transfer of learning

Consistent evidence shows that practising with spatially incompatible stimulus–response trials modulates performance on following tasks requiring the solution of cognitive conflict such as the Simon and Stroop tasks. In the present study we assessed whether a spatially incompatible practice can modulate another effect that is thought to be due to a conflict between two response alternatives, the affordance effect. To this end, we requested participants to categorize pictures of common objects on the basis of their upright or inverted orientation. A group of participants performed the categorization task alone, while the other two groups performed the categorization task after practising with a spatial compatibility task with either a compatible or an incompatible mapping. Results showed that the spatially incompatible practice eliminated the affordance effect. These results indicate that the conflict at the basis of the affordance effect is not unavoidable but it rather permeable to modulations affecting the response selection stage. Indeed the “emit the alternative spatial response” rule acquired during the spatially incompatible task can transfer to and modulate how the subsequent affordance task is performed.     

S-R correspondence effects of irrelevant visual affordance: Time course and specificity of response activation

It has been suggested that representations for action, elicited by an object's visual affordance, serve to potentiate motor components (such as a specific hand) to respond to the most afforded action. In three experiments, participants performed speeded left-right button press responses to an imperative target superimposed onto a prime image of an object suggesting a visual affordance oriented to left or right visual space. The time course of response activation was measured by varying the onset time between the prime and target. Long-lasting and gradually developing correspondence effects were found between the suggested affordance of the prime and the side of response, with little effect of response modality (hands uncrossed, hands crossed, or foot response). We conclude that visual affordances can evoke an abstract spatial response code, potentiating a wide variety of lateralized responses corresponding with the affordance.     

行动语义、客体背景和判断任务对客体动作承载性的影响

客体动作承载性指人们知觉客体时同时激活的针对客体的行动。当Gibson最初提出动作承载性概念时, 他认为客体的这种属性是可以自动激活的。然而近年来越来越多的证据显示, 在知觉和行动的关系中, 行动语义知识和客体所处背景对客体动作承载性具有调节作用, 表现在人们可以根据这些自上而下的信息选择针对客体的适当的行动。此外, 不同的判断任务在引发客体动作承载性效应上具有特异性, 表现在若判断任务仅需知觉客体表层属性时, 不能激活对客体的动作, 进而不能产生客体动作承载性; 若判断任务需要对客体进行深层加工时, 才会激活对客体的动作。未来研究还需要进一步探究行动语义知识和客体所处背景影响客体动作承载性发生的原因和机制, 以及不同判断任务中出现结果特异性的原因。     

Bimanual Lifting: Do Fingertip Forces Work Independently or Interactively?

Bimanual coordination is a commonplace activity, but the consequences of using both hands simultaneously are not well understood. The authors examined fingertip forces across 4 experiments in which participants undertook a range of bimanual tasks. They first measured fingertip forces during simultaneous lifts of 2 identical objects, noting that individuals held the objects with more force bimanually than unimanually. They then varied the mass of the objects held by each hand, noting that when both hands lifted together performance was equivalent to unimanual lifts. The authors next measured one hand's static grip force while the other hand lifted an object. They found a gradual reduction of grip force throughout the trial, but once again no evidence of one hand influencing the other. In the final experiment the authors tested whether tapping with one hand could influence the static grip force of its counterpart. Although the authors found no changes in static grip force as a direct consequence of the other hand's actions, they found clear differences from one task to the other, suggesting an effect of task instruction. Overall, these results suggest that fingertip forces are largely independent between hands in a bimanual lifting context, but are sensitive to different task requirements.     

Stimulus-response compatibility and response preparation: effects on motor component of information processing for upper and lower limb responses

The effects of stimulus-response compatibility and response preparation on the motor component of the information processing system were investigated by analyzing the fractionated reaction time for the upper and lower limbs. The reaction time was divided into two periods with respect to the onset of electromyographic activity, premotor and motor times. The response preparation was manipulated by the probability that the locations of the precue and subsequent imperative stimulus corresponded. On a stimulus-response compatible task, subjects were required to release a key on the same side as an imperative stimulus, irrespective of the precued side. On an incompatible task, subjects were required to act in the reverse manner. The upper and lower limb responses were measured during both tasks. A repeated-measures design was used with 12 male university students. Analysis of the reaction and premotor times indicated that the stimulus-response compatibility effect became larger as response preparation decreased. The analysis of motor time yielded significant interactions between stimulus-response compatibility and limb and between response preparation and limb. These findings indicated that the motor component of information processing for the lower limb response is affected by both stimulus-response compatibility and response preparation.     

Motor inhibition associated with the affordance of briefly displayed objects

Research has demonstrated that left- and right-hand responses are facilitated when they are performed with the hand compatible with the orientation of a viewed object. This suggests that graspable objects automatically activate the motor representations that correspond to their orientation. It has recently been proposed that similar positive stimulus–response compatibility effects (PCE) may turn into negative compatibility effects (NCE) when a prime object is displayed very briefly. These NCEs are suggested to reflect motor inhibition mechanisms—motor activation triggered by briefly viewed objects may be treated by the motor system as unwanted, and thus it is rapidly inhibited. We examined whether the motor activation triggered by the orientation of a task-irrelevant object is similarly inhibited when the object is displayed briefly. In Experiment 1, a NCE was observed between the orientation of an object and the responding hand when the object was displayed for 30 or 70 ms. The effect turned into a PCE when the object was displayed for 370 ms. Experiment 2 confirmed that this motor inhibition effect was produced by the handle affordance of the object rather than some abstract visual properties of the object.     

When left feels right: asymmetry in the affordance effect

Previous research has demonstrated the existence of the so-called affordance effect (faster response when the visual affordance of a graspable object (e.g., a pan) corresponds to the response location). It has been argued that the effect is due to abstract spatial coding of the position of the handle relative to the object instead of the grasping affordance. Our experiment tested the hypothesis that the affordance effect is not caused solely by abstract spatial coding but also by specific motor activation in response to the visual affordance. We assumed that, in the case of abstract spatial codes, response location and not hand distinction would be the critical factor for producing an affordance effect. In our experiment, bi-manual crossed/uncrossed responses to left/right symbols superimposed on a picture of a pan were used. The task was to attend to the symbol and to press a corresponding left/right button. Affordances of the pan were manipulated. A three-way interaction between side of affordance (left/right), mode of response (crossed/uncrossed hands), and response-affordance correspondence (corresponding/non-corresponding) showed a correspondence effect in the right affordance condition with hands uncrossed and no correspondence effect with hands crossed. The correspondence effect was obtained in the left affordance condition across hand positions that differed only by their magnitude. Overall, the results suggest that both mechanisms (grasping affordance and spatial codes) differentially contribute to the processing of an object with a graspable handle, depending on the affordance side and response hand.     

Evidence for task-specific resolution of response conflict

When a target requires different responses to a relevant and to an irrelevant task in a task-switching paradigm, there is response conflict. This target-induced response conflict was combined with conflict caused by a subliminally presented prime presented prior to the target. We found that target-related conflict reduced prime-induced conflict effects within the same trial. However, target-related conflict modified prime-related conflict effects according to the irrelevant stimulus-response (S-R) rule, but not according to the relevant S-R rule. Moreover, trial-to-trial modulations of the target congruency effect were observed in task repetition trials, but not in task switch trials. These results indicate that conflict resolution mechanisms, at least under the present circumstances, operate in a strictly task-specific manner.     

The predictive mirror: interactions of mirror and affordance processes during action observation

An important question for the study of social interactions is how the motor actions of others are represented. Research has demonstrated that simply watching someone perform an action activates a similar motor representation in oneself. Key issues include (1) the automaticity of such processes, and (2) the role object affordances play in establishing motor representations of others' actions. Participants were asked to move a lever to the left or right to respond to the grip width of a hand moving across a workspace. Stimulus-response compatibility effects were modulated by two task-irrelevant aspects of the visual stimulus: the observed reach direction and the match between hand-grasp and the affordance evoked by an incidentally presented visual object. These findings demonstrate that the observation of another person's actions automatically evokes sophisticated motor representations that reflect the relationship between actions and objects even when an action is not directed towards an object.     

Action priming by briefly presented objects

Three experiments investigated how visual objects prime the actions they afford. The principal concern was whether such visuomotor priming depends upon a concurrent visual input--as would be expected if it is mediated by on-line dorsal system processes. Experiment 1 showed there to be essentially identical advantages for making afforded over non-afforded responses when these were made to objects still in view and following brief (30 or 50 ms) object exposures that were backward masked. Experiment 2 showed that affordance effects were also unaffected by stimulus degradation. Finally, Experiment 3 showed there to be statistically equal effects from images of objects and their names. The results suggest that an active object representation is sufficient to generate affordance compatibility effects based on associated actions, whether or not the object is concurrently visible.     

Affordance Compatibility Effect for Word Learning in Virtual Reality

Rich sensorimotor interaction facilitates language learning and is presumed to ground conceptual representations. Yet empirical support for early stages of embodied word learning is currently lacking. Finding evidence that sensorimotor interaction shapes learned linguistic representations would provide crucial support for embodied language theories. We developed a gamified word learning experiment in virtual reality in which participants learned the names of six novel objects by grasping and manipulating objects with either their left or right hand. Participants then completed a word–color match task in which they were tested on the same six words and objects. Participants were faster to respond to stimuli in the match task when the response hand was compatible with the hand used to interact with the named object, an effect we refer to as affordance compatibility. In two follow up experiments, we found that merely observing virtual hands interact with the objects was sufficient to acquire a smaller affordance compatibility effect, and we found that the compatibility effect was driven primarily by responses with a compatible hand and not by responses in a compatible spatial location. Our results support theoretical views of language which ground word representations in sensorimotor experiences, and they suggest promising future routes to explore the sensorimotor foundations of higher cognition through immersive virtual experiments.     

Is automatic imitation a specialized form of stimulus–response compatibility? Dissociating imitative and spatial compatibilities

In recent years research on automatic imitation has received considerable attention because it represents an experimental platform for investigating a number of interrelated theories suggesting that the perception of action automatically activates corresponding motor programs. A key debate within this research centers on whether automatic imitation is any different than other long-term S-R associations, such as spatial stimulus-response compatibility. One approach to resolving this issue is to examine whether automatic imitation shows similar response characteristics as other classes of stimulus-response compatibility. This hypothesis was tested by comparing imitative and spatial compatibility effects with a two alternative forced-choice stimulus-response compatibility paradigm. The stimulus on each trial was a left or right hand with either the index or middle finger tapping down. Speeded responses were performed with the index or middle finger of the right hand in response to the identity or the left-right spatial position of the stimulus finger. Two different tasks were administered: one that involved responding to the stimulus (S-R) and one that involved responding to the opposite stimulus (OS-R; i.e., the one not presented on that trial). Based on previous research and a connectionist model, we predicted standard compatibility effects for both spatial and imitative compatibility in the S-R task, and a reverse compatibility effect for spatial compatibility, but not for imitative compatibility, in the OS-R task. The results from the mean response times, mean percentage of errors, and response time distributions all converged to support these predictions. A second noteworthy result was that the recoding of the finger identity in the OS-R task required significantly more time than the recoding of the left-right spatial position, but the encoding time for the two stimuli in the S-R task was equivalent. In sum, this evidence suggests that the processing of spatial and imitative compatibility is dissociable with regard to two different processes in dual processing models of stimulus-response compatibility.     

Response preparation and stimulus-response congruence to fractionating reaction time of upper and lower limbs

We measured the fractionating reaction time for upper and lower limbs of 18 young men, using an electromyogram to clarify the interaction of response preparation and stimulus-response congruence on premotor and motor time. The reaction time was divided into two periods with respect to the onset of the electromyogram, premotor and motor components. Manipulating the probability of the Go versus NoGo signals varied three different amounts of response preparation. Prior to the imperative stimulus, precue information about the position of a stimulus was presented. In the stimulus-response congruent task, subjects were required to release a key on the same side of the body using either an upper or lower limb in response to an imperative Go stimulus. In the stimulus-response incongruent task, subjects were required to act in a reverse manner. Subjects were not supposed to respond to the NoGo stimulus. The premotor time of the upper and lower limb responses was affected by the respective effects of response preparation and stimulus-response congruence. The motor time of the upper and lower limb responses increased as the probability of the Go signal decreased but not in relation to stimulus-response congruence. These results suggest that response preparation affects not only information processing time but also peripheral motor activity due to motor programming, and that the stimulus-response congruence effect on motor time disappears when information about the position of the imperative stimulus is precued.     

Word‐to‐picture recognition is a function of motor components mappings at the stage of retrieval

Embodied approaches of cognition argue that retrieval involves the re‐enactment of both sensory and motor components of the desired remembering. In this study, we investigated the effect of motor action performed to produce the response in a recognition task when this action is compatible with the affordance of the objects that have to be recognised. In our experiment, participants were first asked to learn a list of words referring to graspable objects, and then told to make recognition judgements on pictures. The pictures represented objects where the graspable part was either pointing to the same or to the opposite side of the “Yes” response key. Results show a robust effect of compatibility between objects affordance and response hand. Moreover, this compatibility improves participants' ability of discrimination, suggesting that motor components are relevant cue for memory judgement at the stage of retrieval in a recognition task. More broadly, our data highlight that memory judgements are a function of motor components mappings at the stage of retrieval.