The impact of continuity editing in narrative film on event segmentation

Filmmakers use continuity editing to engender a sense of situational continuity or discontinuity at editing boundaries. The goal of this study was to assess the impact of continuity editing on how people perceive the structure of events in a narrative film and to identify brain networks that are associated with the processing of different types of continuity editing boundaries. Participants viewed a commercially produced film and segmented it into meaningful events, while brain activity was recorded with functional magnetic resonance imaging (MRI). We identified three degrees of continuity that can occur at editing locations: edits that are continuous in space, time, and action; edits that are discontinuous in space or time but continuous in action; and edits that are discontinuous in action as well as space or time. Discontinuities in action had the biggest impact on behavioral event segmentation, and discontinuities in space and time had minor effects. Edits were associated with large transient increases in early visual areas. Spatial-temporal changes and action changes produced strikingly different patterns of transient change, and they provided evidence that specialized mechanisms in higher order perceptual processing regions are engaged to maintain continuity of action in the face of spatiotemporal discontinuities. These results suggest that commercial film editing is shaped to support the comprehension of meaningful events that bridge breaks in low-level visual continuity, and even breaks in continuity of spatial and temporal location.     

First‐time viewers' comprehension of films: Bridging shot transitions

Which perceptual and cognitive prerequisites must be met in order to be able to comprehend a film is still unresolved and a controversial issue. In order to gain some insights into this issue, our field experiment investigates how first‐time adult viewers extract and integrate meaningful information across film cuts. Three major types of commonalities between adjacent shots were differentiated, which may help first‐time viewers with bridging the shots: pictorial, causal, and conceptual. Twenty first‐time, 20 low‐experienced and 20 high‐experienced viewers from Turkey were shown a set of short film clips containing these three kinds of commonalities. Film clips conformed also to the principles of continuity editing. Analyses of viewers' spontaneous interpretations show that first‐time viewers indeed are able to notice basic pictorial (object identity), causal (chains of activity), as well as conceptual (links between gaze direction and object attention) commonalities between shots due to their close relationship with everyday perception and cognition. However, first‐time viewers' comprehension of the commonalities is to a large degree fragile, indicating the lack of a basic notion of what constitutes a film.     

Infants’ grip strength predicts mu rhythm attenuation during observation of lifting actions with weighted blocks

Research has established that the body is fundamentally involved in perception: bodily experience influences activation of the shared neural system underlying action perception and production during action observation, and bodily characteristics influence perception of the spatial environment. However, whether bodily characteristics influence action perception and its underlying neural system is unknown, particularly in early ontogeny. We measured grip strength in 12‐month‐old infants and investigated relations with mu rhythm attenuation, an electroencephalographic correlate of the neural system underlying action perception, during observation of lifting actions performed with differently weighted blocks. We found that infants with higher grip strength exhibited significant mu attenuation during observation of lifting actions, whereas infants with lower grip strength did not. Moreover, a progressively strong relation between grip strength and mu attenuation during observation of lifts was found with increased block weight. We propose that this relation is attributable to differences in infants’ ability to recognize the effort associated with lifting objects of different weights, as a consequence of their developing strength. Together, our results extend the body's role in perception by demonstrating that bodily characteristics influence action perception by shaping the activation of its underlying neural system.     

Neural correlates of infant action processing relate to theory of mind in early childhood

The mechanisms that support infant action processing are thought to be involved in the development of later social cognition. While a growing body of research demonstrates longitudinal links between action processing and explicit theory of mind (TOM), it remains unclear why this link emerges in some measures of action encoding and not others. In this paper, we recruit neural measures as a unique lens into which aspects of human infant action processing (i.e., action encoding and action execution; age 7 months) are related to preschool TOM (age 3 years; n = 31). We test whether individual differences in recruiting the sensorimotor system or attention processes during action encoding predict individual differences in TOM. Results indicate that reduced occipital alpha during action encoding predicts TOM at age 3. This finding converges with behavioral work and suggests that attentional processes involved in action encoding may support TOM. We also test whether neural processing during action execution draws on the proto‐substrates of effortful control (EC). Results indicate that frontal alpha oscillatory activity during action execution predicted EC at age 3—providing strong novel evidence that infant brain activity is longitudinally linked to EC. Further, we demonstrate that EC mediates the link between the frontal alpha response and TOM. This indirect effect is specific in terms of direction, neural response, and behavior. Together, these findings converge with behavioral research and demonstrate that domain general processes show strong links to early infant action processing and TOM.     

Larger,smaller, odd or even? Task-specific effects of optokinetic stimulation on the mental number space

Previous studies have shown that number processing can induce spatial biases in perception and action and can trigger the orienting of visuospatial attention. Few studies, however, have investigated how spatial processing and visuospatial attention influences number processing. In the present study, we used the optokinetic stimulation (OKS) technique to trigger eye movements and thus overt orienting of visuospatial attention. Participants were asked to stare at OKS, while performing parity judgements (Experiment 1) or number comparison (Experiment 2), two numerical tasks that differ in terms of demands on magnitude processing. Numerical stimuli were acoustically presented, and participants responded orally. We examined the effects of OKS direction (leftward or rightward) on number processing. The results showed that rightward OKS abolished the classic number size effect (i.e., faster reaction times for small than large numbers) in the comparison task, whereas the parity task was unaffected by OKS direction. The effect of OKS highlights a link between visuospatial orienting and processing of number magnitude that is complementary to the more established link between numerical and visuospatial processing. We suggest that the bidirectional link between numbers and space is embodied in the mechanisms subserving sensorimotor transformations for the control of eye movements and spatial attention.     

Match-Action: The Role of Motion and Audio in Creating Global Change Blindness in Film

An everyday example of change blindness is our difficulty to detect cuts in an edited moving-image. Edit blindness (Smith & Henderson, 2008) is created by adhering to the continuity editing conventions of Hollywood, for example, coinciding a cut with a sudden onset of motion (match-action). In this study, we isolated the roles motion and audio play in limiting awareness of match-action cuts by removing motion before and/or after cuts in existing Hollywood film clips and presenting the clips with or without the original soundtrack whilst participants tried to detect cuts. Removing post-cut motion significantly decreased cut detection time and the probability of missing the cut. By comparison, removing pre-cut motion had no effect suggesting, contrary to the editing literature, that the onset of motion before a cut may not be as critical for creating edit blindness as the motion after a cut. Analysis of eye movements indicated that viewers reoriented less to new content across intact match-action cuts than shots with motion removed. Audio played a surprisingly large part in creating edit blindness with edit blindness mostly disappearing without audio. These results extend film editor intuitions and are discussed in the context of the Attentional Theory of Cinematic Continuity (Smith, 2012a).     

Developmental changes in automatic rule‐learning mechanisms across early childhood

Infants’ ability to learn complex linguistic regularities from early on has been revealed by electrophysiological studies indicating that 3‐month‐olds, but not adults, can automatically detect non‐adjacent dependencies between syllables. While different ERP responses in adults and infants suggest that both linguistic rule learning and its link to basic auditory processing undergo developmental changes, systematic investigations of the developmental trajectories are scarce. In the present study, we assessed 2‐ and 4‐year‐olds’ ERP indicators of pitch discrimination and linguistic rule learning in a syllable‐based oddball design. To test for the relation between auditory discrimination and rule learning, ERP responses to pitch changes were used as predictor for potential linguistic rule‐learning effects. Results revealed that 2‐year‐olds, but not 4‐year‐olds, showed ERP markers of rule learning. Although, 2‐year‐olds’ rule learning was not dependent on differences in pitch perception, 4‐year‐old children demonstrated a dependency, such that those children who showed more pronounced responses to pitch changes still showed an effect of rule learning. These results narrow down the developmental decline of the ability for automatic linguistic rule learning to the age between 2 and 4 years, and, moreover, point towards a strong modification of this change by auditory processes. At an age when the ability of automatic linguistic rule learning phases out, rule learning can still be observed in children with enhanced auditory responses. The observed interrelations are plausible causes for age‐of‐acquisition effects and inter‐individual differences in language learning.     

The beneficial effect of synchronized action on motor and perceptual timing in children

We examined the role of action in motor and perceptual timing across development. Adults and children aged 5 or 8 years old learned the duration of a rhythmic interval with or without concurrent action. We compared the effects of sensorimotor versus visual learning on subsequent timing behaviour in three different tasks: rhythm reproduction (Experiment 1), rhythm discrimination (Experiment 2) and interval discrimination (Experiment 3). Sensorimotor learning consisted of sensorimotor synchronization (tapping) to an isochronous visual rhythmic stimulus (ISI = 800 ms), whereas visual learning consisted of simply observing this rhythmic stimulus. Results confirmed our hypothesis that synchronized action during learning systematically benefitted subsequent timing performance, particularly for younger children. Action‐related improvements in accuracy were observed for both motor and perceptual timing in 5 years olds and for perceptual timing in the two older age groups. Benefits on perceptual timing tasks indicate that action shapes the cognitive representation of interval duration. Moreover, correlations with neuropsychological scores indicated that while timing performance in the visual learning condition depended on motor and memory capacity, sensorimotor learning facilitated an accurate representation of time independently of individual differences in motor and memory skill. Overall, our findings support the idea that action helps children to construct an independent and flexible representation of time, which leads to coupled sensorimotor coding for action and time.     

The role of sensorimotor experience in the development of mimicry in infancy

During social interactions we often have an automatic and unconscious tendency to copy or ‘mimic’ others’ actions. The dominant view on the neural basis of mimicry appeals to an automatic coupling between perception and action. It has been suggested that this coupling is formed through associative learning during correlated sensorimotor experience. Although studies with adult participants have provided support for this hypothesis, little is known about the role of sensorimotor experience in supporting the development of perceptual‐motor couplings, and consequently mimicry behaviour, in infancy. Here we investigated whether the extent to which an observed action elicits mimicry depends on the opportunity an infant has had to develop perceptual‐motor couplings for this action through correlated sensorimotor experience. We found that mothers’ tendency to imitate their 4‐month‐olds’ facial expressions during a parent‐child interaction session was related to infants’ facial mimicry as measured by electromyography. Maternal facial imitation was not related to infants’ mimicry of hand actions, and instead we found preliminary evidence that infants’ tendency to look at their own hands may be related to their tendency to mimic hand actions. These results are consistent with the idea that mimicry is supported by perceptual‐motor couplings that are formed through correlated sensorimotor experience obtained by observing one's own actions and imitative social partners.     

Position of code and code for position: From isomorphism to a sensorimotor account of space perception

The paper starts with a discussion of the assumption that positions of the outer world are coded by the anatomical locations of firing neurons within retinotopic maps (“coding position by position”). This “code position theory” explains space perception by some kind of structural isomorphism since it implies that the perceptual space is based on a spatial structure within the brain. The axiom of structural isomorphism is rejected. Subsequently, a sensorimotor account of space perception is outlined according to which the spatial structure of the outer world is coded by the temporal structure of cortical processing. The basis is that action changes the perceiver's relationship to the outer world and, therefore, changes the representation of the outer world coded by the sensory responses of the brain. According to this view the code for position is not a spatial but a temporal structure resulting from action (“coding position by action”). The sensorimotor account offers a possible solution to the binding problem. The paper ends with some remarks on the possible origin and function of retinotopic representations.     

“All‐or‐None” Versus “Most‐or‐Some” Options in Risky Choice: Effects of Domain and Handedness

Two methodological variants of Kahneman and Tversky's Asian disease scenario were investigated. One variant involved replacing the “all‐or‐none” outcome scenarios of the risky choice with “most‐or‐some” scenario outcomes, and the second variant involved replacing the negative domain of lives lost with a positive domain of jobs created. In addition, the effects of strength of handedness, a variable related to individual differences in risk perception, were examined. Results indicated that standard framing effects were obtained across both domains, with a decrease in risky choice under the gain domain. Scenario type also interacted with handedness, such that the all‐or‐none scenario yielded framing effects for consistent (strong)‐handers only, whereas the most‐or‐some scenario yielded framing effects for inconsistent (mixed)‐handers only (consistent‐handers are those who use the same hand exclusively for almost all activities). These results demonstrate that framing effects are strongly influenced by the presence versus absence of extreme/absolute outcomes and that individuals (in this case, decision makers with varying degrees of handedness strength) are differentially sensitive to different pieces of information. Copyright © 2014 John Wiley & Sons, Ltd.     

Effect of structuring the workspace on cognitive and sensorimotor distance estimation: no dissociation between perception and action

Independent processing of visual information for perception and action is supported by studies about visual illusions, which showed that context information influences overtjudgment but not reaching attempts. The objection was raised, however, that these two types of performance are notdirectly comparable, since they generally focus on different properties of the visual input. The goal of the present study was to quantify the influence of context information (in the form of a textured background) on the cognitive and sensorimotor processing of egocentric distance. We found that the subjective area comprising reachable objects (probed with a cognitive task) decreased, whereas the amplitude of reaching movement (probed with a sensorimotor task) increased in the presence of the textured background with both binocular and monocular viewing. Directional motor performance was not affected by the experimental conditions, but there was a tendency for the kinematic parameters to mimic trajectory variations. The similar but opposite effects of the textured background in the cognitive and sensorimotor tasks suggested that in both tasks the visual targets were perceived as closer when they were presented in a sparse environment. A common explanation for the opposite effects was confirmed by the percentage of background influence, which was highly correlated in the two tasks. We conclude that visual processing for perception and action cannot be dissociated from context influence, since it does not differ when the tasks entail the processing of similar spatial characteristics.     

“Hearing voices”: Auditory hallucinations as failure of top‐down control of bottom‐up perceptual processes

Auditory hallucination is a key characteristic of schizophrenia that seriously debilitates the patient, with consequences for social engagement with others. Hallucinatory experiences are also observed in healthy individuals in the general population who report “hearing voices” in the absence of an external acoustic input. A view on auditory hallucinations and “hearing voices” is presented that regards such phenomena as perceptual processes, originating from speech perception areas in the left temporal lobe. Healthy individuals “hearing voices” are, however, often aware that the experience comes from inner thought processes, which is not reported by hallucinating patients. A perceptual model can therefore, not alone explain the difference in the phenomenology of how the “voices heard” are attributed to either an inner or outer cause. An expanded model is thus presented which takes into account top‐down cognitive control, localized to prefrontal cortical areas, to inhibit and re‐attribute the perceptual mis‐representations. The expanded model is suggested to be empirically validated using a dichotic listening speech perception paradigm with instructions for top‐down control of attention focus to either the right or left side in auditory space. It is furthermore suggested to use fMRI to validate the temporal and frontal lobe neuronal correlates of the cognitive processes involved in auditory hallucinations.     

Action influences spatial perception: Neuropsychological evidence

We present neuropsychological evidence indicating that action influences spatial perception. First, we review evidence indicating that actions using a tool can modulate unilateral visual neglect and extinction, where patients are unaware of stimuli presented on one side of space. We show that, at least for some patients, modulation comes about through a combination of visual and motor cueing of attention to the affected side (Experiment 1). Subsequently, we review evidence that action‐relations between stimuli reduce visual extinction; there is less extinction when stimuli fall in the correct colocations for action relative to when they fall in the incorrect relations for action and relative to when stimuli are just associatively related. Finally, we demonstrate that action relations between stimuli can also influence the binding of objects to space, in a patient with Balint's syndrome (Experiment 2). These neuropsychological data indicate that perception–action couplings can be crucial to our conscious representation of space.     

Emotional stimuli facilitate time perception in children with attention‐deficit/hyperactivity disorder

The aim of this study was to compare the effect of different emotional stimuli (neutral, positive, and negative) on time perception in children with attention‐deficit/hyperactivity disorder (ADHD) and normal children in dual‐task form. Five hundred and ninety‐nine students from primary schools were randomly selected. The Conner's Teacher Rating Scale (CTRS) questionnaire was completed by teachers. A total of 100 children with a score above the cut‐off point for the CTRS were further assessed using the Child Symptom Inventory‐4 (CSI‐4). A total of 34 children with ADHD and 31 controls completed an emotional time discrimination task in two blocks of 1000 and 2000 ms duration. Children were asked to compare three image groups: neutral with neutral, neutral with positive, and neutral with negative images. Children with ADHD had significantly better performance in the emotional time discrimination task across all conditions when compared with controls: On average, discrimination thresholds were approximately 35 ms shorter for the children with ADHD. Our results indicate that children with ADHD have higher sensitivity to time relative to controls in a situation in which they must distribute resources between temporal and emotional processing. On the basis of the interference effect and the working memory capacity hypothesis, this dividing of attention causes a decrease of time accuracy in normal children.     

Part perception in infancy: Sensitivity to the short-cut rule

Research indicates that object perception involves the decomposition of images into parts. A critical principle that governs part decomposition by adults is the short-cut rule, which states that, all else being equal, the visual system parses objects using the shortest possible cuts. We examined whether 6.5-month-olds’ parsing of images also follows the short-cut rule. Infants in the experimental conditions were habituated to cross shapes and then tested for their preference between segregated patterns produced using long cuts versus short cuts. Infants in the control conditions were directly tested with the segregated patterns. Infants in the experimental conditions exhibited a greater novelty preference for the long-cut over the short-cut patterns than did those in the control conditions, thereby indicating that they are more likely to segregate cross shapes using short cuts rather than long cuts. This sensitivity to the short-cut rule was evident when two alternative parameters, part area and protrusion, were controlled in Experiments 1 and 2, respectively. Thus, a critical principle that governs part segregation in adulthood is operational by 6.5 months of age.     

Evidence for ‘motionese’: modifications in mothers’ infant‐directed action

We investigated the possibility that mothers modify their infant‐directed actions in ways that might assist infants’ processing of human action. In a between‐subjects design, 51 mothers demonstrated the properties of five novel objects either to their infant (age 6–8 months or 11–13 months) or to an adult partner. As predicted, demonstrations to infants were higher in interactiveness, enthusiasm, proximity to partner, range of motion, repetitiveness and simplicity, indicating that mothers indeed modify their infant‐directed actions in ways that likely maintain infants’ attention and highlight the structure and meaning of action. The findings demonstrate that ‘motherese’ is broader in scope than previously recognized, including modifications to action as well as language.     

Searching for the variables that control human rule‐governed “insensitivity”

Verbal rules or instructions often exert obvious and meaningful control over human behavior. Sometimes instructions benefit the individual by enabling faster acquisition of a skill or by obviating an aversive consequence. However, research has also suggested a clear disadvantage: “insensitivity” to changing underlying contingencies. The two experiments described here investigated the variables that control initial rule‐following behavior and rule‐following insensitivity. When the initial rule was inaccurate, behavior was consistent with the rule for approximately half of participants and all participants' behavior was mostly insensitive to changing contingencies. When the initial rule was accurate, behavior of all participants was consistent with it and behavior for nearly all participants was insensitive to changes in underlying contingencies. These findings have implications for how best to establish and maintain rule‐following behavior in applied settings when deviant behavior would be more reinforcing to the individual.     

The Gift Economy of Direct Transnational Civic Action: How Reciprocity and Inequality Are Managed in Religious “Partnerships”

How does religion help facilitate civic action in transnational contexts characterized by material inequality and spatial separation? Short‐term mission (STM) travel, a popular activity among U.S. religious groups, exemplifies a recently emerged form of transnational civic action characterized by face‐to‐face, decentralized, pragmatic activity. Our research analyzes how participants in STM‐based relationships manage inequality while pursuing an ideal of partnership across distance. We match data from a mixed methods study of Arizona congregations that produce STM travel with interview data from foreign religious organizations that host STM travelers in El Salvador. We engage gift exchange theory (GET) to show how a discursive repertoire combines with organized gift exchange practices to manage inequality and produce partnership in STM‐based relationships. Our data provide evidence of a unique cultural process, the spiritualization of reception, which emerges during gift reciprocation. This process converts unequal material gifts from foreign hosts into spiritual understanding among STM travelers, stabilizing status indebtedness that could threaten a partnership. This research increases knowledge of STM travel, shows how gift exchange structures can facilitate transnational religious partnerships, and suggests ways to use GET to understand transnational civic action in general.     

Feature and Configuration in Face Processing: Japanese Are More Configural Than Americans

Previous work suggests that Asians allocate more attention to configuration information than Caucasian Americans do. Yet this cultural variation has been found only with stimuli such as natural scenes and objects that require both feature‐ and configuration‐based processing. Here, we show that the cultural variation also exists in face perception—a domain that is typically viewed as configural in nature. When asked to identify a prototypic face for a set of disparate exemplars, Japanese were more likely than Caucasian Americans to use overall resemblance rather than feature matching. Moreover, in a speeded identity‐matching task, Japanese were more accurate than Americans in identifying the spatial configuration of features (e.g., eyes). Together, these findings underscore the robustness of culture’s influences on cognition.