Recognition of natural scenes from global properties: seeing the forest without representing the trees

Human observers are able to rapidly and accurately categorize natural scenes, but the representation mediating this feat is still unknown. Here we propose a framework of rapid scene categorization that does not segment a scene into objects and instead uses a vocabulary of global, ecological properties that describe spatial and functional aspects of scene space (such as navigability or mean depth). In Experiment 1, we obtained ground truth rankings on global properties for use in Experiments 2-4. To what extent do human observers use global property information when rapidly categorizing natural scenes? In Experiment 2, we found that global property resemblance was a strong predictor of both false alarm rates and reaction times in a rapid scene categorization experiment. To what extent is global property information alone a sufficient predictor of rapid natural scene categorization? In Experiment 3, we found that the performance of a classifier representing only these properties is indistinguishable from human performance in a rapid scene categorization task in terms of both accuracy and false alarms. To what extent is this high predictability unique to a global property representation? In Experiment 4, we compared two models that represent scene object information to human categorization performance and found that these models had lower fidelity at representing the patterns of performance than the global property model. These results provide support for the hypothesis that rapid categorization of natural scenes may not be mediated primarily though objects and parts, but also through global properties of structure and affordance.     

Hierarchical forms processing in adults and children

Two experiments examined child and adult processing of hierarchical stimuli composed of geometric forms. Adults (ages 18-23 years) and children (ages 7-10 years) performed a forced-choice task gauging similarity between visual stimuli consisting of large geometric objects (global level) composed of small geometric objects (local level). The stimuli spatial arrangement was manipulated to assess child and adult reaction times and predisposition toward local or global form categorization under two distinct trial conditions, with varied density of the local forms comprising the global forms. In Experiment 1, children and adults were presented with common, simple geometric shape hierarchical forms composed of ovals and rectangles. In Experiment 2, adults were presented with hierarchical forms composed of the simple geometric shapes, ovals and rectangles, and additional novel complex geometric shapes, “posts” and “arches.” Results show a clear increase of global processing bias across the age ranges of the individuals in the study, with children at 10 years performing similarly to adults on the simple stimuli. In addition, adults presented with the novel complex geometric shapes showed a significant reduction in global processing bias, indicating that form novelty and complexity lead to additional attention to local features in categorization tasks.     

The global non-entropic arrow of time: from global geometrical asymmetry to local energy flow

Since the nineteenth century, the problem of the arrow of time has been traditionally analyzed in terms of entropy by relating the direction past-to-future to the gradient of the entropy function of the universe. In this paper, we reject this traditional perspective and argue for a global and non-entropic approach to the problem, according to which the arrow of time can be defined in terms of the geometrical properties of spacetime. In particular, we show how the global non-entropic arrow can be transferred to the local level, where it takes the form of a non-spacelike local energy flow that provides the criterion for breaking the symmetry resulting from time-reversal invariant local laws.     

LOT,CTM, and the Elephant in the Room

According to the language of thought (LOT) approach and the related computational theory of mind (CTM), thinking is the processing of symbols in an inner mental language that is distinct from any public language. Herein, I explore a deep problem at the heart of the LOT/CTM program—it has yet to provide a plausible conception of a mental symbol.     

Grammatical Processing of Spoken Language in Child and Adult Language Learners

This article presents a selective overview of studies that have investigated auditory language processing in children and late second-language (L2) learners using online methods such as event-related potentials (ERPs), eye-movement monitoring, or the cross-modal priming paradigm. Two grammatical phenomena are examined in detail, children’s and adults’ processing of German plural inflections (Lück et al. Brain Res 1077:144–152, 2006; Hahne et al. J Cognitive Neurosci 18:121–134, 2006; Clahsen et al. J Child Language 34:601–622, 2007) and language learners’ processing of filler-gap dependencies in English (Felser C, Roberts L Second Language Res 23:9–36, 2007; Roberts et al. J Psycholinguist Res 36:175–188, 2007). The results from these studies reveal clear differences between native and nonnative processing in both domains of grammar, suggesting that nonnative listeners rely less on grammatical parsing routines during processing than either child or adult native listeners. We also argue that factors such as slower processing speed or cognitive resource limitations only provide a partial account of our findings.     

Pronominal Resolution and Gap Filling in Agrammatic Aphasia: Evidence from Eye Movements

This paper reports the results of three studies examining comprehension and real-time processing of pronominal (Experiment 1) and Wh-movement (Experiments 2 and 3) structures in agrammatic and unimpaired speakers using eyetracking. We asked the following questions: (a) Is off-line comprehension of these constructions impaired in agrammatic listeners?, (b) Do agrammatic, like unimpaired, listeners show eye movement patterns indicative of automatic pronominal reference resolution and/or gap-filling?, and (c) Do eyetracking patterns differ when sentences are correctly versus incorrectly interpreted, or do automatic processes prevail in spite of comprehension failure? Results showed that off-line comprehension of both pronoun and Wh-movement structures was impaired in our agrammatic cohort. However, the aphasic participants showed visual evidence of real-time reference resolution as they processed binding structures, including both pronouns and reflexives, as did our unimpaired control participants. Similarly, both the patients and the control participants showed patterns consistent with successful gap filling during processing of Wh-movement structures. For neither pronominal nor movement structures did we find evidence of delayed processing. Notably, these patterns were found for the aphasic participants even when they incorrectly interpreted target sentences, with the exception of object relative constructions. For incorrectly interpreted sentences, we found end of sentence lexical competition effects. These findings indicate that aberrant lexical integration, rather than representational deficits or generally slowed processing, may underlie agrammatic aphasic listener’s comprehension failure.     

The extent of active processing of a long-duration stimulus modulates the scalp-recorded sustained potential

A long-duration stimulus will elicit a negative sustained potential (SP) that is maximum in amplitude over fronto-central areas of the scalp. This study examines how the duration of active attentional processing of the stimulus might also elicit a nonsensory contingent negative variation (CNV) that overlaps and summates to the SP. Subjects were presented with either a low- or high-pitched 1.4s duration stimulus. In different conditions, a 20 ms gap occurred either 300 or 1300 ms after stimulus onset in half the stimuli. The subject's task was to button press upon detection of the gap in the low-pitched stimulus. The subject was not required to respond to the gap occurring in the high-pitched tone. In a separate Ignore condition, subjects ignored all stimuli and read a book. In the Ignore condition, a SP was apparent to the long-duration stimuli. In the Attend condition, a large amplitude slow wave, probably the CNV, overlapped and summated with the SP. The extent of the overlapping CNV was dependent on whether the gap occurred early or late. The CNV was not apparent following presentation of the high-pitched tone, when the gap did not need to be detected. Consistent with previous studies, a SP was thus elicited even when active processing of the stimulus was not required. The morphology of the scalp-recorded SP was, nevertheless, much modified by an overlapping and summating CNV, depending on the extent to which active processing of the long-duration stimulus was required.     

Timing dysfunctions in schizophrenia as measured by a repetitive finger tapping task

Schizophrenia may be associated with a fundamental disturbance in the temporal coordination of information processing in the brain, leading to classic symptoms of schizophrenia such as thought disorder and disorganized and contextually inappropriate behavior. Although a variety of behavioral studies have provided strong evidence for perceptual timing deficits in schizophrenia, no study to date has directly examined overt temporal performance in schizophrenia using a task that differentially engages perceptual and motor-based timing processes. The present study aimed to isolate perceptual and motor-based temporal performance in individuals diagnosed with schizophrenia using a repetitive finger-tapping task that has previously been shown to differentially engage brain regions associated with perceptual and motor-related timing behavior. Thirty-two individuals with schizophrenia and 31 non-psychiatric control participants completed the repetitive finger-tapping task, which required participants to first tap in time with computer-generated tones separated by a fixed intertone interval (tone-paced tapping), after which the tones were discontinued and participants were required to continue tapping at the established pace (self-paced tapping). Participants with schizophrenia displayed significantly faster tapping rates for both tone- and self-paced portions of the task compared to the non-psychiatric group. Individuals diagnosed with schizophrenia also displayed greater tapping variability during both tone- and self-paced portions of the task. The application of a mathematical timing model further indicated that group differences were primarily attributable to increased timing – as opposed to task implementation – difficulties in the schizophrenia group, which is noteworthy given the broad range of impairments typically associated with the disorder. These findings support the contention that schizophrenia is associated with a broad range of timing difficulties, including those associated with time perception as well as time production.     

Lateralized effects of categorical and coordinate spatial processing of component parts on the recognition of 3D non-nameable objects

Participants performed two object-matching tasks for novel, non-nameable objects consisting of geons. For each original stimulus, two transformations were applied to create comparison stimuli. In the categorical transformation, a geon connected to geon A was moved to geon B. In the coordinate transformation, a geon connected to geon A was moved to a different position on geon A. The Categorical task consisted of the original and the categorically transformed objects. The Coordinate task consisted of the original and the coordinately transformed objects. The original object was presented to the central visual field, followed by a comparison object presented to the right or left visual half-fields (RVF and LVF). The results showed an RVF advantage for the Categorical task and an LVF advantage for the Coordinate task. The possibility that categorical and coordinate spatial processing subsystems would be basic computational elements for between- and within-category object recognition was discussed.     

Empathy and emotion recognition in semantic dementia: A case report

Recent studies have demonstrated that patients suffering from frontotemporal lobar degeneration (FTLD) show impairments in empathy and emotional processing. In this study, we examined two different aspects of these abilities in a patient with semantic dementia (SD), a variant of FTLD. The first aspect was the assessment of the cognitive and emotional components of empathy through the Interpersonal Reactivity Index. The second was the naming and comprehension of emotions using the Ekman 60 Faces Test. The patient’s emotion word knowledge was spared and the emotional aspects of empathy preserved. Conversely, the patient performed below average for all of the basic emotions when an emotion word had to be matched with a picture. When picture-to-picture matching was tested, however, the patient was able to recognize happiness. This case is a good example of a dissociation of covert and overt emotional functioning in SD. Results are discussed in terms of the impaired empathic behavior and emotional functioning in FTLD.