Revisiting the looking at nothing phenomenon: Visual and semantic biases in memory search

When visual stimuli remain present during search, people spend more time fixating objects that are semantically or visually related to the target instruction than looking at unrelated objects. Are these semantic and visual biases also observable when participants search within memory? We removed the visual display prior to search while continuously measuring eye movements towards locations previously occupied by objects. The target absent trials contained objects that were either visually or semantically related to the target instruction. When the overall mean proportion of fixation time was considered, we found biases towards the location previously occupied by the target, but failed to find biases towards visually or semantically related objects. However, in two experiments the pattern of biases towards the target over time provided a reliable predictor for biases towards the visually and semantically related objects. We therefore conclude that visual and semantic representations alone can guide eye movements in memory search, but that orienting biases are weak when the stimuli are no longer present.     

The effects of thematic relations on picture naming abilities across the lifespan

A picture–word interference paradigm tracked patterns of activation during picture naming in 87 individuals (age range 17–80 years old). Distractor words were presented at stimulus onset asynchronies (SOAs) of ?200, ?100, and 0 ms bearing a has a-, location, or no relationship to the picture. Analyses of group naming reaction times revealed significant facilitation effects for both semantic relation types for all age groups. Analyses of temporal patterns of activation revealed significant effects primarily at SOAs of ?200 and ?100 ms. These findings provide evidence that both thematic relations are particularly salient in how semantic knowledge is organized, and that the patterns of effects from these semantic relations remain the same as one ages.     

A stimulus set of words and pictures matched for visual and semantic similarity

Researchers in different fields of psychology have been interested in how vision and language interact, and what type of representations are involved in such interactions. We introduce a stimulus set that facilitates such research (available online). The set consists of 100 words each of which is paired with four pictures of objects: One semantically similar object (but visually dissimilar), one visually similar object (but semantically dissimilar), and two unrelated objects. Visual and semantic similarity ratings between corresponding items are provided for every picture for Dutch and for English. In addition, visual and linguistic parameters of each picture are reported. We thus present a stimulus set from which researchers can select, on the basis of various parameters, the items most optimal for their research question.     

Semantic effects on sensory-motor modality switching

Language processing always involves a combination of sensory (auditory or visual) and motor modalities (vocal or manual). In line with embodied cognition theories, we additionally assume a semantically implied modality (SIM) due to modality references of the underlying concept. Understanding ear-related words (e.g. “noise”), for example, should activate the auditory SIM. In the present study, we investigated the influence of the SIM on sensory-motor modality switching (e.g. switching between the auditory-vocal and visual-manual combination). During modality switching, participants categorised words with regard to their SIM (e.g. ear- versus eye-related words). Overall performance was improved and switch costs were reduced whenever there was concordance between SIMs and sensory-motor modalities (e.g. an auditory presentation of ear-related words). Thus, the present study provides first evidence for semantic effects during sensory-motor modality switching in terms of facilitation effects whenever the SIM was in concordance with sensory-motor modalities.     

中文词汇加工过程中的无关言语效应

通过两个词汇识别任务,考察词汇加工过程中的无关言语效应。实验1采用真假词判断任务,考察有意义言语、无意义言语、白噪音和安静的背景声音对不同具体性的词汇识别的影响。结果发现,仅有意义言语干扰了词汇识别,且主要体现在对低具体性词汇判断的反应时显著增加。实验2采用了语义范畴判断任务,同样发现有意义言语条件下被试的反应时显著大于其他声音条件。结果表明,中文词汇加工过程中存在无关言语效应,且当任务强调语义加工时,干扰主要源于无关言语的语义成分,支持了语义干扰假说。     

Context and Complexity in Incremental Sentence Interpretation: An ERP Study on Temporal Quantification

The present event-related potential (ERP) study used picture–sentence verification to investigate the neurolinguistic correlates of the online processing of compositional-semantic information. To this end, we examined context effects on sentences involving temporal adverbial quantification likeJana war jeden Morgen schwimmen an den Arbeitstagen (“Jana went for a swim every morning during the working week”). We tested whether the conceptual complexity associated with quantifying over time intervals leads to delayed predictions regarding the upcoming words in a sentence. The present study replicated previous results relating to quantification over individuals, which are conceptually less complex than time intervals. Analogous to previous studies, false vs. true sentences elicited an N400 whenever contextual cues did not permit a potential revision of a locally assigned truth value. The present results are compatible with an approach under which contextual cues are immediately considered for predicting how a sentence continues. The fact that the contextual complexity did not lead to processing delays indicates that the processing system quickly abstracts away from the conceptual complexity associated with the linguistic input if such an abstraction is possible.     

The Influence of the BDNF Val66Met Polymorphism on Mechanisms of Semantic Priming: Analyses with Drift-Diffusion Models of Masked and Unmasked Priming

Automatic and strategic processes in semantic priming can be investigated with masked and unmasked priming tasks. Unmasked priming is thought to enable strategic processes due to the conscious processing of primes, while masked priming exclusively depends on automatic processes due to the invisibility of the prime. Besides task properties, interindividual differences may alter priming effects. In a recent study, masked and unmasked priming based on mean response time (RT) and error rate (ER) differed as a function of the BDNF Val66Met polymorphism (Sanwald et al., 2020). The BDNF Val66Met polymorphism is related to the integrity of several cognitive executive functions and might thus influence the magnitude of priming. In the present study, we reanalyzed this data with drift-diffusion models. Drift-diffusion models conjointly analyze single trial RT and ER data and serve as a framework to elucidate cognitive processes underlying priming. Masked and unmasked priming effects were observed for the drift rates ν, presumably reflecting semantic preactivation. Priming effects on nondecision time t0 were especially pronounced in unmasked priming, suggesting additional conscious processes to be involved in the t0 modulation. Priming effects on the decision thresholds a may reflect a speed-accuracy tradeoff. Considering the BDNF Val66Met polymorphism, we found lowered drift rates and decision thresholds for Met allele carriers, possibly reflecting a superficial processing style in Met allele carriers. The present study shows that differences in cognitive tasks between genetic groups can be elucidated using drift-diffusion modeling.     

基底神经节损伤对知觉性启动效应影响的进一步研究

基底神经节的认知和记忆功能是近年认知神经科学研究的热点。该研究采用两项语义性启动效应（自由联想、偏好）和一项知觉性启动效应（字辨认）任务,发现基底神经节损伤、分别伴两侧海马或右侧丘脑损伤的两例患者的语义性启动效应正常,知觉性启动效应障碍。由于先前研究已经证实海马或丘脑结构与启动效应无关,因此该两例患者表现的知觉性启动效应障碍可归因于基底神经节损伤,进一步证实了王常生等人认为基底神经节可能具有或参与知觉性启动效应调节作用,与语义性启动效应无关的观点。     

Term-Modal Logics

Many powerful logics exist today for reasoning about multi-agent systems, but in most of these it is hard to reason about an infinite or indeterminate number of agents. Also the naming schemes used in the logics often lack expressiveness to name agents in an intuitive way.To obtain a more expressive language for multi-agent reasoning and a better naming scheme for agents, we introduce a family of logics called term-modal logics. A main feature of our logics is the use of modal operators indexed by the terms of the logics. Thus, one can quantify over variables occurring in modal operators. In term-modal logics agents can be represented by terms, and knowledge of agents is expressed with formulas within the scope of modal operators.This gives us a flexible and uniform language for reasoning about the agents themselves and their knowledge. This article gives examples of the expressiveness of the languages and provides sequent-style and tableau-based proof systems for the logics. Furthermore we give proofs of soundness and completeness with respect to the possible world semantics.