The reliability of eyetracking to assess attentional bias to threatening words in healthy individuals

Eyetracking is commonly used to investigate attentional bias. Although some studies have investigated the internal consistency of eyetracking, data are scarce on the test–retest reliability and agreement of eyetracking to investigate attentional bias. This study reports the test–retest reliability, measurement error, and internal consistency of 12 commonly used outcome measures thought to reflect the different components of attentional bias: overall attention, early attention, and late attention. Healthy participants completed a preferential-looking eyetracking task that involved the presentation of threatening (sensory words, general threat words, and affective words) and nonthreatening words. We used intraclass correlation coefficients (ICCs) to measure test–retest reliability (ICC > .70 indicates adequate reliability). The ICCs(2, 1) ranged from –.31 to .71. Reliability varied according to the outcome measure and threat word category. Sensory words had a lower mean ICC (.08) than either affective words (.32) or general threat words (.29). A longer exposure time was associated with higher test–retest reliability. All of the outcome measures, except second-run dwell time, demonstrated low measurement error (<6%). Most of the outcome measures reported high internal consistency (α > .93). Recommendations are discussed for improving the reliability of eyetracking tasks in future research.     

Reproducibility of functional network metrics and network structure: A comparison of task-related BOLD, resting ASL with BOLD contrast, and resting cerebral blood flow

Network analysis is an emerging approach to functional connectivity in which the brain is construed as a graph and its connectivity and information processing estimated by mathematical characterizations of graphs. There has been little to no work examining the reproducibility of network metrics derived from different types of functional magnetic resonance imaging (fMRI) data (e.g., resting vs. task related, or pulse sequences other than standard blood oxygen level dependent [BOLD] data) or of measures of network structure at levels other than summary statistics. Here, we take up these questions, comparing the reproducibility of graphs derived from resting arterial spin-labeling perfusion fMRI with those derived from BOLD scans collected while the participant was performing a task. We also examine the reproducibility of the anatomical connectivity implied by the graph by investigating test–retest consistency of the graphs’ edges. We compare two measures of graph-edge consistency both within versus between subjects and across data types. We find a dissociation in the reproducibility of network metrics, with metrics from resting data most reproducible at lower frequencies and metrics from task-related data most reproducible at higher frequencies; that same dissociation is not recapitulated, however, in network structure, for which the task-related data are most consistent at all frequencies. Implications for the practice of network analysis are discussed.     

Decreased parahippocampal activity in associative priming: evidence from an event-related fMRI study

In recent years, there has been intense debate on the neural basis of associative priming, particularly on the role of the medial temporal lobe (MTL) in retrieving associative information without awareness. In this study, event-related fMRI was used while healthy subjects performed a perceptual identification task on briefly presented unrelated word pairs and an associative recognition memory task. Contamination of priming by explicit memory was successfully controlled, as associative priming and explicit memory were dissociated on the behavioral level. The fMRI results showed a functional dissociation within the MTL with respect to associative priming effects. The right parahippocampal cortex, but not the hippocampus, showed decreased activation for old vs. new pairs and old vs. recombined pairs (associative priming). The bilateral hippocampus and the right parahippocampal cortex were involved in explicit associative memory. These data provide evidence that subregions of the MTL participate in associative priming even when explicit involvement was controlled. Thus, different regions within the MTL play distinct roles in explicit and implicit associative memory.     

Statistically Induced Chunking Recall: A Memory-Based Approach to Statistical Learning

The computations involved in statistical learning have long been debated. Here, we build on work suggesting that a basic memory process, chunking, may account for the processing of statistical regularities into larger units. Drawing on methods from the memory literature, we developed a novel paradigm to test statistical learning by leveraging a robust phenomenon observed in serial recall tasks: that short-term memory is fundamentally shaped by long-term distributional learning. In the statistically induced chunking recall (SICR) task, participants are exposed to an artificial language, using a standard statistical learning exposure phase. Afterward, they recall strings of syllables that either follow the statistics of the artificial language or comprise the same syllables presented in a random order. We hypothesized that if individuals had chunked the artificial language into word-like units, then the statistically structured items would be more accurately recalled relative to the random controls. Our results demonstrate that SICR effectively captures learning in both the auditory and visual modalities, with participants displaying significantly improved recall of the statistically structured items, and even recall specific trigram chunks from the input. SICR also exhibits greater test–retest reliability in the auditory modality and sensitivity to individual differences in both modalities than the standard two-alternative forced-choice task. These results thereby provide key empirical support to the chunking account of statistical learning and contribute a valuable new tool to the literature.     

Affective personality differences in neural processing efficiency confirmed using fMRI

To test for a relation between individual differences in personality and neural-processing efficiency, we used functional magnetic resonance imaging (fMRI) to assess brain activity within regions associated with cognitive control during a demanding working memory task. Fifty-three participants completed both the self-report behavioral inhibition sensitivity (BIS) and behavioral approach sensitivity (BAS) personality scales and a standard measure of fluid intelligence (Raven’s Advanced Progressive Matrices). They were then scanned as they performed a three-back working memory task. A mixed blocked/ event-related fMRI design enabled us to identify both sustained and transient neural activity. Higher BAS was negatively related to event-related activity in the dorsal anterior cingulate, the lateral prefrontal cortex, and parietal areas in regions of interest identified in previous work. These relationships were not explained by differences in either behavioral performance or fluid intelligence, consistent with greater neural efficiency. The results reveal the high specificity of the relationships among personality, cognition, and brain activity. The data confirm that affective dimensions of personality are independent of intelligence, yet also suggest that they might be interrelated in subtle ways, because they modulate activity in overlapping brain regions that appear to be critical for task performance.     

Anterior cingulate cortex and conflict detection: An update of theory and data

The dorsal anterior cingulate cortex (ACC) and associated regions of the medial frontal wall have often been hypothesized to play an important role in cognitive control. We have proposed that the ACC's specific role in cognitive control is to detect conflict between simultaneously active, competing representations and to engage the dorsolateral prefrontal cortex (DLPFC) to resolve such conflict. Here we review some of the evidence supporting this theory, from event-related potential (ERP) and fMRI studies. We focus on data obtained from interference tasks, such as the Stroop task, and review the evidence that trial-to-trial changes in control engagement can be understood as driven by conflict detection; the data suggest that levels of activation of the ACC and the DLPFC in such tasks do indeed reflect conflict and control, respectively. We also discuss some discrepant results in the literature that highlight the need for future research.     

Distributed cortical networks for syntax processing: Broca's area as the common denominator

Different types of syntactic information (word category, grammatical gender) are processed at different times during word recognition. However, it is an open issue which brain systems support these processes. In the present event-related fMRI study, subjects performed either a syntactic gender decision task on German nouns (GEN), a word category decision task (WC, nouns vs. prepositions), or a physical baseline task (BASE). Reaction times in WC were faster than in GEN, supporting earlier electrophysiological results. Relative to BASE, both syntactic tasks activated the inferior tip of BA 44. In addition, BA 45 showed activation in GEN, whereas BA 47 was activated in WC. The imaging data indicate that the inferior portion of BA 44 together with type-specific prefrontal areas supports both initial word category related and later syntactic processes.     

Interactions between the dorsal and the ventral pathways in mental rotation: An fMRI study

In this fMRI study, we examined the relationship between activations in the inferotemporal region (ventral pathway) and the parietal region (dorsal pathway), as well as in the prefrontal cortex (associated with working memory), in a modified mental rotation task. We manipulated figural complexity (simple vs. complex) to affect the figure recognition process (associated with the ventral pathway) and the amount of rotation (0° vs. 90°), typically associated with the dorsal pathway. The pattern of activation not only showed that both streams are affected by both manipulations, but also showed an overadditive interaction. The effect of figural complexity was greater for 90° rotation than for 0° in multiple regions, including the ventral, dorsal, and prefrontal regions. In addition, functional connectivity analyses on the correlations across the time courses of activation between regions of interest showed increased synchronization among multiple brain areas as task demand increased. The results indicate that both the dorsal and the ventral pathways show interactive effects of object and spatial processing, and they suggest that multiple regions interact to perform mental rotation.     

The relevance of the nature of learned associations for the differentiation of human memory systems

In a previous functional magnetic resonance imaging (fMRI) study we demonstrated an involvement of the medial temporal lobe (MTL) during an implicit learning task. We concluded that the MTL was engaged because of the complex contingencies that were implicitly learned. In addition, the basal ganglia demonstrated effects of a paralleled proceduralization of fixed stimulus-response associations. In the present study we directly tested the hypothesis that the MTL activation depends upon implementing the complex regularity in task material, whereas activation of basal ganglia does not. Therefore, we rearranged task material such that it did not contain any complex regularity. The statistical comparison of behavioral and fMRI data between the materials allowed for isolating effects that were directly related to the implicit learning process regarding the complex regularity. The results showed a reliable difference of fMRI signal limited to the MTL, indicating a specific functional role of the MTL in implicit learning of complex contingencies. Furthermore, no difference of BOLD (Blood-Oxygenation Level Dependent) signal in the basal ganglia and cerebellum were detected, supporting the assumption of a functional involvement of the structures in proceduralization of simple stimulus-response associations but not in implicitly learning complex relations. We therefore conclude that the nature of the learned associations is relevant for determining the neuronal focus of learning, rather than the accompanying awareness.     

Role of left posterior superior temporal gyrus in phonological processing for speech perception and production

Models of both speech perception and speech production typically postulate a processing level that involves some form of phonological processing. There is disagreement, however, on the question of whether there are separate phonological systems for speech input versus speech output. We review a range of neuroscientific data that indicate that input and output phonological systems partially overlap. An important anatomical site of overlap appears to be the left posterior superior temporal gyrus. We then present the results of a new event-related functional magnetic resonance imaging (fMRI) experiment in which participants were asked to listen to and then (covertly) produce speech. In each participant, we found two regions in the left posterior superior temporal gyrus that responded both to the perception and production components of the task, suggesting that there is overlap in the neural systems that participate in phonological aspects of speech perception and speech production. The implications for neural models of verbal working memory are also discussed in connection with our findings.     

Further Investigation of the Validity and Reliability of the Photographic Figure Rating Scale for Body Image Assessment

Previous studies have not fully investigated the psychometric properties of the Photographic Figure Rating Scale (PFRS). In 2 studies, we report on the test–retest reliability and convergent validity of ratings derived from the PFRS. In Study 1, 322 female university students in Britain provided self-ratings on the PFRS and objectively measured body mass index (BMI); a subsample of 132 women also completed the task after 5 weeks. In Study 2, 243 women from the community in Austria completed the PFRS along with a battery of other body image scales. Results of Study 1 showed that ratings on the PFRS had good test–retest reliability (all rs > .87) and good convergent validity in relation to BMI. Results of Study 2 showed that PFRS-derived body dissatisfaction scores were significantly correlated with a range of body image variables. These results provide evidence for the convergent validity and good test–retest reliability of the PFRS.     

How to support learning from multiple hypertext sources

In the present study, we investigated three factors that were assumed to have a significant influence on the success of learning from multiple hypertexts, and on the construction of a documents model in particular. These factors were task (argumentative vs. narrative), available text material (with vs. without primary sources), and presentation format (active vs. static). The study was conducted with the help of the combination of three tools (DEWEX, Chemnitz LogAnalyzer, and SummTool) developed for Web-based experimenting. The results show that the task is the most important factor for successful learning from multiple hypertexts. Depending on the task, the participants were either able or unable to apply adequate strategies, such as considering the source information. It was also observed that argumentative tasks were supported by an active hypertext presentation format, whereas performance on narrative tasks increased with a passive presentation format. No effect was shown for the type of texts available.     

Errors without conflict: implications for performance monitoring theories of anterior cingulate cortex

Recent theories of the neural basis of performance monitoring have emphasized a central role for the anterior cingulate cortex (ACC). Replicating an earlier event-related potential (ERP) study, which showed an error feedback negativity that was modeled as having an ACC generator, we used event-related fMRI to investigate whether the ACC would differentiate between correct and incorrect feedback stimuli in a time estimation task. The design controlled for response conflict and frequency and expectancy effects. Although participants in the current study adjusted their performance following error feedback, we did not observe error feedback-evoked ACC activity. In contrast, we did observe ACC activity while the same subjects performed the Stroop task, in which an area of the ACC activated during both conflict and error trials. These findings are inconsistent with previous dipole models of the error feedback negativity, and suggest the ACC may not be involved in the generation of this ERP component. These results question involvement of the ACC in the detection of errors per se when controlling for conflict.     

Reproducibility of fMRI-determined language lateralization in individual subjects

This study investigated within-subject test-retest reproducibility (i.e., reliability) of language lateralization obtained with fMRI. Nine healthy subjects performed the same set of three different language tasks during two fMRI sessions on separate days (verb generation, antonym generation, and picture naming). A fourth task analysis was added in which the three tasks were analyzed conjointly (combined task analysis, CTA). The CTA targets brain areas that are commonly used in different language tasks, aiming more selectively at language-critical structures. The number of active voxels (i.e., robustness) and calculated lateralization index (LI) were compared across sessions, tasks, subjects, and two a priori defined volumes of interest (classical language regions versus whole hemisphere) for a wide range of statistical thresholds. Robustness and reliability strongly varied between task analyses. The CTA was a robust detector of language-related brain activity, in contrast to the single task approaches. The CTA and verb generation task allowed for reliable calculation of the LI. Higher thresholds yielded a clear increase in left lateralization, which was largest when calculated from active voxels in classical language regions.     

Leipzig Affective Norms for German: A reliability study

To facilitate investigations of verbal emotional processing, we introduce the Leipzig Affective Norms for German (LANG), a list of 1,000 German nouns that have been rated for emotional valence, arousal, and concreteness. A critical factor regarding the quality of normative word data is their reliability. We therefore acquired ratings from a sample that was tested twice, with an interval of 2 years, to calculate test—retest reliability. Furthermore, we recruited a second sample to test reliability across independent samples. The results show (1) the typical quadratic relation of valence and arousal, replicating previous data, (2) very high test—retest reliability (>.95), and (3) high correlations between the two samples (>.85). Because the range of ratings was also very high, we provide a comprehensive set of words with reliable affective norms, which makes it possible to select highly controlled subsamples varying in emotional status. The database is available as a supplement for this article at http://brm.psychonomic-journals.org/content/supplemental.     

概率贴现和时间贴现在人脑中的分离

本研究运用ERP技术来检验概率贴现和时间贴现是否反映了相同的神经机制过程。在本研究中,我们在一个刺激中同时操纵概率贴现（风险vs.安全）和时间贴现（1个月后vs.今天）水平。通过对两个过程上的ERN以及全时间段的ERP分析来确定它们是否反映了相同的认知过程。结果发现,这两者在ERN上存在差异,同时这两个效应在ERP的时程和出现的电极点上都存在差异。这些差异表明这两者可能包含着不同的神经机制过程。     

One-year test–retest reliability of the Maryland Resource for the Behavioral Utilization of the Reinforcement of Negative Stimuli (MRBURNS)

The Maryland Resource for the Behavioral Utilization of the Reinforcement of Negative Stimuli (MRBURNS) is a novel behavioral task designed to measure individual differences in negative reinforcement-based risk taking propensity. Performance on the MRBURNS has been linked with alcohol-related problems and negative reinforcement-based drinking motives, as well as symptoms of anxiety and depression; however, it is unclear if performance on the task represents a stable measure of negative reinforcement-based risk taking over time. As such, the current study aimed to examine the test–retest reliability of the MRBURNS over a period of one year. Results indicate that the correlation between year 1 and year 2 risk behavior (average number of pumps) on the MRBURNS was .43 across all trials. With the one year test–retest reliability of the MRBURNS established, the MRBURNS may be a useful approach to measuring the relative contribution of negative reinforcement-based risk taking in the development of risky behaviors over time, and may be used to monitor the effects of novel interventions that aim to reduce negative reinforcement based risk taking in the real world.     

Test–retest reliability and task order effects of emotional cognitive tests in healthy subjects

Little is known of the retest reliability of emotional cognitive tasks or the impact of using different tasks employing similar emotional stimuli within a battery. We investigated this in healthy subjects. We found improved overall performance in an emotional attentional blink task (EABT) with repeat testing at one hour and one week compared to baseline, but the impact of an emotional stimulus on performance was unchanged. Similarly, performance on a facial expression recognition task (FERT) was better one week after a baseline test, though the relative effect of specific emotions was unaltered. There was no effect of repeat testing on an emotional word categorising, recall and recognition task. We found no difference in performance in the FERT and EABT irrespective of task order. We concluded that it is possible to use emotional cognitive tasks in longitudinal studies and combine tasks using emotional facial stimuli in a single battery.