Advances in the assessment of cognitive skills using computer-based measurement

The impact of technology in the field of intellectual assessment has, for the most part, been limited to computerized administration and scoring. Anderson’s (2001) theory of intelligence suggests that performance on traditional IQ measures is acquired via two main routes, thinking and dedicated processing systems known as modules. Empirical data used to support this relationship between the speed of basic processing and intellectual functioning have been evidenced primarily by correlations between measures of general intelligence and measures of inspection time (IT). These IT measures allow individuals to make a forced choice discrimination task without a motor component. Because only the time used to cognitively solve the problem is recorded, these responses typically occur in milliseconds. Many theorists (e.g., Burns & Nettelbeck, 2002; Deary, 2000; Jensen, 2006) consider IT to be a more “pure” measure of intelligence, because the influences of verbal skills, memory, and socialization are minimized and results are therefore considered to be more culture-fair. Until relatively recently, IT measurement was restricted to complex and expensive specialized laboratory equipment. This article describes the theoretical background and developmental process of a computer-based IT measure that is easily adaptable to accommodate the needs of the researcher.     

Measuring recognition performance using computer-based and paper-based methods

Using a within-subjects design, we administered to 83 naval pilots and flight officers computer-based and paper-based tests to assess recognition of aircraft silhouettes in order to determine the relative reliabilities and validities of these two measurement modes. Estimates of internal consistencies, equivalences, and discriminative validities were computed for multiple performance measures. It was established that the relative reliabilities and validities derived for these two assessment schemes were contingent on the employed multivariate measurement criteria, that is, percentage correct responses, average response latency, and average degree of confidence in recognition judgments, as well as the statistical criteria used to ascertain the comparative quality of these two modes of testing.     

Automatic testing of cognitive performance in baboons maintained in social groups

Laboratory procedures used to study the cognitive functions of primates traditionally have involved removal of the subjects from their living quarters to be tested singly in a remote experimental room. This article presents an alternative research strategy favoring testing primates while they are maintained in their social group. The automatic learning device for monkeys (ALDM) is a computerized test system controlled by an automatic radio frequency identification of subjects. It is provided ad lib inside the social group of monkeys, for voluntary self-testing on a 24-h schedule. Nine baboons were tested with ALDM during a 7-month period. Experiments were performed to assess learning in motor control and abstract reasoning tasks. The results revealed high trial frequencies and excellent learning performance, even in tasks involving the highest cognitive complexities. A different study using ALDM with a group of 3 rhesus monkeys revealed social influences on learning. Beyond its interest for cognitive psychologists, ALDM is of interest for pharmacologists and cognitive neuroscientists working with nonhuman primates. ALDM also can serve as an enrichment tool for captive animals and may be used to study a variety of species other than primates.     

Affective and cognitive modulation of performance monitoring: Behavioral and ERP evidence

This study investigates the effects of negative affect on performance monitoring. EEG was acquired during a lateralized, numeric Stroop working memory task that featured task-irrelevant aversive and neutral pictures between stimuli. Performance accuracy showed a right-hemisphere advantage for stimuli that followed aversive pictures. Response-locked event-related potentials (ERPs) from accurate trials showed an early negative component (CRN; correct response/conflict-related negativity) followed by a positive wave comparable to the Pe (error positivity). The CRN was bi-peaked with an earlier peak that was sensitive to aversive pictures during early portions of the experiment and a later peak that increased with error likelihood later in the experiment. Pe amplitude was increased with aversive pictures early in the experiment and was sensitive to picture type, Stroop interference, and hemisphere of stimulus delivery during later trials. This suggests that ERP indices of performance monitoring, the CRN and Pe, are dynamically modulated by both affective and cognitive demands.     

考虑题目选项信息的非参数认知诊断计算机自适应测验

选择题中的作答选项能提供额外诊断信息, 为充分利用选项信息, 研究提出认知诊断计算机自适应测验(CD-CAT)中两种处理选择题选项信息的非参数选题策略和变长终止规则。模拟研究的结果发现：(1)定长条件下两种非参数选题策略的分类准确性整体要高于参数选题策略; (2)两种非参数选题策略较参数选题策略具有更加均衡的题库使用情况; (3)非参数选题策略在两种新的变长终止规则下具有更高的分类准确率; (4)两种非参数选题策略均适用于选择题CD-CAT情境, 使用者可任选其一进行测验分析。     

Verbal and cognitive distractors in driving performance while using hands-free phones

This study investigated the effect of different types of distractions related to use of a hands-free phone on driving performance. The study used three types of verbal distractors: casual conversation, simple arithmetic number guessing, and number adding, in the phone conversation. 12 adults were instructed to follow a lead vehicle on a closed-course highway in a fixed-based driving simulator. The results showed that use of a hands-free cellular phone involving verbal and cognitive distractions impaired driving performance and skill. Types of distraction produced significantly different effects on several dependent variables: the driving speed, headway (distance between the lead car and the manipulated car), brake reaction time, and number of collisions with the lead car. In general, the higher the cognitive load involved in the dialogue, the worse the driving performance.     

Activities, self-referent memory beliefs, and cognitive performance: evidence for direct and mediated relations

In this study, the authors investigated the role of activities and self-referent memory beliefs for cognitive performance in a life-span sample. A factor analysis identified 8 activity factors, including Developmental Activities, Experiential Activities, Social Activities, Physical Activities, Technology Use, Watching Television, Games, and Crafts. A second-order general activity factor was significantly related to a general factor of cognitive function as defined by ability tests. Structural regression models suggested that prediction of cognition by activity level was partially mediated by memory beliefs, controlling for age, education, health, and depressive affect. Models adding paths from general and specific activities to aspects of crystallized intelligence suggested additional unique predictive effects for some activities. In alternative models, nonsignificant effects of beliefs on activities were detected when cognition predicted both variables, consistent with the hypothesis that beliefs derive from monitoring cognition and have no influence on activity patterns.     

Syntactic component in language responsible cognitive structure: Neurological evidence

From the results of a broad ranging comprehension test, a hierarchy of difficulty emerged that is shared by the two groups of aphasics (Broca's and Wernicke's aphasics) and by the control group of normal subjects. The parallelism has been interpreted as a confirmation of the hypothesis that syntactic competence is not inaccessible either in Wernicke's or in Broca's aphasia. The Minimal Distance Principle, as a relevant recognition principle, has been studied, and although not confirmed by the scores has been brought to the fore both by the correlations between the variables under study and by the correlations with the concomitant variables of age and level of education.     

Cholinergic-dopaminergic interactions in cognitive performance

Both acetylcholinergic (ACh) and dopaminergic (DA) systems have been found to be crucial for the maintenance of accurate cognitive performance. In a series of studies examining those aspects of cognitive function revealed by the radial-arm maze, we have found that these two neurotransmitter systems interact in a complex fashion. Choice accuracy deficits in the radial-arm maze can be induced by blockade of either muscarinic- or nicotinic-ACh receptors. The choice accuracy deficit induced by blockade of muscarinic receptors with scopolamine can be reversed by the DA receptor blocker, haloperidol. The specific DA D1 blocker SCH 23390 also has this effect, whereas the specific D2 blocker raclopride does not, implying that it is D1 blockade that is critical for reversing the scopolamine effect. On the other hand, the choice accuracy deficit induced by nicotinic blockade with mecamylamine is potentiated by haloperidol. This effect is also seen with the D2 antagonist raclopride, but not with the D1 antagonist SCH 23390, implying that it is the D2 receptor which is important for the potentiation of the mecamylamine effect. The relevance of the D2 receptor for nicotinic actions on cognitive function is emphasized by the finding that the selective D2 agonist LY 171555 reverses the choice accuracy deficit caused by mecamylamine. Nicotinic and muscarinic blockade are synergistic in the deficit they produce. Antagonist doses subthreshold when given alone produce a pronounced impairment when given together. This latter deficit can be reversed by the D2 agonist LY 171555. These studies have outlined the complex nature of ACh-DA interactions with regard to cognitive function. Possible neural circuits for these interactions are discussed. The effectiveness of these selective DA treatments in reversing cognitive deficits due to ACh underactivation suggests a novel approach to treating cognitive dysfunction in syndromes such as Alzheimer's disease.     

CEDATS: A cognitive experimental design and testing system

CEDATS (cognitive experimental design and testing system) is a set of programs that allows students and instructors to easily create unique experiments even though they may have no experience with computers or knowledge of any programming language. Designs including up to six independent variables may be created, and from 24 to 31 stimulus presentation parameters may be manipulated or controlled. Responses and response times are recorded and printed and/or stored on disk.     

Repeated testing does not confound cognitive performance in the Western Australian magpie (Cracticus tibicen dorsalis)

Animal Cognition - A robust understanding of cognitive variation at the individual level is essential to understand selection for and against cognitive traits. Studies of animal cognition often...     

Early childhood cognitive development and parental cognitive stimulation: evidence for reciprocal gene-environment transactions

Parenting is traditionally conceptualized as an exogenous environment that affects child development. However, children can also influence the quality of parenting that they receive. Using longitudinal data from 650 identical and fraternal twin pairs, we found that, controlling for cognitive ability at age 2 years, cognitive stimulation by parents (coded from video recorded behaviors during a dyadic task) at 2 years predicted subsequent reading ability at age 4 years. Moreover, controlling for cognitive stimulation at 2 years, children's cognitive ability at 2 years predicted the quality of stimulation received from their parents at 4 years. Genetic and environmental factors differentially contributed to these effects. Parenting influenced subsequent cognitive development through a family-level environmental pathway, whereas children's cognitive ability influenced subsequent parenting through a genetic pathway. These results suggest that genetic influences on cognitive development occur through a transactional process, in which genetic predispositions lead children to evoke cognitively stimulating experiences from their environments.     

Self-organization of cognitive performance

Background noise is the irregular variation across repeated measurements of human performance. Background noise remains after task and treatment effects are minimized. Background noise refers to intrinsic sources of variability, the intrinsic dynamics of mind and body, and the internal workings of a living being. Two experiments demonstrate 1/f scaling (pink noise) in simple reaction times and speeded word naming times, which round out a catalog of laboratory task demonstrations that background noise is pink noise. Ubiquitous pink noise suggests processes of mind and body that change each other's dynamics. Such interaction-dominant dynamics are found in systems that self-organize their behavior. Self-organization provides an unconventional perspective on cognition, but this perspective closely parallels a contemporary interdisciplinary view of living systems.     

Personality and motivation: Sources of inefficiency in cognitive performance

Impulsivity and anxiety are two dimensions of personality which have strong effects upon the efficiency of cognitive performance. The effects of these two variables depend upon characteristics of the task as well as upon four types of tradeoffs between psychological resources. Tasks may be characterized in terms of their relative requirements for sustained information transfer (SIT), short-term memory (STM), and long-term memory (LTM). Resource tradeoffs may be automatic, strategic, directional, or stylistic. Impulsivity effects on performance involve an automatic arousal-induced tradeoff between SIT and STM, strategic tradeoffs of speed for accuracy, and stylistic differences in persistence. Anxiety effects involve strategic, directional, and stylistic tradeoffs.     

Training cognitive skills in virtual reality: measuring performance.

Across a variety of operational environments, virtual reality (VR) is being increasingly used as a means of simulating hazardous work conditions in order to allow trainees to practice advanced cognitive skills such as problem-solving and decision-making. Replicating dangerous conditions particularly involving heavy machinery in the real world can be dangerous and costly. The use of VR is therefore appealing across many industries such as aviation, mining, and rail. However, while the number of training prototypes increase less focus is being given to appropriate evaluation of the training provided via this technology. Increasing skills acquisition and performance does not depend solely on the appropriate design of simulation training. Of equal importance are strong performance measures which can ultimately feedback on the success or otherwise of training and highlight any deficits to guide ongoing improvements. To ensure cognitive skills acquired in a virtual training environment (VTE) are transferable to the real world, training objectives need to be tied directly to realistic scenario events which in turn are directly linked to measures of specific required behaviors.     

Anxiety and cognitive performance: attentional control theory

Attentional control theory is an approach to anxiety and cognition representing a major development of Eysenck and Calvo's (1992) processing efficiency theory. It is assumed that anxiety impairs efficient functioning of the goal-directed attentional system and increases the extent to which processing is influenced by the stimulus-driven attentional system. In addition to decreasing attentional control, anxiety increases attention to threat-related stimuli. Adverse effects of anxiety on processing efficiency depend on two central executive functions involving attentional control: inhibition and shifting. However, anxiety may not impair performance effectiveness (quality of performance) when it leads to the use of compensatory strategies (e.g., enhanced effort; increased use of processing resources). Directions for future research are discussed.     

Apolipoprotein E and cognitive performance: a meta-analysis

The epsilon4 allele of the apolipoprotein E (APOE) gene is a known risk factor for Alzheimer's disease and may also affect cognitive performance in normal aging. Evidence of the presence and magnitude of epsilon4-related cognitive deficits was examined with a meta-analysis of the available literature. Thirty-eight studies were included, and cognitive performance was collapsed into 8 domains. Results indicated significant APOE-epsilon4 group differences for global cognitive functioning, episodic memory, and executive functioning, in favor of non-epsilon4 carriers. In addition, older age and APOE-epsilon4 heterozygosity was associated with smaller epsilon4-related impairments. The meta-analysis results suggest that APOE-epsilon4 genotype does affect cognitive performance in healthy aging, although the influence is relatively small and specific to certain domains of cognitive performance.     

Social regulation and individual cognitive function: Effects of individuation on cognitive performance

Numerous experiments have illustrated the intervention of social regulations in individual cognitive functioning, applying such concepts as social co-ordination, socio-cognitive conflict and social marking. Two experiments, involving secondary school pupils are presented within this general framework. The first tests the hypothesis that individual cognitive functioning, highlighted in a task requiring mobilization of knowledge learned to that end, can under certain conditions be regulated by experimentally induced social resources. The second experiment uses the same paradigm to compare the information processing, under anonymous versus individuated conditions, of pupils respectively with successful and unsuccessful academic histories. The results of both experiments indicate that cognitive functioning is strongly influenced by the social situations created within the experimental settings. These results are discussed in terms of the social meta systems which may intervene in cognitive processes.     

A speeded coding task using a computer-based mouse response

This study assessed whether a speeded coding task that used a computer-based mouse response (CBMR) format was a measure of general processing speed (Gs). By analyzing the task within a network of tasks representing both traditional Gs tests and reaction time tasks, it was shown that a CBMR test can be used to measure the same construct as traditional paper-and-pencil (PP) tests and that this response format does not introduce variance associated with psychomotor performance. Differences between PP and CBMR formats were observed, and it is argued that these may provide information on individual differences in performance not available from traditional coding tests.