Combined eyetracking and keystroke-logging methods for studying cognitive processes in text production

Writers typically spend a certain proportion of time looking back over the text that they have written. This is likely to serve a number of different functions, which are currently poorly understood. In this article, we present two systems, ScriptLog+TimeLine and EyeWrite, that adopt different and complementary approaches to exploring this activity by collecting and analyzing combined eye movement and keystroke data from writers composing extended texts. ScriptLog+TimeLine is a system that is based on an existing keystroke-logging program and uses heuristic, pattern-matching methods to identify reading episodes within eye movement data. EyeWrite is an integrated editor and analysis system that permits identification of the words that the writer fixates and their location within the developing text. We demonstrate how the methods instantiated within these systems can be used to make sense of the large amount of data generated by eyetracking and keystroke logging in order to inform understanding of the cognitive processes that underlie written text production.     

The biological foundations of cognitive science

Cognitive Science originated in reactions against behaviorism that were motivated in significant part by the example of the computer. The computer raised the exciting possibility that mind could be understood almost entirely independently of brain: if the operations of the mind are akin to the execution of a program, then almost all the relevant aspects of mind would be captured by that program, independently of whatever was running it, be it transistors or neurons. This presumed independence of cognitive science from biology has waned considerably in recent decades, but in this paper, I argue that there is at least one crucial aspect of biology that has yet to be appreciated for its relevance to mental and other normative processes—the thermodynamics of living systems. In particular, I argue that the emergence of normativity in general—and normative function and representation in particular—depends on special systems that are far from thermodynamic equilibrium; these form the interface between the factual world of atoms and molecules and the normative world of mind. The nature of that emergence, in turn, imposes strong constraints on how the central nervous system functions, and, therefore, on how cognition is realized.     

Evaluation of the Dispositional Hope Scale in injury survivors

Hope is a higher-order cognitive construct that encompasses the belief in one’s ability to accomplish personal goals. Hope has been conceptualised as consisting of two constructs – Pathways (the individual’s perceived means available to achieve goals) and Agency (belief in ones ability to succeed in using the identified Pathways). This study aimed to validate a measure of hope, the Dispositional Hope Scale (DHS: [Snyder, C. R., Harris, C., Anderson, J. R., Holleran, S. A., Irving, L. M., Sigman, S. T., et al. (1991). The will and the ways: Development and validation of an individual differences measure of hope. Journal of Personality and Social Psychology, 60(4), 570–585]) in a large sample of traumatic injury survivors (N = 1025). The findings support the psychometric properties of the scale, as well as the two-factor structure of Agency and Pathways, in this population. This study provides support for the use of the DHS as a measure of hope in traumatised populations.     

Interpreting Self-Directed Search profiles: Validity of the “Rule of Eight”

Based on the standard error of measurement, Holland (1985) suggested the “rule of eight” for determining the meaningfulness of differences between two summary scores on the Self Directed Search. The present study empirically examined the rule's validity for practice. The participants were 2397 (1497 females and 900 males) undergraduate students enrolled in the exploratory major at a large Midwestern university. The results strongly supported the interpretive rule of eight. For those participants who scored a primary-code distinction of eight or more points, the hit rate was 55% with a kappa of .38. This compared to a hit rate of 40% with a kappa of .21 for those participants with less than eight-point distinction between their top two scores. The authors also discuss the practical implications for interpreting SDS results using the “rule of eight.”     

Neural Network Models and Mechanisms of Strategy Development

The focus of this paper is mechanisms that may be responsible for intellectual and developmental differences in the cognitive strategies of typical and atypical children, including those with mental retardation. The discussion of these mechanisms is based on behavioral experiments on external memory strategies and on a set of neural network models designed for these tasks. Following the review of the external memory research, the rationale for using neural network models, how they have been used in other research, and their specific application to intellectual and developmental differences in external memory, including the results of several simulations, are reviewed. This is followed by a discussion of the mechanisms of intellectual differences and developmental change included in the models and some challenges for this type of modeling. Neural network modeling is discussed as an asset to research on cognitive development.     

Measuring Parenting in Community and Public Health Research Using Brief Child and Parent Reports

The use of multi-method, multi-informant assessment is a hallmark of research in child development and mental health; however, many research strategies such as population surveys require brief assessment tools. The Alabama Parenting Questionnaire (APQ) is a popular measure of empirically identified aspects of positive and negative parenting styles important to conduct problems in children. A brief version exists, however it does not measure all relevant parenting domains, and it has not been validated for child reports. We evaluated validity of the brief parent and child report version of the complete five subscale version of the APQ in a sample of 208 children aged between 9 and 17, at risk for conduct problems and antisocial behaviour. The results showed that all five dimensions of parenting can be measured using a brief 15 item version; specifically child and parent reports converged as expected and discriminated high from low conduct problem children using parent and teacher reports. Only child reports converged with independent observations of parenting behaviour, supporting previous research showing that child reports of parenting are particularly important. Finally, results did not support the typical methods used for combining child and parent reports into one index.     

Pupil diameter tracks changes in control state predicted by the adaptive gain theory of locus coeruleus function

An important dimension of cognitive control is the adaptive regulation of the balance between exploitation (pursuing known sources of reward) and exploration (seeking new ones) in response to changes in task utility. Recent studies have suggested that the locus coeruleus-norepinephrine system may play an important role in this function and that pupil diameter can be used to index locus coeruleus activity. On the basis of this, we reasoned that pupil diameter may correlate closely with control state and associated changes in behavior. Specifically, we predicted that increases in baseline pupil diameter would be associated with decreases in task utility and disengagement from the task (exploration), whereas reduced baseline diameter (but increases in task-evoked dilations) would be associated with task engagement (exploitation). Findings in three experiments were consistent with these predictions, suggesting that pupillometry may be useful as an index of both control state and, indirectly, locus coeruleus function.     

FREGE'S CONCEPT PARADOX AND THE MIRRORING PRINCIPLE

Frege held that singular terms can refer only to objects, not to concepts. I argue that the counter-intuitive consequences of this claim ('the concept paradox') arise from Frege's mirroring principle that an incomplete expression can only express an incomplete sense and stand for an incomplete reference. This is not, as is sometimes thought, merely because predicates and singular terms cannot be intersubstituted salva veritate ( congruitate ). The concept paradox, properly understood, poses therefore a different, harder, challenge. An investigation of the foundations of the mirroring principle also sheds light on the role which language plays in Frege's epistemology of logic.     

Bifactor models and rotations: exploring the extent to which multidimensional data yield univocal scale scores

The application of psychological measures often results in item response data that arguably are consistent with both unidimensional (a single common factor) and multidimensional latent structures (typically caused by parcels of items that tap similar content domains). As such, structural ambiguity leads to seemingly endless "confirmatory" factor analytic studies in which the research question is whether scale scores can be interpreted as reflecting variation on a single trait. An alternative to the more commonly observed unidimensional, correlated traits, or second-order representations of a measure's latent structure is a bifactor model. Bifactor structures, however, are not well understood in the personality assessment community and thus rarely are applied. To address this, herein we (a) describe issues that arise in conceptualizing and modeling multidimensionality, (b) describe exploratory (including Schmid-Leiman [Schmid & Leiman, 1957] and target bifactor rotations) and confirmatory bifactor modeling, (c) differentiate between bifactor and second-order models, and (d) suggest contexts where bifactor analysis is particularly valuable (e.g., for evaluating the plausibility of subscales, determining the extent to which scores reflect a single variable even when the data are multidimensional, and evaluating the feasibility of applying a unidimensional item response theory (IRT) measurement model). We emphasize that the determination of dimensionality is a related but distinct question from either determining the extent to which scores reflect a single individual difference variable or determining the effect of multidimensionality on IRT item parameter estimates. Indeed, we suggest that in many contexts, multidimensional data can yield interpretable scale scores and be appropriately fitted to unidimensional IRT models.