A Hierarchical Rater Model for Longitudinal Data

Research studies in psychology and education often seek to detect changes or growth in an outcome over a duration of time. This research provides a solution to those interested in estimating latent traits from psychological measures that rely on human raters. Rater effects potentially degrade the quality of scores in constructed response and performance assessments. We develop an extension of the hierarchical rater model (HRM), which yields estimates of latent traits that have been corrected for individual rater bias and variability, for ratings that come from longitudinal designs. The parameterization, called the longitudinal HRM (L-HRM), includes an autoregressive time series process to permit serial dependence between latent traits at adjacent timepoints, as well as a parameter for overall growth. We evaluate and demonstrate the feasibility and performance of the L-HRM using simulation studies. Parameter recovery results reveal predictable amounts and patterns of bias and error for most parameters across conditions. An application to ratings from a study of character strength demonstrates the model. We discuss limitations and future research directions to improve the L-HRM.     

The Impact of Life Transition on Emerging Adult Attachment,Social Support,and Well‐Being: A Multiple‐Group Comparison

Life transitions can induce distress for emerging adults. This study compared a model of the attachment, social support, and well‐being of emerging adults in transition with a model of those not in transition (N = 378). The transition sample reported less life satisfaction and environmental mastery and higher attachment avoidance than the nontransition sample. The transition sample showed weaker mediating effects of social support, suggesting that attachment accounted for additional unique variance for this group. Counseling implications are provided.     

Relationship of social support and social burden to repeated breast cancer screening in the women's health initiative.

Direct and interactive effects of social support, social burden (caregiving, negative life events, and social strain), education, and income on repeated use of breast cancer screening among a large (N=55,278), national sample of postmenopausal women participating in the Women's Health Initiative observational study were examined. Repeated screening decreased as emotional/informational support and positive social interactions decreased (ps<.01). Repeated mammography decreased with frequent caregiving (p<.01). Less social strain reduced the frequency of repeated breast self-examinations (BSEs; ps<.01), but frequent caregiving and more negative life events increased repeated use of BSE (ps<.01). Interactive effects suggested that emotional/informational but not tangible support is associated with repeated mammography and clinical breast examinations (ps<.01) and may be particularly important among low-income older women, especially those burdened by caregiving.     

Steering a new course for deception detection research

Vrij and Granhag (2012) argue for a new direction in deception research based on structuring interviews in ways that more consistently elicit cues to deception. Although we find ourselves in general agreement, we believe there are several additional issues for researchers to consider. We emphasize the need to examine whether the proposed interview techniques lead to potential tradeoffs between information elicitation and deception detection, the importance of individual differences that may moderate previously obtained results, and the value of pursuing a goal of theoretical refinement alongside application development.     

Defense attorneys' concerns about the competence of adolescent defendants

Research indicates that a sizable proportion of adolescent defendants have difficulty understanding and participating in legal proceedings against them, and may be incompetent to stand trial. To examine attorneys' experience in defending adolescents with competence‐related difficulties, 214 juvenile attorneys were surveyed. Findings indicated that attorneys have doubts about the competence of approximately 10% of adolescent defendants, and that they find these cases particularly challenging to defend. Most attorneys appear to recognize that developmental factors may contribute to adolescents' competence‐related difficulties, and believe that the law should accept developmental immaturity as a basis for incompetence findings. In approximately half of the cases in which attorneys had doubts about competence, attorneys did not request a competence evaluation but instead made other efforts to address competence issues, such as by teaching adolescents about legal proceedings and further involving their parents. The implications of these findings are discussed. Copyright © 2010 John Wiley & Sons, Ltd.     

Computer scoring of the Levels of Emotional Awareness Scale

The Levels of Emotional Awareness Scale (LEAS; Lane, Quinlan, Schwartz, Walker, & Zeitlan, 1990) is the most commonly used measure of differentiation and complexity in the use of emotion words and is associated with important clinical outcomes. Hand scoring the LEAS is time consuming. Existing programs for scoring open-ended responses cannot mimic LEAS hand scoring. Therefore, Leaf and Barchard (2006) developed the Program for Open-Ended Scoring (POES) to score the LEAS. In this article, we report a study in which the reliability and validity of POES scoring were examined. In the study, we used three participant types (adult community members, university students, children), three LEAS versions (paper based, computer based, and the LEAS for children), and a diverse set of criterion variables. Across this variety of conditions, the four POES scoring methods had internal consistencies and validities that were comparable to hand scoring, indicating that POES scoring can be used in clinical practice and other applied settings in which hand scoring is impractical.     

Providing information about diagnostic features at retrieval reduces false recognition

In the following study, participants encoded blocked DRM word lists and we varied whether they received information before test about the utility of mnemonic features that potentially discriminate between veridical and false memories. The results of three experiments revealed that this manipulation successfully reduced false recognition of critical theme words. We also found that this manipulation was effective for younger but not older adults. Furthermore, calling attention to the features in test instructions alone was sufficient for reducing false recognition and its effectiveness was not enhanced by also asking participants to rate their phenomenal experience. We argue that providing diagnostic information before test allows participants to establish more accurate expectations about the task and thus improves the efficacy of retrieval and monitoring processes that are subsequently engaged.     

Assessing risk of reoffending in adolescents who have committed a sexual offense: the accuracy of clinical judgments after completion of risk assessment instruments

As courts often rely on clinicians when differentiating between sexually abusive youth at a low versus high risk of reoffense, understanding factors that contribute to accuracy in assessment of risk is imperative. The present study built on existing research by examining (1) the accuracy of clinical judgments of risk made after completing risk assessment instruments, (2) whether instrument-informed clinical judgments made with a high degree of confidence are associated with greater accuracy, and (3) the risk assessment instruments and subscales most predictive of clinical judgments. Raters assessed each youth's (n = 166) risk of reoffending after completing the SAVRY and J-SOAP-II. Raters were not able to predict detected cases of either sexual recidivism or nonsexual violent recidivism above chance, and a high degree of rater confidence was not associated with higher levels of accuracy. Total scores on the J-SOAP-II were predictive of instrument-informed clinical judgments of sexual risk, and total scores on the SAVRY of nonsexual risk.     

Features and feedback: enhancing metamnemonic knowledge at retrieval reduces source-monitoring errors

Three experiments explored the issue of whether enhanced metamnemonic knowledge at retrieval can improve participants' ability to make difficult source discriminations in the context of the eyewitness suggestibility paradigm. The 1st experiment documented differences in phenomenal experience between veridical and false memories. Experiment 2 revealed that drawing participants' attention to these differences by pairing the ratings of the features with instructions about their utility was successful in reducing source misattributions of suggested items to the event. The results of Experiment 3 showed that participants can make online adjustments in the types of evidence used to make source judgments, as participants who received correct feedback during the training portion of the test reduced misattribution errors on the remainder of the test where feedback was not provided. Altogether, these studies suggest that people can discover and benefit from updated knowledge of the types of memorial evidence that discriminate between sources of information in memory.     

What gene-environment interactions can tell us about social competence in typical and atypical populations

Social competence is a complex human behaviour that is likely to involve a system of genes that interacts with a myriad of environmental risk and protective factors. The search for its genetic and environmental origins and influences is equally complex and will require a multidimensional conceptualization and multiple methods and levels of analysis. Behavioural genetic research can begin to address the fundamental yet complex question of how children develop social competence by uncovering the various influences on social development and disentangling variance due to multiple genes, environments and experiences. In this paper, we review the current status of research on sociability, face recognition, emotion recognition, and theory of mind (TOM)--well defined and measured constructs that are likely to be useful indices for detecting genetic and environmental influences on social competence. We also propose specific milestones as indices of further progress in the field: the development of an operational definition of the construct of social competence, the identification of social endophenotypes-psychological processes that are validly and reliably measured components of social competence, and improving specificity and homogeneity with regard to social endophenotypes within a population of study by employing 'extreme social phenotypes'. These efforts will lead to a better understanding of the specific contributions to the normal variation of social competence in the general population as well as to atypical social development.