Using PPT to Analyze Suboptimal Human–Automation Performance

Diagnostic automation aids are designed to improve human performance by increasing accuracy in event detection tasks. However, human–automation performance has frequently fallen short of expectations, particularly when the aid is highly reliable. In those cases, human–automation performance is often suboptimal, in that a human being augmented with a diagnostic aid does more poorly than the automation itself. Previously, there have been only ambiguous explanations for why this occurs, with few suggestions on how to effectively eliminate suboptimal performance. Fortunately, with the advent of a new general theory of task performance, termed Potential Performance Theory (PPT) by D. Trafimow and S. Rice (2008 Trafimow, D. and Rice, S. 2008. Potential Performance Theory: A general theory of task performance applied to morality. Psychological Review, 115(2): 447–462. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; 2009), one can now determine exactly why suboptimal performance occurs. Results from the present study reveal that inconsistency is the culprit, rather than just poor strategy selection. Furthermore, PPT allows one to determine exactly how much of the performance decrement is because of inconsistency.     

Body Image–Acceptance and Action Questionnaire–5: An Abbreviation Using Genetic Algorithms

Body image concerns are typically linked with negative outcomes such as disordered eating and diminished well-being, but some people can exhibit psychological flexibility and remain committed to their valued goals despite being dissatisfied about their bodies. Such flexibility is most frequently measured by the Body Image–Acceptance and Action Questionnaire (BI-AAQ). This study used a recently validated, fully automated method based on genetic algorithms (GAs) on data from an American community sample (N₁ = 538, 71.5% female, Age: M = 40.87, SD = 13.5) to abbreviate the 12-item BI-AAQ to a 5-item short form, BI-AAQ-5. Validation tests were conducted on data from an independent community sample (N_2 = 762, 44.6% female, Age: M = 40.65, SD = 13.06). The short form performed comparably to the long form in terms of its factor structure and correlations with theoretically relevant constructs, including body image dissatisfaction, stigma, internalization of societal norms of appearance, self-compassion, and poor mental health. Further, preliminary analyses using structural equation modeling showed that body image flexibility, as measured by either the long or short form, was associated with almost all the criterion variables, even while controlling for a highly related construct of body image dissatisfaction. These results demonstrate the potential discriminant validity of both the long and short form of the BI-AAQ, and show that the BI-AAQ-5 is a suitable alternative to its long form. We discuss how psychological flexibility with respect to body image dissatisfaction can be conducive to positive functioning.     

Estimating Structural Equation Models Using James–Stein Type Shrinkage Estimators

Psychometrika - We propose a two-step procedure to estimate structural equation models (SEMs). In a first step, the latent variable is replaced by its conditional expectation given the observed...     

Formative Versus Reflective Measurement: An Illustration Using Work–Family Balance

The aim of this article is to propose the formative measurement approach that can be used in various constructs of applied psychology. To illustrate this approach, the authors will (a) discuss the distinction between commonly used principal-factor (reflective) measures in comparison to the composite (formative) latent variable model, which is often applied in other disciplines such as marketing or engineering, and (b) point out the advantages and limitations of formative specifications using the example of the work–family balance (WFB) construct. Data collected from 2 large cross-sectional field studies confirm the reliability and validity of formative WFB measures as well as its predictive value regarding criteria of WFB (i.e., job satisfaction, family satisfaction, and life satisfaction). Last, the specific informational value of each formative indicator will be demonstrated and discussed in terms of practical implications for the assessment in different psychological fields.     

Using Clinician-Rated Five-Factor Model Data to Score the DSM–IV Personality Disorders

Proposals suggest that many or all of the Diagnostic and Statistical Manual of Mental Disorders (4th ed. [DSM–IV]; American Psychiatric Association, 1994) personality disorders (PDs) may be omitted from the DSM (5th ed.; DSM–V) and replaced with a dimensional trait model of personality pathology (Krueger, Skodol, Livesley, Shrout, &; Huang, 2007 Krueger, R. F., Skodol, A. E., Livesley, W. J., Shrout, P. E. and Huang, Y. 2007. Synthesizing dimensional and categorical approaches to personality disorders: Refining the research agenda for DSM-V Axis II. International Journal of Methods in Psychiatric Research, 16: 65–73. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Skodol, 2009 Skodol, A. 2009. Emerging DSM-V perspectives on personality disorders. Plenary address presented at the Eleventh International ISSPD Congress. August2009, New York, New York.  [Google Scholar]). Several authors have expressed concerns that this may be difficult for clinicians and researchers who are more comfortable with the extant PD diagnoses. In this study, we tested whether clinician ratings of traits from the Five-factor model (FFM; Costa &; McCrae, 1990) can be used to recreate DSM–IV PDs. Using a sample of 130 clinical outpatients, we tested the convergent and discriminant validity of the FFM PD counts in relation to consensus ratings of the DSM–IV PDs. We then examined whether the FFM and DSM–IV PD scores correlate in similar ways with self-reported personality traits from the Schedule for Nonadaptive and Adaptive Personality (Clark, 1993 Clark, L. A. 1993. Manual for the Schedule for Nonadaptive and Adaptive Personality (SNAP), Minneapolis: University of Minnesota Press.  [Google Scholar]). Finally, we tested the clinical utility of the FFM PD counts in relation to functional impairment. Overall, the FFM PD counts, scored using clinician ratings of the FFM traits, appeared to function like the DSM–IV PDs, thus suggesting that the use of a dimensional trait model of personality in the DSM–V may still allow for an assessment of the DSM–IV PD constructs.     

Using relationship-focused reflection to improve teacher–child relationships and teachers' student-specific self-efficacy

The present study evaluated whether LLInC (Leerkracht-Leerling Interactie Coaching in Dutch, or Teacher-Student Interaction Coaching), a teacher-based coaching-intervention, yielded improvements in dyadic affective teacher–child relationships in elementary school (Grades 2–6). Based on attachment theory, LLInC aims to foster more flexible and differentiated mental representations of teachers' relationships with individual children with whom they experience relationship difficulties. Using a quasi-experimental design, we compared an intervention group of teachers (n = 46 teachers and 92 children) receiving LLInC with a control group receiving no form of intervention (n = 32 teachers and 88 children). To investigate possible transfer effects, we asked teachers from the intervention group to report on their relationships and self-efficacy beliefs regarding two other children with whom they experienced relationship difficulties as well (n = 46 teachers and 81 children). Multilevel models were used to examine intervention effects on teachers' perceptions of relationship quality (i.e., Closeness, Conflict, Dependency), and teachers' student-specific self-efficacy beliefs for Behavior Management and Emotional Support. Teachers receiving LLInC reported short-term improvements in Closeness and self-efficacy beliefs for Emotional Support and decreases in Conflict as compared to control teachers. Similar improvements in Closeness and self-efficacy for Emotional Support were found for the intervention-transfer group as compared to control teachers. Also, teachers receiving LLInC had short-term and longer-term improvements in self-efficacy beliefs for Behavior Management as compared to control teachers. These improvements regarding Behavior Management were not found for the intervention-transfer group.     

Using the MMPI–2–RF to Discriminate Psychometrically Identified Schizotypic College Students From a Matched Comparison Sample

This study investigates the extent to which the Minnesota Multiphasic Personality Inventory–2 Restructured Form (MMPI–2–RF) profiles of 52 individuals making up a psychometrically identified schizotypes (SZT) sample could be successfully discriminated from the protocols of 52 individuals in a matched comparison (MC) sample. Replication analyses were performed with an additional 53 pairs of SZT and MC participants. Results showed significant differences in mean T-score values between these 2 groups across a variety of MMPI–2–RF scales. Results from discriminant function analyses indicate that schizotypy can be predicted effectively using 4 MMPI–2–RF scales and that this method of classification held up on replication. Additional results demonstrated that these MMPI–2–RF scales nominally outperformed MMPI–2 scales suggested by previous research as being indicative of schizophrenia liability. Directions for future research with the MMPI–2–RF are suggested.     

Evidence for a Spatial–Numerical Association in Kindergartners Using a Number Line Task

In Western cultures, small numbers are often associated with the left and large with the right space. We investigated whether this association is already present in kindergartners and second graders. Children (N = 59) estimated the position of numbers on a number line that was labeled either with a small number on the left side and a large number on the right side (i.e., left-to-right orientation) or vice versa (i.e., right-to-left orientation). The estimations were less accurate if the number line was oriented from right to left and if the children started with this condition. The results suggest that already kindergartners possess a culture-typical spatial–numerical association that develops before the acquisition of reading and writing skills and significantly affects the accuracy of numerical estimations. The performance of second graders, too, was affected by the orientation of the number line, but to a smaller degree than that of kindergartners.     

Assessment Intervention Using the Rey–Osterrieth Complex Figure Test: A Clinical Illustration

Therapeutic assessment (TA) aims to affect change in a client, in part, through an in vivo intervention using any number of assessment methods during a planned assessment intervention session (AIS). To date, neuropsychological tests have not been widely used in AIS. We suggest that the Rey–Osterrieth Complex Figure Test (RCFT) can be a helpful tool, especially when the assessment questions pertain to cognitive functioning, owing to its complexity and the fact that it taps several different cognitive functions. To illustrate this, we present the case of Mr. B, a 45-year-old man with a childhood history of neglect and abuse who was struggling with mood and cognitive complaints in the context of identifying a satisfying career. His performance on the RCFT had illuminated his cognitive style, and an AIS was built around observing and changing his approach to problem solving in the context of a supportive relationship. Based on the intervention, he was able to reassess his narrative of cognitive dysfunction, address his problems in organization, and practice using another person for support in problem solving.     

Using MMPI–2–RF Correlates to Elucidate the PCL–R and Its Four Facets in a Sample of Male Forensic Psychiatric Patients

This study documents the associations between the MMPI–2–RF (Ben-Porath &; Tellegen, 2008 Ben-Porath, Y. S., &; Tellegen, A. (2008). MMPI–2–RF (Minnesota Multiphasic Personality Inventory–2–Restructured Form): Manual for administration and scoring. Minneapolis: University of Minnesota Press. [Google Scholar]) scale scores and the Psychopathy Checklist Revised (PCL–R; Hare, 2003 Hare, R. D. (2003). The Hare Psychopathy Checklist–Revised (2nd ed.). Toronto, ON, Canada: Multi-Health Systems. [Google Scholar]) facet scores in a forensic psychiatric sample. Objectives were to determine how the MMPI–2–RF scales might enhance substantive understanding of the nature of the 4 PCL–R facets and to discern possible implications for the treatment of psychopathic patients. A sample of 127 male forensic psychiatric offenders admitted to a Dutch forensic psychiatric hospital completed the PCL–R and the MMPI–2. Exploratory stepwise regression analyses assessed the prediction of the PCL–R total and its facet scores from MMPI–2–RF scales at its 3 hierarchical levels. Conceptually meaningful results emerged at each level of the MMPI–2–RF hierarchy, including several consistent differences between predictor sets across the facets. Interestingly, ideas of persecution (RC6) was a specific predictor of PCL–R Facet 2, a facet noted for its association with treatment failure. Results are compared and contrasted to the extant body of empirical work to date, and some tentative clinical implications are offered.     

Using Historical Knowledge to Reason About Contemporary Political Issues: An Expert–Novice Study

People often justify history's place in the curriculum by its relationship to citizenship, yet there is little research to help educators picture how people use historical knowledge for civic purposes. This expert–novice study used the think-aloud method to examine how eight political scientists and eight high school students employed historical knowledge to reason about a political issue. Findings indicated that detailed historical narrative played an important role for experts’ reasoning, and the experts used narrative to frame the issue, support their positions, and evaluate historical claims. Participating students used narrative as well, but their narratives were lacking in detail. They never used history to frame the problem, contextualize documents, or to support their positions, and they rarely used narrative to evaluate claims. These differences in how experts and novices use history to make sense of the present have implications for history instruction and research in history and civic education.     

Empirically Defining Treatment Response and Remission in Obsessive-Compulsive Disorder Using the Obsessive-Compulsive Inventory–Revised

In clinical trials of obsessive-compulsive disorder (OCD), clinical outcomes are generally measured using lengthy clinician-administered interviews. However, in routine clinical practice, many clinicians lack the time to administer such instruments. This study evaluated cutoffs for treatment response and remission in OCD using the self-rated Obsessive-Compulsive Inventory—Revised (OCI-R). Data from 349 patients in three clinical trials of cognitive-behavioral therapy for OCD were pooled for analysis. The OCI-R was compared to gold-standard criteria for response and remission based on the clinician-administered Yale–Brown Obsessive Compulsive Scale and the Clinical Global Impression Scale. The results showed that a ≥40% reduction on the OCI-R was the optimal cutoff for treatment response, with a sensitivity of 0.72 and a specificity of 0.79. For remission status, the optimal cutoff was ≤8 points on the OCI-R, with a sensitivity of 0.57 and specificity of 0.83. Results from additional analyses using the 12-item version of the OCI were similar. These cutoffs provide a simple and time-efficient way to help determine treatment response and remission in OCD when the administration of clinician-administered instruments is unfeasible.     

A Psychometric Analysis of the Trait Emotional Intelligence Questionnaire–Short Form (TEIQue–SF) Using Item Response Theory

Trait emotional intelligence refers to a constellation of emotional self-perceptions located at the lower levels of personality hierarchies. In 2 studies, we sought to examine the psychometric properties of the Trait Emotional Intelligence Questionnaire–Short Form (TEIQue–SF; Petrides, 2009) using item response theory (IRT). Study 1 (N= 1,119, 455 men) showed that most items had good discrimination and threshold parameters and high item information values. At the global level, the TEIQue–SF showed very good precision across most of the latent trait range. Study 2 (N= 866, 432 men) used similar IRT techniques in a new sample based on the latest version of the TEIQue–SF (version 1.50). Results replicated Study 1, with the instrument showing good psychometric properties at the item and global level. Overall, the 2 studies suggest the TEIQue-SF can be recommended when a rapid assessment of trait emotional intelligence is required.     

Measuring Effortful Control Using the Children's Behavior Questionnaire–Very Short Form: Modeling Matters

Effortful control (EC) is an important concept in the research on self-regulation in children. We tested 2 alternative factor models of EC as measured by the Children's Behavior Questionnaire–Very Short Form (CBQ–VSF; Putnam &; Rothbart, 2006 Putnam, S. P., &; Rothbart, M. K. (2006). Development of short and very short forms of the Children's Behavior Questionnaire. Journal of Personality Assessment, 87, 103–113. doi:10.1207/s15327752jpa8701_9[Crossref], [Web of Science ®] , [Google Scholar]) in a large sample of preschoolers (N = 1,007): 1 lower order and 1 hierarchical second-order structure. Additionally, convergent and predictive validity of EC as measured by the CBQ–VSF were investigated. The results supported a hierarchical model. Moderate convergent validity of the second-order latent EC factor was found in that it correlated with compliance and observed EC tasks. Both CBQ–VSF EC measures were also negatively correlated with child physical aggression. The results have implications for the measurement, modeling, and interpretation of EC applying the CBQ.     

Age, Gender, and Ethnicity Effects on Parent–Child Discrepancy Using Identical Item Measures

Objective assessment of child and adolescent behavioral and emotional symptoms is traditionally obtained from multiple sources. However, a substantial body of research indicates that parental and child reports provide significant amounts of contradicting diagnostic information. Although a large and growing body of research attempts to identify potential influences of discrepant reports, the current research improves upon previous research in three primary ways: using identical item measures, using expanded statistical analyses, and evaluating cultural influences on observed discrepancies. A total of 2,153 parent–child dyads completed ratings of child behavior and emotional functioning. Specifically, parents and children completed the Ohio Scales, an empirically supported, identical item measure. Generally, reporter agreement was greater than typically reported. Similar to previous research with clinical populations, parents reported greater levels of child problems than their children. While age was not associated with observed discrepancies, parents and daughters demonstrated greater discrepancies on fewer specific items while parents and sons demonstrated more pervasive yet less severe discrepancies. Additionally, Hispanic dyads demonstrated less discrepancy than did African American and Caucasian dyads independent of discrepancy analysis. Discrepancies must be measured using multiple statistical methods in order to understand patterns. Furthermore, discrepancy research must address key demographic factors (e.g., ethnicity, gender).     

Using scissors to bisect a line: A perception–action dissociation in complex tool use

Previous research has shown that unilateral visual neglect is improved when patients are required to actively grasp an object at its center, rather than only pointing to its center. A similar dissociation between pointing and grasping responses has been reported for pseudoneglect, a spatial bias toward the left side of space that is normally exhibited by healthy participants. Among other theories, the two-visual-streams hypothesis has been offered as an explanation for these dissociations. According to this hypothesis, highly practiced actions that are performed under easily available visual input (e.g., grasping an object) are controlled by the dorsal stream and can resist perceptual judgment biases. We investigated whether, in pseudoneglect, dissociations between perceptual judgments and motor–manipulative responses occur when participants have to respond with complex tools that are highly practiced but that have been shown to rely on both ventral- and dorsal-stream processing. In a standard line bisection task, participants had to either mark the center of a line with a pencil or cut the line in two halves using a pair of scissors. The results indicated the typical leftward bias (pseudoneglect) in the pencil task, whereas performance was much more accurate in the scissors task. These results show that actions featuring complex tool use can resist perceptual judgment biases, and the findings are discussed with reference to existing accounts of perception–action dissociations.     

Using the Research Domain Criteria Framework to Explore Associations Between MMPI–2–RF Constructs and Physiological Variables Assessed by Eye-Tracker Technology

The National Institute of Mental Health has proposed a paradigm shift in the conceptualization of psychopathology, abandoning the traditional categorical model in favor of one based on hierarchically organized dimensional constructs (Insel et al., 2010 Insel, T., Cuthbert, B., Garvey, M., Heinssen, R., Pine, D. S., Quinn, K., … Wang, P. (2010). Research domain criteria (RDoC): Toward a new classification framework for research on mental disorders. American Journal of Psychiatry, 167, 748–751.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). One explicit goal of this initiative, the Research Domain Criteria (RDoC) project, is to facilitate the incorporation of newly available neurobiologic variables into research on psychopathology. The Minnesota Multiphasic Personality Inventory–2–Restructured Form (MMPI–2–RF; Ben-Porath &; Tellegen, 2008/2011 Ben-Porath, Y., &; Tellegen, A. (2011). Minnesota Multiphasic Personality Inventory–Restructured Form: Manual for administration, scoring, and interpretation. Minneapolis: University of Minnesota Press. (Original work published 2008) [Google Scholar]) represents a similar paradigm shift, also adopting a hierarchical arrangement of dimensional constructs. This study examined associations between MMPI–2–RF measures of psychopathology and eye-movement metrics. Participants were college students (n = 270) who completed the MMPI–2–RF and then viewed a sequence of 30-s video clips. Results show a pattern of positive correlations between pupil size and emotional/internalizing dysfunction scales when viewing video eliciting negative emotional reactions, reflecting greater arousability in individuals with higher scores on these measures. In contrast, when viewing stimuli depicting angry, threatening material, a clear pattern of negative correlations was found between pupil size and behavioral/externalizing trait measures. These data add to the construct validity of the MMPI–2–RF and support the use of the RDoC matrix as a framework for research on psychopathology.     

A Review of Articles Using Observation Methods to Study Creativity in Education (1980–2018)

This paper reports on an integrative literature review of published articles that used either quantitative or qualitative observation methods to research creativity in learning contexts. Observation is an empirical research method used in quantitative and qualitative naturalistic studies focused on understanding behavior and interactions as they unfold in real-time, which makes it particularly salient for examining the processes associated with the generation and adoption of creative ideas. However, observation remains underutilized in the field of creativity studies, partly because data collection can be time and resource intensive, but also because there are a lack of protocols and recommended research practices for observing creative thinking and problem solving in an educational environment that covers all phases of design, collection, analysis, and reporting. Thirty-seven articles from 1980–2018 were reviewed along seven dimensions: definition of creativity, unit of observation, observer role, observation sampling method, research design, data collection, and data analysis. The paper concludes with five recommendations for using observation to advance the state of research on creativity and education.     

Using continuous heart rate monitoring to investigate anxiety and its communication with the dentist–patient interaction

Abstract

The importance of communication within the dentist–patient relationship has long been recognised with regard to patient satisfaction and anxiety. However there has been little research into the anxiety experienced by both patient and dentist during the administration of dental treatment nor how such affects are perceived and communicated within the dentist–patient interaction.

The study reported here, examined affective communication between dental students (n=16) and their patients (n=64) by using continuous and simultaneous cardiovascular monitoring during an entire dental treatment session. The data was analysed using stepwise regression analysis together with the development of a measure of emotionality in order to understand the communication of anxiety during dental treatment procedures. The results suggested that anxiety was communicated between dental operator and patient but was dependent on the degree of clinical experience of the operator.