Can we differentiate sensory over‐responsivity from anxiety symptoms in toddlers? perspectives of occupational therapists and psychologists

Suppose a toddler becomes distressed after hearing a loud noise or when getting messy; are these indicators of sensory over‐responsiveness or indicators of anxiety? There is little evidence regarding the distinction between sensory over‐responsivity and anxiety disorders in toddlers. This construct validity study examined differences between occupational therapists' and psychologists' judgments of behaviors as representing sensory processing disorders (SPD) versus anxiety disorders. Twenty‐four occupational therapists and 25 psychologists completed a mailed survey, rating items from sensory and anxiety scales as representing sensory and/or anxiety disorders in toddlers, and analyzing cases of toddlers with these disorders. Occupational therapists were more likely to rate items as representing SPD than psychologists, and occupational therapists were more certain of the distinction of the sensory scales from anxiety. For the case designed to present a general anxiety disorder and the one designed to present sensory over‐responsivity, more occupational therapists diagnosed as sensory over‐responsive, while more psychologists diagnosed with a general anxiety disorder. The overlap in judgments of sensory over‐responsivity and anxiety supports the notion that these constructs in part reflect different professionals' perspectives upon behaviors as well as the difficulty in distinguishing these constructs in toddlers.     

Confirmatory factor analysis of the AEQ-A questionnaire in Finland

The Adolescent version of the Alcohol Expectancy Questionnaire (Brown et al., 1980) was administered to a male population sample in Finland (N=195; median age 18.5 years). Three issues were investigated: Did the items of each subscale measure single latent constructs? Was the AEQ-A better described by a single-factor model (e.g., global positive expectancy) or by a null model implying scale independence? Were alcohol expectancies related to drinking habits? Confirmatory factor analyses by PRELIS2 and LISREL8 indicated that single-construct models were appropriate only for the Enhanced sexuality and Increased arousal scales while several items were unrelated to the postulated latent constructs in the other five scales. Adequate fits were obtained for these scales only when unrelated items were removedand/or anlayses were based on nondichotomus scores derived from contentwise homogenous groups of items. Even when revised so that the each scale formally fitted a single latent construct, the resulting latent constructs were not well described by either the single-factor model or the null model. Expected social benefit in terms of the revised Enhanced or impeded social behavior scale was the most significant predictor of drinking frequency while quantity consumed per drinking occasion was significantly related to the Improved cognitive and motor abilities scale only.     

ISSUES AND STRATEGIES FOR REDUCING THE LENGTH OF SELF-REPORT SCALES

Greater understanding of the complex interrelationships among work-relevant constructs has increased the number of constructs on organizational surveys. Good psychometric practice also dictates the use of multiple items per construct. The net result has been longer surveys. Longer surveys take more time to complete, tend to have more missing data, and have higher refusal rates than short surveys. Arguably, then, techniques for reducing the length of scales while maintaining psychometric quality are worthwhile. Little guidance exists on how to reduce the length of a multi-item scale and we argue that the most common technique, maximizing internal consistency, is problematic and should be avoided. We present a set of item "quality indices" to help conceptualize the competing issues that influence item retention decisions. Statistical analysis of an example case using these indices suggested that there are 3 key aspects of item quality to consider when reducing a scale. We describe strategies that can assist scale developers in using these 3 aspects of item quality when making scale reduction decisions.     

Shyness and Social Anxiety Assessed Through Self-Report: What Are We Measuring?

The distinction between shyness and social anxiety remains unclear in the literature. In an attempt to shed further light on this issue, our research evaluated whether shyness and social anxiety were the same construct underlying various measurement scales. Participants (N = 801, M_age = 36.21, range = 18–74, female = 53.10%) responded to 10 questionnaires assessing either shyness or social anxiety. Evidence indicated that the scales were highly correlated and loaded onto 1 factor. Confirmatory factor analysis corroborated this finding. A second exploratory factor analysis revealed that all the shyness and social anxiety items best loaded together onto 3 factors: one corresponding to fear of negative evaluation, embarrassment, self-consciousness, scrutiny, authority, interaction anxiety, and shyness (71.0%); a second comprised of primarily interaction anxiety and shyness (17.7%); and a third associated with performance anxiety (7.5%). All scales were similarly discriminated from sociability. Overall, the constructs of shyness and social anxiety were not differentiated from each other. Researchers should carefully consider what items are included in shyness and social anxiety scales if these constructs are to be distinguished from one another.     

Cross-national validity of dimensions of family functioning: First experiences with the Dutch version of the McMaster Family Assessment Device (FAD)

The present study describes the first psychometric findings obtained in The Netherlands with the Dutch version of the Family Assessment Device (FAD) which was originally developed in the Anglo-American cultural context. In a sample of community volunteers, confirmatory analysis (multiple-group method) provided evidence of factorial validity of the FAD measuring constructs. Only 3 out of 60 items were found to be biased and had to be deleted from their a priori defined scales. Reliability and homogeneity indices pertaining to each FAD dimension were good. Despite (very) high correlations among FAD factors/scales, further analyses were focused on determining their convergent and divergent validity which offered good support for such. A higher-order analysis which incorporated reliable scales of the FAD and the Family Environment Scale yielded a two-factor composition: General Family Functioning and Family Influence / Power and Integration. There was evidence to support the viewpoint that a general measure of family functioning may be utilized which is broader in terms of content than the already existing subscale measure termed General Functioning. In line with findings pointing to the ability of the FAD to distinguish between families of psychiatric patients and nonclinical families, the great majority of the FAD subscales, especially Problem Solving and General Functioning, were found to correlate with psychological symptom states as assessed with the Symptom Checklist-90-R. Specific subscales were found to be affected by educational level, while none were affected by sex, age, or religious affiliation. All in all, the findings confirm the further use of the FAD in the Dutch national context.     

Point: Salespeople and Senior Management: Not a “Match Made in Heaven”

This article reports the results of an examination of the Selling Orientation-Customer Orientation scale to determine if the number of items could be reduced while still maintaining the scale's dimensionality and consistency. Analysis of a new Australian data set was undertaken using data from 250 salespeople, 157 of their managers and 276 of their customers in a range of business to business markets. The findings provide evidence that salespeople's customer orientation, as defined by Saxe and Weitz (1982), can be measured with little information loss by ten items, rather than the twenty-four items originally suggested. This significant reduction in length may contribute to a more reliable and valid scale by reducing response fatigue and acquiescence bias, as well as making it possible to include the construct in larger studies with other multiple item scales. Further research is suggested to test the revised scale across a number of industries and consumer groups, to verify its generalizability.     

Are True Scores and Construct Scores the Same? A critical examination of their substitutability and the implications for research results

Relations between constructs are estimated based on correlations between measures of constructs corrected for measurement error. This process assumes that the true scores on the measure are linearly related to construct scores, an assumption that may not hold. We examined the extent to which differences in distribution shape reduce the correlation between true scores on a measure and scores on the underlying construct they are intended to measure. We found, via a series of Monte Carlo simulations, that when the actual construct distribution is normal, nonnormal distributions of true scores caused this correlation to drop by an average of only .02 across 15 conditions. When both construct and true score distributions assumed different combinations of nonnormal distributions, the average correlation was reduced by .05 across 375 conditions. We conclude that theory‐based scales intended to measure constructs usually correlate highly with the constructs they are constructed to measure. We show that, as a result, in most cases true score correlations only modestly underestimate correlations between different constructs. However, in cases in which the two constructs are redundant, this underestimation can lead to the false conclusion that the constructs are ‘correlated but distinct constructs,’ resulting in construct proliferation.     

Are assessment center behaviors' meanings consistent across exercises? A measurement invariance approach

To examine the appropriateness of a Multi‐Trait–Multi‐Method framework for testing construct validity of Assessment Centers (ACs) and get practical implications for the improved AC design, degree to which the AC dimension‐related performance behaviors consistently manifest across multiple AC rating situations was investigated. The present study used a large sample (N = 5,006) to apply a measurement invariance analysis. AC rating situations generally produced consistent factor loadings for items on AC dimensions, item residuals, dimension factor variances, and covariance between dimensions. The AC rating situation of interview tended to produce higher ratings and less item residuals. These findings support the consistency in constructs assessed across different AC rating situations, while some exercises may be better for teasing apart particular dimensions than others.     

The Incremental Validity of a Short Form of the Ideational Behavior Scale and Usefulness of Distractor,Contraindicative, and Lie Scales

This article describes an empirical refinement of the Runco Ideational Behavior Scale (RIBS). The RIBS seems to be associated with divergent thinking, and the potential for creative thinking, but it was possible that its validity could be improved. With this in mind, three new scales were developed and the unique benefit (or “incremental validity”) of each was assessed. The three validity scales contained (a) distractor items, (b) contraindicative items, or (c) items constituting a lie scale. Step‐wise analyses using the three validity scales indicated very little incremental validity: They were interpreted in the light of psychometric theory, which suggests that their contribution may have been on a behavioral rather than on a statistical level. One additional analysis explored the possibility that a short form could be constructed. The short form of the RIBS was highly correlated with the long form (r = .94). Thus, most decisions made by the short form will be entirely compatible with decisions that would have been reached using the long form. A second significant result was that the RIBS was highly correlated with a check list of creative activities, supporting its concurrent validity.     

The Use of the Devereux Scales of Mental Disorders in the Assessment of Attention-Deficit/Hyperactivity Disorder and Conduct Disorder

The present study was designed to gather validity data on the Devereux Scales of Mental Disorders (DSMD) for distinguishing among children and adolescents with Attention-Deficit/Hyperactivity Disorder (ADHD; N = 32), Conduct Disorder (CD; N = 34), or no clinical diagnosis (NC; N = 65). Three types of indicators were compared: (a) DSMD scale, composite, and total scores, (b) the number of ADHD or CD-related items endorsed, and (c) diagnostic efficiency statistics (e.g., sensitivity, positive and negative predictive power). The clinical groups did not differ significantly from each other, but both were significantly higher than the NC group on all DSMD scales. Moreover, there were significant differences between the ADHD and the CD groups on the number of respective ADHD and CD-related items endorsed. A cut-off of seven to eight items yielded the best discrimination between the two diagnostic groups. Diagnostic efficiency statistics indicate that the DSMD may be effective at differentiating between similar disruptive behavior disorders.     

The Lifespan Self-Esteem Scale: Initial Validation of a New Measure of Global Self-Esteem

This article introduces the Lifespan Self-Esteem Scale (LSE), a short measure of global self-esteem suitable for populations drawn from across the lifespan. Many existing measures of global self-esteem cannot be used across multiple developmental periods due to changes in item content, response formats, and other scale characteristics. This creates a need for a new lifespan scale so that changes in global self-esteem over time can be studied without confounding maturational changes with alterations in the measure. The LSE is a 4-item measure with a 5-point response format using items inspired by established self-esteem scales. The scale is essentially unidimensional and internally consistent, and it converges with existing self-esteem measures across ages 5 to 93 (N = 2,714). Thus, the LSE appears to be a useful measure of global self-esteem suitable for use across the lifespan as well as contexts where a short measure is desirable, such as populations with short attention spans or large projects assessing multiple constructs. Moreover, the LSE is one of the first global self-esteem scales to be validated for children younger than age 8, which provides the opportunity to broaden the field to include research on early formation and development of global self-esteem, an area that has previously been limited.     

The Efficient Assessment of Self-Esteem: Proposing the Brief Rosenberg Self-Esteem Scale

Self-esteem is defined as sense of self-worth and self-respect, being crucial for understanding people’s well-being and success. It is one of the most studied constructs in the social sciences, with the Rosenberg Self-Esteem Scale (RSES) being the most used measure. Across four studies (N = 1450), we tested the psychometric parameters of an abbreviated version of the RSES. Through Item Response Theory, the five best items were selected to form the unidimensional Brief Rosenberg Self-Esteem Scale (B-RSES), a reliable and valid measure of self-esteem, which is invariant across age groups and gender. In addition, both RSES and B-RSES correlated very similarly with the Big Five Personality Factors. Also, the B-RSES was strongly correlated with three other short measures of self-esteem, besides being more strongly associated with a range of variables such as conscientiousness and self-competence in comparison to the other three short scales. Together, the B-RSES is especially useful in research that requires rapid evaluation and the use of multiple variables.

     

Development and psychometric properties of a new measure for memory phenomenology: The Autobiographical Memory Characteristics Questionnaire

The purpose of this study is to develop a valid and reliable measure for the phenomenology of autobiographical memories. The psychometric properties of the Autobiographical Memory Characteristics Questionnaire (AMCQ) were tested in three studies: the factor structure of the AMCQ was examined for childhood memories in Study 1 (N = 305); for autobiographical memories related to romantic relationships in Study 2 (N = 197); and for self-defining memories in Study 3 (N = 262). The explanatory factor analyses performed for each memory type demonstrated the consistency of the AMCQ factor structure across all memory types; while a confirmatory factor analysis on the data garnered from all three studies supported the constructs for the autobiographical memory characteristics defined by the researchers. The AMCQ consists of 63 items and 14 factors, and the internal consistency values of all 14 scales were ranged between .66 and .97. The relationships between the AMCQ scales related to gender and individual emotions, as well as the intercorrelations among the scales, were consistent with both theoretical expectations and previous findings. The results of all the three studies indicated that this new instrument is a reliable and robust measure for memory phenomenology.     

Construct Measurement Quality Improves Predictive Accuracy in Violence Risk Assessment: an Illustration Using the Personality Assessment Inventory

Much of the risk assessment literature has focused on the predictive validity of risk assessment tools. However, these tools often comprise a list of risk factors that are themselves complex constructs, and focusing on the quality of measurement of individual risk factors may improve the predictive validity of the tools. The present study illustrates this concern using the Antisocial Features and Aggression scales of the Personality Assessment Inventory (Morey, 1991). In a sample of 1,545 prison inmates and offenders undergoing treatment for substance abuse (85% male), we evaluated (a) the factorial validity of the ANT and AGG scales, (b) the utility of original ANT and AGG scales and newly derived ANT and AGG scales for predicting antisocial outcomes (recidivism and institutional infractions), and (c) whether items with a stronger relationship to the underlying constructs (higher factor loadings) were in turn more strongly related to antisocial outcomes. Confirmatory factor analyses (CFAs) indicated that ANT and AGG items were not structured optimally in these data in terms of correspondence to the subscale structure identified in the PAI manual. Exploratory factor analyses were conducted on a random split‐half of the sample to derive optimized alternative factor structures, and cross‐validated in the second split‐half using CFA. Four‐factor models emerged for both the ANT and AGG scales, and, as predicted, the size of item factor loadings was associated with the strength with which items were associated with institutional infractions and community recidivism. This suggests that the quality by which a construct is measured is associated with its predictive strength. Implications for risk assessment are discussed. Copyright © 2013 John Wiley & Sons, Ltd.     

Discrimination Learning and Discrimination Reversal Learning in Normal and Feebleminded Children

Two studies compared methods of estimating factor scores for the Child's Report of Parental Behavior Inventory. In Study I, least squares factor scores for 5th and 6th graders were computed and correlated with estimates obtained by multiple regression, weighted summation, and unweighted summation with either (a) all scales best defining each factor, (b) the three best, or (c) the two best defining scales. All three estimation methods were highly accurate, and estimates obtained with three and even two scales per factor still correlated highly with the factor scores. In Study 11, factor scores for college students were correlated with estimates obtained by multiple regression and unweighted summation of the same subsets of scales. Again both estimation methods were highly accurate, and reducing the number of scales did not markedly reduce the correspondence of estimated scores to exact scores.     

THE CONSTANCY OF STRUCTURE OF PERCEIVED PARENTAL REARING STYLE IN GREEK AND SPANISH SUBJECTS AS COMPARED WITH THE DUTCH

To be able to contribute to the cross-cultural study of child-rearing practices and psychopathology, this study sought to examine the cross-national generalizability of parental rearing constructs by analyzing self-report data on the EMBU, an instrument designed to assess memories of one's parents' rearing behavior. Of the four primary factors identified originally with Dutch individuals, namely Rejection, Emotional Warmth, Overprotection and Favoring Subject, the first three were replicated in a similar form in a Greek and a Spanish sample of normal research volunteers. Other properties of the factors, their corresponding scales, and the items constituting the scales were such that it would be warranted to carry out mean scale level or pattern comparisons between subjects from the respective countries on the three constructs evidencing cross-national constancy. Scale-level factor analysis of these constructs produced identical two- factor compositions (CARE and PROTECTION) across the Greek, the Spanish and the Dutch samples which further supported this conclusion.     

Time manages interference in visual short-term memory

Emerging evidence suggests that age-related declines in memory may reflect a failure in pattern separation, a process that is believed to reduce the encoding overlap between similar stimulus representations during memory encoding. Indeed, behavioural pattern separation may be indexed by a visual continuous recognition task in which items are presented in sequence and observers report for each whether it is novel, previously viewed (old), or whether it shares features with a previously viewed item (similar). In comparison to young adults, older adults show a decreased pattern separation when the number of items between “old” and “similar” items is increased. Yet the mechanisms of forgetting underpinning this type of recognition task are yet to be explored in a cognitively homogenous group, with careful control over the parameters of the task, including elapsing time (a critical variable in models of forgetting). By extending the inter-item intervals, number of intervening items and overall decay interval, we observed in a young adult sample (N?=?35, M_age?=?19.56 years) that the critical factor governing performance was inter-item interval. We argue that tasks using behavioural continuous recognition to index pattern separation in immediate memory will benefit from generous inter-item spacing, offering protection from inter-item interference.     

Comparing the construct validity of scales derived from the Narcissistic Personality Inventory: A reply to

Rosenthal and Hooley (2010) suggested that the Narcissistic Personality Inventory (NPI) includes items that are tangential to narcissism. They demonstrated that the removal of these items resulted in scores that are not confounded by self-esteem. We tested whether NPI scales derived from Rosenthal and Hooley’s included (NPI-N) and excluded (NPI-X) items manifest divergent relations with self-esteem, entitlement, distress, NPD, and general traits in two samples of undergraduates. The scales generated similar patterns of correlations, although the NPI-N items were more strongly related to (dis)Agreeableness, whereas the NPI-X items were more strongly related to Extraversion. Ultimately, the NPI-X items bore significant relations to constructs central to grandiose narcissism and do not seem to have caused problems in the assessment of narcissism.     

An item‐level investigation of conceptual and empirical distinctiveness of proactivity constructs

Beyond the prior investigations that took scale‐level approaches to determining discriminant validity in proactivity constructs, the current study contributes a much‐needed interrogation of the items used to measure the behaviors in this domain. The substantive validity (SV) assessments (Study 1) showed that many of the items were judged to be inconsistent with the definition of the construct they assess or, alternatively, more consistent with the definition of a different construct in the domain. Further, exploratory factor analysis revealed the difficulty in empirically separating the four behaviors, while BiM results also advocated against the unique variance of them after accounting for a general factor (Study 2). Altogether, our results show that the items are partly to blame for the empirical redundancy issue.