Large-sample confidence intervals for validity and reliability coefficients

Large-sample confidence intervals (CI) for reliability, validity, and unattenuated validity are presented. The CI for unattenuated validity is based on the Bonferroni inequality, which relies on one CI for test-retest reliability and one for validity. Covered are four reliability-validity situations: (a) both estimates were from random samples; (b) reliability was from a random sample but validity was from a selected sample; (c) validity was from a random sample but reliability was from a selected sample; and (d) both estimates were from selected samples. All CIs were evaluated by using a simulation. CIs on reliability, validity, or unattenuated validity are accurate as long as selection ratio is at least 20% and selected sample size is 100 or larger. When selection ratio is less than 20%, estimators tend to underestimate their parameters.     

Differences between Saimiri sciureus and Callicebus moloch in physiological responsiveness: implications for behavior

The New World primates Callicebus moloch and Saimiri sciureus differ markedly in life modes. Physiological responsiveness (heart rate, cortisol) of these related taxa was compared in two situations that differed in the presumed degree of stress imposed, exposure to a novel environment and physical restraint. In both situations, Saimiri exhibited higher initial levels of heart rate and corticosteroids. In addition, the species differed in their patterns of response to both situations. Saimiri maintained initial heart rate levels across a 1-hour exposure period, whereas Callicebus showed a marked and continuous decline in heart rate. Adrenocortical activity increased in both species in response to test situations, but the elevations in plasma corticosteroids were substantially greater for Saimiri than for Callicebus. The results indicate that the species differ with respect to organization of physiological regulatory systems in a manner consistent with behavioral contrasts between them.     

Concepts as Tools Not Rules: a Commentary on (Re-) Defining Racism

In (Re-) Defining Racism, Alberto Urquidez argues that conflicting philosophical accounts over the definition of racism are at bottom linguistic confusions that would benefit from a Wittgensteinian-inspired approach. In this essay, I argue that such an approach would be helpful in disputes over the definition of metaphysically contested concepts, such as “race,” or semantically contested concepts, such as “racialization.” I disagree, however, that such insights would prove helpful or do very little for disputes concerning normatively contested concepts, such as “racism.”

     

Within- and between-nervous-system inhibition of return: Observation is as good as performance

Inhibition of return (IOR) has been shown to occur when an individual returns to a target location (within-person IOR) and when an individual moves to a location just engaged by another individual (between-person IOR). Although within- and between-person IOR likely result from the same inhibitory mechanisms, different processes must activate these mechanisms following the performance and observation of action. Consistent with the suggestion that the mirror neuron system may be responsible for activating the inhibitory mechanisms behind IOR on observation trials, between-person IOR was only detected under restricted viewing conditions known to activate mirror neurons. These results indicate that mirror neuron system may be involved in both higher-order and automatic cognitive behavior.     

Well…ah…: Hesitations and Hedges as an Influence on Jurors' Decisions1

Hispanic jurors' verdicts and whether these decisions were related to jurors' judgments of the credibility of the witness were the focus of this experiment. A prosecution witness testified in English or in Spanish with interpretation in English. Witnesses' speaking style systematically included hedges and hesitations or did not. Guilty verdicts were independent of language of testimony. Within Spanish‐interpreted conditions, jurors convicted the defendant 47% of the time in the absence of hedges and hesitations. When he hedged and hesitated, they convicted 34% of the time. This effect was complicated by a reliable Witness Hesitation × Juror Language Dominance interaction. These results are interpreted in the context of the courtroom impact of non‐English‐speaking witnesses and the impact of interpretation.     

Cellphone addiction explains how cellphones impair learning for lecture materials

Students' cellphone use has been related to poorer learning, possibly due to greater distraction. This study investigated whether cellphone‐related anxiety, addiction, and disconnection were related to distraction and learning as well as how practical educational policies could minimize negative effects. Participants (N = 218) watched a video lecture and were divided into two groups: cellphone‐allowed for academic use (Use‐Cellphone Group) and no cellphone instruction (No‐Instruction Group). During the lecture, participants received several anonymous text messages and overt distracted was measured. Learning was assessed via a test following the video. Our findings showed that participants in the Use‐Cellphone Group experienced a greater degree of distraction and worse test performance than those in the No‐Instruction Group. Only cellphone addiction and distractedness played key roles in impacting the effects of condition on test performance. Thus, allowing cellphones in class may exacerbate existing cellphone addiction behaviors and impair learning.     

Model Conditioned Data Elasticity in Path Analysis: Assessing the “Confoundability” of Model/Data Characteristics

Much research has been directed at the validity of fit indices in Path Analysis and Structural Equation Modeling (e.g., Browne, MacCallum, Kim, Andersen, &; Glaser, 2002 Browne, M.W., MacCallum, R.C., Kim, C.T., Andersen, B.L., &; Glaser, R. (2002). When fit indices and residuals are incompatible. Psychological Methods, 7, 403–421.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Heene, Hilbert, Draxler, Ziegler, &; Bühner, 2011 Heene, M., Hilbert, S., Draxler, C., Ziegler, M., &; Bühner, M. (2011). Masking misfit in confirmatory factor analysis by increasing unique variances: A cautionary note on the usefulness of cutoff values of fit indices. Psychological Methods, 16(3), 319–336.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Hu &; Bentler, 1999 Hu, L., &; Bentler, P. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, J., 6(1), 1–55.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]; Marsh, Hau, &; Wen, 2004 Marsh, H.W., Hau, K.T., &; Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling, 11(3), 320–341.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]). Recent developments (e.g., Preacher, 2006 Preacher, K.J. (2006). Quantifying parsimony in structural equation modeling. Multivariate Behavioral Research, 41(3), 227–259.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]; Roberts &; Pashler, 2000 Roberts, S., &; Pashler, H. (2000). How persuasive is a good fit? A comment on theory testing. Psychological Review, 107(2), 358–367.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar], 2002 Roberts, S., &; Pashler, H. (2002). Reply to Rodgers and Rowe (2002). Psychological Review, 109(3), 605–607.[Crossref] , [Google Scholar]) have encouraged researchers to investigate other criteria for comparing models, including model complexity. What has not been investigated is the inherent ability of a particular data set to be fitted with a constrained set of randomly generated linear models, which we call Model Conditioned Data Elasticity (DE). In this article we show how DE can be compared with the problem of equivalent models and a more general problem of the “confoundability” of data/model combinations (see MacCallum, Wegener, Uchino, &; Fabrigar, 1993 MacCallum, R.C., Wegener, D.T., Uchino, B.N., &; Fabrigar, L.R. (1993). The problem of equivalent models in applications of covariance structure analysis. Psychological Bulletin, 114(1), 185–199.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). Using the DE package in R, we show how DE can be assessed through automated computer searches. Finally, we discuss how DE fits within the controversy surrounding the use of fit statistics.