Two Grades of Internalism (Pass and Fail)

Internalism about mental content holds that microphysical duplicates must be mental duplicates full-stop. Anyone particle-for-particle indiscernible from someone who believes that Aristotle was wise, for instance, must share that same belief. Externalism instead contends that many perfectly ordinary propositional attitudes can be had only in certain sorts of physical, sociolinguistic, or historical context. To have a belief about Aristotle, for instance, a person must have been causally impacted in the right way by Aristotle himself (e.g., by hearing about him, or reading some of his works).An interesting third view, which I call ‘weak’ internalism, is a mix of what are arguably the most plausible aspects of the two extreme views. On the one hand, the weak internalist rejects the externalist’s idea that certain propositional attitudes can be had only in certain sorts of physical, socio-linguistic, or historical context; but on the other hand, she rejects the internalist’s claim that microphysical duplicates must be mental duplicates.One of the most vocal opponents of externalism, John Searle, defends a paradigm case of weak internalism. In this paper I explain his view and why it might seem like the ideal compromise: in particular, it captures intuitions underlying both sides of the debate. I then argue, however, that Searle’s view is untenable; and my objection shows the untenability of weak internalism in general. Despite the attractiveness of a compromise view, we must choose between internalism and externalism full-stop.     

Scores of Spanish-Speaking Children on Repeated Tests

Abstract

(Burrow, T. The Biology of Human Conflict. New York: Macmillan, 1937. Pp. 435.) Reviewed By William Galt

(Wheeler, R. H. The Science of Psychology. New York: Crowell, 1940. Pp. 436.) Reviewed By David G. Ryans     

Fitting the Normal-Ogive Factor Analytic Model to Scores on Tests

This article (a) describes how McDonald's nonlinear factor analytic approach to the normal ogive curve can be used to factor analyse total test scores, (b) discusses the conditions in which this model is more appropriate than the widely used linear model, and (c) illustrates the applicability of both models using an empirical example. The rationale for the described procedure is that the test scores are simple sums of binary item responses whose item characteristic curves are adequately represented by normal ogives. The results obtained in the empirical example are meaningful and informative, and agree with the results obtained at the item level.     

Evaluations of Tests Used for Making Selection and Promotion Decisions

Participants (N= 212) rated the fairness, job relevance, appropriateness, and invasiveness of 16 tests that could be used to select or promote people into production or management positions. Fairness, job relevance and appropriateness were highly correlated, and were combined to form a composite evaluation scale. Evaluations and invasiveness ratings varied among the 16 tests, with the most positive ratings given to interviews and work samples and the most negative ratings given to astrology, graphology and polygraphs. Evaluations of four tests were affected by the position (manager vs. production worker). Evaluations of 11 tests and invasiveness ratings of two tests were affected by respondent experience with the test. Respondents who had experienced the tests evaluated them more positively and considered them to entail a smaller invasion of privacy. Responses were not affected by whether the test was to be used for selection versus promotion decisions.     

Reliability and Validity of Scores From the Inventory of Drug Use Consequences

Psychometric properties of the Inventory of Drug Use Consequences (InDUC; W. M. Miller, J. S. Tonigan, & R. Longabaugh, 1995), a self‐report assessment of negative consequences associated with alcohol and other drug use, were investigated. The InDUC demonstrated sound psychometric characteristics and can be a valuable clinical tool for chemical dependency counselors.     

Practical Limitations in Making Decisions Regarding the Distribution of Applicant Personality Test Scores Based on Incumbent Data

For practitioners, the possibility of faking on personality tests has potential implications that are much broader than those captured by current theoretical debates over criterion-related validity, factor structure, or psychological processes. One unexplored potential impact of response distortion involves the pass rates associated with applying cutoff scores developed using a concurrent validation design to applicant samples. This practitioner-oriented paper compared applicant and incumbent scores on three personality dimensions and uncovered significant standardized group differences. These differences greatly influenced pass rates for three different selection models, which impacted expected utility of the selection system. Potential solutions for practitioners are provided, along with recommendations for future research in this area. An earlier version of this paper was presented at the annual meeting of the Society for Industrial and Organizational Psychologists in Orlando, Florida.     

Estimating the Reliability of Aggregated and Within-Person Centered Scores in Ecological Momentary Assessment

Consider two independent groups with K measures for each subject. For the j^th group and k^th measure, let μ^tjk be the population trimmed mean, j = 1, 2; k = 1, ..., K. This article compares several methods for testing H 0 : u1k = t2k such that the probability of at least one Type I error is, and simultaneous probability coverage is 1 - α when computing confidence intervals for μ^t1k - μ^t2k . The emphasis is on K = 4 and α = .05. For zero trimming the problem reduces to comparing means, but it is well known that when comparing means, arbitrarily small departures from normality can result in extremely low power relative to using say 20% trimming. Moreover, when skewed distributions are being compared, conventional methods for comparing means can be biased for reasons reviewed in the article. A consequence is that in some realistic situations, the probability of rejecting can be higher when the null hypothesis is true versus a situation where the means differ by a half standard deviation. Switching to robust measures of location is known to reduce this problem, and combining robust measures of location with some type of bootstrap method reduces the problem even more. Published articles suggest that for the problem at hand, the percentile t bootstrap, combined with a 20% trimmed mean, will perform relatively well, but there are known situations where it does not eliminate all problems. In this article we consider an extension of the percentile bootstrap approach that is found to give better results.     

An Information-Processing-Based Conceptual Framework of the Effects of Unproctored Internet-Based Testing Devices on Scores on Employment-Related Assessments and Tests

The widespread use of unproctored Internet-based testing (UIT) in employment-related assessments has resulted in a burgeoning use of mobile devices to complete these assessments. Coupled with this is a concomitant interest in UIT-device-type effects, specifically, differences or lack thereof between assessments completed on “mobile” versus “nonmobile” devices. However, there is limited theoretical or conceptual work that seeks to explain the observed effects of UIT device type on test scores. Consequently, this article first presents a review of the extant empirical literature and then, on the basis of that, presents a framework—the structural characteristics/information processing framework—for psychologically conceptualizing the effect of UIT device types on test and assessment scores. The framework is used to explain previous findings and advance testable propositions for future research.     

Multilevel Reliability Measures of Latent Scores Within an Item Response Theory Framework

Abstract

This paper evaluated multilevel reliability measures in two-level nested designs (e.g., students nested within teachers) within an item response theory framework. A simulation study was implemented to investigate the behavior of the multilevel reliability measures and the uncertainty associated with the measures in various multilevel designs regarding the number of clusters, cluster sizes, and intraclass correlations (ICCs), and in different test lengths, for two parameterizations of multilevel item response models with separate item discriminations or the same item discrimination over levels. Marginal maximum likelihood estimation (MMLE)-multiple imputation and Bayesian analysis were employed to evaluate the accuracy of the multilevel reliability measures and the empirical coverage rates of Monte Carlo (MC) confidence or credible intervals. Considering the accuracy of the multilevel reliability measures and the empirical coverage rate of the intervals, the results lead us to generally recommend MMLE-multiple imputation. In the model with separate item discriminations over levels, marginally acceptable accuracy of the multilevel reliability measures and empirical coverage rate of the MC confidence intervals were found in a limited condition, 200 clusters, 30 cluster size, .2 ICC, and 40 items, in MMLE-multiple imputation. In the model with the same item discrimination over levels, the accuracy of the multilevel reliability measures and the empirical coverage rate of the MC confidence intervals were acceptable in all multilevel designs we considered with 40 items under MMLE-multiple imputation. We discuss these findings and provide guidelines for reporting multilevel reliability measures.     

The Reliability and Validity of Big Five Inventory Scores With African American College Students

The reliability and validity of scores on the Big Five Inventory (BFI; O. P. John, E. M. Donahue, & R. L. Kentle, 1991) were examined in a sample of 336 African American college students. Results indicated moderate reliability and structural validity for BFI scores. Additionally, BFI subscales had few meaningful correlations with self‐esteem and social desirability. La fiabilidad y la validez de los resultados del Inventario “Big Five” (BFI; O. P. John, E. M. Donahue, y R. L. Kentle, 1991) se examinan en una muestra de 336 estudiantes universitarios afro‐americanos. Los resultados indican una fiabilidad moderada y una validez estructural para los resultados del BFI. Adicionalmente, las subescalas del BFI tuvieron pocas correlaciones importantes con el auto‐estima y el deseo social.     

Meta-analytic Decisions and Reliability: A Serendipitous Case of Three Independent Telecommuting Meta-analyses

Purpose  

Despite the potential for researcher decisions to negatively impact the reliability of meta-analysis, very few methodological studies have examined this possibility. The present study compared three independent and concurrent telecommuting meta-analyses in order to determine how researcher decisions affected the process and findings of these studies.     

The Creativity Crisis: The Decrease in Creative Thinking Scores on the Torrance Tests of Creative Thinking

The Torrance Tests of Creative Thinking (TTCT) was developed in 1966 and renormed five times: in 1974, 1984, 1990, 1998, and 2008. The total sample for all six normative samples included 272,599 kindergarten through 12th grade students and adults. Analysis of the normative data showed that creative thinking scores remained static or decreased, starting at sixth grade. Results also indicated that since 1990, even as IQ scores have risen, creative thinking scores have significantly decreased. The decrease for kindergartners through third graders was the most significant.     

Retest Reliability of Scores on Objective and Projective Measures of Dependency: Relationship to Life Events and Interest Interval

The retest reliabilities of widely used objective and projective measures of dependency were assessed in a mixed-sex sample of undergraduates (54 women and 34 men). Subjects completed Hirschfeld and colleagues' (1977) Interpersonal Dependency Inventory (IDI) and Masling, Rabie, and Blondheim's (1967) Rorschach Oral Dependency (ROD) scale on two occasions separated by 16, 28, or 60 weeks. The IDI and ROD scale showed good retest reliability over 16 weeks in both men and women. However, the ROD scale did not show adequate retest reliability over longer periods in subjects of either sex. IDI scores showed excellent long-term retest reliability in women, but poor longterm retest reliability in men. Subjects' self-reports and impact ratings of life events experienced during the intertest period were unrelated To changes in subjects' IDI and ROD scale scores from Time 1 to Time 2, regardless of the intertest interval used.     

大五人格测验在中国应用的信度概化分析

对过去20年(1994~2013年)间国内有关大五人格测验的研究文献进行信度概化分析。结果表明:(1)检索到的文献中约68.15%存在"信度引入"现象;(2)未加权估计中,A和O的均值最低,N和C的均值最高,国内所得结果均略低于国外(O除外),而后者的变异性略大(E除外);采用α系数效果量方法,在随机效应模型中,N的估计值最高,O和A的估计值最低;(3)回归分析显示,分数均值、量表来源和南北地域差异是N维度信度的预测变量;量表来源、文章专业类型、测验版本和测验记分对E维度信度具有预测作用;样本量、文章专业类型和量表来源是O维度信度的预测变量;量表来源、文章专业类型、项目数和样本类型对A维度信度具有预测作用;量表来源、项目数、文章专业类型和测验记分是C维度信度的预测变量。     

Personality Assessment Inventory Scores as Predictors of Evaluation Referrals,Evaluator Opinions,and Commitment Decisions in Sexually Violent Predator Cases

We used data from more than 1,500 offenders to examine the association between Personality Assessment Inventory (PAI; Morey, 1991 Morey, L. C. (1991). Personality Assessment Inventory: Professional manual. Odessa, FL: Psychological Assessment Resources. [Google Scholar]) scores and progress through the sexually violent predator (SVP) screening, evaluation, and commitment process. There was no clear association between PAI scores and referrals for full evaluations, but PAI scores were small to moderate predictors of evaluator opinions and diagnoses among offenders who underwent full evaluations. Higher Antisocial Features (ANT) scores were associated with diagnoses of antisocial personality disorder, but this association was moderated by offender response style. ANT scores were more strongly associated with antisocial personality disorder diagnoses among those responding defensively (d = .71) than among those responding openly (d = .48). The mean ANT score among defensive responders diagnosed with antisocial personality disorder was about 55T, suggesting that even moderate ANT scale elevations could indicate a clinically significant level of antisocial traits among some offenders.     

Reliability of Summed Item Scores Using Structural Equation Modeling: An Alternative to Coefficient Alpha

A method is presented for estimating reliability using structural equation modeling (SEM) that allows for nonlinearity between factors and item scores. Assuming the focus is on consistency of summed item scores, this method for estimating reliability is preferred to those based on linear SEM models and to the most commonly reported estimate of reliability, coefficient alpha.     

Linking Scores From Tests of Similar Content Given in Different Languages: An Illustration Involving Methodological Alternatives

This study compares two methods commonly used (concordance and prediction) to establish linkages between scores from tests of similar content given in different languages. Score linkages between the Verbal and Math sections of the SAT I and the corresponding sections of the Spanish-language admissions test, the Prueba de Aptitud Academica (PAA), are used to illustrate the issues. The results indicate that for both single and composite score linkage, prediction is preferable to concordance. A comparison of prediction and concordance results for composite scores versus single scores indicates that when verbal scores were added to math scores, the prediction for the resultant composite score is better than that obtained for verbal scores alone but worse than that obtained for math scores alone.