Can we disregard the whole model? Omnibus non-inferiority testing for R2 in multi-variable linear regression and in ANOVA

Determining a lack of association between an outcome variable and a number of different explanatory variables is frequently necessary in order to disregard a proposed model (i.e., to confirm the lack of a meaningful association between an outcome and predictors). Despite this, the literature rarely offers information about, or technical recommendations concerning, the appropriate statistical methodology to be used to accomplish this task. This paper introduces non-inferiority tests for ANOVA and linear regression analyses, which correspond to the standard widely used F test for and R², respectively. A simulation study is conducted to examine the Type I error rates and statistical power of the tests, and a comparison is made with an alternative Bayesian testing approach. The results indicate that the proposed non-inferiority test is a potentially useful tool for ‘testing the null’.     

Emotional intelligence,cognitive ability and information search in tactical decision-making

Emotional intelligence (EI) may promote more effective decision-making under stress. In the present study, 167 participants completed a situation judgment test for EI, and performed a decision-making task based on an Antarctic rescue scenario. Participants were assigned to either a negative or neutral feedback group. Negative feedback significantly increased distress and impaired decision-making. EI failed to moderate the impacts of negative feedback, but higher EI was associated with greater information-search activity irrespective of feedback condition. It is concluded that ability EI may have a motivational component that may support more exhaustive analysis of both social and non-social stimuli.     

Applicant Perceptions of Test Fairness: Integrating Justice and Self-Serving Bias Perspectives

The justice perspective is the current dominant framework for research on applicant perceptions of test fairness. Recently, an emerging perspective suggests that self-serving bias mechanisms may be operative in the development of test fairness perceptions. Using data from 494 actual applicants to an entry-level State Police Trooper position, this study integrates both the justice and self-serving bias perspectives to achieve a better understanding of test fairness perceptions. Results from structural equation modeling show that perceived job-relevance affects perceived fairness. In addition, test performance affects both perceptions indirectly through perceived performance.     

Predictors of Participation in Performance Appraisal: A Voluntary System in a Blue-Collar Work Environment

Organisations have long acknowledged the value of performance appraisal in both administration decisions and in motivating employees. However, it would appear that most empirical research has focused on compulsory systems designed for use with executives and managers (Bannister and Balkin 1990; Ilgen, Fisher and Taylor 1979; Klein 1989). The reluctance to implement appraisal systems with lower level and base-grade employees may be due to several factors, including employee and union resistance to compulsory systems of appraisal (Nankervis 1990). Faced with this problem, appraisal can be viewed by appraisees and appraisers as an `innovation'. In a climate with growing emphasis on participative management styles, self-regulated or voluntary systems of performance appraisal may become increasingly prevalent and important. Thus, 476 base-grade (shop floor) employees of an Australian government business enterprise completed a survey regarding issues such as attitude to performance appraisal, source credibility, system satisfaction, anticipated feedback, perceived consequences of participation and intention to enter the system. Roger's (1983) innovation-decision model was utilised in the structure and analysis of the data and provided useful insights regarding the factors which are related to participation in a voluntary system of performance appraisal. Findings indicated that attitude towards, and support of, performance appraisal in general, perception of consequences of performance appraisal, satisfaction with the supervisor, anticipated feedback, and awareness and knowledge of the system in place in the organisation, were important in predicting the decision to adopt or reject the performance appraisal scheme.     

Efficient nonparametric approaches for estimating the operating characteristics of discrete item responses

Rationale and the actual procedures of two nonparametric approaches, called Bivariate P.D.F. Approach and Conditional P.D.F. Approach, for estimating the operating characteristic of a discrete item response, or the conditional probability, given latent trait, that the examinee's response be that specific response, are introduced and discussed. These methods are featured by the facts that: (a) estimation is made without assuming any mathematical forms, and (b) it is based upon a relatively small sample of several hundred to a few thousand examinees.Some examples of the results obtained by the Simple Sum Procedure and the Differential Weight Procedure of the Conditional P.D.F. Approach are given, using simulated data. The usefulness of these nonparametric methods is also discussed.This research was mostly supported by the Office of Naval Research (N00014-77-C-0360, N00014-81-C-0569, N00014-87-K-0320, N00014-90-J-1456).     

过去时间的心理结构

４０８名大学生被试用秒、分、小时、日、星期、年和月７个时间单位和模糊统计试验方法对４０个不定的过去时间修饰词作经验赋值,结果显示：（１）过去时间和未来时间在心理结构上是对称的,分为三个心理时间段,即以秒和分为计时单位的“较近的过去”和“较近的未来”,以小时、日和月为计时单位的“近的过去”和“近的未来”,和以年为计时单位的“远的过去”和“远的未来”。（２）随着时间修饰词的词义离现在由近至远,其词义地     

Profiling movement quality and gait characteristics according to body-mass index in children (9–11 y)

Obese children move less and with greater difficulty than their normal-weight counterparts. Whilst the effect of high BMI on cardiovascular fitness is well known, the effect on movement quality characteristics during a standardised fitness test has not been investigated. The aims of this study were, to characterise the movement quality of children performing the multi-stage fitness test (MSFT), and, report how movement quality characteristics cluster according to weight status. One hundred and three children (10.3 ± 0.6 y, 1.42 ± 0.08 m, 37.8 ± 9.3 kg, BMI; 18.5 ± 3.3 kg m²) performed the MSFT whilst wearing an ankle mounted accelerometer. BMI groups were used to classify children as underweight (UW), normal weight (NW), overweight (OW) and obese (OB). Characteristics of movement were profiled using a clustering algorithm. Spearman’s rho was used to assess relationship with BMI group, and a Mann-Whitney U test was used to assess differences between BMI groups. Obese children had significantly lower spectral purity than every other group and significantly lower time to exhaustion (TTE) than UW and NW children (P < 0.05). BMI was clustered with stride profile and TTE with spectral purity. Significant negative correlations (P < 0.05) were found between BMI and TTE (r = −0.25), spectral purity (r = −0.24), integrated acceleration (r = −0.22), stride angle (r = −0.23) and stride variability (r = −0.22). This was the first study to report the spectral purity of children’s gait. Further analysis unveiled key performance characteristics that differed between BMI groups. These were (i) representative of children’s performance during the MSFT and, (ii) significantly negatively correlated with BMI.     

The Development and Testing of a New Version of the Cognitive Reflection Test Applying Item Response Theory (IRT)

The cognitive reflection test (CRT) is a short measure of a person's ability to resist intuitive response tendencies and to produce a normatively correct response, which is based on effortful reasoning. Although the CRT is a very popular measure, its psychometric properties have not been extensively investigated. A major limitation of the CRT is the difficulty of the items, which can lead to floor effects in populations other than highly educated adults. The present study aimed at investigating the psychometric properties of the CRT applying item response theory analyses (a two‐parameter logistic model) and at developing a new version of the scale (the CRT‐long), which is appropriate for participants with both lower and higher levels of cognitive reflection. The results demonstrated the good psychometric properties of the original, as well as the new scale. The validity of the new scale was also assessed by measuring correlations with various indicators of intelligence, numeracy, reasoning and decision‐making skills, and thinking dispositions. Moreover, we present evidence for the suitability of the new scale to be used with developmental samples. Finally, by comparing the performance of adolescents and young adults on the CRT and CRT‐long, we report the first investigation into the development of cognitive reflection. Copyright © 2015 John Wiley & Sons, Ltd.     

Test of memory malingering with children: The utility of Trial 1 and TOMMe10 as screeners of test validity

There is a growing body of research suggesting that the shorter versions of the Test of Memory Malingering (TOMM) may provide an accurate assessment of effort in children. During neuropsychological evaluations, some circumstances result in only one completed trial of the TOMM or partial completion of a trial. Research suggests that a cut-score of 40 or 41 on Trial1 is highly predictive of passing the TOMM overall. In the current study, 194 school-age children with academic and/or behavioral problems were used to compare the accuracy of TOMM1 and TOMMe10 (errors on the first 10 items of TOMM1) in predicting passing/failing of TOMM2. For the children in this sample, a score of < 40 items correct (≥ 10 errors) on TOMM1 was highly accurate in predicting a passing performance on the TOMM2 (sensitivity = .80, specificity = .91) with a Negative Predictive Value = .98 at the malingering base rate of 7% (TOMM2 failure in our sample). A score of 2 errors (8 items correct) on the TOMMe10 was slightly less sensitive than that of the TOMM1 (specificity = .96, sensitivity = .53) but with a similar Negative Predictive Value (.96). Consistent with the research from adult populations, TOMM1 and TOMMe10 appear to be quite accurate in predicting performance on the standard administration of the TOMM and may be useful screeners. However, compared to that found in adult samples, slight differences in suggested cutoffs for TOMM1 and TOMMe10 may be warranted for children.