Sequential learning models for the Wisconsin card sort task: Assessing processes in substance dependent individuals

The Wisconsin card sort task (WCST) is a commonly used neuropsychological test of executive or frontal lobe functioning. Traditional behavioral measures from the task (e.g., perseverative errors) distinguish healthy controls from clinical populations, but such measures can be difficult to interpret. In an attempt to supplement traditional measures, we developed and tested a family of sequential learning models that allowed for estimation of processes at the individual subject level in the WCST. Testing the model with substance dependent individuals and healthy controls, the model parameters significantly predicted group membership, even when controlling for traditional behavioral measures from the task. Substance dependence was associated with (a) slower attention shifting following punished trials and (b) reduced decision consistency. Results suggest that model parameters may offer both incremental content validity and incremental predictive validity.     

The relationship of specific mental ability measures compared to a general mental ability measure to quality and quantity performance on a clerical job sample

Barrett (1993) presented evidence that mental ability measures designed specifically for the prediction of performance in tasks and jobs have validity at least equal to that of tests of general mental ability, while having advantages such as lower adverse impact. The current study demonstrates that the match in specificity of predictor and criterion can be attained through simple changes in the scoring of standard mental and clerical ability tests. A sample of 51 university students completed a battery of pre-employment tests and, a week or two later, worked on a clerical job sample. The results indicated that quality of performance (number of errors on the task) was best predicted using the number of errors made on the predictor tests while quantity of work was only predicted by the number correct. A test of general mental ability did not correlate with either criterion. These results contradicted the conclusions of Schmidt (1993) that specific ability tests have no incremental validity above a general ability test.Ralph Alexander died before this report was complete. Consequently, the conclusions are those of the first two authors.     

Training attentional control in older adults

Recent research has demonstrated benefits for older adults from training attentional control using a variable priority strategy, but the construct validity of the training task and the degree to which benefits of training transfer to other contexts are unclear. The goal of this study was to characterize baseline performance on the training task in a sample of 105 healthy older adults and to test for transfer of training in a subset (n?=?21). Training gains after 5 days and extent of transfer was compared to another subset (n?=?20) that served as a control group. Baseline performance on the training task was characterized by a two-factor model of working memory and processing speed. Processing speed correlated with the training task. Training gains in speed and accuracy were reliable and robust (ps <.001, η(2)?=?.57 to .90). Transfer to an analogous task was observed (ps <.05, η(2)?=?.10 to .17). The beneficial effect of training did not translate to improved performance on related measures of processing speed. This study highlights the robust effect of training and transfer to a similar context using a variable priority training task. Although processing speed is an important aspect of the training task, training benefit is either related to an untested aspect of the training task or transfer of training is limited to the training context.     

Incremental validity of person-organization fit over the Big Five personality measures

Few studies have provided the validity evidence of a measure of objective person-organization fit (P-O fit) as a selection tool. The present study used a concurrent validation design to examine the criterion-related validity and the incremental validity of a P-O fit measure beyond the validity of the Big Five personality test for predicting job performance (task performance and organizational citizenship behavior) and employee commitment (organizational commitment and supervisory commitment) for a group of high-tech professional employees in Taiwan. Results showed that P-O fit predicted the contextual component of overall job performance and was significantly related to two types of employee commitment. Moreover, P-O fit had an incremental validity beyond that of the personality measures for predicting some of our outcome variables.     

Fully contextualized,frequency-based personality measurement: A replication and extension

We compared the predictive validity of two types of Frame-of-Reference personality measures to each other and to a baseline generic measure. Each version of the measures used a unique response-format referred to as frequency-based estimation that allowed the behavioral consistency of responses to be gauged. Generic personality scales, tagged scales with “at school”, and completely modified scales were compared in their prediction of academic performance, counterproductive academic behavior, and participant reactions. Results showed that completely contextualized measures were the most predictively valid and, contrary to our expectations, behavioral consistency did not moderate the relationships. Face validity and to a lesser extent perceived predictive validity improved with increasing contextualization. We discuss the implications of our results for personality assessment in applied settings.     

Training attentional control in older adults

ABSTRACT

Recent research has demonstrated benefits for older adults from training attentional control using a variable priority strategy, but the construct validity of the training task and the degree to which benefits of training transfer to other contexts are unclear. The goal of this study was to characterize baseline performance on the training task in a sample of 105 healthy older adults and to test for transfer of training in a subset (n?=?21). Training gains after 5 days and extent of transfer was compared to another subset (n?=?20) that served as a control group. Baseline performance on the training task was characterized by a two-factor model of working memory and processing speed. Processing speed correlated with the training task. Training gains in speed and accuracy were reliable and robust (ps <.001, η²?=?.57 to .90). Transfer to an analogous task was observed (ps <.05, η²?=?.10 to .17). The beneficial effect of training did not translate to improved performance on related measures of processing speed. This study highlights the robust effect of training and transfer to a similar context using a variable priority training task. Although processing speed is an important aspect of the training task, training benefit is either related to an untested aspect of the training task or transfer of training is limited to the training context.     

Psychological collectivism: a measurement validation and linkage to group member performance

The 3 studies presented here introduce a new measure of the individual-difference form of collectivism. Psychological collectivism is conceptualized as a multidimensional construct with the following 5 facets: preference for in-groups, reliance on in-groups, concern for in-groups, acceptance of in-group norms, and prioritization of in-group goals. Study 1 developed and tested the new measure in a sample of consultants. Study 2 cross-validated the measure using an alumni sample of a Southeastern university, assessing its convergent validity with other collectivism measures. Study 3 linked scores on the measure to 4 dimensions of group member performance (task performance, citizenship behavior, counterproductive behavior, and withdrawal behavior) in a computer software firm and assessed discriminant validity using the Big Five. The results of the studies support the construct validity of the measure and illustrate the potential value of collectivism as a predictor of group member performance.     

The effects of cognitive style and training on performance ratings' validity

This study investigated how personal cognitive style and training effect rating validity with two different rating tasks. Male undergraduate volunteers (n = 53) served as raters and rated videotaped lecturers. Using the Embedded Figures Test to measure cognitive style, two groups of raters were formed: those who tend to structure information presented (articulated) and those who do not (global). Half of each cognitive style received observational training designed to be congruent with the behavioral rating task. All raters completed two rating tasks: one requiring an evaluative judgment and one requiring a judgment of behavior frequency. It was hypothesized that with the evaluative rating task, cognitive style would be and training would not be a significant predictor of validity, because the training was not relevant to the task. It was also hypothesized that with the observational task training would improve rating validity (overcoming cognitive style), because the training was relevant to the rating task. Both hypotheses were supported.I wish to thank Dr. Kevin Murphy for the use of the videotapes.     

Age and individual differences in working memory: the size judgment span task

The authors introduced the Size Judgment Span (SJS) task, a working memory measure developed for use with persons of varied educational backgrounds and general intellectual ability. The authors pooled data from 5 published articles where the SJS task and other measures of cognitive performance were administered to create an archival data set with 496 participants. Analyses of these data yielded strong evidence of age and individual ability differences in SJS performance, confirming the sensitivity of this task for empirically distinguishing age and ability groups. The SJS was also significantly correlated with the backward digit span and listening span tasks. Using hierarchical regression analyses, the authors examined the SJS task as a predictor of different forms of episodic memory, including spatial location memory, verbal free recall, and recognition memory. Results confirmed the practical utility and predictive validity of the SJS task. The authors considered implications for current theoretical views of working memory.     

Faking and selection: considering the use of personality from select-in and select-out perspectives

The effects of faking on criterion-related validity and the quality of selection decisions are examined in the present study by combining the control of an experiment with the realism of an applicant setting. Participants completed an achievement motivation measure in either a control group or an incentive group and then completed a performance task. With respect to validity, greater prediction error was found in the incentive condition among those with scores at the high end of the predictor distribution. When selection ratios were small, those in the incentive condition were more likely to be selected and had lower mean performance than those in the control group. Implications for using personality assessments from select-in and select-out strategies are discussed.     

PROJECT A VALIDITY RESULTS: THE RELATIONSHIP BETWEEN PREDICTOR AND CRITERION DOMAINS

A predictor battery of cognitive ability, perceptual-psychomotor ability, temperament/personality, interest, and job outcome preference measures was administered to enlisted soldiers in nine Army jobs. These measures were summarized in terms of 24 composite scores. The relationships between the predictor composite scores and five components of job performance were analyzed. Scores from the cognitive and perceptual-psychomotor ability tests provided the best prediction of job-specific and general task proficiency, while the temperament/personality composites were the best predictors of giving extra effort, supporting peers, and exhibiting personal discipline. Composite scores derived from the interest inventory were correlated more highly with task proficiency than with demonstrating effort and peer support. In particular, vocational interests were among the best predictors of task proficiency in combat jobs. The results suggest that the Army can improve the prediction of job performance by adding non-cognitive predictors to its present battery of predictor tests.     

Criterion‐Related Validity of Statistical Operationalizations of Group General Cognitive Ability as a Function of Task Type: Comparing the Mean,Maximum, and Minimum1

The objective of the present study was to investigate the comparative criterion‐related validity of different statistical operationalizations of group general cognitive ability (i.e., mean, maximum, and minimum) as a function of task type based on Steiner's (1966, 1972) task typology. In contrast to recent investigations, we hypothesized that, regardless of task type, the mean of group members’ general cognitive ability would predict group performance as well as or better than other statistical operationalizations of group general cognitive ability. We conducted a laboratory study where 157 four‐person groups worked on 4 tasks that conformed to Steiner's typology (additive, compensatory, conjunctive, and disjunctive). The results indicate that the mean was the strongest predictor of group performance across all 4 task types and, in particular, was significantly stronger than the maximum and minimum on both the disjunctive and conjunctive tasks.     

Incremental Validity of Locus of Control After Controlling for Cognitive Ability and Conscientiousness

This research examined the criterion-related validity of work-specific locus of control in predicting job performance, including incremental validity after controlling for cognitive ability and conscientiousness. Data from a student sample and from a large employee sample were used to evaluate the scale properties of measures of locus of control, conscientiousness, and cognitive ability. Two concurrent criterion-related validation studies were then conducted to evaluate the incremental validity of locus of control. In both validation studies, locus of control demonstrated overall and incremental relationships with performance after controlling for ability and conscientiousness, such that employees with higher internal locus of control performed more effectively than externals.     

Criterion‐Related Validity of Dutch Police‐Selection Measures and Differences Between Ethnic Groups

This study investigated the criterion‐related validity of cognitive ability as well as non‐cognitive ability measures and differences between ethnic majority (N=2365) and minority applicants (N=682) in Dutch police officer selection. Findings confirmed the relatively low predictive validity of cognitive ability generally found for police jobs. Previous research reported no differential prediction. The present study, however, found small but systematic evidence for differences in validity for the ethnic majority and minority group of both cognitive and non‐cognitive measures. For the minority group, training performance appeared to be mainly predicted by the cognitive ability test. For the majority group, cognitive ability showed very little predictive power. Non‐cognitive ability variables appeared to be somewhat more predictive in this group.     

AN OBJECTIVE GROUP QUESTIONNAIRE AS A SUBSTITUTE FOR A PERSONAL INTERVIEW IN THE PREDICTION OF SUCCESS IN MILITARY TRAINING IN ISRAEL

The need for reliable and valid measures of personality and motivational factors in the prediction of success in military training was discussed. The personnel classification system currently used by the Israeli Army was briefly described. The personality factors used in that system are measured by an interview, which is individually administered to each enlisted man. The goal of the present study was to replace this interview by an objective group questionnaire, with the hope of saving time, manpower and effort without any loss to predictive validity. The criterion for validation of the system was the performance of the soldiers in elementary training. This performance was assessed by commanding officers and by peers. The results showed that the questionnaire is eventually equivalent to the interview as a predictor of performance in military training. It was concluded that the questionnaire should be preferred for economical reasons.     

Specificity Matters: Criterion-Related Validity of Contextualized and Facet Measures of Conscientiousness in Predicting College Student Performance

To enhance the predictive validity of self-report personality measures, 2 distinct ways of increasing specificity of personality measures have been proposed in the literature—contextual specificity (i.e., providing a contextual referent) and content specificity (i.e., focusing on more specific constructs such as the Big Five facets). This study extends this line of research by examining whether there is an optimal way to configure, align, or integrate contextual and content specificity using measures of conscientiousness to predict college student success. A sample of 478 undergraduate students completed 4 measures of conscientiousness that varied in the level of content and contextual specificity. These forms of specificity were crossed to yield 4 distinct measures of conscientiousness. We then evaluated and compared the relative importance and the incremental importance of these different measures in the prediction of academic success. Superior predictive validity was found for both contextualized and facet measures of conscientiousness compared to a measure of global conscientiousness in predicting grade-point average and a broader behavioral criterion of student performance. When contextual and content specificity approaches were compared and combined, we observed the strongest predictive validity when the level of specificity is appropriately matched between predictor and criterion.     

Construct-oriented Biodata: Capturing Change-related and Contextually Relevant Future Performance

This study highlights an approach to the development of performance and predictor constructs that has the potential to permit context and culture relevant selection. Task, contextual and adaptive measures of performance were used as criterion data in a selection study involving 325 staff in the hotel industry. Construct-oriented biodata were developed to predict adaptive and contextual performance and the validities were contrasted with measures of cognitive ability and personality. The results provided construct support for the separation of adaptive performance from task and contextual performance and for the predictive validity of change-related biodata after controlling for cognitive ability. The pattern of correlations among the personality measures, biodata scales and cognitive tests supported the construct validity of the biodata scales. Results are discussed in relation to the context in which the data were collected, and the general relevance of the procedure across countries or cultures.     

主管认知信任和情感信任对员工行为及绩效的影响

采用问卷调查法,检验主管认知信任与情感信任对员工行为及绩效影响的双路径模型。通过结构方程模型分析563份上下级配对数据,结果显示：主管认知信任通过注意聚焦的完全中介作用正向影响员工的任务绩效和组织公民行为。主管情感信任则通过情感承诺的部分中介作用正向影响员工的任务绩效和组织公民行为,即一方面直接影响员工的任务绩效和个体指向公民行为,另一方面通过情感承诺间接影响员工的任务绩效和组织公民行为。并且,主管情感信任对员工行为和绩效的影响作用要大于认知信任的作     

Adaptive n-back training does not improve fluid intelligence at the construct level: Gains on individual tests suggest that training may enhance visuospatial processing

Short-term adaptive cognitive training based on the n-back task is reported to increase scores on individual ability tests, but the key question of whether such increases generalize to the intelligence construct is not clear. Here we evaluate fluid/abstract intelligence (Gf), crystallized/verbal intelligence (Gc), working memory capacity (WMC), and attention control (ATT) using diverse measures, with equivalent versions, for estimating any changes at the construct level after training. Beginning with a sample of 169 participants, two groups of twenty-eight women each were selected and matched for their general cognitive ability scores and demographic variables. Under strict supervision in the laboratory, the training group completed an intensive adaptive training program based on the n-back task (visual, auditory, and dual versions) across twenty-four sessions distributed over twelve weeks. Results showed that this group had the expected systematic improvements in n-back performance over time; this performance systematically correlated across sessions with Gf, Gc, and WMC, but not with ATT. However, the main finding showed no significant changes in the assessed psychological constructs for the training group as compared with the control group. Nevertheless, post-hoc analyses suggested that specific tests and tasks tapping visuospatial processing might be sensitive to training.     

Which Aspects of a Semistructured Interview,Besides Cognitive Ability Tests,Contribute Incrementally to Predicting the Training Success of Air Traffic Controller Trainees?

This study examined whether a semistructured interview is valid in predicting training performance in theoretical and simulation examinations and overall training success; which aspects of the interview show incremental validity over cognitive ability tests; and whether additional variables enhance the prediction from the interview. The sample involved data from 337 trainees of the German Air Navigation Service Provider selected by the German Aerospace Center and 657 (interview) and 6,885 (cognitive ability) candidates being the corresponding reference samples. Findings indicate incremental validity of the interview over the cognitive ability tests. Additional variables contributed only to the prediction of theoretical examination performance. Attention, general motivation, and social competence predicted the criteria best, particularly the theoretical examination performance and overall training success.