Increasing Validity with Forced‐Choice Criterion Measurement Formats

The relative validities of forced‐choice (ipsative) and Likert rating‐scale item formats as criterion measures are examined. While there has been much debate about the relative technical and psychometric merits and demerits of ipsative instruments, the present research focused on the crucial question of whether the use of this format has any practical benefit – in terms of improved validity. An analysis is reported from a meta‐analysis data set. This demonstrates that higher operational validity coefficients (prediction of line‐manager ratings of competencies) are associated with the use of forced‐choice (r=.38) rather than rating scale (r=.25) item formats for the criterion measurement instrument when performance is rated by the same line managers on both formats and where the predictor is held constant. Thus the apparent criterion‐related validity of a predictor can increase by 50% simply by changing the format of the criterion measurement instrument. The implications of this for practice are discussed.     

When should "riskier" subjects be excluded from research participation?

The exclusion of potential subjects based on increased risks is a common practice in human subjects research. However, there are no guidelines to ensure that this practice is conducted in a systematic and fair way. This gap in the literature and regulation is addressed by a specific account of a "condition on inclusion risks" (CIR), a condition under which potential subjects should be excluded from research on the basis of increased risks. This account provides a general framework for assessing standard exclusions as well as more controversial ones such as the exclusion of pregnant women and women of childbearing potential from certain types of research.     

Rehearsal and retrieval processes in free recall of categorized lists

The relationships between rehearsal and subsequent retrieval characteristics were examined in the context of free recall of categorized lists. The results indicated a direct correspondence between the frequency of rehearsal and the order and speed of retrieval within categories. The same relationship obtained for the categories themselves. It was suggested that both retrieval time and order effects can be predicted in terms of the organization of input processing and the resultant repetition frequency of categories and exemplars.     

The impact of event vividness,event severity,and prior paranormal belief on attributions towards a depicted remarkable coincidence experience: Two studies examining the misattribution hypothesis

Two studies examine the impact event vividness, event severity, and prior paranormal belief has on causal attributions for a depicted remarkable coincidence experience. In Study 1, respondents (n = 179) read a hypothetical vignette in which a fictional character accurately predicts a plane crash 1 day before it occurs. The crash was described in either vivid or pallid terms with the final outcome being either severe (fatal) or non‐severe (non‐fatal). Respondents completed 29 causal attribution items, one attribution confidence item, nine scenario perception items, a popular paranormal belief scale, and a standard demographics questionnaire. Principal axis factoring reduced the 29 attribution items to four attribution factors which were then subjected to a 2 (event vividness) × 2 (event severity) × 2 (paranormal belief) MANCOVA controlling for respondent gender. As expected, paranormal believers attributed the accurate crash prediction less to coincidence and more to both paranormal and transcendental knowing than did paranormal sceptics. Furthermore, paranormal (psychokinesis) believers deemed the prediction more reflective of paranormal knowing to both (1) a vivid/non‐fatal and (2) a pallid/fatal crash depiction. Vividness, severity, and paranormal belief types had no impact on attribution confidence. In Study 2, respondents (also n = 179) generated data that were a moderately good fit to the previous factor structure and replicated several differences across attributional pairings albeit for paranormal non‐believers only. Corresponding effects for event severity and paranormal belief were not replicated. Findings are discussed in terms of their support for the paranormal misattribution hypothesis and the impact of availability biases in the form of both vividness and severity effects. Methodological issues and future research ideas are also discussed.     

Internet Recruitment and Selection: Kissing Frogs to find Princes

The Internet has already had a dramatic impact on the way in which recruitment and selection are carried out in North America, and the impact is increasingly being felt in terms of changes in practice in Europe and Asia-Pacific. The paper presents a picture of the current development of the Internet as a medium in general and as a recruitment and selection medium in particular. The new medium has enabled the widespread adoption of computer-based assessment and it is predicted that it will replace paper as the default medium before very long. A range of issues are raised and discussed. These include security, confidentiality, authentication, control of assessment conditions, control over practice and equality of access. It is argued that as the second generation of users takes over from the first generation, so inequality of skill and access are becoming less and less of an issue. Finally, some potential areas of abuse of the system are noted and a call is made for the development of international standards to protect the rights and interests of test providers, test users and test takers.     

From goal motivation to goal progress: the mediating role of coping in the Self-Concordance Model

Abstract

The present studies examined the mediating role of self-regulatory mechanisms in the relationship between goal motivation and goal progress in the Self-Concordance Model. First, a systematic review, using meta-analytical path analysis, supported the mediating role of effort and action planning in the positive association between autonomous goal motivation and goal progress. Second, results from two additional empirical studies, using structural equation modeling, lent credence to the mediating role of coping in the relationship between goal motivation and goal progress of university students. Autonomous goal motivation was positively associated with task-oriented coping, which predicted greater goal progress during midterm exams (Study 1, N=702) and at the end of the semester in a different sample (Study 2, N=167). Controlled goal motivation was associated with greater disengagement-oriented coping (Study 1 and Study 2) and lesser use of task-oriented coping (Study 2), which reduced goal progress. These results held up after controlling for perceived stress (Study 2). Our findings highlight the importance of coping in the “inception-to-attainment” goal process because autonomous goal motivation indirectly rather than directly predicts goal progress of university students through their usage of task-oriented coping.     

From goal motivation to goal progress: the mediating role of coping in the Self-Concordance Model

The present studies examined the mediating role of self-regulatory mechanisms in the relationship between goal motivation and goal progress in the Self-Concordance Model. First, a systematic review, using meta-analytical path analysis, supported the mediating role of effort and action planning in the positive association between autonomous goal motivation and goal progress. Second, results from two additional empirical studies, using structural equation modeling, lent credence to the mediating role of coping in the relationship between goal motivation and goal progress of university students. Autonomous goal motivation was positively associated with task-oriented coping, which predicted greater goal progress during midterm exams (Study 1, N=702) and at the end of the semester in a different sample (Study 2, N=167). Controlled goal motivation was associated with greater disengagement-oriented coping (Study 1 and Study 2) and lesser use of task-oriented coping (Study 2), which reduced goal progress. These results held up after controlling for perceived stress (Study 2). Our findings highlight the importance of coping in the "inception-to-attainment" goal process because autonomous goal motivation indirectly rather than directly predicts goal progress of university students through their usage of task-oriented coping.