Validity of Stimulus and Response Components in a Video Test of Social Competence

Various stimulus components (video, orally-presented questions) and response components (multiple-choice, written, orally-given replies) of situational judgement tests of occupational social competency were investigated as to their impact upon the validity for a behavior-oriented role playing criterion while keeping test content constant. The stimulus component video alone had no impact upon validity. The response components contributed to validity. Validity increased with improved fidelity of response components. Concerning stimulus-response-combinations, the validity of two video tests (r = 0.17 and r = 0.36) was not higher than the validity of similar oral questioning (r = 0.13 and r = 0.37) but was significantly lower than a situational interview (r = 0.59). Response fidelity proved to be a bottleneck regarding validity of video tests. As a result, it is recommended that, in order to maximize validity of video and multimedia efforts, the developers of video- and multimedia tests focus special attention on response fidelity.     

Book Reviews

Schabracq, Marc J., Winnibst, Jacques A.M. and Cooper, Cary L., Handbook of Work and Health Psychology Bandura, Albert, Self-efficacy: the exercise of control Wiggins, Jerry S. The Five-Factor Model of Personality. Theoretical Perspectives Arredondo, Patricia, Successful diversity management initiatives: a blueprint for planning and implementation     

Bayesian Factor Analysis as a Variable-Selection Problem: Alternative Priors and Consequences

Factor analysis is a popular statistical technique for multivariate data analysis. Developments in the structural equation modeling framework have enabled the use of hybrid confirmatory/exploratory approaches in which factor-loading structures can be explored relatively flexibly within a confirmatory factor analysis (CFA) framework. Recently, Muthén & Asparouhov proposed a Bayesian structural equation modeling (BSEM) approach to explore the presence of cross loadings in CFA models. We show that the issue of determining factor-loading patterns may be formulated as a Bayesian variable selection problem in which Muthén and Asparouhov's approach can be regarded as a BSEM approach with ridge regression prior (BSEM-RP). We propose another Bayesian approach, denoted herein as the Bayesian structural equation modeling with spike-and-slab prior (BSEM-SSP), which serves as a one-stage alternative to the BSEM-RP. We review the theoretical advantages and disadvantages of both approaches and compare their empirical performance relative to two modification indices-based approaches and exploratory factor analysis with target rotation. A teacher stress scale data set is used to demonstrate our approach.     

Probabilistic Inferences Under Emotional Stress: How Arousal Affects Decision Processes

Many models of decision making neglect emotional states that could affect individuals' cognitive processes. The present work explores the effect of emotional stress on people's cognitive processes when making probabilistic inferences. Two contrasting hypotheses are tested against one another: the uncertainty‐reduction and attention‐narrowing hypotheses of how emotional stress affects decision making. In the experimental study, emotional stress was induced through the use of highly aversive pictures immediately before each decision. Emotional state was assessed by both subjective (state anxiety, arousal, and pleasantness ratings) and objective (skin conductance) measures. The results show that emotional stress impacts decision making; in particular, emotionally aroused participants seem to have focused on the most important information and selected simpler decision strategies relative to participants in a control condition. The results are in line with the attention‐narrowing hypothesis and suggest that emotional stress can impact decision making through limited predecisional information search and the selection of simpler decision strategies. Copyright © 2015 John Wiley & Sons, Ltd.     

The interaction between social saliency and perceptual saliency

The ability to select visual targets in hierarchical stimuli can be affected by both perceptual saliency and social saliency. However, the functional relations between the effects are not understood. Here we examined whether these two factors interact or combine in an additive way. Participants first learnt to associate geometric shapes with three people (e.g., triangle–self, square–stranger). After learning the associations, participants were presented with compound stimuli (e.g., a global triangle formed by a set of local squares) and had to select a target at the global or local level. In Experiment 1 the task was to identify the person associated with the local or global shape. In Experiment 2 the task was simply to identify the shape. We manipulated perceptual saliency by blurring local elements to form perceptually global salient stimuli or by contrasting the colours of neighbouring local elements (red vs. white) to form perceptually local salient stimuli. In Experiment 1 (person discrimination) there was a strong effect of saliency on local targets (there were faster and more accurate responses to high than to low saliency targets) when social and perceptual saliency occurred at same level. However, both perceptual and social saliency effects were eliminated when the effect of saliency at one level competed with that at the other level. In Experiment 2 (shape discrimination), there were only effects of perceptual saliency. The data indicate that social saliency interacts with perceptual saliency when explicit social categorizations are made, consistent with both factors modulating a common process of visual selection.     

Retrieval of bindings between task-irrelevant stimuli and responses can facilitate behaviour under conditions of high response certainty

Repetition priming can be driven by the encoding and retrieval of stimulus–response (S–R) bindings. When a previously encoded S–R binding is retrieved, and is congruent with the response currently required, it can bias response-selection processes towards selecting the retrieved response, resulting in facilitation. Previous studies have used classification tasks at retrieval. Here, two (or more) response options are competing, and it is likely that any evidence (e.g., an S–R binding) in favour of one option will be utilized to effect a decision. Thus, S–R effects are likely to be seen when using such a task. It is unclear whether such effects can be seen under conditions of higher response certainty, when participants are explicitly cued to make a response. Across two experiments, evidence for a modulating influence of S–R bindings is seen despite using a response cueing method at retrieval to minimize response uncertainty and despite stimuli being task irrelevant. Finally, the results suggest that responses within these S–R bindings are coded at the level of left versus right hand, and not a more fine-grained within-hand thumb versus index finger. The results underline the resilience of S–R effects, suggesting that they are present even under conditions where no explicit object-oriented decision is required.     

Whose Evolution? Which Theology?

The importance of scientific conflicts for theology andphilosophy is difficult to judge. In many disputes of significance, prominent scientists can be found on both sides. Profound philosophical and religious implications are sometimes said to be implied by the new theory as well. This article examines the dispute over natural selection between Richard Dawkins and Stephen Jay Gould as a contemporary instance of such a conflict. While both claim that profound philosophical conclusions flow from their own alternativeaccount of evolution, I suggest that the implication is not as great as is claimed and that the alleged implications have as much to do with their own perceptions of theology as with the actual theories themselves. Nevertheless, evolutionary theory is not irrelevant for theology. Theologians should be aware of the possible implications of evolutionary theory and at the same time theextent and limits of such implications.     

An evaluation of multi‐criteria methods in integrated assessment of climate policy

Those who conduct integrated assessments (IAs) are aware of the need to explicitly consider multiple criteria and uncertainties when evaluating policies for preventing global warming. MCDM methods are potentially useful for understanding tradeoffs and evaluating risks associated with climate policy alternatives. A difficulty facing potential MCDM users is the wide range of different techniques that have been proposed, each with distinct advantages. Methods differ in terms of validity, ease of use, and appropriateness to the problem. Alternative methods also can yield strikingly different rankings of alternatives. A workshop was held in which climate change experts and policy makers evaluated the usefulness of MCDM for IA. Participants applied several methods in the context of a hypothetical greenhouse gas policy decision. Methods compared include value and utility functions, goal programming, ELECTRE, fuzzy sets, stochastic dominance, min max regret, and several weight selection methods. Ranges, rather than point estimates, were provided for some questions to incorporate imprecision regarding weights. Additionally, several visualization methods for both deterministic and uncertain cases were used and evaluated. Analysis of method results and participant feedback through questionnaires and discussion provide the basis for conclusions regarding the use of MCDM methods for climate change policy and IA analyses. Hypotheses are examined concerning predictive and convergent validity of methods, existence of splitting bias among experts, perceived ability of methods to aid decision‐making, and whether expressing imprecision can change ranking results. Because participants gained from viewing a problem from several perspectives and results from different methods often significantly differed, it appears worthwhile to apply several MCDM methods to increase user confidence and insight. The participants themselves recommended such multimethod approaches for policymaking. Yet they preferred the freedom of unaided decision‐making most of all, challenging the MCDM community to create transparent methods that permit maximum user control. Copyright © 2002 John Wiley & Sons, Ltd.     

Constrained maximum likelihood estimation of two-level covariance structure model via EM type algorithms

In this paper, the constrained maximum likelihood estimation of a two-level covariance structure model with unbalanced designs is considered. The two-level model is reformulated as a single-level model by treating the group level latent random vectors as hypothetical missing-data. Then, the popular EM algorithm is extended to obtain the constrained maximum likelihood estimates. For general nonlinear constraints, the multiplier method is used at theM-step to find the constrained minimum of the conditional expectation. An accelerated EM gradient procedure is derived to handle linear constraints. The empirical performance of the proposed EM type algorithms is illustrated by some artifical and real examples.This research was supported by a Hong Kong UCG Earmarked Grant, CUHK 4026/97H. We are greatly indebted to D.E. Morisky and J.A. Stein for the use of their AIDS data in our example. We also thank the Editor, two anonymous reviewers, W.Y. Poon and H.T. Zhu for constructive suggestions and comments in improving the paper. The assistance of Michael K.H. Leung and Esther L.S. Tam is gratefully acknowledged.     

Equivalence class establishment, expansion, and modification in preschool children

Preschool children were taught four two-choice match-to-sample conditional discriminations with 10 arbitrary visual stimuli. For 6 participants, 2 of the 10 stimuli served as the sample, or conditional, stimuli in all discriminations. For 5 additional participants, the same pair of stimuli served as the discriminative, or comparison, stimuli in all discriminations. Equivalence classes were established with more participants in the latter group, replicating prior research with participants with retardation. Four participants, in whom equivalence classes were established and who were available for further participation, were exposed to new conditional discriminations without trial-by-trial feedback and involving some novel and some familiar stimuli. Consistent conditional responding was observed, and tests for inclusion of the novel stimuli in the original classes showed class expansion. Training to reverse the unreinforced conditional performances produced a reversal of class membership in 3 of 4 participants, an outcome not consistent with other studies. The results are discussed with respect to the interaction of class structure and size.