情境判断测验的效度研究述评

情境判断测验是一种为作答者呈现工作相关的典型情境以及该情境下可能的行为反应, 要求根据指导语提示进行选择或评价的测验形式。随着其理论和实践的发展, 研究者越来越关注情境判断测验的效度研究, 包括对其构想效度、效标关联效度和递增效度的探讨, 以及指导语类型、情境保真度以及计分方式等因素对其效度的影响。基于这些研究进展, 未来情境判断测验实践领域可能的方向是：(1)开发针对特定构想的情境判断测验; (2)结合具体构想选用相应的指导语; (3)应用作假和培训对效度影响的研究结果指导实践。     

Testing the measurement equivalence of personality adjective items across cultures

Although previous research has examined cross-cultural differences in personality, many of these studies neglected to first establish that the measures being used were equivalent in meaning across cultures. Using samples of Chinese, Greek, and American respondents, the measurement equivalence of the Big Five Mini-Markers [Saucier, G. (1994). Mini-markers: A brief version of Goldberg’s unipolar Big-Five markers. Journal of Personality assessment, 63, 506–516] was assessed using confirmatory factor analysis. The results indicate that all of the scales demonstrate configural invariance, but fail to show metric or scalar invariance. Several adjectives from these scales were found to exhibit bias at the item-level. The practical implications of these results are discussed and future research is suggested.     

Validité de construit d’une épreuve de jeu de rôle dans le cadre d’un centre d’évaluation chez des officiers de marine.

The present study was designed to obtain validity estimates for a role-play test. Participants were 125 french Navy officers who were rated by a pool of professional assessors and psychologists. All the assessors received reccurring training sessions, focusing on the behavioral checklist, on rating errors, and on share frame of reference. The assessment procedure included role play exercise, cognitive ability scale (g factor) and personality scale (big five factors). First, exploratory factor analyses were conducted on the data gathered, and four factors were identified (authoritarianism, oral communication, consideration with others and frankness). In a nomological perspective, we also analysed the links between the exercises dimensions, personality inventorie and intelligence scale. The findings suggest that role play dimension, personality and intelligence seem to measure different thinks.     

What sources contribute to variance in observer ratings? Using generalizability theory to assess construct validity of psychological measures

Cronbach and Meehl (Psychol. Bull. 1955; 52:281–302) stated that the key question to be addressed when assessing construct validity is ‘What sources contribute to variance in test performance?’ We illustrate the utility of generalizability theory (GT) as a conceptual framework that encourages psychological researchers to address this question and as a flexible set of analytic tools that can provide answers to inform both substantive theory and measurement practice. To illustrate these capabilities, we analyze observer ratings of 27 caregiver–child dyads, focusing on the importance of situational (contextual) factors as sources of variance in observer ratings of caregiver–child behaviors. Cross‐situational consistency was relatively low for the categories of behavior analyzed, indicating that dyads vary greatly in their interactional patterns from one situation to the next, so that it is difficult to predict behavioral frequencies in one context from behaviors observed in a different context. Our findings suggest that single‐situation behavioral measures may have limited generalizability, either to behavior in other contexts or as measures of global interaction tendencies. We discuss the implications of these findings for research and measurement design in developmental psychology. Copyright © 2008 John Wiley & Sons, Ltd.     

EQUIVALENCE CLASS FORMATION: A METHOD FOR TEACHING STATISTICAL INTERACTIONS

Many students struggle with statistical concepts such as interaction. In an experimental group, participants took a paper‐and‐pencil test and then were given training to establish equivalent classes containing four different statistical interactions. All participants formed the equivalence classes and showed maintenance when probes contained novel negative exemplars. Thereafter, participants took a second paper‐and‐pencil test. Participants in the control group received two versions of the paper‐and‐pencil test without equivalence‐based instruction. All participants in the experimental group showed increased paper‐and‐pencil test scores after forming the interaction‐indicative equivalence classes. Class‐indicative responding also generalized to novel exemplars and the novel question format used in the paper‐and‐pencil test. Test scores did not change with repetition for control group participants. Implications for behavioral diagnostics and teaching technology are discussed.     

ESTABLISHING DERIVED TEXTUAL CONTROL IN ACTIVITY SCHEDULES WITH CHILDREN WITH AUTISM

Activity schedules are often used to facilitate task engagement and transition for children with autism. This study evaluated whether conditional discrimination training would serve to transfer the control from activity‐schedule pictures to printed words (i.e., derived textual control). Two preschoolers with autism were taught to select pictures and printed words given their dictated names. Following training, participants could respond to printed words by completing the depicted task, match printed words to pictures, and read printed words without explicit training (i.e., emergent relations).     

Motor constancy and the upsizing of handwriting

Although handwriting can vary in size, it remains remarkably similar in form, demonstrating motor constancy (equivalence). A consideration of changes in writing size may indicate: (1) how rescaling is accomplished, and (2) those invariant features that remain constrained under size variation. In the experiment reported here nine participants wrote the word “minimum” (without dotting “i’s”) in cursive text, under three size conditions on a SmartBoard. The standard deviation of stroke slope did not change its relationship to mean stroke slope, but stroke durations and lengths did vary. Kinematic analysis indicated that the number of submovements, their efficiency, and their kinematic structure varied across the three writing size conditions. The results suggested that motor constancy does not merely reflect a simple change in a single parameter of scale.     

ELECTROPHYSIOLOGICAL CORRELATES OF STIMULUS EQUIVALENCE PROCESSES

Research reported here concerns neural processes relating to stimulus equivalence class formation. In Experiment 1, two types of word pairs were presented successively to normally capable adults. In one type, the words had related usage in English (e.g., uncle, aunt). In the other, the two words were not typically related in their usage (e.g., wrist, corn). For pairs of both types, event‐related cortical potentials were recorded during and immediately after the presentation of the second word. The obtained waveforms differentiated these two types of pairs. For the unrelated pairs, the waveforms were significantly more negative about 400 ms after the second word was presented, thus replicating the “N400” phenomenon of the cognitive neuroscience literature. In addition, there was a strong positive‐tending wave form difference post‐stimulus presentation (peaked at about 500 ms) that also differentiated the unrelated from related stimulus pairs. In Experiment 2, the procedures were extended to study arbitrary stimulus—stimulus relations established via matching‐to‐sample training. Participants were experimentally näive adults. Sample stimuli (Set A) were trigrams, and comparison stimuli (Sets B, C, D, E, and F) were nonrepresentative forms. Behavioral tests evaluated potentially emergent equivalence relations (i.e., BD, DF, CE, etc.). All participants exhibited classes consistent with the arbitrary matching training. They were also exposed also to an event‐related potential procedure like that used in Experiment 1. Some received the ERP procedure before equivalence tests and some after. Only those participants who received ERP procedures after equivalence tests exhibited robust N400 differentiation initially. The positivity observed in Experiment 1 was absent for all participants. These results support speculations that equivalence tests may provide contextual support for the formation of equivalence classes including those that emerge gradually during testing.     

Contriving transitive conditioned establishing operations to establish derived manding skills in adults with severe developmental disabilities

The purpose of this study was to demonstrate derived manding skills in 2 adults with severe developmental disabilities and language deficits by contriving transitive conditioned establishing operations. Specifically, we evaluated whether a history of reinforced conditional discrimination learning would ultimately result in a derived mand repertoire, in which participants manded for items that were needed to complete chained tasks. After mastering the first three phases of the picture exchange communication system (PECS), participants were taught to mand for the needed items by exchanging pictures of the items for the items themselves. They were then taught to conditionally relate the dictated names of the items to the corresponding pictures of the items and to relate the dictated names to the corresponding printed words. We then tested, in the absence of reinforcement, whether participants would mand for the items needed to complete the chained tasks using text rather than pictures. Both participants showed the emergence of derived mands and some derived stimulus relations as a result of this instruction. Some of the derived relations were shown to be intact at 1-month follow-up, and scores on derived mand probes were higher at follow-up than before training. In addition, the 2 participants vocally requested the needed items on maintenance test probes, a skill that was never trained and was not previously in their repertoires. These results suggest that a history of reinforced relational responding may facilitate the expansion of a number of verbal skills and emphasize the possibility of a synthesis of Skinner's (1957) analysis of verbal behavior and derived stimulus relations into language-training efforts for persons with significant disabilities.