Testing response-stimulus equivalence relations using differential responses as a sample

This study tested the notion that an equivalence relation may include a response when differential responses are paired with stimuli presented during training. Eight normal adults learned three kinds of computer mouse movements as differential response topographies (R1, R2, and R3). Next, in matching-to-sample training, one of the response topographies was used to select a comparison stimulus B (B1, B2, or B3) conditionally upon presentation of sample stimulus A (A1, A2, or A3), and to select stimulus D (D1, D2, or D3) conditionally upon presentation of stimulus C (C1, C2, or C3). After two sample-comparison-response relations (ABR and CDR) were established, 18 sample-comparison relations were tested (BA, DC, RA, RB, RC, RD, AC, CA, AD, DA, BC, CB, BD, DB, AA, BB, CC, and DD). In the RA, RB, RC, and RD tests, the differential responses (R1, R2, and R3) were used as sample stimuli. All subjects made class-consistent comparison selections in the tests. This study provides evidence that responses may become members of an equivalence class.     

Experimental control of nodality via equal presentations of conditional discriminations in different equivalence protocols under speed and no-speed conditions

A within-participant comparison of simple-to-complex, complex-to-simple, and simultaneous protocols was conducted establishing different sets of three 7-member equivalence classes for 4 undergraduate students. The protocols were implemented under either accuracy-only or accuracy-plus-speed conditions while keeping number of presentations of training and testing trials equal. The results partially support previous reports of differential effects on acquisition, with participants completing more blocks in training under the simultaneous than the complex-to-simple and the simple-to-complex protocols. Across the protocols, however, the number of trials completed to criterion did not vary systematically. More important, response speed and accuracy did not decrease as a function of nodal number, with or without the speed contingency, or under any protocol. The latter results challenge the generality of previous reports of the nodality effect and the notion of "relatedness" of equivalence-class members, and support a reinforcement-contingency, instead of a structural, perspective on equivalence-class formation.     

Stimulus equivalence: testing Sidman's (2000) theory

Sidman's (2000) theory regarding the origin of equivalence relations predicts that a reinforcing stimulus common to distinct equivalence classes must drop out of the equivalence relations. This prediction was tested in the present study by arranging class-specific reinforcers, R1 and R2, following correct responding on the prerequisite conditional discriminations (Ax-Bx, Cx-Bx) for two stimulus classes, A1B1C1 and A2B2C2. A class-common reinforcer, R3, was presented following correct responding on the prerequisite conditional discriminations for a further two stimulus classes, A3B3C3 and A4B4C4. Sidman's theory predicts reinforcer inclusion within Classes 1 and 2 only, given this training arrangement. Experiment 1 tested for the emergence of four equivalence classes and of stimulus-reinforcer and reinforcer-stimulus relations in each class. Four of the 6 subjects demonstrated the reinforcer-based relations in all four equivalence classes, rather than in only those classes with a class-specific reinforcer, as Sidman's theory predicts. One of the remaining 2 subjects showed the reinforcer-based relations in three of the four classes. Experiment 2 extended these findings to document the emergence of interclass matching relations based on the common reinforcer R3, in 5 of 6 subjects, such that a Class 3 sample occasioned the selection of a Class 4 sample when the Class 3 comparison was absent, and similarly, a Class 4 sample occasioned the selection of a Class 3 comparison when the Class 4 comparison was absent. These interclass relations emerged despite the simultaneous maintenance of Class 3 and 4 baseline conditional discriminations, so that the Class 3 and 4 stimuli and reinforcer simultaneously were, and were not, part of a single larger equivalence class. These data are irreconcilable with Sidman's theory, and question the utility of the application of the equivalence relation in describing derived stimulus relations.     

Psychometrics in Psychological Research: Role Model or Partner in Science?

This is a reaction to Borsboom's (2006) discussion paper on the issue that psychology takes so little notice of the modern developments in psychometrics, in particular, latent variable methods. Contrary to Borsboom, it is argued that latent variables are summaries of interesting data properties, that construct validation should involve studying nomological networks, that psychological research slowly but definitely will incorporate latent variable methods, and that the role of psychometrics in psychology is that of partner, not role model. Requests for reprints should be sent to Klaas Sijtsma, Department of Methodology and Statistics, FSW, Tilburg University, PO Box 90153, 5000 LE, Tilburg, The Netherlands.     

A procedure for generating differential "sample" responding without different exteroceptive stimuli

Sidman (1994, 2000) suggested that responses as well as stimuli can join equivalence classes, a hypothesis difficult to test because differential responding typically requires different stimuli. The present experiments describe a procedure with pigeons that avoids this potential confounding effect. In Experiment 1, spacing two responses 3 s apart (a differential-reinforcement-of-low-rate [DRL] schedule) to a white stimulus on some trials produced food or the comparison stimuli in a matching task, whereas pecking 10 or more times with no temporal restrictions (a fixed-ratio [FR] schedule) produced the same effect on other trials. Completing the alternative (unscheduled) requirement terminated the white stimulus and repeated the trial. Following such errors, pigeons learned to switch to the alternative response pattern on the repeat trials. In addition, the correct response pattern functioned as a conditional cue for comparison choice. In Experiment 2, mixed DRL-FR training was preceded by two-sample/two-alternative matching-to-sample with DRL and FR sample-response requirements. In a subsequent transfer test in which the correct response pattern to white served as the sample, pigeons preferentially chose the comparison previously reinforced following that pattern in the baseline task. This "unsignaled response" procedure may be useful for assessing whether differential responses can be members of acquired equivalence classes.     

Transfer of specific contextual functions to novel conditional discriminations

Three adolescents and 4 children participated in studies designed to examine contextually controlled conditional discrimination performance. In Study 1, participants selected Comparison B1 in the presence one stimulus (A1) and Comparison B2 in the presence of another stimulus (A2) using a matching-to-sample procedure. Next, contextual stimuli X1 or X2 were presented, such that in the presence of X1, selection of B1 given A1 and selection of B2 given A2 were reinforced; and in the presence of X2, selection of B2 given A1 and selection of B1 given A2 were reinforced. Then, new conditional discriminations were taught with Stimuli E and F. When the contextual Stimuli X1 and X2 were presented, participants selected the same comparisons as previously established in the EF relations in the presence of X1, but the opposite comparison as in the EF relations in the presence of X2. The results then were replicated with new Stimuli G and H. In Study 2, a new conditional discrimination, CD, was taught. Then, four combinations of two-element samples--C1 and D1, C2 and D2, C1 and D2, or C2 and D1--were presented with X1 and X2 as comparisons. Five of 6 participants selected X1 in the presence of C1 and D1 or C2 and D2, and selected X2 in the presence of C1 and D2 or C2 and D1. Finally, in Study 3, two new discriminations IJ and JK were taught. Then, the transitive IK relations were tested with X1 and X2 as contextual stimuli. The 4 participants selected K1 in the presence of I1 and K2 in the presence of I2 when the contextual stimulus was X1--demonstrating class formation--and selected the other comparisons when the contextual stimulus was X2. These results suggest that the contextual control functions of X1 and X2 transferred even to relations that had not been directly taught. These results extend those demonstrating generalized contextual control by showing transfer of functions of the contextual stimuli in transitivity tests and when the former contextual stimuli were presented as comparisons.     

Measurement Equivalence and Multisource Ratings for Non-managerial Positions: Recommendations for Research and Practice

ABSTRACT: The present investigation applies a comprehensive sequence of confirmatory factor analysis tests (Vandenberg and Lance, Organisational Research Methods, 3, 4–69, 2000) to the examination of the measurement equivalence of self, peer, and supervisor ratings of non-managerial targets across several performance dimensions. Results indicate a high degree of measurement equivalence across rater sources and performance dimensions. The paper illustrates how this procedure can identify very specific areas of non-equivalence and how the complexity of a multisource feedback system may be represented using such procedures. Implications of these results and recommendations for both research and practice are offered.     

Internationalizing 360-Degree Feedback: Are Subordinate Ratings Comparable?

ABSTRACT: This study addressed whether 360-degree feedback ratings made by subordinates are equivalent across national cultures (Great Britain, Hong Kong, Japan, U.S.). Employees ratings of their leaders were collected via a companys existing 360-degree feedback survey. A two-factor baseline model was developed using exploratory factor analysis and tested across cultures utilizing confirmatory factor analysis techniques. Results revealed differences in factor form, suggesting that the constructs underlying the survey and their relationship to the survey items differed across cultures. These results emphasize the need for multinational companies to use caution when transporting human resources practices, such as 360-degree feedback, to international locations.The author would like to express appreciation to Alice Stuhlmacher for her valuable comments on earlier versions of this article. This research was conducted as part of the authors doctoral dissertation. Portions of this article were presented at the 17th Annual Conference of the Society for Industrial and Organizational Psychology, Toronto, Ontario, Canada, April 2002.     

Managerial Experience and the Measurement Equivalence of Performance Ratings

ABSTRACT: Establishing the measurement equivalence of instruments is a prerequisite to making meaningful comparisons between individuals or within individuals over time. Whereas previous research has investigated the effects of rater characteristics on the measurement equivalence of performance ratings, the current study investigated a ratee characteristic—ratee job experience. Using confirmatory factor analysis and item response theory methods with replication, the measurement equivalence of supervisor ratings of 7,200 managers with differing levels of managerial experience was assessed. Overall, results indicated a high degree of measurement equivalence suggesting that meaningful comparison may be made across ratees with different levels of job experience.