The relationship between differential stimulus relatedness and implicit measure effect sizes

Implicit measures have been hypothesized to allow researchers to ascertain the existence and strength of relations between stimuli, often in the context of research on attitudes. However, little controlled behavioral research has focused on whether stimulus relations, and the degree of relatedness within such relations, are indexed by implicit measures. The current study examined this issue using a behavior‐analytic implicit‐style stimulus relation indexing procedure known as the Function Acquisition Speed Test (FAST). Using a matching‐to‐sample (MTS) procedure to train stimulus equivalence relations between nonsense syllables, the number of iterations of the procedure was varied across groups of participants, hence controlling stimulus relatedness in the resulting equivalence relations. Following final exposure to the MTS procedure, participants completed a FAST. Another group of participants was exposed to a FAST procedure with word pairs of known relatedness. Results showed that increasing relatedness resulted in a linear increase in FAST effect size. These results provide the first direct empirical support for a key process‐level assumption of the implicit literature, and offer a behavior‐analytic paradigm within which to understand these effects. These results also suggest that the FAST may be a viable procedure for the quantification of emergent stimulus relations in stimulus equivalence training.     

A precursor to the relational evaluation procedure: searching for the contextual cues that control equivalence responding.

The precursor to the relational evaluation procedure (pREP) is a go/no-go successive discrimination procedure for examining stimulus equivalence. Previous research has shown that it does not readily produce equivalence responding unless some matching-to-sample (MTS) procedures are incorporated into the experimental sequence. Two experiments attempted to identify contextual cues that would generate equivalence responding on the pREP. Experiment 1 examined the effects of using abstract symbols or various verbal labels as response options on the pREP. Only the words same and different, when used as response options, reliably produced equivalence responding across 4 subjects. Experiment 2 examined different pretraining preparations designed to attach the functions of the words same and different to abstract symbols that could then be used as response options on the pREP. The most effective pretraining procedure involved multiple-exemplar training during which subjects were trained to respond to abstract symbols in the presence of pairs of stimuli that were either formally the same or different. The abstract symbols were subsequently used as response options with the pREP, and all subjects reliably demonstrated equivalence responding. The findings suggest that the relations of same and different may be fundamental to equivalence responding. These findings are discussed in terms of what they suggest about the nature of the equivalence phenomenon specifically and derived relational responding more generally.     

熟练中-英双语者对多义词早期识别中语义和语法的相互作用

以中、英文的多义词为材料, 采用跨语言隐蔽启动的实验范式, 考察在无语境条件下熟练中–英双语者对多义词的早期识别。结果表明：(1)熟练中–英双语者表现出显著的隐蔽翻译启动效应, 当目标词是主要翻译对等词时, 启动效应更加显著。(2)翻译对等词的性质、多义词的义项联系程度以及是否是词类歧义词都影响熟练中–英双语者对中、英多义词的早期加工。(3)在无语境条件下, 词类信息在意义通达的早期就已经激活, 并且同语义信息之间存在着交互作用。根据研究结果, 扩展和修正了分布式概念表征模型。     

Generalization of money-handling though training in equivalence relationships

This research used a matching-to-sample procedure and equivalence learning process with language and verbal tasks. In the study, an application of the equivalence relationship of money was used with several kinds of euro coins presented. The sample consisted of 16 children (8 in the experimental group and 8 in the control group) aged 5 years. The prerequisite behaviors, the identification of coins and the practical use of different euro coins, were assessed in the pre and post phases for both groups. The children in the experimental group performed an equivalence task using the matching-to-sample procedure. This consisted of a stimulus sample and four matching stimuli, using a series of euro coins with equivalent value in each set. The children in the control group did not undergo this training process. The results showed a large variability in the children's data of the equivalence tests. The experimental group showed the greatest pre and post changes in the statistically significant data. They also showed a greater generalization in the identification of money and in the use of euro coins than the control group. The implications for educational training and the characteristics of the procedure used here for coin equivalence are discussed.     

On realizable biorders and the biorder dimension of a relation

The paper discusses the mathematical foundations of a technique of multidimensional scaling, generalizing Guttman scaling, in which the structure of the embedding space relies only on ordinal concepts. An empirical relation is represented as an intersection of a minimal number (called bidimension) of Guttman relations. Fairly complete results are given for the cases of bidimensions 1 and 2. In the general case, the main results are based on the equivalence between the bidimension and the dimension of a certain partial order. A characterization of the bidimension as the chromatic number of some hypergraph is also provided.     

Selection Testing via the Internet: Practical Considerations and Exploratory Empirical Findings*

Despite a growing body of applied research on using the Internet for some human resource management practices, few studies have provided equivalence information or practical lessons concerning selection testing via the Internet. We identify several issues associated with measurement and validity, the role of several individual characteristics, respondents' reactions and behaviors, and other considerations concerning Internet test administration. We also report results from an exploratory study of the correlation between paper‐and‐pencil and Internet‐administered cognitively oriented selection tests (including timed and untimed, proctored tests). Our empirical results suggest modest degrees of cross‐mode equivalence for an untimed situational judgment test (r= .84) and for a timed cognitive ability test (r= .60). Further, some types of items (math, verbal, spatial) in the timed cognitive ability test seem to play a differential role in the reduced cross‐mode equivalence. New issues regarding the perception of, and reaction to, items presented via the Internet are presented, and a variety of practical issues are derived and discussed.     

Comment on Levine's blank trial method: A procedure for estimating true hypothesis behavior

When Levine's method of blank trial probes is used to study hypothesis behavior the probability that a probe results in a cue-defined choice combination usually lies between .70 and .90, depending upon the age group and the treatment conditions. It may not be safe to assume that each such combination signifies an hypothesis. A procedure for estimating the probability of true hypothesis behavior is presented, including a validity test for the resulting estimate. The procedure is applied to data taken from three research reports, and reveals substantial differences between age and treatment groups. Implications of the procedure for correctly interpreting empirical results are discussed.     

On Nonequivalence of Several Procedures of Structural Equation Modeling

The normal theory based maximum likelihood procedure is widely used in structural equation modeling. Three alternatives are: the normal theory based generalized least squares, the normal theory based iteratively reweighted least squares, and the asymptotically distribution-free procedure. When data are normally distributed and the model structure is correctly specified, the four procedures are asymptotically equivalent. However, this equivalence is often used when models are not correctly specified. This short paper clarifies conditions under which these procedures are not asymptotically equivalent. Analytical results indicate that, when a model is not correct, two factors contribute to the nonequivalence of the different procedures. One is that the estimated covariance matrices by different procedures are different, the other is that they use different scales to measure the distance between the sample covariance matrix and the estimated covariance matrix. The results are illustrated using real as well as simulated data. Implication of the results to model fit indices is also discussed using the comparative fit index as an example. The work described in this paper was supported by a grant from the Research Grants Council of Hong Kong Special Administrative Region (Project No. CUHK 4170/99M) and by NSF grant DMS04-37167.     

Evaluating Factorial Invariance: An Interval Estimation Approach Using Bayesian Structural Equation Modeling

In this study, we introduce an interval estimation approach based on Bayesian structural equation modeling to evaluate factorial invariance. For each tested parameter, the size of noninvariance with an uncertainty interval (i.e. highest density interval [HDI]) is assessed via Bayesian parameter estimation. By comparing the most credible values (i.e. 95% HDI) with a region of practical equivalence (ROPE), the Bayesian approach allows researchers to (1) support the null hypothesis of practical invariance, and (2) examine the practical importance of the noninvariant parameter. Compared to the traditional likelihood ratio test, simulation results suggested that the proposed Bayesian approach could offer additional insight into evaluating factorial invariance, thus, leading to more informative conclusions. We provide an empirical example to demonstrate the procedures necessary to implement the proposed method in applied research. The importance of and influences on the choice of an appropriate ROPE are discussed.     

Item characteristics that predict response latency in personality measures

This study assesses some item characteristics that are expected to affect response latencies in the computerized administration of a personality questionnaire. First, some previous empirical results are discussed, and a theoretical framework from which predictions can be made is proposed. Second, the predictions are empirically assessed using two data-sets, one of them based on binary items, and the other one based on graded-response items. Some of the results obtained are new, whereas the remaining agree with previous empirical results. The implications of the present results in applied research, and particularly for the use of latencies, is discussed.     

Testing the actual equivalence of automatically generated items

If the automatic item generation is used for generating test items, the question of how the equivalence among different instances may be tested is fundamental to assure an accurate assessment. In the present research, the question was dealt by using the knowledge space theory framework. Two different ways of considering the equivalence among instances are proposed: The former is at a deterministic level and it requires that all the instances of an item template must belong to exactly the same knowledge states; the latter adds a probabilistic level to the deterministic one. The former type of equivalence can be modeled by using the BLIM with a knowledge structure assuming equally informative instances; the latter can be modeled by a constrained BLIM. This model assumes equality constraints among the error parameters of the equivalent instances. An approach is proposed for testing the equivalence among instances, which is based on a series of model comparisons. A simulation study and an empirical application show the viability of the approach.     

Facilitation of the equivalence--equivalence responding

Equivalence-Equivalence responding, based on equivalence class formation, is a key concept of the functional-analytic model of analogical reasoning held by RFT theorists. Relational stimulus control is supposed to play an important role in this arbitrary relational response. Previous research showed that mere training of the prerequisites for equivalence class formation is not always enough for the derivation of equivalence-equivalence responding, even in adults. In the first experiment, with 12 adult participants, we designed a matching-to-sample training and testing procedure that, although it provided all necessary conditions, did not lead to Equivalence-Equivalence responding in most participants, so that the efficacy of a facilitation procedure could be assessed. In Experiment 2, with 32 valid participants, a matching-to-sample procedure based on non-arbitrary relations was introduced to assess its efficacy in enhancing stimulus control by the relational properties of sample and comparisons. Results showed a moderate effect: 40.6% of the participants passed the test after being exposed to a non-arbitrary relational matching task (but none without it). This research underlines the importance of non-arbitrary relational responses in the derivation of more complex repertoires.     

Rotation in the dynamic factor modeling of multivariate stationary time series

A special rotation procedure is proposed for the exploratory dynamic factor model for stationary multivariate time series. The rotation procedure applies separately to each univariate component series of aq-variate latent factor series and transforms such a component, initially represented as white noise, into a univariate moving-average. This is accomplished by minimizing a so-called state-space criterion that penalizes deviations of the rotated solution from a generalized state-space model with only instantaneous factor loadings. Alternative criteria are discussed in the closing section. The results of an empirical application are presented in some detail.This research was supported by the Institute for Developmental and Health Research Methodology, University of Virginia.     

Factorial Structure of the Family Values Scale From a Multilevel-Multicultural Perspective

In cross-cultural research, there is a tendency for researchers to draw inferences at the country level based on individual-level data. Such action implicitly and often mistakenly assumes that both the measuring instrument and its underlying construct(s) are operating equivalently across both levels. Based on responses from 5,482 college students sampled from 27 countries, we took a structural equation modeling approach to addressing this issue of level equivalence. Purposes of the study were: (a) to validate the hypothesized two-factor structure of the Family Values Scale (FV Scale; Georgas, 1999) within a multilevel framework that took individual- and country-level information into account; (b) to test equivalence of the FV Scale across individual and country levels; and (c) to evaluate relations between the FV Scale and three possibly important covariates—gender at the individual level, and affluence and religion at the country level. Implications of findings and importance of multilevel equivalence in cross-cultural research are discussed.     

个人化设计在临床研究中的应用——从个体角度研究个体差异

本文从有关研究证据的基础上,介绍了个人化设计的理论基础和实验设计,并在此基础上讨论了个人化设计在临床研究领域中的应用价值,总结出一种适合临床病人使用的研究程序。个人化设计允许对个体的个人价值进行分析,并能同时研究不同刺激信息的作用,在个体水平上分析个体差异。通过简化了的实验程序,个人化设计为解决临床研究中的问题提供了一种新的思维方式。文中还对相关研究法的局限进行了讨论。     

Evidence of precurrent responses expanding equivalence classes in a delayed matching-to-sample task

Delayed matching to sample (DMTS) increases the probability of equivalence class formation. Precurrent responses can mediate the retention interval in DMTS trials and control the selection of comparisons. In human participants, precurrent responses usually consist of naming the experimental stimuli based on their similarities to meaningful stimuli with preexperimental history. We tested whether precurrents expand classes by serving as nodes between experimental and meaningful stimuli. A DMTS (2 s) was used throughout the entire experiment. Eleven undergraduates learned A1B1 and A2B2 relations and then were submitted to ArC trials that required them to answer math problems presented during the DMTS interval: when the sample was A1, the problems resulted in 12 and C1 was correct; when the sample was A2, they resulted in 9 and C2 was correct. Response-as-node tests assessed whether participants would relate B1 and C1 to the printed number 12 and B2 and C2 to the printed number 9. Ten participants responded accordingly to this pattern, showing that the responses to the problems expanded the classes. Parity tests using the words “even” and “odd” further confirmed this hypothesis. These results contribute to understanding why DMTS enhances equivalence performances. Implications of using this procedure in stimulus-equivalence studies are discussed.     

The assessment of organizational culture in cross‐cultural settings: Investigating the psychometric quality and cultural equivalence of three quantitative instruments

This study tested the psychometric quality and cultural equivalence of the German versions of three instruments for measuring organizational culture: the Denison Organizational Culture Survey (DOCS), the Organizational Culture Profile (OCP), and the Global leadership & organizational behavior effectiveness survey (GLOBE). Using an organizational sample from the banking industry, we analyzed the metric equivalence (by means of assessing the psychometric quality), the conceptual equivalence (by means of assessing the construct validity) as well as the linguistic and functional equivalence of the three instruments. The results indicate that the psychometric properties and the equivalence of the DOCS and the OCP can be summarized as satisfactory. In contrast, reliability indices of the GLOBE scales were far below recommended thresholds and results regarding its construct validity were unsatisfying. Conceptual equivalence could therefore not be assumed. Avenues for future research and implications for practitioners are discussed. In addition, the authors created and tested a German translation of the OCP scales and an adapted version of the German DOCS scales.     

Protocol analysis of the correspondence of verbal behavior and equivalence class formation.

In two equivalence experiments, a "think aloud" procedure modeled after Ericsson and Simon's (1980) protocol analysis was implemented to examine subjects' covert verbal responses during matching to sample. The purpose was to identify variables that might explain individual differences in equivalence class formation. The results from Experiment 1 suggested that subjects who formed equivalence classes described the relations among stimuli, whereas those not showing equivalence described sample and comparison stimuli as unitary compounds. Because Experiment 1 only demonstrated a correlation between describing stimulus compounds and the absence of equivalence classes, a second study was conducted. In Experiment 2, equivalence class formation was brought under experimental control through pretraining manipulations that facilitated responding either to stimulus compounds or to relations among stimuli. The results demonstrated that a history of describing stimulus compounds, when compared with describing the relations among the stimuli, interfered with the emergence of stimulus equivalence. These findings clarify individual differences in stimulus equivalence. They also demonstrate the utility of analyzing verbal reports to identify possible variables that can be manipulated experimentally.     

The logical and empirical bases of conservation judgements

It is argued that conservation judgements are based on a particular combination of logical necessity and empirical belief. The empirical belief is that a given transformation will not alter a particular quantity (Elkind's conservation of identity). The logical aspect is a transitive deductive argument containing an initial equivalence of two quantities and the conservation of identity belief as premises which lead to the conclusion of maintained equivalence (Elkind's conservation of equivalence). In two experiments, it is shown that conservation of identity beliefs can be manipulated in subjects who have long since developed the capacity for transitive deductive inference. Untrained 10 year olds were unaware of how sublimation acts to alter certain quantities over particular transformations of shape. And untrained adults incorrectly believed that both the area and perimeter of a closed figure would be conserved over transformations which elongated the figure. Both groups of subjects could be trained in the correct conservation of identity beliefs and this affected their conservation of equivalence judgements in predicted ways. It is suggested that the locical aspect of conservation is developmentally stable and that the empirical aspect varies widely across problems and individuals because of its dependence on relevant experience.