Investigating measurement equivalence of visual analogue scales and Likert-type scales in Internet-based personality questionnaires

Visual analogue scales (VASs) have shown superior measurement qualities in comparison to traditional Likert-type response scales in previous studies. The present study expands the comparison of response scales to properties of Internet-based personality scales in a within-subjects design. A sample of 879 participants filled out an online questionnaire measuring Conscientiousness, Excitement Seeking, and Narcissism. The questionnaire contained all instruments in both answer scale versions in a counterbalanced design. Results show comparable reliabilities, means, and SDs for the VAS versions of the original scales, in comparison to Likert-type scales. To assess the validity of the measurements, age and gender were used as criteria, because all three constructs have shown non-zero correlations with age and gender in previous research. Both response scales showed a high overlap and the proposed relationships with age and gender. The associations were largely identical, with the exception of an increase in explained variance when predicting age from the VAS version of Excitement Seeking (B₁₀ =1318.95, ΔR ² =.025). VASs showed similar properties to Likert-type response scales in most cases.     

Measurement invariance in mentoring research: A cross-cultural examination across Taiwan and the U.S.

Workplace mentoring in the international context is an emerging research area with significant potential for global integration. However, although measurement equivalence is a prerequisite for examining cross-cultural differences, this assumption has yet to be examined in mentoring research. This study contributes to the mentoring literature by assessing the measurement equivalence of the Mentoring Functions Questionnaire (MFQ-9) across two diverse cultural settings, the U.S. and Taiwan. Results of a series of multi-group confirmatory factor analyses supported full configural invariance, full metric invariance, and partial scalar invariance across the two groups. These findings suggest MFQ-9 may provide acceptable comparisons and meaningful interpretations across cultures. Implications for future international mentoring research and managerial practice are discussed.     

Measuring recognition performance using computer-based and paper-based methods

Using a within-subjects design, we administered to 83 naval pilots and flight officers computer-based and paper-based tests to assess recognition of aircraft silhouettes in order to determine the relative reliabilities and validities of these two measurement modes. Estimates of internal consistencies, equivalences, and discriminative validities were computed for multiple performance measures. It was established that the relative reliabilities and validities derived for these two assessment schemes were contingent on the employed multivariate measurement criteria, that is, percentage correct responses, average response latency, and average degree of confidence in recognition judgments, as well as the statistical criteria used to ascertain the comparative quality of these two modes of testing.     

Comparison of three psychological defense mechanism questionnaires

The Defense Mechanisms Inventory (DMI), the Coping Operations Preference Enquiry (COPE), and the scales developed by Joffe and Naditch (J&N) were compared using multitrait-multimethod logic. Convergent validity was tow as measures of the same defense were not highly correlated across instruments. Similar patterns of correlations occurred within instruments but the J&N scales, and particularly the DMI scales, had high interscale correlations so overall discriminant validity was limited. These results suggest that either the defense constructs or at least some of the defense scales studied lack validity. Another possibility is that the scales are valid, but assess different parameters of defensiveness (e.g., intensity versus breadth of use of mechanisms). Comparisons of the scales' predictive validity should help resolve these points.     

Perceived benefits of using an Internet-based interactive career planning system

Making Better Career Decisions (MBCD) is an Internet-based interactive career planning system designed to help deliberating individuals. The present research examined the benefits of a dialogue with MBCD, by analyzing 712 users’ perceptions of its contribution to their career decision-making process, and locating variables associated with these perceptions. A pre-dialogue and a post-dialogue questionnaire were used to collect the users’ perceptions of its benefits and measure the change in the degree of decidedness. Perceived benefit was derived from participants’ ratings of the degree of progress they had made in their career decision-making process, whether they had learned about additional factors to be considered and their career-related preferences, as well as their ratings of the quality of the list of “promising” career alternatives presented to them during their dialogue with MBCD. This composite perceived benefit was found to be positively associated with the users’ decidedness at the completion of the dialogue with MBCD. Users’ satisfaction with the length and variety of their personal “promising alternatives” list was associated with a higher perceived benefit.     

Methodological issues in interviewing and using self-report questionnaires with people with mental retardation

In this article the authors review methodological issues that arise when interviews and self-report questionnaires are used with people with mental retardation and offer suggestions for overcoming some of the difficulties described. Examples are drawn from studies that use qualitative methodology, quantitative studies assessing different question types, and studies reporting on the development of instruments measuring psychiatric symptoms, self-concept, and quality of life. Specific problems that arise with respect to item content (e.g., quantitative judgments, generalizations), question phrasing (e.g., modifiers), response format (e.g., acquiescence, multiple-choice questions), and psychometric properties (factor structure and validity) are discussed. It is argued that because many self-report questionnaires include questions that have been found to be problematic in this population, more attention needs to be paid to establishing the validity of such measures and to clearly defining the population for which the instrument is designed.     

Measurement equivalence/invariance of the abusive supervision measure across workers from Taiwan and the United States

Growing international research interest in negative-leadership behaviors prompts the need to examine whether measures of ineffective leadership developed in the United States are equivalent across countries outside the United States. B. J. Tepper's (2000) abusive supervision measure has been used widely inside and outside the United States and merits research attention on its construct equivalence across different cultural settings. The authors conducted a series of multigroup confirmatory factor analyses to investigate the measurement equivalence of this measure across Taiwan (N = 256) and the United States (N = 389). Configural invariance was established, suggesting that both U.S. and Taiwanese samples perceive abusive supervision as a single-factor concept. Furthermore, the establishment of partial metric invariance and partial scalar invariance suggests that the abusive supervision measure is applicable to crosscultural comparisons in latent means, construct variance, construct covariances, and unstandardized path coefficients with the caution that workers from different cultures calibrate their responses differently when answering some items.     

Antecedents and consequences of approach and avoidance achievement goals: A test of gender invariance

ObjectiveBased on Elliot's revised achievement goal framework [Elliot and McGregor (2001). A 2×2 achievement goal framework. Journal of Personality and Social Psychology, 80, 501–519], the present study tested the gender invariance of the multiple achievement goal measurement model as well as the hypothesized antecedents and consequences of the multiple achievement goals embedded in a structural model.MethodA sample of 450 British male and female athletes (M age=22.17, SD=6.59) were used. A multi-section questionnaire, assessing approach and avoidance achievement goals, perceived sport competence, fear of failure, and motivation regulations, was administered to the athletes before or after training. Data were collected with the informed consent of the coaches and the athletes.DesignCross-sectional design.ResultsAnalyses of factorial invariance revealed that the four goal model could be considered as equivalent across gender. Only partial invariance was supported with respect to the antecedents-achievement goals-consequences model. The paths between fear of failure to mastery-avoidance goal, mastery-approach goal to intrinsic motivation, and performance-approach goal to extrinsic motivation regulation were not invariant for males and females.ConclusionThe factorial validity of multiple achievement goal measure was supported for both genders. The present findings provided only partial support for gender invariance in the 2×2 model.     

Evaluation on types of invariance in studying extreme response bias with an IRTree approach

In recent years, item response tree (IRTree) approaches have received increasing attention in the response style literature for their ability to partial out response style latent variables as well as associated item parameters. When an IRTree approach is adopted to measure extreme response styles, directional and content invariance could be assumed at the latent variable and item parameter levels. In this study, we propose to evaluate the empirical validity of these invariance assumptions by employing a general IRTree model with relaxed invariance assumptions. This would allow us to examine extreme response biases, beyond extreme response styles. With three empirical applications of the proposed evaluation, we find that relaxing some of the invariance assumptions improves the model fit, which suggests that not all assumed invariances are empirically supported. Specifically, at the latent variable level, we find reasonable evidence for directional invariance but mixed evidence for content invariance, although we also find that estimated correlations between content-specific extreme response latent variables are high, hinting at the potential presence of a general extreme response tendency. At the item parameter level, we find no directional or content invariance for thresholds and no content invariance for slopes. We discuss how the variant item parameter estimates obtained from a general IRTree model can offer useful insight to help us understand response bias related to extreme responding measured within the IRTree framework.     

The parental attitude research instrument: An approach to use of attitude questionnaires

Parental attitude questionnaires such as the Parental Attitude Research Instrument (PARI) are still in use despite their inherent difficulties. In light of the need to test theoretical models by measuring a range of parental characteristics, the properties of the PARI were re-examined and, on the basis of a factor analysis of the 23 subtests of the PARI, a shortened version was constructed. A measure of maternal Authoritarian Control, which was found to be associated with measures of maternal mental ability, personality, level of education, reading age, number of adverse family conditions and child-rearing practices, has proved useful for other projects related to this ongoing study. It is recommended that such instruments be used only in conjunction with other measures which examine the family environment, for example in an index of child-rearing practices.     

Projective invariance and the kinetic depth effect.

Seven experiments test the assumption that, in the kinetic depth effect, observers have reliable and direct access to the equivalence of shapes in projective geometry. The assumption is implicit in 'inverse optics' approaches to visual form perception. Observers adjusted a comparison shape to match a standard shape; both standard and comparison were portrayed as in continuous rotation in space, using a graphics computer. The shapes were either plane quadrilaterals or solid prisms. The angular difference of the planes of the shapes was varied, as was the dot density of a texture in those planes. Departure from projective equivalence was measured in six studies by measuring the planar analogue of cross ratio, and in a seventh by measuring the cross ratio for points in space. Projective equivalence was not found to be perceived uniformly, except in one experiment that did not involve rotation in depth. Otherwise changes in orientation of up to 180 degrees about a single coordinate axis had no significant effect on matches in shape, while changes in orientation about more than one coordinate axis produced significant effects. The addition of texture and a change in rotation speed did not correct departures from projective equivalence.     

The assessment of factorial invariance in need for cognition using Hispanic and Anglo samples

The Need for Cognition Scale-Short Form (NCS-SF; J. T. Cacioppo, R. E. Petty, & C. F. Kao, 1984) is a commonly administered measure in the behavioral sciences, but little research has assessed its applicability across cultures. A sample of undergraduates in the southeastern United States and a sample of undergraduates at a southwestern U.S. university completed the NCS-SE Hispanic respondents did not differ from Anglos in their mean NCS-SF scores. Confirmatory factor analysis revealed that factor parameter estimates and item intercepts were partially measurement invariant across samples.     

Evidence for complete translational and reflectional invariance in visual object priming.

The magnitude of priming on naming reaction times and on the error rates, resulting from the perception of a briefly presented picture of an object approximately 7 min before the primed object, was found to be independent of whether the primed object was originally viewed in the same hemifield, left-right or upper-lower, or in the same left-right orientation. Performance for same-name, different-examplar images was worse than for identical images, indicating that not only was there priming from block one to block two, but that some of the priming was visual, rather than purely verbal or conceptual. These results provide evidence for complete translational and reflectional invariance in the representation of objects for purposes of visual recognition. Explicit recognition memory for position and orientation was above chance, suggesting that the representation of objects for recognition is independent of the representations of the location and left-right orientation of objects in space.     

我国大陆、台湾地区《人体器官移植条例》的比较研究

采用条文比较与法理分析方法,对我国大陆和台湾地区的《人体器官移植条例》进行比较,主要就立法目的、立法调整范围、人体器官自愿捐献、禁止人体器官商业交易、医疗机构与人员的准入和退出、违反人体器官移植之规定的法律责任等问题作了探讨与分析.本研究将为我国大陆地区的具体立法探索一些有价值的意见与建议.     

我国大陆、台湾地区《人体器官移植条例》的比较研究

采用条文比较与法理分析方法,对我国大陆和台湾地区的《人体器官移植条例》进行比较,主要就立法目的、立法调整范围、人体器官自愿捐献、禁止人体器官商业交易、医疗机构与人员的准入和退出、违反人体器官移植之规定的法律责任等问题作了探讨与分析。本研究将为我国大陆地区的具体立法探索一些有价值的意见与建议。