Measurement of newcomer socialization: Construct validation of a multidimensional scale

A construct validation approach was taken to develop a primary measure of newcomer socialization that addresses shortcomings with a prior scale (Chao, Kelly, Wolf, Klein, & Gardner, 1994). Three separate groups of subject matter experts reviewed items to ensure the content validity of the Newcomer Socialization Questionnaire (NSQ). Studies 1 and 2 examined the NSQ’s psychometric properties using employed students and organizational newcomers as participants, respectively. Results illustrate scale reliability, factor structure, convergent and discriminant validity, and correlations with criterion variables. The NSQ measures three dimensions or domains of newcomer socialization: the organization, the group and the job/task. In addition, both factual knowledge and knowledge of expected role behaviors are assessed within each domain. Thus, the NSQ provides a useful measurement tool for researchers and practitioners interested in examining direct outcomes of being socialized.     

Development and validation of a multidimensional smoking behaviour questionnaire

We administered a 42-item smoking behaviour questionnaire to 150 adult smokers (75 men and 75 women), 18 to 70 years old (M = 37.1 yr., SD = 12.2). A principal component analysis of their responses followed by varimax rotation yielded four factors accounting for about 52% of the total variance: dependence, social integration, regulation of negative affect, and hedonism. Some sociodemographic and dispositional characteristics of the smokers predict these four dimensions. The predictors of each smoking dimension are quite different for male and female smokers.     

Peer defending as a multidimensional behavior: Development and validation of the Defending Behaviors Scale

Defending represents any prosocial behavior taken to assist an individual being victimized. Like other forms of prosocial behavior, defending may be best conceptualized as a multidimensional set of behaviors, including both direct and indirect forms of defending. The objective of the current research was to design and validate the Defending Behaviors Scale (DBS), a multidimensional self-report scale of defending behaviors. Data were collected from 572 early adolescents in Grades 6 to 8. Participants completed the DBS as well as established measures of bullying, victimization, empathy, aggression, social self-efficacy, social support, and prosocial behavior. Data were analyzed using an exploratory structural equation modeling framework. A four-factor model provided the best fit to the data. Direct defending included aggressive and solution-focused behaviors, whereas indirect defending included comforting and reporting to authority. Girls were more likely to defend others by offering comfort and reporting to authority, whereas aggressive defending was more common among boys. Each subscale demonstrated good internal consistency (α's 0.80–0.92) and was uniquely associated with empathy, aggression, and other types of prosocial behavior. The DBS is a new, psychometrically-valid measure that will aid in the assessment of heterogenous defending behaviors.     

Initial validation of the trust of automated systems test (TOAST)

ABSTRACT

Trust is a key determinant of whether people rely on automated systems in the military and the public. However, there is currently no standard for measuring trust in automated systems. In the present studies, we propose a scale to measure trust in automated systems that is grounded in current research and theory on trust formation, which we refer to as the Trust in Automated Systems Test (TOAST). We evaluated both the reliability of the scale structure and criterion validity using independent, military-affiliated and civilian samples. In both studies we found that the TOAST exhibited a two-factor structure, measuring system understanding and performance (respectively), and that factor scores significantly predicted scores on theoretically related constructs demonstrating clear criterion validity. We discuss the implications of our findings for advancing the empirical literature and in improving interface design.     

Beyond dysfunction and threshold-based classification: a multidimensional model of personality disorder diagnosis

An alternative dimensional model of personality disorder (PD) diagnosis that addresses several difficulties inherent in the current DSM conceptualization of PDs (excessive PD overlap and comorbidity, use of arbitrary thresholds to distinguish normal from pathological personality functioning, failure to capture variations in the adaptative value of PD symptoms, and inattention to the impact of situational influences on PD-related behaviors) is outlined. The model uses a set of diagnostician-friendly strategies to render PD diagnosis in three steps: (1) the diagnostician assigns every patient a single dimensional rating of overall level of personality dysfunction on a 50-point continuum; (2) the diagnostician assigns separate intensity and impairment ratings for each PD dimension (e.g., narcissism, avoidance, dependency); and (3) the diagnostician lists any personality traits-including PD-related traits-that enhance adaptation and functioning (e.g., histrionic theatricality, obsessive attention to detail). Advantages of the proposed model for clinicians and clinical researchers are discussed.     

It is more than personal: Development and validation of a multidimensional privacy orientation scale

This study summarizes the development and validation of a multidimensional privacy orientation scale designed for measuring privacy attitudes of Social Network Site (SNS) users. Findings confirm the existence of four dimensions: (1) belief in the value of “privacy as a right”; (2) “other-contingent privacy”; (3) “concern about own informational privacy” and (4) “concern about privacy of others.” Moreover, a segmentation of SNS users based on these attitude scores reveals three types of users: (1) privacy advocates, who are concerned about both their own and other people’s privacy; (2) privacy individualists, who are concerned mostly about their own privacy, and (3) privacy indifferents, whose score on all dimensions are lower than other segments. The results indicate that the four privacy orientation dimensions and three user segments predict key differences in terms of privacy protective behavior, information disclosure, and viewing personal information of others.     

The stability of the factorial pattern of aircrew classification tests in four analyses

This study consists of four factor analyses of the Army Air Forces Aircrew Classification Batteries. The first was an analysis of the 1945 wartime battery, while the other three were analyses of the 1947 postwar battery, consisting of essentially the same variables, but using different samples. Eleven factors were found which had been identified and reported in previous analyses. An additional factor, possibly an artifact, was identified as an age-education doublet. The only factor which differed significantly in the analyses was pilot or flying interest. These factor analyses show that the factorial content of the tests remains quite similar in both wartime and postwar populations.The data reported in this study were collected as part of the United States Air Force Human Resources Research and Development Program and described in Research Bulletin 52-16. The opinions or conclusions contained in this report are those of the authors. They are not to be construed as reflecting the view or indorsement of the Department of the Air Force.     

Selective attention in the speeded classification and comparison of multidimensional stimuli

Selective attention was studied when subjects were required to make either speeded classifications of single stimuli or comparisons of pairs of multidimensional stimuli. Experiment 1 established that subjects were able to attend selectively to form when the irrelevant dimension of size or shading varied in a speeded-classification (card-sorting) task. Experiment 2 confirmed this finding in a discrete-trials task. However, subjects werenot able to filter out irrelevant dimensional disparity in a comparably designed simultaneous-comparison (i.e., “same”-“different”) task. Mean “same” reaction time increased monotonically with increases in disparity between the two stimuli on the irrelevant dimension. Experiment 3 also revealed a monotonie increase in “same” RT as a function of irrelevant disparity in a successive-comparison task. These results were discussed in terms of a normalization model proposed by Dixon and Just (1978) in which it is assumed that a subject equates the two stimuli on the irrelevant dimension before deciding that they are the same along the relevant dimension. It was concluded that: (1) although subjects can efficiently filter out irrelevant disparity in a speeded-classification task, interference due to irrelevant disparity is obtained in the comparison tasks, (2) a common process such as normalization does not necessarily underlie performance in the speeded-classification and comparison tasks, (3) the ability to attend selectively to a stimulus dimension may be task determined as well as stimulus determined, and (4) contrary to the Dixon and Just proposal, normalization of irrelevant disparity occurs in a comparison task, even when the relevant dimension is represented as a separate encoding feature.     

Development and validation of the multidimensional health profile, part I: Psychosocial functioning

This article describes the development and preliminary validation of the Multidimensional Health Profile, Part I: Psychosocial Functioning (MHP-P), a self-report screening instrument for use in mental health and primary care settings. The MHP-P assesses mental health, life stress, coping skills, and social resources. In Study 1, retest reliability, validity, social desirability response bias, and factor structure were examined in a national sample of men and women (N = 673). In Study 2, the effect of time frame on the retest reliability of the mental health scales was examined in a sample of male and female college students (N = 147). A national sample of men and women (N = 2,411) provided data for additional confirmatory factor analyses and norm development in Study 3.     

Examining a multidimensional model of student motivation and engagement using a construct validation approach

Background. This study seeks to examine a multidimensional model of student motivation and engagement using within‐ and between‐network construct validation approaches. Aims. The study tests the first‐ and higher‐order factor structure of the motivation and engagement wheel and its corresponding measurement tool, the Motivation and Engagement Scale – High School (MES‐HS; formerly the Student Motivation and Engagement Scale). Sample. The study draws upon data from 12,237 high school students from 38 Australian high schools. Methods. The hypothesized 11‐factor first‐order structure and the four‐factor higher‐order structure, their relationship with a set of between‐network measures (class participation, enjoyment of school, educational aspirations), factor invariance across gender and year‐level, and the effects of age and gender are examined using confirmatory factor analysis and structural equation modelling. Results. In terms of within‐network validity, (1) the data confirm that the 11‐factor and higher‐order factor models of motivation and engagement are good fitting and (2) multigroup tests showed invariance across gender and year levels. In terms of between‐network validity, (3) correlations with enjoyment of school, class participation and educational aspirations are in the hypothesized directions, and (4) girls reflect a more adaptive pattern of motivation and engagement, and year‐level findings broadly confirm hypotheses that middle high school students seem to reflect a less adaptive pattern of motivation and engagement. Conclusion. The first‐ and higher‐order structures hold direct implications for educational practice and directions for future motivation and engagement research.     

Construction and validation of a multidimensional model of students' adjustment to college context

This article presents a model of interaction of personal and contextual variables in the prediction of academic performance and psychosocial development of Portuguese college students. The sample consists of 560 first-year college students of the University of Minho. The path analysis results suggest that initial expectations of the students' involvement in academic life constituted an effective predictor of their involvement during their first year; as well as the social climate of the classroom influenced their involvement, well-being and levels of satisfaction obtained. However, these relationships were not strong enough to influence the criterion variables integrated in the model (academic performance and psychosocial development). Academic performance was predicted by the high school grades and college entrance examination scores, and the level of psychosocial development was determined by the level of development showed at the time they entered college. Though more research is needed, these results point to the importance of students' pre-college characteristics when we are considering the quality of their college adjustment process.     

Automatic classification of dysfunctional thoughts: a feasibility test.

The identification of dysfunctional thoughts is a central effort in cognitive therapy. This paper describes the first version of a computer module that classifies dysfunctional thoughts automatically. It is part of COGNO, a system we are developing to give automatic feedback on dysfunctional thoughts. The system uses rules that were developed from language markers identified in a sample of 149 dysfunctional thoughts. The system was tested with an independent set of 112 example thoughts. The system detects the majority of dysfunctional thoughts, but works reliably only for some thought categories. Automatic thought classification may be a first step toward developing natural dialogue systems in cognitive therapy.     

Pilot selection in the Norwegian Air Force: a validation and meta-analysis of the test battery

The purpose of this study was to evaluate the test battery currently used for pilot selection to the Norwegian Air Force. Selection is currently based on a standard battery of 20 different psychological tests as well as on medical tests and on an interview by a licensed psychologist. First, two-factor analyses were conducted to examine the relation between the tests in the battery. Then, a correlation study was conducted to evaluate the predictive validity of the tests against two criteria of pilot performance collected during the basic training period. Finally, a small-scale meta-analysis of previous validation studies in Norway was conducted. me best predictors of success in training, based on the meta-analysis, were Instrument Comprehension (mean r = .29), Mechanical Principles (mean r = .23), and Aviation Information (mean r = .22)     

Development and validation of a self-report measure of emotional intelligence as a multidimensional trait domain

Psychometric review of 33 peer-reviewed studies of six self-report emotional intelligence (EI) measures supports a multidimensional conceptualization of EI. The nature and number of EI facets, however, and their distinctiveness from more established trait domains is unclear. Building on earlier efforts, three studies were undertaken (Ns = 138, 163, 152) to develop self-report measures of 10 facets of EI proposed by Salovey and Mayer (1990). Results support the reliability (internal consistency, test-retest) and validity (content, criterion, construct, structural) of the proposed scales and their distinctiveness among themselves and with respect to more established trait domains (e.g., personality). Specifically, three satisfaction and four cross-cultural adaptability facets were predicted uniquely by 9 of the 10 proposed subscales, controlling for social desirability, the Big Five, positive and negative affect, and self-monitoring. All told, results confirm that trait-EI can be measured using self-report and conceptualized as a distinct multidimensional domain.