Perceived political self‐efficacy: Theory,assessment, and applications

Political efficacy is addressed within the framework of social cognitive theory and a new measure to assess perceived political self‐efficacy is presented. Three studies document the validity of the new scale of measurement. The first study (N = 1673) examined the psychometric properties of the scale in accordance with classical test theory. This led to the identification of a unidimensional factor structure, including perceived political self‐efficacy in promoting one's own political opinion, in sustaining the political programs of the party to which one belongs, and in monitoring one's own political representatives' commitment. The second study (N = 632) further confirmed the internal and construct validity of the scale; criterion validity was also investigated using several indicators of political interest and participation. The third study (N = 1176) showed that politicians holding offices have higher levels of perceived political self‐efficacy than partisans and voters, further corroborating the criterion validity of the scale. Copyright © 2009 John Wiley & Sons, Ltd.     

Anticipatory baseline effects and information integration in visual world studies

Researchers often conduct visual world studies to investigate how listeners integrate linguistic information with prior context. Such studies are likely to generate anticipatory baseline effects (ABEs), differences in listeners' expectations about what a speaker might mention that exist before a critical speech stimulus is presented. ABEs show that listeners have attended to and accessed prior contextual information in time to influence the processing of the critical speech stimulus. However, further evidence is required to show that the information actually did influence subsequent processing. ABEs can compromise the validity of inferences about information integration if they are not appropriately controlled. We discuss four solutions: statistical estimation, experimental control, elimination of “on-target” trials, and neutral gaze. An experiment compares the performance of these solutions, and suggests that the elimination of on-target trials introduces bias in the direction of ABEs, due to the statistical phenomenon of regression toward the mean. We conclude that statistical estimation, possibly coupled with experimental control, offers the most valid and least biased solution.     

The Relationship Between Political Efficacy and Citizen Participation: Construct Validation Studies

Political efficacy is the belief that one has the skills to influence the political system. Two similar studies are described that support the validity of a scale designed to measure internal and external political efficacy (Craig & Maggiotto, 1982). One study used a sample of 388 undergraduates; the second study used a sample of 159 nonstudents. Factor analytic results from both studies replicated the factor structure reported earlier (Craig & Maggiotto, 1982). Convergent and discriminant evidence was established using measures of community involvement, leadership, alienation, and perceived competence. Political efficacy was also greater for members of politically oriented voluntary organizations than both nonmembers and members of nonpolitical organizations. Implications of the study of political efficacy for understanding citizen participation are discussed.     

Changing the logic of replication: A case from infant studies

Among infant researchers there is growing concern regarding the widespread practice of undertaking studies that have small sample sizes and employ tests with low statistical power (to detect a wide range of possible effects). For many researchers, issues of confidence may be partially resolved by relying on replications. Here, we bring further evidence that the classical logic of confirmation, according to which the result of a replication study confirms the original finding when it reaches statistical significance, could be usefully abandoned. With real examples taken from the infant literature and Monte Carlo simulations, we show that a very wide range of possible replication results would in a formal statistical sense constitute confirmation as they can be explained simply due to sampling error. Thus, often no useful conclusion can be derived from a single or small number of replication studies. We suggest that, in order to accumulate and generate new knowledge, the dichotomous view of replication as confirmatory/disconfirmatory can be replaced by an approach that emphasizes the estimation of effect sizes via meta-analysis. Moreover, we discuss possible solutions for reducing problems affecting the validity of conclusions drawn from meta-analyses in infant research.     

Comparisons of the Psychometric characteristics of the adaptive behavior inventory for children for different subgroups of children

Psychometric characteristics of the Adaptive Behavior Inventory for Children (ABIC) are analyzed through five statistical procedures (internal consistency, item difficulty, correlations of item-total correlations, concurrent validity, and construct validity) using data on 436 elementary age children from three racial-ethnic and two social class groups. Data from these five statistical procedures are reported for nine demographic characteristics: children's race, social class, sex, age, birth order, health, family size, family structure, and urban acculturation. Few systematic differences are apparent on internal consistency, correlation of item-total correlations, and construct validity. Some differences are apparent on item difficulty and concurrent validity. On item difficulty the ABIC scores are higher for middle-SES, older, first- or second-born children, and from families whose structures are more typical. Regarding concurrent validity, lower correlations are noted for Mexican American and Black, for more healthy, and for less acculturated children. ABIC-achievement correlations generally are too low to be of practical value. The results are interpreted in terms of possible test bias on the ABIC.     

An evaluation of the quantity and quality of empirical research in three pastoral care and counseling journals, 1990-1999: has anything changed?

This article summarizes a review of all articles published in Pastoral Psychology, The Journal of Rleigion and Health, and The Journal of Pastoral Care between 1900 and 1999, identifying a total of 737 scholarly articles, of which 165 (22.4%) were research studies. The proportion of research studies, especially quantitative studies, increased significantly between the first and second half of the study period (p < .05). There was a significant positive correlation between compliance with three out of four criteria of internal validity. Three of five criteria of external validity were also positively related to one another. Compared to previous research using identical criteria to assess quantitative studies in the same journals in 1980-1989, the 1990-1999 sample showed improved compliance with respect to specifying the sampling method (p < .001), reporting the response rate (p < .05), and discussing the limitations of research studies (p < .001). However, the overall findings suggest that many researchers in the field do not have a sophisticated knowledge of statistical sampling, statistical analysis, or research design. Several recommendations for increasing the quality of quantitative research are offered.     

The effect of varying the number of response alternatives in rating scales: Experimental evidence from intra-individual effects

Despite a hundred years of questionnaire testing, no consensus has been reached on the optimal number of response alternatives in rating scales. Differences in prior research may have been due to the use of various psychometric models (classical test theory, item factor analysis, and item response theory) and different performance criteria (reliability, convergent/discriminant validity, and internal structure of the questionnaire). Furthermore, previous empirical studies on this issue have tackled the experimental design from a between-subjects perspective, thus ignoring intra-individual effects. In contrast with this approach, we propose a within-subjects experimental design and a comprehensive statistical methodology using structural equation models for studying all of these aspects simultaneously, therefore increasing statistical power. To illustrate the method, two personality questionnaires were examined using a repeated measures design. Results indicated that as the number of response alternatives increased, (1) internal consistency increased, (2) there was no effect on convergent validity, and (3) goodness of fit worsened. Finally, the article assesses the practical consequences of this research for the design of future personality questionnaires.     

The intervention selection bias: an underrecognized confound in intervention research

Selection bias can be the most important threat to internal validity in intervention research, but is often insufficiently recognized and controlled. The bias is illustrated in research on parental interventions (punishment, homework assistance); medical interventions (hospitalization); and psychological interventions for suicide risk, sex offending, and juvenile delinquency. The intervention selection bias is most adequately controlled in randomized studies or strong quasi-experimental designs, although recent statistical innovations can enhance weaker designs. The most important points are to increase awareness of the intervention selection bias and to systematically evaluate plausible alternative explanations of data before making causal conclusions.     

Psychometric properties of the Turkish adaptation of the Mathematics Teacher Efficacy Belief Instrument for in-service teachers

Teaching efficacy beliefs have attracted researchers' attention in recent decades because of its close association with and potential impact on the implementation of new ideas and skills in education. In the present study, we have explored the psychometric properties and construct validity of the Turkish adaptation of the Mathematics Teacher Efficacy Belief Instrument developed by Enochs, Smith, & Huinker (2000) for in-service mathematics teachers. The instrument distinguishes between two dimensions of efficacy beliefs for mathematics teachers: personal mathematics teaching efficacy and mathematics teaching outcome expectancy. The sample consisted of 1355 in-service elementary school teachers and middle school mathematics teachers from 368 schools. Exploratory and confirmatory factor analysis revealed a two-factor structure similar to that found in other studies. Also, scores from the two subscales indicated acceptable internal consistency.     

Science, ethnicity, and bias: where have we gone wrong?

The quality, quantity, and funding of ethnic minority research have been inadequate. One factor that has contributed to this inadequacy is the practice of scientific psychology. Although principles of psychological science involve internal and external validity, in practice psychology emphasizes internal validity in research studies. Because many psychological principles and measures have not been cross-validated with different populations, those conducting ethnic minority research often have a more difficult time demonstrating rigorous internal validity. Thus, psychology's overemphasis of internal as opposed to external validity has differentially hindered the development of ethnic minority research. To develop stronger research knowledge on ethnic minority groups, it is important that (a) all research studies address external validity issues and explicitly specify the populations to which the findings are applicable; (b) different research approaches, including the use of qualitative and ethnographic methods, be appreciated; and (c) the psychological meaning of ethnicity or race be examined in ethnic comparisons.     

Child Adjustment and Parent Efficacy Scale: Development and Initial Validation of a Parent Report Measure

This study examined the psychometric characteristics of the Child Adjustment and Parent Efficacy Scale (CAPES). The CAPES was designed as a brief outcome measure in the evaluation of both public health and individual or group parenting interventions. The scale consists of a 30‐item intensity scale with two subscales measuring children's behaviour problems and emotional maladjustment and a 20‐item self‐efficacy scale that measures parent's self‐efficacy in managing specific child problem behaviours. A sample of 347 parents of 2–12‐year‐old children participated in the study. Psychometric evaluation of the CAPES revealed that both the intensity and self‐efficacy scales had good internal consistency, as well as satisfactory convergent and discriminant validity. Potential uses of the measure and implications for future validation studies are discussed.     

The personal style inventory: Preliminary validation studies of new measures of sociotropy and autonomy

We conducted five studies with depressed patients, demographically matched controls, and college students to develop and psychometrically evaluate new measures of concerns about interpersonal relationships (sociotropy) and autonomous achievement (autonomy), constructs that have been proposed to confer vulnerability to depression. The final version of the Personal Style Inventory (PSI) Sociotropy and Autonomy scales showed a good factor structure, internal consistency reliability, and test-retest stability, a low correlation with each other, and weak or no gender differences. Convergent and discriminant validity were examined with respect to depressive symptom levels, the Dependency and Self-Criticism scales of the Revised Depressive Experiences Questionnaire, and a social desirability scale and were generally acceptable. Further evaluations of the construct validity of the PSI are indicated.     

Meta- and statistical analysis of single-case intervention research data: Quantitative gifts and a wish list

In this commentary, we add to the spirit of the articles appearing in the special series devoted to meta- and statistical analysis of single-case intervention-design data. Following a brief discussion of historical factors leading to our initial involvement in statistical analysis of such data, we discuss: (a) the value added by including statistical-analysis recommendations in the What Works Clearinghouse Standards for single-case intervention designs; (b) the importance of visual analysis in single-case intervention research, along with the distinctive role that could be played by single-case effect-size measures; and (c) the elevated internal validity and statistical-conclusion validity afforded by the incorporation of various forms of randomization into basic single-case design structures. For the future, we envision more widespread application of quantitative analyses, as critical adjuncts to visual analysis, in both primary single-case intervention research studies and literature reviews in the behavioral, educational, and health sciences.     

Evaluating the construct validity of psychopathy in black and white male inmates: three preliminary studies

Although Black inmates represent almost half the population of United States prisons and have been included in several studies of psychopathy, there appear to be no published studies to date addressing the validity of the psychopathy construct in Black inmates. Three studies were conducted to assess the validity of the construct in Black male inmates using Hare's Psychopathy Checklist (PCL). In Study 1, we examined the internal structure of the PCL and the relation of checklist scores to several constructs relevant to psychopathy. We observed differences between Blacks and Whites in the distribution of psychopathy scores, in the relation of psychopathy to measures of impulsivity, and in the congruence of the underlying factor structure of the PCL. In Study 2, Black psychopaths were found to manifest a pattern of passive avoidance deficits similar but not identical to that reported for White psychopaths in Newman and Kosson's study. Study 3 demonstrated that psychopaths of both races receive more criminal charges in a wider variety of offense categories than do nonpsychopaths. The psychopathy construct appears tentatively applicable to Blacks, although its components may be somewhat different than for Whites.     

Measuring Collective Efficacy Among Children in Community-based Afterschool Programs: Exploring Pathways toward Prevention and Positive Youth Development

Collective efficacy refers to a perceived sense of connectedness and willingness to intervene among youth, and is a potential aspect of positive youth development (Larson in Am Psychol 55:170–183, 2000; Lerner et al. in Child Dev 71:11–20, 2000; Sampson et al. in Science 277:918–924, 1997). Theoretically, those who feel connected to a group that is empowered to positively influence the behavior of their peers may demonstrate fewer problem behaviors. Few studies, however, have measured the impact of youth perceptions of collective efficacy. As a relatively new child-related research topic, there is much to be learned. One contribution to the foundation of this research agenda begins by evaluating the reliability and validity of a measure of collective efficacy with elementary children attending community-based afterschool programs. This paper describes the internal consistency reliability and various indicators of construct and concurrent validity of the Collective Efficacy Among Children Scale. The measure was found to have high internal consistency reliability. Construct validity was tested using exploratory factor analyses of collective efficacy including the dimensions of willingness to intervene and cohesion found in previous research (Sampson et al. in Science 277:918–924, 1997). Concurrent validity assessed relations between the scale and other measures in theoretically congruent ways. Using Hierarchical Linear Models to account for children's nestedness in after-school programs, connectedness was found to be more related to emotional adjustment, particularly children’s prosocial attitudes (caring about others and sharing). Children’s perception of the willingness of the group to intervene was found to be related to less problem behavior, (i.e. smoking tobacco, drinking alcohol, vandalism, and stealing). The implications suggest that future research should further explore children’s collective efficacy, and ways to foster its development in youth-serving afterschool settings.     

Doping use in sport teams: The development and validation of measures of team-based efficacy beliefs and moral disengagement from a cross-national perspective

ObjectivesThe main goal of this research focused on the development and validation of three instruments designed to assess athletes' self-regulatory efficacy in team contexts, team collective efficacy and team moral disengagement with relevance for doping use across three European countries.DesignThe research relied on three distinct studies. A first qualitative study focused on item development. The second study assessed the factor structure and internal reliability of each of the new team instruments. The third study provided evidence for instrument validity by assessing the hypothesis that efficacy measures and moral disengagement would contribute to team athletes' doping intentions. The latter two studies also focused on the relations among measures and on measurement reliability, both within and across countries.MethodThe first study relied on focus group data collected from twenty-one team sport professionals (mean age = 34; SD = 11.65). Four hundred and fourteen adolescent athletes (mean age = 16.69; SD = 1.55) participated in the second study, whereas seven hundred forty-nine adolescent team athletes (mean age = 16.43; SD = 1.69) participated in the third study. For the latter two studies, team athletes were recruited across Italy, Germany and Greece and provided data on the new team measures. Only athletes participating in the third study provided data on doping intentions.ResultsThe findings of the three studies supported the empirical goals of the investigation and provided evidence for the factor structure, reliability and validity of the team instruments. Furthermore, multi-group findings supported the hypothesis that the new instruments would have equivalent measurement and validity characteristics across the three European countries. The conclusions focus on the conceptual and practical implications of these findings.     

Psychometric properties of the OCI-R in a college sample

Two studies examined the psychometric properties of the Obsessive-Compulsive Inventory-Revised (OCI-R; Psychol. Assessment 14 (2002) 485) in a nonclinical student sample. In Study 1, we investigated the factor structure and internal consistency of the OCI-R using a sample of 395 undergraduate students. At a second testing session 1 month later, 178 students completed the OCI-R. Test-retest reliability was examined using data from 94 students who completed the OCI-R in both sessions. Convergent validity was also assessed with the Maudsley Obsessive-Compulsive Inventory (MOCI). In Study 2, we further investigated the convergent and divergent validity of the OCI-R using a new sample of 221 students who completed a battery of measures of obsessive-compulsive symptoms, worry, and depression. There was a significant order effect for both the OCI-R and the MOCI: means of each measure were significantly lower when presented second. Despite the order effect, statistical analyses indicated that the OCI-R has adequate test-retest reliability for the full scale and subscale scores, solid factor structure, and high internal consistency. Convergent validity with other measures of obsessive-compulsive symptoms was moderate to excellent, and divergent validity was good. The results indicate that the OCI-R is a short, psychometrically sound self-report measure of obsessive-compulsive symptoms.     

Different randomized multiple-baseline models for different situations: A practical guide for single-case intervention researchers

Single-case researchers often implement multiple-baseline designs as their preferred methodology for intervention evaluations. Recent writings and empirical investigations have argued in favor of incorporating various forms of randomization into such designs for the purpose of elevating the intervention study's internal validity and scientific credibility. In this article, we consider a variety of randomized multiple-baseline designs and associated randomization statistical tests, along with their potential strengths and limitations. In what amounts to a practical guide, we refer school psychology researchers to these versatile randomization procedures for planning and executing their intervention studies.     

The limits of empirical studies on research ethics

The results of empirical research in psychology and psychiatry are increasingly being used to formulate as well as understand problems at the interface of law and psychiatry. There has been a proliferation of studies, such as the determinants of individual competence or threat to self or others, the results of which are influencing policy and legislative decisions as well as buttressing holdings in court cases. In this article, I explore the issues of interpretation of epidemiological studies, particularly the role of ideological positions on the design and results of empirical findings, the importance of the way data are interpreted, and the role of ideologies in the way research findings are presented to provide support for policy positions. Two levels of analysis are involved in determining the validity of a study. The first addresses the questions of whether the study meets the statistical and epidemiological requirements for reliable results. These include considerations such as the appropriateness of the study design and methods for gathering and interpreting data. The second focuses on the underlying framework of the study. This involves factors such as the perspectives and values of those conducting the study, the explicit and implicit dominating ideologies where they operate, and the extent to which the study is constructed to reaffirm specific ideologies. This level of analysis is essential for disclosing the influences of ideologies on the results of studies and the way in which data are interpreted. In this article, I try to demonstrate through critiques of selected studies that the first stage of analysis is insufficient without an examination of underlying preconceived values to establish the meaningfulness of results.     

Intraclass correlation associated with therapists: estimates and applications in planning psychotherapy research

It is essential that outcome research permit clear conclusions to be drawn about the efficacy of interventions. The common practice of nesting therapists within conditions can pose important methodological challenges that affect interpretation, particularly if the study is not powered to account for the nested design. An obstacle to the optimal design of these studies is the lack of data about the intraclass correlation coefficient (ICC), which measures the statistical dependencies introduced by nesting. To begin the development of a public database of ICC estimates, the authors investigated ICCs for a variety outcomes reported in 20 psychotherapy outcome studies. The magnitude of the 495 ICC estimates varied widely across measures and studies. The authors provide recommendations regarding how to select and aggregate ICC estimates for power calculations and show how researchers can use ICC estimates to choose the number of patients and therapists that will optimize power. Attention to these recommendations will strengthen the validity of inferences drawn from psychotherapy studies that nest therapists within conditions.