Participatory Evaluation: A Case Study of Involving Stakeholders in the Evaluation Process

ABSTRACT

One way to ensure that an evaluation has “utility” is to use a participatory evaluation approach where the evaluator partners with primary users to carry out various phases of an evaluation. This article provides a case study of how participatory evaluation was used in an out-of-school youth development and employment program at the Science Museum of Minnesota's Kitty Andersen Youth Science Center. Youth staff participated in a series of evaluation workshops where they learned about evaluation, made their own meaning of evaluation data, generated recommendations to improve their museum work, and ultimately took more ownership and control of their program. As a result of the workshops, youth also carried out their own formative evaluation of four museum programs. The program manager and the youth staff reaped a number of benefits from this process. The factors leading to its success are discussed.     

The Perpetrator-Motive Research Design: A strategy for understanding motivations,values, and tactics of criminal offenders

For decades, applied research in the field of behavioral criminology has been successfully utilized to develop theories and training modalities for the purpose of informing practice. One method for conducting this type of research is in-depth interviews of perpetrators. The Perpetrator-Motive Research Design (PMRD) is a 12-step methodological design, which focuses on gaining a thorough understanding of the motivations, values, needs, and tactics of those who commit offenses against others. PMRD has been employed in a pilot study conducted with captive-takers in the FBI's Global Hostage-Taking Research and Analysis Project (GHosT-RAP). Even though global captive-taking is a major domestic and international security problem that affects the interests of the United States, and poses serious challenges abroad, only a modicum of investigative attention has been directed to this problem. This void is addressed through the tripartite mission of GHosT-RAP: (1) to elicit and describe captive-taker values and paradigms, (2) to determine motivations and methods for captive-taking, and (3) to utilize resultant data to improve strategies for mitigation and prevention, preparedness, response, and recovery activities. In addition, GHosT-RAP will serve to formalize and operationalize the PMRD approach into a well-defined, systematic, and replicable process that can be used to better understand a myriad of offenders and their nominal enterprises.     

A Note on Family Acceptance Involving Interracial Friendships and Romantic Relationships

Perceptions of family acceptance concerning interracial friendships and romantic relationships were investigated in a group of 142 undergraduates. The Assessment Scale of Interracial Relationships (ASIR) was constructed by the authors and administered to 68 men and 74 women recruited from introductory psychology courses. Results showed that both men and women held negative attitudes toward interracial relationships, although Black students held more favorable attitudes than did White students. These findings also showed that the women were less accepting of interracial friendships and romantic relationships than the men were. Both Black and White students indicated that family perception of these interracial relationships would be negative.     

The Effect of Smiling and of Head Tilting on Person Perception

A survey on alcohol and drug use was completed by 1,291 college students. As predicted from research on self-schemas, greater self-efficacy was associated with lower substance use among respondents who indicated having been treated for substance abuse but not among those who had not received treatment. Also, those who reported receiving treatment were more likely than the others to report having attended campus programs on substance abuse. These findings suggest that substance use and its control are important aspects of the self-definition of those who receive treatment for substance abuse.     

Reasoning Ability in Young Children

The astrological assumption of personality differences among individuals born under different sun signs was investigated. Significant differences were obtained between sun sign groups on four of the 18 scales of the California Psychological Inventory (CPI) as follows: Communality, Socialization, Flexibility, and Femininity. The overall pattern of results based on F ratios, multiple comparisons between means, and estimates of strength of association was interpreted as showing no meaningful relationships between sun sign and scores on Communality, Socialization, and Flexibility. Adopting even the most conservative standards of inference, however, all of the test statistics employed indicated a powerful effect on the Femininity scale. Implications for future research were discussed.     

Changes in Immobility Responses in Rat Pups with Maternal Stimuli

Presentation of maternal stimuli to an isolated rat pup results in what has been called “comfort” responses, as indicated by both behavioral and physiological quieting. This experiment investigated the role of passive maternal stimuli on tonic immobility and dorsal immobility in 9- and 15-day-old rat pups. Although these stimuli appeared ineffective in inducing tonic immobility, presentation of the mother did produce an increase in duration of dorsal immobility in 15-day-old pups. This increase in the dorsal immobility response may reduce struggling in the presence of the mother and thereby aid the mother in transporting the infant back to the nest.     

Poly‐victimization and executive functions in junior college students

This study sought to characterize executive dysfunctions in poly‐victimized students without posttraumatic stress disorder (PTSD) symptoms and the relationship between neuropsychological and behavioral rating measures of executive functions (EFs). Based on self‐report data of exposure to victimization and PTSD symptoms, 259 junior college students aged 18–21 years were classified into four groups: poly‐victimization with PTSD symptoms (PVP), poly‐victimization without PTSD symptoms (PVnP), non‐poly‐victimization (nPV), and non‐victimization (nV). Respondents also completed the Behavior Rating Inventory of Executive Function‐Adult Version (BRIEF‐A). Of the 259 participants, 131 were administered a battery of neuropsychological tests from the Cambridge Neuropsychological Testing Automated Battery (CANTAB). The PVP group and the PVnP group performed worse than the nV group on most BRIEF‐A scales. When compared with the nPV group, the PVP group demonstrated poorer performance on the scales of Inhibit, Shift, Emotional Control, Initiate, and Working Memory, while the PVnP group performed more poorly on the Working Memory scale and the Task Monitor scale. For all BRIEF‐A scales, no significant differences were detected between the PVP group and the PVnP group. This study showed no between‐group differences for most of the neuropsychological tests except for the Stop Signal Task (SST), and no correlations between these two measures of EFs. Overall, we found evidence of an association between deficits in EFs and poly‐victimization. Although our study raises questions about the relationship between these two measures of EFs, it suggests that the use of the BRIEF‐A in conjunction with the CANTAB provides a more complete assessment of the executive dysfunctions.     

Spirituality and Substance Abuse Recovery

Researchers explored patient and staff perceptions of spiritual well-being and the spiritual needs of patients enrolled in a residential substance abuse treatment program. The Spiritual Well-Being Scale was used to gather quantitative data. Additionally, a brief questionnaire containing one qualitative and two quantitative questions was completed by both clients and staff. A statistically significant difference was found, indicating a more positive sense of spiritual well-being among patients upon discharge. Although the staff and clients of the residential program have similar perceptions regarding the concept of spiritual well-being, their definitions do not appear identical.