THE RIGORS OF TRAINING EVALUATION: A DISCUSSION AND FIELD DEMONSTRATION1

Training evaluation is one of the most under-researched and neglected areas of industrial/organizational psychology. This article discusses the need for, and feasibility of, utilizing extended-control-group pretest designs in evaluation research; and reports a field application of such a design (the Solomon 4-Group) in an organizational training context. The effectiveness of a basic electricity training program for telephone installer-repairmen was measured, and the potential contaminating effects of pretesting were monitored. The results indicated that the training was potentially effective, but that pretest contaminations were present. To identify the pretest effects it was necessary to go beyond the Solomon model and consider complex interactions involving numerical aptitude level, pretesting and training. Pretest exposure depressed the posttest performance of trained subjects of medium and low numerical aptitude, while facilitating that of medium level untrained subjects. Pretest exposure had no effect on subjects scoring high in numerical aptitude in either the trained or untrained condition. Possible explanations for the moderating role of numerical aptitude are offered, and implications of the findings are discussed relative to applied organizational evaluation efforts and future research.     

Cognitive consequences of playing brain-training games in immersive virtual reality

The goal of the present study was to examine the effects of playing an immersive virtual reality game that included a collection of gamified cognitive tasks, Cerevrum, on specific components of cognition, including perceptual attention, mental rotation, working memory, visualization, visual field of view, and visual processing speed. Participants completed a pretest of cognitive assessments, played one of the two mini-games within Cerevrum (Stardust or Heroes) for 1.5 hr over three 30-min sessions and then completed a posttest of cognitive assessments and a questionnaire about interest and engagement during the game. An inactive control group completed only the pretest and posttest. Results showed no significant differences among the Heroes group, Stardust group, and control group on the posttest scores, even when controlled for pretest scores. These findings do not support the claim that playing brain-training games for a short period results in transfer of cognitive training to nongame venues.     

Extremity shifts,risk shifts and attitude shifts after group discussion

Moscovici and Zavalloni (1969) suggest that both risk shifts and attitude shifts after group discussion are examples of a general group tendency to polarize opinions. In the present experiment, using both attitude and risk items, group discussion did not make individual opinions more extreme; only the group average became more extreme. This group extremity increase was not simply a more general way of conceptualizing the directional shifts in attitude and risk; group extremity increase appeared to be an effect of discussion that was independent of the risk and attitude shifts. Also, subjects in the co-working pretest of the standard risk-shift paradigm were found to be less extreme and more ‘agreeing’ than pretest subjects who were truly alone. This co-working/alone difference persisted after discussion and was not related to group extremity increase. On both attitude and risk items, group extremity increase was strongly correlated with group opinion convergence. It is argued from this correlation that group extremity increase may be an effect of some aspect of conformity influence.     

Evaluation of the Responding in Peaceful and Positive Ways (RIPP) Seventh Grade Violence Prevention Curriculum

We evaluated the impact of RIPP-7, a seventh grade violence prevention curriculum designed to strengthen and extend the effects of the sixth grade RIPP-6 curriculum. Classes of seventh graders at two urban middle schools serving predominantly African-American youth where RIPP-6 had been implemented the preceding school year were randomized to intervention (N = 239) and control groups (N = 237). Compared to students in the control group, students who participated in RIPP-7 had fewer disciplinary code violations for violent offenses during the following school year. A limited number of main effects were found on self-report outcome measures and measures of attitudes. Although significant main effects were not found on self-report measures of physical aggression, drug use, or anxiety, analyses of interactions with pretest scores indicated that intervention effects were significantly moderated by pretest scores for several outcome measures. Students most likely to benefit from the intervention were those who reported higher pretest rates of problem behaviors including violent behavior, nonphysical aggression, and delinquent behavior.     

Self‐Efficacy as a Moderator of the Effects of Job‐Search Workshops on Re‐Employment: A Field Experiment1

We investigated the additive and interactive effects of self‐efficacy as a possible moderator of the effects of a job‐search workshop on re‐employment outcomes. We recruited 659 recently unemployed respondents and randomly assigned them to an experimental group invited to participate in the job‐search workshop (n = 442), or a control group (n = 217). All respondents provided pretest data using self‐administered questionnaires, and posttest data using questionnaires mailed to them 1 and 6 months after the workshop. No direct effects of the intervention on re‐employment outcomes were found. The pretest–posttest change in self‐efficacy interacted with the experimental condition to predict 3 re‐employment outcomes. However, only 1 of the 3 moderating effects found supported our prior expectation in this regard.     

What is Said?

It is sometimes argued that certain sentences of natural language fail to express truth conditional contents. Standard examples include e.g. Tipper is ready and Steel is strong enough. In this paper, we provide a novel analysis of truth conditional meaning (what is said) using the notion of a question under discussion. This account (i) explains why these types of sentences are not, in fact, semantically underdetermined (yet seem truth conditionally incomplete), (ii) provides a principled analysis of the process by which natural language sentences (in general) can come to have enriched meanings in context, and (iii) shows why various alternative views, e.g. so‐called Radical Contextualism, Moderate Contextualism, and Semantic Minimalism, are partially right in their respective analyses of the problem, but also all ultimately wrong. Our analysis achieves this result using a standard truth conditional and compositional semantics and without making any assumptions about enriched logical forms, i.e. logical forms containing phonologically null expressions.     

Fostering At-Risk Kindergarten Children's Number Sense

A 9-month training experiment evaluated whether computer-assisted discovery learning of arithmetic regularities can facilitate kindergartners’ fluency with the easiest sums. After a pretest, kindergartners with at least one risk factor (n = 28) were randomly assigned to either a structured add-0/1 training condition, which focused on recognizing the n + 0/0 + n = n and the n + 1/1 + n = the number-after-n rules, or an active control group. Using pretest fluency as the covariate, ANCOVAs revealed that the structured add-0/1 group significantly outperformed the control group on both practiced and unpracticed (transfer) n + 0/0 + n and n + 1/1 + n items at the delayed posttest and had significantly larger gains in mathematics achievement. Key instructional implications include: Early intervention that targets discovering rules for adding with 0 and 1 and family-specific developmental prerequisites is feasible and more effective than typical classroom instruction in promoting fluency with such basic sums. Such rules may be a critically important bridge between informal and formal mathematics.     

Effect of pretesting on intentions and behaviour: A pedometer and walking intervention

This study addressed the influence of pedometers and a pretest on walking intentions and behaviour. Using a Solomon four-group design, 63 female university students were randomly assigned to one of four conditions: pedometer and pretest (n = 16), pedometer and no pretest (n = 16), no pedometer and pretest (n = 15), no pedometer and no pretest (n = 16). The pretest conditions included questions on walking, intentions to walk 12,500 steps per day, and self-efficacy for walking 12,500 steps per day. In the pedometer conditions a Yamax Digi-Walker SW-650 pedometer was worn for one week. All participants completed posttest questions. While significant pretest x pedometer interactions would have indicated the presence of pretest sensitisation, no such interactions were observed for either intention or self-reported walking. Wearing pedometers reduced intentions for future walking and coping self-efficacy. However, after controlling for pretest self-reported walking, pedometer use resulted in more self-reported walking. We conclude that wearing a pedometer increased self-reported walking behaviour but that a pretest did not differentially influence walking intentions, behaviour, or self-efficacy.     

The child in time: The influence of parent–child discussion about a future experience on how it is remembered

We investigated the influence of preparation provided by parents on preschoolers’ recall. One day before children participated in a staged novel event, parents discussed the event with their child either with (verbal+photos) or without (verbal) photographs. Parents and children in a control condition read an unrelated story. Then 8–10 days later the children were interviewed about the event. Children in the verbal+photos condition recalled significantly more than those in the control condition. Parental preparation style (e.g., evaluations, hypothetical language) was associated with the child's contributions to the preparatory discussion, but no aspect of parent or child style or content was associated with children's verbal recall. Similarly, there were no significant associations between children's performance on a task of episodic future thinking, and their preparatory discussion or recall, although episodic future thinking was strongly associated with language ability. The potential underlying mechanisms and theoretical implications are discussed.     

Studies of the Startle Pattern: IV. Infants

Individual versus group risk taking was examined by using a novel set of industrial product purchasing situations as stimuli. The set incorporated situations that varied along a dimension called “normative risk.” Situations represented either low-normative risk, medium-normative risk, or high-normative risk. Normative risk was defined in a decision theoretical context. The set was administered to introductory business students at a large university in the United States. The results of the study showed that groups were not invariably riskier than individuals; rather the amount of risky shift following group discussion was negatively related to the level of normative risk. This overall conclusion held true also in relation to the degree of perceived riskiness of the situations, since a positive relationship between normative risk and perceived risk was established. The theoretical implications of the results are discussed.     

A Rational-Emotive Treatment program with conduct disorder and attention-deficit hyperactivity disorder adolescents

This study investigated the effects of a 12-week treatment program, based on Rational-Emotive Therapy, with conduct disorder (CD) and attention-deficit hyperactivity disorder (ADHD) adolescents. Two independent homogeneous CD (N=12) and ADHD (N=12) groups were selected on the basis of the DSM-111-R and use of methylphenidate. The dependent variables were irrational thinking, depression, and anger. Lecture, discussion, and theYou Can Do It!Motivational Program video were used in the treatment intervention. Discriminant function analysis of pretest scores revealed that 96% of the students were correctly classified (CD=100%, ADHD=92%). Multivariate analysis of pre-posttest scores revealed that the CD group significantly changed on all dependent variables, while no significant differences were found with the ADHD group. A comparison of posttest scores on the measure of irrational thinking revealed that the CD group accepted responsibility for their upsetness and were more willing to change than the ADHD group. The results of the study are interpreted in terms of the distinguishing characteristics of each group.G. Barry Morris Ph.D., is Director of the Canadian Institute for Rational-Emotive Therapy. He is a Fellow and training supervisor in Rational-Emotive Therapy, a professor at the University of Saskatchewan, a licensed psychologist, and is engaged in private practice.     

Effect of Concurrent Visual Feedback Frequency on Postural Control Learning in Adolescents

The purpose was to find better augmented visual feedback frequency (100% or 67%) for learning a balance task in adolescents. Thirty subjects were divided randomly into a control group, and 100% and 67% feedback groups. The three groups performed pretest (3 trials), practice (12 trials), posttest (3 trials) and retention (3 trials, 24 hours later). The reduced feedback group showed lower RMS in the posttest than in the pretest (p = 0.04). The control and reduced feedback groups showed significant lower median frequency in the posttest than in the pretest (p < 0.05). Both feedback groups showed lower values in retention than in the pretest (p < 0.05). Even when the effect of feedback frequency could not be detected in motor learning, 67% of the feedback was recommended for motor adaptation.     

Improving Children's Mental Rotation Accuracy With Computer Game Playing

The authors investigated the relation between mental rotation (MR) and computer game-playing experience. Third grade boys (n = 24) and girls (n = 23) completed a 2-dimensional MR test before and after playing computer games (during 11 separate 30-min sessions), which either involved the use of MR skills (the experimental group) or did not involve the use of MR skills (the control group). The experimental group outperformed the control group on the MR posttest but not on the pretest. Boys outperformed girls on the pretest but not on the posttest. Children whose initial MR performance was low improved after playing computer games that entailed MR skills. The findings imply that computer-based instructional activities can be used in schools to enhance children's spatial abilities.     

Preschoolers out of adults: Discriminative learning with a cognitive load

This paper explores novel predictions from the spontaneous overtraining interpretation of human discrimination shift learning (Sirois & Shultz, 1998a). Results from six experiments where adults perform a discrimination shift task with or without a cognitive distractor are reported. In three experiments with a concurrent distractor task (Experiments 1A, 2A, and 3A), performance of adults is comparable to what would be expected from preschoolers performing only the learning task. These adults show no dimensional transfer from initial learning, unless new attributes are introduced in shift learning. On the same tasks without a cognitive load (Experiments 1B, 2B, and 3B), performance is typical of normal adults. The discussion focuses on the relative ability of competing theoretical models (i.e., levels of processing, attentional mediation, and perceptual differentiation) to account for these data.     

Development and training of role-taking abilities with emotionally disturbed preschoolers: A pilot study

The purposes of the present study were to verify whether emotionally disturbed preschoolers admitted to a medical day-care center would evidence a developmental lag in role-taking skills as compared to nondisturbed kindergartners and to study the effects of a training program with as its purpose to teach the MDC children to deal with their own and others' emotions. Forty-three children from a kindergarten (n=22; mean age of 4.11 years) and a medical day-care center (n=21; mean age of 4.11 years) participated in this study. The MDC children were randomly assigned to a control (n=9) and to a training condition (n=12). The training for the latter group covered a 10-week period. The results from this pretest and posttest design revealed no differences in performance for emotional role-taking (i.e., Borke-task) and social guessing (i.e., De Vries-task) between the disturbed and nondisturbed children on the pretest. On the posttest, however, a significant developmental lag was evident for the MDC-children who did not receive the training and those who did and the control group.     

Nonsuicidal Self‐Injury in Adolescents: Characterization of the Disorder and the Issue of Distress and Impairment

Nonsuicidal self‐injury disorder (NSSID) is a condition in need of further study to assess the validity of the potential diagnosis and its suggested criteria. This study examined the NSSID diagnosis and investigated the distress/impairment criterion by comparing community adolescents who met all criteria for NSSID (n = 186) to adolescents with five or more nonsuicidal self‐injury (NSSI) episodes (n = 314), and to a group of adolescents who met all criteria but negated that their NSSI caused them any distress or impairment, thus failing to meet criterion E (n = 29). The NSSID group delimited from the ≥ 5 NSSI group by reporting significantly more frequent and severe self‐injurious thoughts and behaviors, as well as having more experiences of negative life events and higher levels of trauma symptoms. There were also some differences between the NSSID group and adolescents without distress/impairment, which together contribute valuable information on the potential NSSID diagnosis, as well as the discussion of criterion E.     

German Abstract

The magnitude of the cultivation effect for perceptual estimates of social reality has been shown to be affected by a number of contextual factors such as source priming and motivation to process information during judgment construction, and these contextual factors have been linked to the use of heuristic processing strategies when constructing judgments of frequency and probability ( L. J. Shrum, in press ). An experiment that manipulated data collection method explored the implications of these findings. A random sample of general population respondents were randomly assigned to either telephone or mail survey conditions. Because telephone surveys generally result in greater heuristic processing than mail surveys, telephone surveys were expected to produce larger cultivation effects than mail surveys. Results showed that not only were the magnitude of the estimates of affluence, crime, vice, marital discord, and occupations generally greater in the telephone than in the mail survey but the correlation of the estimates with amount of viewing was also greater in the telephone than in the mail survey. The implications for measuring the cultivation effect are discussed.     

Reducing Implicit Stigmatizing Beliefs and Attitudes Toward Depression by Promoting Counterstereotypic Exemplars

Stigma prevents people with depression from seeking professional help, and effective strategies to reduce implicit stigmatizing beliefs and attitudes toward depression are needed. We developed stepwise strategies to promote counterstereotypic exemplars of people with depression and conducted an experiment (N?=?105) with a pretest–posttest control group design to examine effects of these strategies. Our results showed that implicit stigmatizing beliefs and attitudes were reduced more in the experimental group, in which the counterstereotypic strategies were implemented in addition to the provision of education regarding basic knowledge of depression, than in the control group, which received only education.     

Group Psychotherapy by Florence B. Powdermaker and Jerome D. Frank

Subjective countertransference can sharply limit any group leader's effectiveness. However, a therapist can use the group itself to identify such a bias and to remove it as an influence. A five-step method for doing this is presented. These steps begin with introspection but hinge upon the analyst's turning to the group for the vital information that, in the end, clarifies the analyst's own perceptions and helps him or her free the group from the harmful effects of any bias.