The effect of dimension content on observation and ratings of job performance

Recent theory and research in the performance appraisal area (e.g., Denisi, Cafferty, & Meglino, 1984; Feldman, 1986; Ilgen & Feldman, 1983; Williams, Denisi, & Blencoe, 1985) have suggested that providing information regarding the performance dimension to be rated will cause raters to select appropriate observational schemata and, as a result, produce higher quality ratings. A study was conducted to determine if giving raters dimension-relevant information prior to performance observation would affect their attention processes and rating quality. Prior to watching a videotape of an instructor giving a lecture, 156 subjects were given either: 1) correct information, 2) incorrect information, or 3) no information regarding dimensions of performance they would subsequently be asked to rate. The results indicated that giving prior information regarding dimension content affected subjects' attention processes. Further, raters receiving no information and those receiving misinformation prior to performance observation produced less accurate ratings compared to expert raters. Ratings produced by subjects receiving correct information did not differ significantly from experts' ratings. These results are discussed in terms of both their practical and theoretical implications.     

Reducing the Biological and Psychological Toxicity of Poverty-related Stress: Initial Efficacy of the BaSICS Intervention for Early Adolescents

This proof-of-concept study tests the initial efficacy of the Building a Strong Identity and Coping Skills (BaSICS) intervention, a selective prevention of internalizing problems program for early adolescents exposed to high levels of poverty-related stress. Eighty-four early adolescents (M_age = 11.36 years) residing in very low-income neighborhoods were randomized to receive the 16-session intervention (n = 44) or to an assessment-only control condition (n = 40). BaSICS teaches coping skills, social identity development, and collective social action to empower youth with the ability to connect with members of their communities and cope with poverty-related stress in positive and collaborative ways. Pretest–posttest analyses showed that intervention adolescents acquired problem-solving and cognitive-restructuring skills and reduced their reliance on avoidant coping. In addition, HPA reactivity was significantly reduced in the intervention youth, but not controls. Finally, intervention youth's internalizing and somatic symptoms as reported by both youth and their parents, showed significant reductions over time, whereas control youth had no such changes. Results provide strong support for this approach to strength-building and symptom reduction in a population of early adolescents exposed to poverty-related stress.     

Commentaries on “Beyond statistical significance: Five principles for the new era of data analysis and reporting”

Three commentaries below provide different perspectives on data analysis and reporting. They generally focus on how the quality of the measures and manipulations determines the value of the analysis. Norbert Schwarz and Fritz Strack's comment is less on the right statistic and more on “sloppy reasoning, gaps between theoretical concepts and their operationalizations, and blissful ignorance of the situated nature of human thinking, feeling, and doing contribute more to the limited reproducibility of empirical findings than the choice of a particular test statistic.” They propose that particular effects are contextual and inappropriately labeled as true or false. Instead, our job is to focus on general constructs that make sense of the diversity of human experience and psychological reactions. Too often studies replicating psychological effects in the noisy and confounded conditions of the marketplace result in statistical uncertainty of garbage in, garbage out. Researchers instead need to look toward tests of specific interactions, which can clarify the influencing factors based on theoretical considerations. The second comment is by Andrew Gelman, an outstanding psychological statistician. He proposes that “once the data have been collected, the most important decisions have already been done.” He then provides four recommendations that enable the statistics to work appropriately. The first requirement of an effective study is to be sure that the measures address the construct of interest. Similar to the position of Schwarz and Strack, it is important to articulate the relevance of a statistically significant finding. The second recommendation seeks to curb large number of studies with inflated effect sizes built from narrow studies and unwarranted optimism. The third recommendation is to simulate data from a model and consider the distribution of possible results. That is often done to test a new analysis method, but it can be even more important in marketplace studies where novel characteristics of the sample and experimental conditions are included in the analysis. Finally, he recommends that one consider likely analyses needed before getting the data. Such foresight would encourage, for example, thinking about the kind of data needed to defend the equality of the control demographics against the treatment. The final commentary is by Stijn van Osselaer. He agrees that p-values reflect the detailed methods from a given study but do not focus on the problem of generalizability. Like Gelman, he sees designs focused on effect sizes may have generated too many studies that do not replicate. He contrasts broad explorations with narrowly defined existence tests that provide evidence that an effect exists somewhere but are mute on other contexts where they may apply. For theoretical problems relevant to applications, it is important to identify moderators through broad sampling across population characteristics, stimuli, and situations. He proposes that consumer psychologists should not try to do everything in one paper, but to build practically relevant, applicable knowledge across multiple articles. Different articles, authors, and research methods play various roles, with each article focusing on important stages in the process from generating hypotheses, providing existence proofs, and exploring their broad applicability. That pragmatic approach can integrate theoretical silos that seek to resolve complex human problems and has promise as a criterion for relevant publications.     

The comparative effectiveness of distributed and colocated team after-action reviews

Despite their frequent use in the military and private sectors, the comparative effectiveness of colocated and distributed after-action reviews (AARs) is relatively unknown. Consequently, this study examined the comparative effectiveness of colocated and distributed AARs across taskwork and teamwork outcomes. Data were obtained from 492 participants randomly assigned to 123 four-person teams who participated in one of six AAR conditions. The results indicated that teams in the AAR conditions had significantly higher performance and team efficacy scores than the teams in the non-AAR conditions. In summary, the findings highlight that regardless of the training environment or type of AAR, the AAR remains an effective method at increasing performance and other outcomes. Therefore, the use of distributed AARs does not engender the posited process losses that were hypothesized.     

Minimal Risk of Internalizing Problems in Typically-Developing Siblings of Children with High-Functioning Autism Spectrum Disorder

We examined anxiety and depression clinical symptom levels in 42 typically-developing (TD) siblings of children with high-functioning autism spectrum disorder (HFASD), compared to 42 TD siblings of TD children, matched on age, ethnicity, and gender. Participants were between the ages of 6 and 16. Groups were compared using the parent-report and child self-report versions of the Behavior Assessment System for Children, Second Edition, anxiety and depression clinical scales. Within-group differences were examined for parent versus child ratings. Multivariate procedures did not support clinically elevated levels of internalizing problems in siblings of children with HFASD. Results from both sources were consistent with the overall finding. The findings do not support an increased need for targeted intervention, though clinical and school-based practitioners should attend to clinical warning signs if presented.     

Intimate partner violence and preschoolers' explicit memory functioning.

This research examines whether parents' intimate partner physical violence (IPV) relates to their preschoolers' explicit memory functioning, whether children's symptoms of hyperarousal mediate this relation, and whether mothers' positive parenting moderates this relation. Participants were 69 mothers and their 4- or 5-year-old child (34 girls). Mothers completed measures of IPV, children's hyperarousal symptoms, parent-child aggression, and positive parenting. Measures of explicit memory functioning were administered to preschoolers. As expected, IPV correlated negatively with preschoolers' performance on explicit memory tasks, even after controlling for parent-child aggression and demographic variables related to preschoolers' memory functioning. Preschoolers' hyperarousal symptoms did not mediate the relation between IPV and explicit memory functioning, but mothers' positive parenting moderated this relation. Specifically, the negative relation between IPV and preschoolers' performance on 2 of the 3 explicit memory tasks was weaker when mothers engaged in higher levels of positive parenting. These findings extend research on IPV and children's adjustment difficulties to explicit memory functioning in preschoolers and suggest that mothers can ameliorate the influence of IPV on preschoolers' memory functioning via their parenting.     

At the boundaries of automaticity: negation as reflective operation

The present research investigated whether automatic social-cognitive skills are based on the same representations and processes as their controlled counterparts. Using the cognitive task of negating valence, the authors demonstrate that enhanced practice in negating the valence of a stimulus can lead to changes in the underlying associative representation. However, procedural, rule-based components of negations were generally unaffected by practice (Experiments 1-3). Moreover, negations of evaluative stimuli did not influence automatic evaluative responses to these stimuli, unless the negation was included in the associative representation of a stimulus (Experiments 4-6). These results suggest that some practice-related skill improvements are limited to conditions in which a general procedure can be substituted by the retrieval of results of previous applications from associative memory. Implications for research on automaticity and social cognition are discussed.     

A field examination of two measures of work motivation as predictors of leaders' influence tactics

The authors tested 2 motivation measures, the Motivation Sources Inventory (MSI; J. E. Barbuto & R. W. Scholl, 1998) and the Job Choice Decision-Making Exercise (A. M. Harrell & M. J. Stahl, 1981) as predictors of leaders' influence tactics. The authors sampled 219 leader-member dyads from a variety of organizations and communities throughout the central United States. Results strongly favored the MSI as a predictor of influence tactics. Limitations of the study include low power of relationships, sample size as limited by the research design, and education levels of participants. Future researchers should use larger and more diverse samples and test other relevant antecedents of leaders' behaviors.