Choosing Between Parametric and Nonparametric Tests

A fundamental analysis decision confronting researchers in psychology and education is the choice between parametric and nonparametric tests. Despite the statistical and substantive implications of this important decision, many researchers unerringly employ parametric tests and thus ignore the advantages of their nonparametric counterparts. One justification for this behavior has been the absence of guidelines for choosing between these procedures. A second has been the lack of a comprehensive nonparametric test that is computationally manageable. In this article, the author discusses several statistical and substantive criteria that can be used to choose between parametric and nonparametric tests. A non-parametric test capable of testing a number of statistical hypotheses using existing computer packages is also presented. Recommendations are made encouraging researchers to routinely use nonparametric tests in their data analytic work.     

On between-subjects versus within-subjects comparisons in testing utility theory

Empirical studies of expected utility theory often employ a between-subjects design. This practice has been recently criticized by J. C. Hershey and P. J. H. Schoemaker (1980, Organizational Behavior and Human Performance, 25, 395–418). The present paper provides a critical analysis of the controversial issues concerning the use of between-subjects vs within-subjects comparisons. It is claimed that the choice of experimental design should be determined, among other things, by theoretical aspects (e.g., the interpretation of utility theory) and the nature of the scientific problem. Following, we present relevant psychological considerations and conclude that, in the context of testing utility theory, a between-subjects design will often be more desirable. We then describe three different hypotheses that a researcher may be interested in testing, and identify the appropriate design for testing each of these hypotheses. The relationships between the different hypotheses are discussed. We apply our framework to reanalyze the reflection effect and compare it with the analysis proposed by Hershey and Schoemaker (1980). Methodological implications for future research are briefly discussed.     

Adolescent Strategies for Coping With Cultural Diversity

This investigation tested H. L. K. Coleman's (1995b) hypotheses that the strategies adolescents use to cope with cultural diversity will be organized in a sequential manner and that adolescents will use different strategies depending on the situation. To test these hypotheses, the authors had 398 adolescents rate the likelihood of using 6 strategies for coping with cultural diversity: Separation, Assimilation, Acculturation, Alternation, Integration, and Fusion. The authors make suggestions for future research, and implications for counseling are suggested.     

Duchenne Muscular Dystrophy: a Survey of Perspectives on Carrier Testing and Communication Within the Family

Carrier testing is widely available for multiple genetic conditions, and several professional organizations have created practice guidelines regarding appropriate clinical application and the testing of minors. Previous research has focused on carrier screening, predictive testing, and testing for X-linked conditions. However, family perspectives on carrier testing for X-linked lethal diseases have yet to be described. In this study, we explored communication within the family about carrier testing and the perspectives of mothers of sons with an X-linked lethal disease, Duchenne muscular dystrophy (DMD). Twenty-five mothers of sons with DMD participated in an anonymous online survey. Survey questions included multiple choice, Likert scale, and open ended, short answer questions. Analysis of the multiple choice and Likert scale questions revealed that most mothers preferred a gradual style of communication with their daughters regarding risk status. In addition, most participants reported having consulted with a genetic counselor and found it helpful. Comparisons between groups, analyzed using Fisher’s exact tests, found no differences in preferred style due to mother’s carrier status or having a daughter. Thematic analysis was conducted on responses to open ended questions. Themes identified included the impact of family implications, age and maturity, and a desire for autonomy regarding the decision to discuss and undergo carrier testing with at-risk daughters, particularly timing of these discussions. Implications for genetic counseling practice are discussed.     

Toward a Methodology of Experimental Analysis and Treatment of Aberrant Classroom Behaviors

A behavior analytic methodlogy for linking assessment and intervention for aberrant classroom behavior is presented. This methodology assists the behavioral consultant and classroom teacher in looking at the environmental variables that support undesirable behavior in three ways: structurally, functionally, or through some combination of the two approaches. Treatment strategies arising from the analysis may then be implemented. The methodology consists of the following steps: (a) problem identification, (b) data collection to generate hypotheses, (c) formulation of hypotheses regarding structural and functional relations, (d) design of analogue conditions to test the hypotheses, (e) conducting the analysis, and (f) treatment development and evaluation. An example of a structural analysis and treatment of the stereotypic behavior of an 8-year-old girl functioning in the severe-profound range of mental retardation conducted by her teacher in a special education classroom is presented.     

Information-gathering processes: Diagnosticity,hypothesis-confirmatory strategies,and perceived hypothesis confirmation

Recent research has investigated the information-gathering strategies that people employ as they attempt to test hypotheses. Three such strategies of information seeking were examined. Two kinds of hypothesis-confirmation strategies were considered. The first of these concerned evidence being sought to the extent that it is more likely under the hypothesis being tested than under the alternative. The second kind of hypothesis-confirmation strategy refers to the tendency to ask questions that will have the effect of making the hypothesis under test appear to be true. In addition, a third kind of strategy is a diagnosing strategy under which people prefer evidence that is most differentially probable under the hypothesis and the alternative. Important changes in methodology from past work were made, and the data supported a predominant diagnosing strategy and a less significant, but nonetheless strong and consistent, tendency to ask hypothesis-confirming questions. In addition, subjects' choice of questions made it likely that they would perceive as confirmed the specific hypotheses they were testing. This occurred even though the questions employed were not constraining. Discussion involves the strategies of information gathering and the reasons underlying them as well as the implications of these strategies for the inferences people make about their predictive abilities.     

The attraction effect in decision making: superior performance by older adults

Previous work showed that older adults' choice performance can be wiser than that of younger adults (Tentori, Osherson, Hasher, & May, 2001). We contrasted two possible interpretations: a general expertise/wisdom view that suggests that older adults are generally more skilled at making decisions than younger adults and a domain-specific expertise view that suggests that older adults are more skilled decision makers only in domains in which they have greater knowledge. These hypotheses were contrasted using attraction effect tasks in two different domains: earning extra credit in a course and grocery shopping, domains presumed to be of different levels of knowledge to younger and older adults. Older adults showed consistent choice for both domains; younger adults showed consistent choice only for the extra credit problem. Several explanations of these findings are considered, including Damasio's somatic marker theory and age differences in reliance on heuristic versus analytic styles.     

Affect,Reason, and Persuasion Advertising Strategies That Predict Affective and Analytic-Cognitive Responses

Advertisements are messages designed with the goal of persuasion and can therefore be considered as ecologically valid examples of persuasive messages. The study of responses to advertisements can provide insights into the interplay of affective and analytic-cognitive aspects of the persuasion process. This study develops and tests hypotheses concerning the relationship of specific advertising strategies to affective (syncretic-cognitive) and analytic cognitive responses in the audience. Specifically, it is postulated that different advertising strategies predict different patterns of affective and analytic cognition with product involvement and other relevant variables controlled. Two hundred forty advertisements are analyzed both in terms of their strategy attributes and the reactions they evoke. Advertising strategy variables are demonstrated to account substantially for the variance in affective and analytic cognition.     

Assessing the evidence for a cue-induced trade-off between capacity and precision in visual working memory using mixture modelling and Bayesian model comparison

There is considerable debate regarding the ability to trade mnemonic precision for capacity in working memory (WM), with some studies reporting evidence consistent with such a trade-off and others suggesting it may not be possible. The majority of studies addressing this question have utilized a standard approach to analysing continuous recall data in which individual-subject data from each experimental condition is fitted with a probabilistic model of choice. Estimated parameter values related to different aspects of WM (e.g., the capacity and precision of stored items) are then compared using statistical tests to determine the presence of hypothesized differences between experimental conditions. However, recent research has suggested that the standard approach is flawed in several respects. In this study, we presented participants with behavioural pre-cues informing them about the upcoming number of to-be-remembered items (high- vs. low-load) with the goal of inducing a trade-off between capacity and precision. The data were then analysed using the standard analytical approach and a more rigorous Bayesian model comparison (BMC) approach. The second approach involved generating a set of probabilistic models whose priors reflect different hypotheses regarding the effect of our key experimental manipulations on behaviour. Our results demonstrate that these two approaches can produce notably different results. More specifically, the standard analysis revealed that a high- versus a low-load cue resulted in higher capacity and lower precision parameter estimates, suggesting the presence of a trade-off between capacity and precision. However, the more rigorous BMC analysis revealed that it was very unlikely that participants employed a behavioural strategy in which they sacrificed mnemonic precision to achieve higher storage capacity. In light of these differences, we advocate for a more stringent approach to model selection and hypothesis testing in studies implementing mixture modelling.     

Social exclusion and choice: The moderating effect of power state

When encountering two product options in which one has been chosen by minority and the other by majority, what will influence consumers to make a choice? Although much research has solved this question, this research will address these issues from different perspectives by examining the interplay of power state and social exclusion on consumer choice. Drawing on power approach/inhibition and distinctive theories, we propose that the individuals in low power state prefer more distinctive products when they are in social exclusion than in social inclusion. In contrast, the individuals in high power state prefer less distinctive products when they are in social exclusion than in social inclusion. Two studies were conducted to confirm the hypotheses. Specifically, study 1 confirms our hypotheses by manipulating social exclusion and power state. And study 2 further confirms our hypotheses through using different experimental stimuli and a behavioral measure of choice. The theoretical and practical implications of this research are provided. Copyright © 2016 John Wiley & Sons, Ltd.     

On the costs and benefits of faces and words: process characteristics of feature search in highly meaningful stimuli

The authors present a comprehensive consideration of the process characteristics of visual search in contexts that vary in their meaningfulness. The authors frame hypotheses regarding process architecture, stopping rule, capacity, and channel independence, using analytic results and a rigorously specified dynamic system to characterize a set of alternative hypotheses that vary along all of these dimensions. Results of the tests of these hypotheses suggest that process architecture and the stopping rule do not distinguish the processing of meaningful and meaningless forms. The major distinction between configural and nonconfigural processing was with regard to processing capacity, potentially implicating channel interdependencies. All of these conclusions hold for both faces and words.     

Toward a theoretical model to understand teacher emotions and teacher burnout in the context of student misbehavior: Appraisal, regulation and coping

Compared with other professions, teachers in P-12 schools appear to experience a higher level of emotional exhaustion (see review in Maslach et al. in Ann Rev Psychol 52(1):397, 2001; Schaufeli and Enzmann in The burnout companion to study and practice: a critical analysis, Taylor & Francis, Philadelphia, 1998). The purpose of this study is to examine teacher emotions within the context of teachers’ appraisals and the ways they regulate and cope with their emotions. The study explores teachers’ appraisals of disruptive classroom behavior situations and investigates the adaptive coping and emotion regulation strategies that ease teacher burnout. Data were collected from 492 teachers in the US Midwest and subjected to hypothesis testing using structural equation modeling. The model provides evidence supporting a pathway between teachers’ antecedent judgments and their experience of emotion, as well as providing evidence for how the consequent emotions contribute to teachers’ feelings of burnout. This study further validates the relationships between the appraisals teachers make about an incident and the correlative intensity of emotions. Several hypotheses are either supported or partially supported after testing alternate models. Discussion and implications regarding teacher emotion regulation and coping are provided.     

Testing hypotheses about the self: Assessments of job suitability1

This investigation examined the strategies employed by individuals when testing hypotheses about the self. Participants known to possess masculine, feminine, or androgynous sex role identities tested hypotheses about their suitability for one of two jobs: either a job characterized in terms of the attributes and aptitudes typically associated with a “masculine” personality, or one characterized in terms of those typically associated with a “feminine” personality. When testing these hypotheses about themselves, participants preferentially reported those aspects of themselves that would suggest their suitedness rather than their unsuitedness for the job under consideration regardless of their sex role identity. Moreover, subsequent judgments of job suitability were positively related to the amount of suitedness evidence reported, but unrelated to the amount of unsuitedness evidence reported. Some consequences of these strategies for testing hypotheses about the self are discussed.     

Externalizing Behavior Problems and Discipline Revisited: Nonlinear Effects and Variation by Culture,Context, and Gender

Debate continues regarding the magnitude and importance ofparenting effects on the development of children's externalizing behavior problems, in spite of the evidence that environments (as well as genes) contribute to individual differences in these behaviors. Research has demonstrated an association between harsh physical discipline and child aggression and conduct problems, a likely causal mechanism that probably operates as a shared environmental factor. We offer four hypotheses about the relation between discipline practices and child externalizing problems that may resolve some debate and help lead toward a more comprehensive understanding of how and when discipline practices will make a substantial difference: 1. The association between discipline and child aggression includes a nonlinear component. 2. The parent behavior-child behavior link varies across cultural groups. 3. Parental discipline effects on children vary according to the context of the broader parent-child relationship. 4. The discipline effect is maximized in same-gender parent-child dyads. Discussion focuses on the role of children's mental representations of discipline experiences as a mediator of discipline effects, and research implications with respect to sampling, measurement, and analytic strategies are noted.     

Modeling the Ecological Validity of Neurocognitive Assessment in Adults with Acquired Brain Injury

Neuropsychologists are increasingly asked to make judgments regarding treatment options and rehabilitation strategies in addition to evaluating the degree and scope of neuropsychological impairment following acquired brain injuries. The capacity to make informed clinical decisions relies upon research investigating the relationships between neuropsychological and psychosocial status (i.e., ecological validity). Unfortunately, much of this research employs exploratory analyses, an approach that can lead to theoretical ambiguity and ad-hoc interpretations. The current availability and accessibility of analytical tools, like structural equation modeling (SEM), however, permits the testing of specific hypotheses regarding ecological validity and promotes a-priori theory development. In the current study, a theory-driven model of the ecological validity of a neurocognitive assessment was tested against data obtained from individuals with acquired brain injury using SEM. The results provide confirmatory evidence for the ecological validity of neurocognitive constructs and empirical support for a theory-driven analytical approach to ecological validity research.     

On shame,countertransference, and analytic style

Some analysands experience a restricted space in the analytic situation with special counter-transferential consequences. The author discusses how shame is involved in these situations, and projected on to the analyst. This leads to an important choice of direction for the analyst regarding counter-transference acting out or conditions for a real analytic situation. Shame plays a special rôle in these choices of direction. The author illustrates the problem with a clinical vignette and shows how integration of shame is accomplished clinically, and continues with a discussion of the connections between the analyst's analytic style, his own communicative style as a defense against shame and the analytic styles of different analytic “schools”. A discussion of Liberman's concept, of “asymmetrical dialogue” and its connection with countertransference acting out and analytic styles, forms a conclusion to the paper.     

A method for studying the analysis of aspects of the patient's experience of the relationship in psychoanalysis and psychotherapy

We have described a coding scheme for obtaining an objective account of the analysis of resisted aspects of the patient's experience of the relationship with the therapist in single, audio-recorded sessions of psychoanalysis and psychotherapy. The focus is on what is often regarded as an important first step in the analysis of transference: the identification and exploration of the preconscious points of attachment of transference ideas in the here-and-now. Related to the scheme is the view that there is generally a plausible basis in the here-and-now for the patient's ideas about the therapist. The implications of that view for the concept of transference are discussed. Future directions for research are noted, including improving the reliability of the scheme and testing various hypotheses regarding how the particular step in technique assessed by the method affects other aspects of the process and outcome.     

Statistical testing and null distributions: what to do when samples are not random.

Selected literature related to statistical testing is reviewed to compare the theoretical models underlying parametric and nonparametric inference. Specifically, we show that these models evaluate different hypotheses, are based on different concepts of probability and resultant null distributions, and support different substantive conclusions. We suggest that cognitive scientists should be aware of both models, thus providing them with a better appreciation of the implications and consequences of their choices among potential methods of analysis. This is especially true when it is recognized that most cognitive science research employs design features that do not justify parametric procedures, but that do support nonparametric methods of analysis, particularly those based on the method of permutation/randomization.     

A response set analysis of developmental differences in children's moral judgments

The study tested the hypotheses that 1) children may not adopt a moral response set when faced with moral dilemmas and 2) their knowledge of what constitutes a moral constellation of behaviors may differ from that of adults and may lead to developmental differences. To test these hypotheses, the study examined children's responses to a multiple choice moral dilemmas questionnaire under neutral instructions, instructions to answer as a good child or as a bad child. Subjects in fourth and seventh grade were asked whether a story hero would transgress and were required to justify their answers. In addition, questions regarding affective reactions to transgressions, confessions, and due punishment were asked. Fourth grade children answering in the good child instructions condition tended to give significantly different responses than under neutral instructions, while seventh grade subjects did not tend to differentiate between these two instruction conditions. While adult theories of morality would predict a differentiation between good and bad child instructions, on some of the measures no differences were found between good and bad child instructions. The implications of these results for cognitive-developmental theory were discussed and a general framework for interpreting the data was offered.     

Intelligence analysts’ strategies for solving analytic tasks

Analytic performance may be assessed by the nature of the process applied to intelligence tasks and analysts are expected to use a “critical” or deliberative mindset. However, there is little research on how analysts do their work. We report the findings of a quantitative survey of 113 intelligence analysts who were asked to report how often they would apply strategies involving more or less critical thinking when performing representative tasks along the analytic workflow. Analysts reported using “deliberative” strategies significantly more often than “intuitive” ones when capturing customer requirements, processing data, and communicating conclusions. Years of experience working in the intelligence community, skill level, analytic thinking training, and time spent working collaboratively (opposed to individually) were largely unrelated to reported strategy use. We discuss the implications of these findings for both improving intelligence analysis and developing an evidence-based approach to policy and practice in this domain.