Combining quantitative and qualitative methods in evaluating a course of family therapy

This paper reports on the use of a single case (A-B) design, with multiple measures of first and second order change and family satisfaction. A within-session process analysis was also made. Second order change was found to relate most clearly to the process of sessions. The single case design and process study is easy to apply in practice and is a potential response to clinical audit. The problems of combining quantitative and qualitative approaches are discussed.     

Linking qualitative and quantitative methods in cross-cultural survey research: Techniques from cognitive science

Survey research with diverse cultural and ethnic minority groups is a complex and challenging endeavor that confronts the researcher with problems related to linguistic and conceptual equivalence and measurement as well as problems related to difficulties that respondents have with the sociocultural dimensions of the survey/interview process. One way to improve the quality of cross-cultural surveys and to insure that the findings are culturally relevant and accurate is to combine qualitative and quantitative methods. This paper proposes that certain qualitative techniques from cognitive science, specifically cognitive anthropology and cognitive psychology, are particularly well suited to being combined with survey research. These techniques provide information corresponding to the underlying thought processes of respondents and enable researchers to better understand how different cultural and ethnic groups construe the world. The information obtained can be used improve the formulation of survey questions, design and structure questionnaire formats to coincide with the way particular groups organize concepts, and help researchers understand difficulties respondents may have with the survey/interview process. In addition, the techniques produce data that are easily codifiable and more manageable than traditional qualitative techniques including participant observation and in-depth interviews.     

Representations of qualitative and quantitative dimensions

Geometric representations of psychological dimensions are analyzed and compared to an alternative set-theoretical approach. Judgments of similarity between forms and figures reveal the following effects: (a) qualitative attributes are curved relative to quantitative attributes, contrary to intradimensional subtractivity; (b) quantitative attributes augment differences in qualitative attributes, contrary to interdimensional additivity; (c) adding a new dimension with a fixed value increases similarity, contrary to translation invariance. The implications of these results to multidimensional representations of proximity data are discussed.     

Evaluating sources of baseline data using dual-criteria and conservative dual-criteria methods: A quantitative analysis

Scheithauer et al. (2020) recently demonstrated that differences in the source of baseline data extracted from a functional analysis (FA) may not affect subsequent clinical decision-making in comparison to a standard baseline. These outcomes warrant additional quantitative examination, as correspondence of visual analysis has sometimes been reported to be unreliable. In the current study, we quantified the occurrence of false positives within a dataset of FA and baseline data using the dual-criteria (DC) and conservative dual-criteria (CDC) methods. Results of this quantitative analysis suggest that false positives were more likely when using FA data (rather than original baseline data) as the initial treatment baseline. However, both sources of baseline data may have acceptably low levels of false positives for practical use. Overall, the findings provide preliminary quantitative support for the conclusion that determinations of effective treatment may be easily obtained using different sources of baseline data.     

Personality and leadership: a qualitative and quantitative review

This article provides a qualitative review of the trait perspective in leadership research, followed by a meta-analysis. The authors used the five-factor model as an organizing framework and meta-analyzed 222 correlations from 73 samples. Overall, the correlations with leadership were Neuroticism = -.24, Extraversion = .31, Openness to Experience = .24, Agreeableness = .08, and Conscientiousness = .28. Results indicated that the relations of Neuroticism, Extraversion, Openness to Experience, and Conscientiousness with leadership generalized in that more than 90% of the individual correlations were greater than 0. Extraversion was the most consistent correlate of leadership across study settings and leadership criteria (leader emergence and leadership effectiveness). Overall, the five-factor model had a multiple correlation of .48 with leadership, indicating strong support for the leader trait perspective when traits are organized according to the five-factor model.     

Age-related quantitative and qualitative changes in decision making ability

The "frontal aging hypothesis" predicts that brain senescence affects predominantly the prefrontal regions. Preliminary evidence has recently been gathered in favour of an age-related change in a typically frontal process, i.e. decision making, using the Iowa Gambling Task (IGT), but overall findings have been conflicting. Following the traditional scoring method, coupled with a qualitative analysis, in the present study we compared IGT performance of 40 young (mean age: 27.9+/-4.7) and 40 old (mean age: 65.4+/-8.6) healthy adults and of 18 patients affected by frontal lobe dementia of mild severity (mean age: 65.1+/-7.4, mean MMSE score: 24.1+/-3.9). Quantitative findings support the notion that decision making ability declines with age; moreover, it approximates the impairment observed in executive dysfunction due to neurodegeneration. Results of the qualitative analysis did not reach statistical significance for the motivational and learning decision making components considered, but approached significance for the attentional component for elderly versus young normals, suggesting a possible decrease in the ability to maintain sustained attention during complex and prolonged tasks as the putative deficit underlying impaired decision making in normal aging.     

Similarity and multidimensional ratio estimation with simultaneous qualitative and quantitative variation

Abstract.— Previous work on content models of multidimensional similarity have mostly been concerned with the case of only qualitative variation. In this study a set of emotion words that varied both in content and intensity was used as stimuli. Subjects gave multidimensional ratio estimations, similarity estimations and also unidimensional ratings of intensity. Both individual data and group data were collected. Five different previously suggested content models of similarity failed to fit these data that showed large individual idiosyncratic variability. It is pointed out that previous work, where some of the models fitted rather well, was concerned with cases that were largely insensitive to deviations fram the models.     

Evaluating dialectical structures with Bayesian methods

This paper shows how complex argumentation, analyzed as dialectical structures, can be evaluated within a Bayesian framework by interpreting them as coherence constraints on subjective degrees of belief. A dialectical structure is a set of arguments (premiss-conclusion structure) among which support- and attack-relations hold. This approach addresses the observation that some theses in a debate can be better justified than others and thus fixes a shortcoming of a theory of defeasible reasoning which applies the bivalence principle to argument evaluations by assigning them the status of being either defeated or undefeated. Evaluation procedures which are based on the principle of bivalence can, however, be embedded as a special case within the Bayesian framework. The approach developed in this paper rests on the assumptions that arguments can be reconstructed as deductively valid and that complex argumentation can be reconstructed such that premisses of arguments with equivalent conclusions are pairwise independent.     

The job satisfaction-job performance relationship: a qualitative and quantitative review

A qualitative and quantitative review of the relationship between job satisfaction and job performance is provided. The qualitative review is organized around 7 models that characterize past research on the relationship between job satisfaction and job performance. Although some models have received more support than have others, research has not provided conclusive confirmation or disconfirmation of any model, partly because of a lack of assimilation and integration in the literature. Research devoted to testing these models waned following 2 meta-analyses of the job satisfaction-job performance relationship. Because of limitations in these prior analyses and the misinterpretation of their findings, a new meta-analysis was conducted on 312 samples with a combined N of 54,417. The mean true correlation between overall job satisfaction and job performance was estimated to be .30. In light of these results and the qualitative review, an agenda for future research on the satisfaction-performance relationship is provided.     

Early child grammars: qualitative and quantitative analysis of morphosyntactic production

This article reports on a series of 5 analyses of spontaneous production of verbal inflection (tense and person–number agreement) by 2-year-olds acquiring French as a native language. A formal analysis of the qualitative and quantitative results is developed using the unique resources of Optimality Theory (OT; Prince & Smolensky, 2004). It is argued that acquisition of morphosyntax proceeds via overlapping grammars (rather than through abrupt changes), which OT formalizes in terms of partial rather than total constraint rankings. Initially, economy of structure constraints take priority over faithfulness constraints that demand faithful expression of a speaker's intent, resulting in child production of tense that is comparable in level to that of child-directed speech. Using the independent Predominant Length of Utterance measure of syntactic development proposed in Vainikka, Legendre, and Todorova (1999), production of agreement is shown first to lag behind tense then to compete with tense at an intermediate stage of development. As the child's development progresses, faithfulness constraints become more dominant, and the overall production of tense and agreement becomes adult-like.     

Reconsidering qualitative and quantitative research approaches: A cognitive developmental perspective

Rather than embracing the notion that contextualism requires purely qualitative methodologies, Westerman and Yanchar argue that there is a place for quantification in post-positivist research. Both authors provide compelling arguments for this position. From our cognitive developmental perspective, we see this as a move toward a new level of integration in psychology. Whereas reactive shifts between positivist quantification and radical contextualism exemplify the kind of pendulum swing we see in individual development immediately before the emergence of a new developmental level, the moves suggested by Westerman and Yanchar are in the direction of a qualitative shift—a new level of differentiation and integration. We argue that the arguments put forward by Westerman and Yanchar do not quite achieve consolidation at this new level, because they remain embedded in a post-positivist contextualism that demands an a priori rejection of psychological universals and strong forms of quantification. In our view, consolidation at this new level requires a shift to a problem-focused methodological pluralism that assimilates a wide range of methodological approaches, critiques them, and adapts them in light of the problems researchers seek to solve.     

Race and older mothers' differentiation: a sequential quantitative and qualitative analysis

The goal of this paper is to demonstrate a process by which qualitative and quantitative approaches are combined to reveal patterns in the data that are unlikely to be detected and confirmed by either method alone. Specifically, we take a sequential approach to combining qualitative and quantitative data to explore race differences in how mothers differentiate among their adult children. We began with a standard multivariate analysis examining race differences in mothers' differentiation among their adult children regarding emotional closeness and confiding. Finding no race differences in this analysis, we conducted an in-depth comparison of the Black and White mothers' narratives to determine whether there were underlying patterns that we had been unable to detect in our first analysis. Using this method, we found that Black mothers were substantially more likely than White mothers to emphasize interpersonal relationships within the family when describing differences among their children. In our final step, we developed a measure of familism based on the qualitative data and conducted a multivariate analysis to confirm the patterns revealed by the in-depth comparison of the mothers' narratives. We conclude that using such a sequential mixed methods approach to data analysis has the potential to shed new light on complex family relations.     

The role of work experience and individual beliefs in police officers' perceptions of date rape: An integration of quantitative and qualitative methods

Surveyed police officers from two police departments in the Midwest on their perceptions of date rape (N=91). The aim of this research was to examine the influence of officers' work experiences and general beliefs about women on their perceptions of date rape. Two approaches were utilized. First, using quantitative structural-equation modeling, a model that integrated work experiences and individual beliefs was evaluated using LISREL VII. Results suggest a direct path from the work experience variables to perceptions of date rape: Officers with more experience with rape cases held more sympathetic beliefs about data rape and date rape victims. Officers who found their training on rape to be very helpful, and those who reported that their work environment was sexualized and sexual harassment was a problem, were also less victim blaming. An indirect influence of these variables was also supported. Officers with more experience, those who perceived their training as helpful, and those with heightened awareness of sexual harassment in the workplace also held more favorable attitudes toward women, which, in turn, predicted less victim-blaming perceptions of date rape. Second, qualitative methods were used to have the police define and describe in their own words what has shaped their beliefs about date rape. These narratives were content analyzed by two raters. The qualitative results validated the quantitative findings as the officers were most likely to mention professional experience with rape cases and departmental trainings as important factors that changed their opinions. Work climate and personal experiences were also cited as influential. Implications for integrating qualitative and quantitative methods in research, and training interventions with police are discussed. The author thanks the Editor, Bill Davidson, Holly Angelique, Susan Englund, Doug Luke, Melody Scofield, and three anonymous reviewers for their helpful comments on this paper. I also acknowledge Camille Johnson and Jody Venable for their assistance collecting and coding the data. This research was supported by a grant from the George W. Fairweather Fund.     

Evaluating backward chaining methods on vocational tasks by adults with developmental disabilities

Backward chains are widely used to teach complex skills to individuals with developmental disabilities. Implementation of chaining procedures may vary regarding untaught steps and there is little to guide practitioners in the selection of chaining procedures. Moreover, there is a dearth of research evaluating effectiveness and efficiency of procedural variations of behavior chains. The purpose of this study was to extend previous research by evaluating the effectiveness, efficiency, and preference for four procedural variations (i.e., teacher‐completion, participant‐completion, no‐completion, and a control condition) of backward chains across vocational tasks with adults with developmental disabilities. Although procedural variations effectively established vocational skills, the participant‐completion procedure (in which the instructor implemented a least‐to‐most prompt hierarchy during all untrained steps in the chain) was the most efficacious backward chaining procedural variation and efficient in terms of sessions to mastery. The no‐completion procedure (in which the instructor completed all untrained steps in the chain out of view of the participant) was least efficient across trials, sessions, errors, and total duration to mastery. One participant preferred the no‐completion condition while the other two participants showed an initial preference for the teacher‐completion condition that changed to preference for the no‐completion condition. Vocational skills maintained 1‐ and 4‐weeks postmastery. Stakeholders rated goals, procedures, and outcomes as socially valid.     

Evaluating methods for approximating stochastic differential equations

Models of decision making and response time (RT) are often formulated using stochastic differential equations (SDEs). Researchers often investigate these models using a simple Monte Carlo method based on Euler's method for solving ordinary differential equations. The accuracy of Euler's method is investigated and compared to the performance of more complex simulation methods. The more complex methods for solving SDEs yielded no improvement in accuracy over the Euler method. However, the matrix method proposed by Diederich and Busemeyer (2003) yielded significant improvements. The accuracy of all methods depended critically on the size of the approximating time step. The large (∼10 ms) step sizes often used by psychological researchers resulted in large and systematic errors in evaluating RT distributions.     

The relationship between qualitative and quantitative research: Lessons from feminist psychology

The dominant methodological approach in psychological research has involved the use of quantitative methods within a positivist framework. In this article we argue that both qualitative and quantitative methods have their strengths and limitations, depending on the research question under investigation. We examine some of the advantages of qualitative methods, paying particular attention to the value of such methods for feminist researchers. We challenge the positivist assumption that all research should be apolitical and value-free, arguing that the political context in which all research studies take place plays an important role in decisions about the appropriate research methods to use. Despite the value attached to qualitative methods by feminist researchers, there may be projects for which quantitative methods, or a combination of qualitative and quantitative techniques, are more suitable. We draw on examples from our research on the transition from school to the job market for young people, and a study of 16- to 19-year-old first time mothers to illustrate these points, examining the practical implications of our arguments for applied social psychology research.