Reliability and Validity of a Paper-and-Pencil Test Measuring Hemisphere Preference

The present studies examined the reliability and validity of the Preference Test (PT), a widely used self-report index of preferred hemisphere thinking styles. The PT consists of items that intend to tap left-hemisphere and right-hemisphere cognitions. In the first study (N=47), PT scores were found to have reasonable test–retest stability. In the second study (N=334), a factor analysis of PT scores showed that the PT has a two-factor solution that can best be interpreted in terms of putative left- and right-hemisphere items. In the third study (N=29), background EEG activity (F3, F4, P3 and P4) of subjects was recorded. PT scores were found to be related to EEG asymmetry patterns for frontal, but not for parietal, recording sites. More specifically, subjects with a left-hemisphere preference displayed relatively stronger left frontal activity than subjects with a right-hemisphere preference. By and large, the present findings provide strong support for the reliability and some suggestive evidence for the validity of the PT.     

Personality in Cultural Context: Methodological Issues

Methodological issues in cultural and cross-cultural personality research are described. A taxonomy of these studies is presented, based on whether a study is exploratory or tests hypotheses, and whether or not contextual information is measured. Core methodological issues are bias and equivalence: a taxonomy and a brief overview of statistical procedures to examine equivalence are presented, with a focus on procedures for assessing structural equivalence (i.e., similarity of meaning of an instrument across cultures). Examples are given of studies in which cultural and cross-cultural approaches, often seen as antithetical, have been fruitfully integrated. Finally, multilevel models are described in which personality characteristics are examined at individual and cultural level.     

Attention in Children: Conceptual and Methodological Issues

This commentary discusses conceptual and methodological issues in the assessment of attention in children. The five articles in this special issue are important advances in the study of attention in children with brain-related disorders. They provide important guidelines for future studies in this area: specification of the underlying model of attention, selection of tasks according to the model, and the use of multiple tasks in well-defined clinical populations.     

Methodological Issues in the Assessment of Traumatic Events1

Three sets of challenges in assessing traumatic events are discussed: Understanding the sequelae of such events and their implications for the timing of longitudinal data collection; obtaining information on the objective severity of such crises for the individuals affected; and determining the social and environmental context in which such extreme situations occur. Given the complexity of events that ensue from a traumatic experience and the need to understand their mental health consequences, a semistructured approach to measurement is recommended.     

Current Issues in Causation

Book Information Current Issues in Causation. Current Issues in Causation Wolfgang Spohn Marion Ledwig Michael Esfeld Paderborn Mentis 2001 207 Paperback DM 78 Edited by Wolfgang Spohn; Marion Ledwig; Michael Esfeld. Mentis. Paderborn. Pp. 207. Paperback:DM 78,     

Methodological Issues in Treatment Research for Anxiety Disorders in Youth

This article identifies and addresses three methodological domains relevant to the treatment of anxiety disorders in youth: (a) procedural matters, (b) the assessment of anxious distress, and (c) the analysis of treatment-produced change. Procedural topics include the need to manualize treatment, have diversity among participants and comparability of the duration of treatment and control conditions, and control for medication status. Multiple-method measurement issues include child and parent reports, observations, and structured interviewing. Our examination of change issues considers comorbidity, analyzing the intent-to-treat sample, treatment spillover, and clinical as well as statistical significance. Problems are identified and potential ameliorative strategies are offered.     

Methodological Issues in Psychology of Religion Research in the Chinese Context

The present study investigates methodological issues in psychology of religion in Mainland China. Beginning with an overview of Western and Eastern scholars’ representative views on methodological issues relative to psychology of religion, this essay then analyzes the distinctive Chinese cultural background in terms of influences exerted by mainstream ideology, opportunities provided by the goal of building a harmonious society, and the real demand for the development of psychology of religion. Finally, this study puts forward several methodological strategies for constructing a Chinese psychology of religion including advanced theoretical research to strengthen the basis of research methods in Chinese psychology of religion; understanding more precisely the basis of constructing localized methods with Chinese features; and encouraging exploration on diversification and promotion of methodological innovation for psychology of religion in China.     

积极效应研究的几个方法学问题

社会情绪选择理论从时间知觉和动机的角度推论老年人的情绪加工有积极效应; 即与年轻人相比, 老年人更偏向于加工积极刺激而回避消极刺激。但是, 关于积极效应的实证研究有诸多不一致之处。分析近年相关研究的设计细节, 验证积极效应的研究多采用年轻和老年两个年龄组的对照, 而采用3个以上年龄组被试的研究结果不一致; 积极效应在东方文化下的应用研究结论也不一致; 多样化的情绪刺激、情绪分类和刺激呈现方式是各研究结论差异的重要原因, 而且积极效应研究应区分“情绪偏向”和“情绪效应”两种年龄组评价方式。因此, 今后研究需要尽可能地扩大年龄范围以确认积极效应出现时间、加强跨文化、跨地区比较以验证积极效应的普适性, 并提高研究中所用刺激材料的生态效度, 深入探索积极效应的普遍性与神经机制。     

Research With the Draw-A-Person Test: Conceptual and Methodological Issues

A number of methodological, statistical, and conceptual problems are inherent in research with the Draw-A-Person Test (DAP). These difficulties invalidate the theoretical position that an individual's gender-role identification is reflected in the sex of the figure drawn. The complexity of these problems affects the evaluation of the DAP and illustrates the need for multiple approaches to its interpretation.     

基于反应时的人格内隐测量及其方法学的思考

人格测量的热点已经转向内隐层面,以反应时为基础的内隐人格测量方法不断推陈出新,如多因素特质内隐联结测验、个人化内隐联结测验、内隐联结程序、单目标词内隐联结测验等,它们从不同侧面丰富了内隐人格测量的方法,深化了内隐人格的理论建构。但新的问题也不断出现,如内隐测量的表征是无意识的吗？内隐测量能避免社会赞许性等动机的影响吗？内隐测量的表征是高度稳定的吗？内隐测量是过程纯净的吗？内隐人格测量可以防止作伪吗？文章回顾了内隐人格测量的相关理论及有关的研究,对这些问题进行了初步的思考     

Measuring Mental Wellbeing Among Adolescents: A Systematic Review of Instruments

Globally, promoting mental wellbeing among adolescents is of great public health and social significance. However, less is known about advances in measures of mental wellbeing, relevant for use in mental health interventions, which are age-appropriate and acceptable for use among adolescents. Comprehensive assessment includes multiple aspects of mental wellbeing, as well as positive indicators of feeling and functioning. This review used systematic review methods, guided by PRISMA, to identify and assess comprehensive instruments in terms of their content, conceptual relevance for youth, and responsiveness to change. Ryan and Deci’s framework for mental wellbeing, grounded in hedonic and eudaimonic perspectives, was applied to assess the preponderance of feeling and functioning items for each instrument. The review identified 11 instruments that fit specified inclusion criteria. Only four of the scales were developed for adolescents. Though the scales varied in their preponderance of items, all scales encompassed at least one indicator of both feeling and functioning. Findings emphasize the importance of validating adult-developed instruments for youth and ensuring the instrument’s cultural and conceptual relevance within groups of adolescents. As promoting mental wellbeing becomes critical to the field of practice, practitioners need access to relevant and acceptable measures.     

Evaluation of Revision Effect on Criterion Validity of Multiple-Component Measuring Instruments

A method for point and interval estimation of change in criterion validity of multiple-component measuring instruments as a result of revision is outlined. The procedure is developed within the framework of covariance structure modeling, which complements earlier methods for testing change in composite reliability due to addition or deletion of components from tentative scales. The approach aids the process of constructing instruments with high validity in behavioral research that is illustrated with a pair of numerical examples.     

Issues of Reliability in Measuring Intimate Partner Violence during Courtship

The current paper focuses on problems in conceptualizing and establishing reliability when using self-administered measures of intimate partner violence to assess dating violence. Establishing reliability is an important step in the development of dating violence assessment instruments. However, the nature of dating violence can make it difficult to establish reliability. Most notably, measures of intimate partner violence in courtship yield data that are positively skewed, with almost no one reporting high levels of violence. This could have implications for the calculation of several forms of reliability that assume normality (e.g., Pearson correlations, intraclass correlations). In addition, there are other characteristics of dating violence that could impact reliability. For example, partner violence perpetrators do not necessarily use multiple acts (internal consistency reliability) or repeat specific acts (test-retest reliability). And, gender differences in the perception of partner violence may influence intra-couple reliability in heterosexual couples. Finally, statistical interdependence within couples makes current intra-couple reliability assessment suspect. Research is reviewed and recommendations are made concerning the establishment of test-retest reliability, intra-couple reliability, and internal consistency reliability for measures of dating violence.     

Comparing Paper-and-Pencil and Internet Survey Methods Conducted in a Combat-Deployed Environment

The Unit Behavioral Health Needs Assessment Survey (UBHNAS) is a tool used to aid behavioral health providers in assessing the needs of service members of a military unit. Traditionally, the survey has been administered by paper-and-pencil; however, implementing the survey via the Internet may be a faster and easier way to administer the survey. There are, however, potential drawbacks to Internet survey administration, and previous studies comparing the 2 methods have yielded inconsistent findings. Using a between-subjects design with a combat-deployed military sample, the present study compared the 2 survey administration methods. Specifically, we assessed comparability for (a) psychological constructs, (b) auxiliary measures (such as completion time, frequency of missing data, and length of written comments), and (c) ratings and perceptions of the UBHNAS, and preference in methodology. The method of survey administration did not predict differences in the psychological outcome variables. However, participants in the paper-and-pencil condition reported higher rates of comfort answering questions, belief that responses would remain anonymous, and frankness and honesty in answering questions. Nevertheless, participants in both conditions preferred to take the survey via the Internet as opposed to paper-and-pencil in the future. Finally, participants in the Internet condition completed the survey faster and tended to write longer comments, although in terms of the comments being informative, there was no difference between the groups. Based on our findings, we recommend the use of the Internet for administering the UBHNAS; however, we caution that there may be tradeoffs regarding concerns about comfort, honesty, and anonymity.