Timepieces: Components of Survey Question Response Latencies

Political scientists have increasingly found that the time respondents require to answer survey questions is a useful measure of the strength of political attitudes. However, questions remain about the collection, use, and interpretation of response time data— particularly latencies collected during telephone interviews, far removed from the controlled environment of a laboratory setting. This paper uses a theoretical model of question response to decompose survey response time data into three hypothesized elements—components of response time attributable to baseline individual differences, systematic question effects, and the accessibility of the attitudes being targeted. These findings have implications for the study of political attitudes and other mental constructs, as well as practical implications for public opinion survey researchers using response time data.     

Implementation of Primary Care-Mental Health Integration Services in the Veterans Health Administration: Program Activity and Associations with Engagement in Specialty Mental Health Services

This paper describes the status of the Veterans Health Administration (VHA) Primary Care-Mental Health Integration (PC-MHI) services implementation and presents an assessment of associations between receipt of PC-MHI services and likelihood of receiving a second specialty mental health (SMH) appointment following an initial SMH encounter. The total PC-MHI service recipients and encounters/month rose substantially between October 2007 and April 2011. Adjusting for important covariates, the likelihood of receiving a second SMH encounter within 3 months of an index SMH appointment was 1.37 times greater among individuals who had received a PC-MHI encounter within 3 months of the initial SMH appointment. Implementation of VHA PC-MHI services has substantially increased VHA capacity to deliver mental health services in primary care and findings indicate that PC-MHI services are associated with greater engagement in SMH treatment. Implementation of VHA PC-MHI services is progressing with new technical assistance strategies being deployed.     

Coerced First Sexual Intercourse Among Women in Ghana: Evidence from the Demographic and Health Survey

Using the 2008 Demographic and Health Survey, and applying logit and log-normal hazard models, this study examined the determinants and timing of coerced first sexual intercourse among women aged 15–49 years in Ghana. Results indicate statistically significant relationships between demographic and sociocultural variables on the likelihood and timing of coerced first sexual intercourse among Ghanaian women. Married women were significantly less likely to report coercion at first sex, but had a faster timing to coerced first sex compared to the never married. Older women were significantly less likely to report coerced first sex, compared to younger women. Similarly, women who had their sexual debut at younger ages were more likely to say they were forced, compared to those who experiencing theirs at older ages. While Ewe and Ga Adangbe women were more likely to report coerced first sex, compared to Akans, traditionalists were less likely to do so, compared to Christians. This study highlights the need for critical appraisal of the cultural interpretation of violence and for future studies to explore the causes of this phenomenon.     

GRADSCOPE: An Analysis of the Item Structure and a Survey of Usage

Two studies of GRADSCOPE, the most widely-used system for computer-assisted careers guidance in higher education in Britain, are reported. The first is an item analysis of the GRADSCOPE questionnaire. The six-factor solution from this factor analysis suggests that, with the exception of the Artistic theme, the content domain of the GRADSCOPE questionnaire covers Holland's occupational themes, and that GRADSCOPE is primarily concerned with the motivational component rather than the performance requirements of jobs. The second study, a postal survey of careers services and careers advisers about their experiences of using the interactive version of GRADSCOPE, aimed to examine the potential of interactive systems to effect change in careers work.     

Examination of potential disparities in suicide risk identification and follow-up care within the Veterans Health Administration

To improve the identification and intervention of suicide risk, the Veterans Health Administration implemented the use of electronic patient record flags (PRF) to indicate when a veteran is identified as high risk for suicide and to increase the clinical contacts made with the veteran. The current study utilized an intersectional approach to assess potential disparities in the likelihood of receiving a PRF and the likelihood of receiving post-PRF follow-up care among veterans with substance use disorders (SUDs). Among 458,092 veterans who received a SUD diagnosis in 2012, Black veterans were less likely to receive a PRF, although Black-disabled veterans and Black-female veterans were more likely to receive a PRF. Homelessness was related to greater likelihood of receiving a PRF and post-PRF care. Hispanic/Latinx veterans who experienced homelessness were more likely to receive post-PRF care, while disabled veterans who experienced homelessness were less likely. Hispanic/Latinx, female veterans, and Black-disabled veterans were significantly less likely to receive post-PRF care. Overall, few marginalized or intersecting identities were associated with decreased PRF or decreased follow-up care. There are opportunities for specific strategies that promote engagement in VA follow-up services for veterans identifying as Hispanic/Latinx women, disabled Black veterans, and disabled homeless veterans.     

Testimony Validity as a Function of Question Form, Atmosphere, and Item Difficulty

The effects of five kinds of questioning, two interpersonal atmospheres of interviewing, and five levels of item difficulty on the accuracy and completeness of testimony about a short film were tested in a legal interrogation setting. Subjects enjoyed the supportive style of interviewing more than the challenging style, but atmosphere had no important effect on recall performance.
The type of questioning produced almost no differences in affective or cognitive reactions. However, as the specificity of questions increased, so did the completeness of testimony. Accuracy of testimony showed slight decreases for more specific questions. The trade-off between accuracy and completeness was mediated by item difficulty. It was very pronounced for items of high difficulty and not apparent for items of low difficulty.
Leading questions by themselves or in interaction with atmosphere did not produce special distortions in accuracy.     

Training in and implementation of Acceptance and Commitment Therapy for depression in the Veterans Health Administration: Therapist and patient outcomes

ObjectiveThe U.S. Department of Veterans Affairs has implemented a national dissemination and training initiative to promote the availability of Acceptance and Commitment Therapy for depression (ACT-D). This paper reports on therapist and patient outcomes associated with competency-based training in and implementation of ACT-D.MethodTherapist and patient outcomes were assessed on eleven cohorts of therapists (n = 391) and their patients (n = 745).ResultsThree-hundred thirty four therapists successfully completed all requirements of the Training Program. Ninety-six percent of therapists achieved competency by the end of training, compared to 21% at the outset of training. Mixed effects model analysis indicated therapists' overall ACT-D competency scores increased from 76 to 112 (conditional SD = 6.6), p < 0.001. Moreover, training was associated with significantly increased therapist self-efficacy and positive attitudes toward ACT-D. Therapeutic alliance increased significantly over the course of therapy. Mixed effects model analysis revealed that mean BDI-II scores decreased from 30 at baseline assessment to 19 (conditional SD = 5.6) at final assessment, t(367) = ?20.3, p < 0.001. Quality of life scores also increased.ConclusionsTraining in and implementation of ACT-D in the treatment of Veterans is associated with significant increases in therapist competency and robust improvements in patient outcomes.     

The Effects of Features of Survey Measurement on Self-Rated Health: Response Option Order and Scale Orientation

Self-rated health (SRH) is widely used to study health across a range of disciplines. However, relatively little research examines how features of its measurement in surveys influence respondents’ answers and the overall quality of the resulting measurement. Manipulations of response option order and scale orientation are particularly relevant to assess for SRH given the increasing prominence of web-based survey data collection and since these factors are often outside of the control of the researcher who is analyzing data collected by other investigators. We examine how the interplay of two features of SRH influence respondents’ answers in a 2-by-3 factorial experiment that varies (1) the order in which the response options are presented (“excellent” to “poor” or “poor” to “excellent”) and (2) the orientation of the response option scale (vertical, horizontal, or banked). The experiment was conducted online using workers from Amazon Mechanical Turk (N = 2945). We find no main effects of response scale orientation and no interaction between response option order and scale orientation. However, we find main effects of response option order: mean SRH and the proportion in “excellent” or “very good” health are higher (better) and the proportion in “fair” or “poor” health lower when the response options are ordered from “excellent” to “poor” compared to “poor” to “excellent.” We also see heterogeneous treatment effects of response option ordering across respondents’ characteristics associated with ability. Overall, the implications for the validity and cross-survey comparability of SRH are likely considerable for response option ordering and minimal for scale orientation.

     

单维项目因素分析：CCFA与IRT估计方法的比较

当观测指标变量为二分分类数据时,传统的因素分析方法不再适用。作者简要回顾了SEM框架下的分类数据因素分析模型和IRT框架下的测验题目和潜在能力的关系模型,并对两种框架下主要采用的参数估计方法进行了总结。通过两个模拟研究,比较了SEM框架下GLSc和MGLSc估计方法与IRT框架下MML/EM估计方法的差异。研究结果表明：（1）三种方法中,GLSc得到参数估计的偏差最大,MGLSc和MML/EM估计方法相差不大;（2）随着样本量增大,各种项目参数估计的精度均提高;（3）项目因素载荷和难度估计的精度受测验长度的影响;（4）项目因素载荷和区分度估计的精度受总体因素载荷（区分度）高低的影响;（5）测验项目中阈值的分布会影响参数估计的精度,其中受影响最大的是项目区分度。（6）总体来看,SEM框架下的项目参数估计精度较IRT框架下项目参数估计的精度高。此外,文章还将两种方法在实际应用中应该注意的问题提供了一些建议。     

Exploring Modifications to Individual Trauma-Focused PTSD Treatments in a Routine Care Setting: An Examination of Medical Records at a Veterans Health Administration PTSD Clinic

Clinicians in naturalistic settings regularly modify the delivery of trauma-focused treatments to enhance client engagement and retention. However, what types of modifications are made in clinical settings, why, and when, and their impact on client outcomes has seldom been examined. As an initial step to address this, the current study applied elements of the updated Framework for Reporting Adaptations and Modifications—Expanded (FRAME; Wilstey Stirman et al., 2019) to examine content-level modifications documented in the delivery of posttraumatic stress disorder (PTSD) treatment to veterans via medical records review in an urban PTSD clinic. Results indicated that the updated FRAME suited the data well, and that modifications occurred in most veteran–clinician pairs over the course of treatment. The four most common modifications documented were spreading (27%), repeating (24%), drift with return (22%), and integrating (21%). Three composite case examples are discussed that describe the application of the most common modifications observed in medical record documentation. This is an important first step toward understanding the real-world modifications of evidence-based trauma-focused interventions that in turn will lead to critical recommendations for improving treatment implementation.     

Measuring Probabilistic Reasoning: The Construction of a New Scale Applying Item Response Theory

Probabilistic reasoning skills are important in various contexts. The aim of the present study was to develop a new instrument (the Probabilistic Reasoning Scale – PRS) to accurately measure low levels of probabilistic reasoning ability in order to identify people with difficulties in this domain. Item response theory was applied to construct the scale, and to investigate differential item functioning (i.e., whether the items were invariant) across genders, educational levels, and languages. Additionally, we tested the validity of the scale by investigating the relationships between the PRS and several other measures. The results revealed that the items had a low level of difficulty. Nonetheless, the discriminative measures showed that the items can discriminate between individuals with different trait levels, and the test information function showed that the scale accurately assesses low levels of probabilistic reasoning ability. Additionally, through investigating differential item functioning, the measurement equivalence of the scale at the item level was confirmed for gender, educational status, and language (i.e., Italian and English). Concerning validity, the results showed the expected correlations with numerical skills, math‐related attitudes, statistics achievement, IQ, reasoning skills, and risky choices both in the Italian and British samples. In conclusion, the PRS is an ideal instrument for identifying individuals who struggle with basic probabilistic reasoning, and who could be targeted by specific interventions. Copyright © 2017 John Wiley & Sons, Ltd.     

Two-Timing: Politics and Response Latencies in a Bilingual Survey

Through the recording of response times in a national four-wave bilingual panel survey, this study reports improvements in the prediction of vote choice up to 1 year in advance of a federal election. These results were achieved with conventional computer-assisted telephone interviewing (CATI) software, indicating that the immediate use of response time measures isboth practical and attractive for commercial as well as academic survey units. Even so, response latencies were found to be sensitive to political circumstance, such that timings should be analyzed separately for minority and majority populations. Moreover, a broad analytic focus, beyond timing only vote intention and partisan commitment, is recommended because latency data on core questions of identity and allegiance reveal a great deal about the contours ofpolitical context.     

Differential Item Functioning of the Symptoms of Major Depression by Race and Ethnicity: An Item Response Theory Analysis

This study examines the psychometric properties, and particularly differential item functioning (DIF) due to racial and ethnic group, of the criteria for a major depressive episode using a large sample (N?=?1,063) of outpatients seeking treatment for mood and anxiety disorders. DIF was evaluated using multiple group confirmatory factor analysis. Item thresholds fell along a continuum with the core features of depressed mood and anhedonia, along with fatigue, being endorsed at lower levels of depression, and change in appetite and suicidal ideation endorsed at more severe levels of depression. Item discriminations, reflecting an item’s ability to discriminate between lower and higher levels of depression, were highest for depressed mood and anhedonia, and lowest for change in appetite and suicidal ideation. When examining model fit among the racial groups we did not find differences in symptom functioning, providing support for the use of these symptoms across diverse groups. This is of particular importance given the paucity of studies examining this question using a semi-structured clinician administered instrument to a clinical sample.     

Modeling and Testing Differential Item Functioning in Unidimensional Binary Item Response Models with a Single Continuous Covariate: A Functional Data Analysis Approach

Differential item functioning (DIF), referring to between-group variation in item characteristics above and beyond the group-level disparity in the latent variable of interest, has long been regarded as an important item-level diagnostic. The presence of DIF impairs the fit of the single-group item response model being used, and calls for either model modification or item deletion in practice, depending on the mode of analysis. Methods for testing DIF with continuous covariates, rather than categorical grouping variables, have been developed; however, they are restrictive in parametric forms, and thus are not sufficiently flexible to describe complex interaction among latent variables and covariates. In the current study, we formulate the probability of endorsing each test item as a general bivariate function of a unidimensional latent trait and a single covariate, which is then approximated by a two-dimensional smoothing spline. The accuracy and precision of the proposed procedure is evaluated via Monte Carlo simulations. If anchor items are available, we proposed an extended model that simultaneously estimates item characteristic functions (ICFs) for anchor items, ICFs conditional on the covariate for non-anchor items, and the latent variable density conditional on the covariate—all using regression splines. A permutation DIF test is developed, and its performance is compared to the conventional parametric approach in a simulation study. We also illustrate the proposed semiparametric DIF testing procedure with an empirical example.     

Well-being and Coping of Student Veterans Readjusting into Academia: A Pilot Survey

This study explored student veterans coping with transitions to postsecondary education. An instrument using a Tailored Survey Design and an Adult Transitioning Framework was developed to collect coping responses of 13 veterans with deployment experience transitioning to postsecondary education. Results indicated 38% reported difficulty managing finances, 93% utilized military training to manage stressors, and 38% sought environmental supports provided by the university. Findings suggest previous military experiences can be incorporated into occupations supporting individual coping skill development for the transition to postsecondary education. Further research is needed to understand barriers and facilitators of student veteran engagement in university resources.     

植入与非植入广告的效果:接受通道与延时的影响

以植入式与非植入式广告比较为主线,探讨感觉通道和延时因素对广告效果的影响。发现非植入式的和视觉+听觉通道的广告有更好的品牌记忆、植入式的听觉广告在品牌记忆与品牌偏好上优于视觉广告、延时条件下植入式广告的品牌偏好保持较好。以上结果与非植入式广告的信息印象优势、植入式广告的品牌较非植入广告与背景的结合度高以及听觉广告的情节整合度与材料特点有关。