The principle of additivity and its relation to clinical decision making

Clients (N = 178) with varying degrees of organic indicators were administered a psychological battery including the Memory for Designs Test (MFD; Graham & Kendall, 1960) to assess the extent to which joint presence of organic indicators affected the sensitivity of the MFD in identifying organicity. Joint presence failed to add to the discriminability of the MFD, although individual instruments such as the PIAT (Arithmetic) and WAIS-R (PIQ less than VIQ) clearly discriminated across the MFD.     

Wisconsin Card Sorting Test embedded validity indicators developed for adults can be extended to children

Past studies have examined the ability of the Wisconsin Card Sorting Test (WCST) to discriminate valid from invalid performance in adults using both individual embedded validity indicators (EVIs) and multivariate approaches. This study is designed to investigate whether the two most stable of these indicators—failures to maintain set (FMS) and the logistical regression equation S-B_LRE—can be extended to pediatric populations.

The classification accuracy for FMS and S-B_LRE was examined in a mixed clinical sample of 226 children aged 7 to 17 years (64.6% male, MAge = 13.6 years) against a combination of established performance validity tests (PVTs).

The results show that at adult cutoffs, FMS and S-B_LRE produce an unacceptably high failure rate (33.2% and 45.6%) and low specificity (.55–.72), but an upward adjustment in cutoffs significantly improves classification accuracy. Defining Pass as <2 and Fail as ≥4 on FMS results in consistently good specificity (.89–.92) but low and variable sensitivity (.00–.33). Similarly, cutting the S-B_LRE distribution at 3.68 produces good specificity (.90–.92) but variable sensitivity (.06–.38). Passing or failing FMS or S-B_LRE is unrelated to age, gender and IQ.

The data from this study suggest that in a pediatric sample, adjusted cutoffs on the FMS and S-B_LRE ensure good specificity, but with low or variable sensitivity. Thus, they should not be used in isolation to determine the credibility of a response set. At the same time, they can make valuable contributions to pediatric neuropsychology by providing empirically-supported, expedient and cost-effective indicators to enhance performance validity assessment.     

The Incremental Validity of a Short Form of the Ideational Behavior Scale and Usefulness of Distractor,Contraindicative, and Lie Scales

This article describes an empirical refinement of the Runco Ideational Behavior Scale (RIBS). The RIBS seems to be associated with divergent thinking, and the potential for creative thinking, but it was possible that its validity could be improved. With this in mind, three new scales were developed and the unique benefit (or “incremental validity”) of each was assessed. The three validity scales contained (a) distractor items, (b) contraindicative items, or (c) items constituting a lie scale. Step‐wise analyses using the three validity scales indicated very little incremental validity: They were interpreted in the light of psychometric theory, which suggests that their contribution may have been on a behavioral rather than on a statistical level. One additional analysis explored the possibility that a short form could be constructed. The short form of the RIBS was highly correlated with the long form (r = .94). Thus, most decisions made by the short form will be entirely compatible with decisions that would have been reached using the long form. A second significant result was that the RIBS was highly correlated with a check list of creative activities, supporting its concurrent validity.     

Health Impact of Jewish Religious Observance in the USA: Findings from the 2000–01 National Jewish Population Survey

Using data from the 2000–01 National Jewish Population Survey (NJPS) (N = 5,148), effects of eight religious measures were investigated in relation to two health outcomes, standard single-item indicators of self-rated health and presence of an activity-limiting health condition. Seven of the religious measures were associated bivariately with one or both health indicators. Through two-step OLS regression of each health indicator onto all of the religious measures, adjusting for age and other sociodemographic correlates, two measures of synagogue involvement remained statistically significant. Follow-up analysis revealed a net health impact of religious observance primarily limited to Orthodox and Conservative Jews.     

Assessing the social validity of telehealth-based applied behavior analysis services for autism spectrum disorder

During the COVID-19 pandemic, applied behavior analysis services for many autistic individuals were transitioned to telehealth. The current study assessed caregiver-reported quality of life (QoL) and social validity for families of autistic children receiving only telehealth services (n = 96) or a combination of telehealth and in-person services (n = 173). Barriers to the telehealth experience were analyzed via an ANOVA, and the impact of funding source was analyzed using an independent samples t-test. Caregivers reported benefit across QoL and social validity items, with scores ranging from 3.31 to 4.44 (1 = least benefit, 5 = most benefit). While many caregivers reported no barriers regarding technology (44.61%), childcare (69.52%), and employment (64.68%), the presence of those barriers significantly impacted QoL and social validity scores. Funding source was not found to have a significant impact. Overall, caregivers found value in their child's telehealth services. Clinicians have an obligation to mitigate barriers to ensure the success of the intervention.     

Comparing Chinese youth with American youth on adjustment: An illustration of measurement issues in cross-cultural research

In this article, we used results from two studies to show the need to go beyond linguistic equivalence to establish construct validity and measurement invariance in cross-cultural research. Study 1 examined Rosenberg Self-Esteem (RSE; 10 items) data from 156 Mainland Chinese youth (M = 13.8 years, SD = .53) and 213 Chinese-American youth (M = 13.6 years, SD = 2.1) from high socioeconomic status (SES) families. The Chinese translation of the RSE has been widely used. Study 2 included 1060 Mainland Chinese youth (M = 15.6 years, SD = 2.3) and 412 racially diverse American youth (M = 16.0, SD = 2.9) from all SES backgrounds. Data were collected with the third and newest edition of the Behavioural Assessment System for Children-Self Report of Personality (BASC-3-SRP; 189 items). We translated and back-translated the BASC-3-SRP between English and Chinese to establish linguistic equivalence. All participants were females. Study 1 showed that the RSE had acceptable internal consistency but lacked construct validity. Study 2 showed that the original and the translated BASC-3-SRP had good internal consistency and construct validity, but nine of its 16 subscales lacked measurement invariance. These results highlight measurement issues facing international and cross-cultural research.     

Brief approaches to assessing task absorption and enhanced subjective experience: Examining ‘short’ and ‘core’ flow in diverse performance domains

The overarching aim of the present study is to expand current approaches to assessing task absorption and subjective experience by assessing two brief measures of flow: (1) ‘short’ flow, reflecting an aggregate or global measure drawn from the ‘long’ multi-item multi-factor flow instrument and (2) ‘core’ flow reflecting the phenomenology of the subjective flow experience itself. We propose that short and core flow have complementary but non-overlapping merits, purposes, and applications. Study 1 examines ‘short’ flow in work (N = 637), sport (N = 239), and music (N = 224). Study 2 examines ‘core’ flow in general school (N = 2,229), extracurricular activity (N = 2,229), mathematics (N = 378), and sport (N = 220) contexts. With few exceptions, both flow measures demonstrated: (a) acceptable model fit, reliability, and distributions, (b) associations with motivation in hypothesized ways, and (c) invariance in factor loadings across diverse samples. Where common data are available, both short and core flow are positively correlated, but with approximately half the variance unexplained they are clearly not the same construct, and so we offer guidance regarding which measure/s to use under particular circumstances. We conclude that the brief flow measures are appropriate for research examining task absorption, subjective experience, and cognate constructs such as motivation.

A moderate financial incentive can increase effort,but not intelligence test performance in adult volunteers

A positive correlation between self-reported test-taking motivation and intelligence test performance has been reported. Additionally, some financial incentive experimental evidence suggests that intelligence test performance can be improved, based on the provision of financial incentives. However, only a small percentage of the experimental research has been conducted with adults. Furthermore, virtually none of the intelligence experimental research has measured the impact of financial incentives on test-taking motivation. Consequently, we conducted an experiment with 99 adult volunteers who completed a battery of intelligence tests under two conditions: no financial incentive and financial incentive (counterbalanced). We also measured self-reported test-taking importance and effort at time 1 and time 2. The financial incentive was observed to impact test-taking effort statistically significantly. By contrast, no statistically significant effects were observed for the intelligence test performance scores. Finally, the intelligence test scores were found to correlate positively with both test-taking importance (r_c = .28) and effort (r_c = .37), although only effort correlated uniquely with intelligence (partial r_c = .26). In conjunction with other empirical research, it is concluded that a financial incentive can increase test-taking effort. However, the potential effects on intelligence test performance in adult volunteers seem limited.     

Preliminary Validity of the Eyberg Child Behavior Inventory With Filipino Immigrant Parents

Filipinos are an understudied minority affected by significant behavioral health disparities. We evaluate evidence for the reliability, construct validity, and convergent validity of the Eyberg Child Behavior Inventory (ECBI) in 6- to 12-year-old Filipino children (N = 23). ECBI scores demonstrated high internal consistency, supporting a single-factor model (preintervention α = .91; postintervention α = .95). Results document convergent validity with the Child Behavior Checklist Externalizing scale at pretest (r = .54, p < .01) and posttest (r = .71, p < .001). We conclude that the ECBI is a promising tool to measure behavior problems in Filipino children.     

Self-Rating of religiosity (SRR) in Iran: validity,reliability, and associations with the Big Five

ABSTRACT

The present research aimed to examine the psychometric properties of the Self-Rating of Religiosity (SRR) in Iran. In addition, the associations between the Persian version of this single-item measure of religiosity and the Big Five personality dimensions were investigated. Study 1 (n?=?51) suggested that the Persian translation of the SRR had adequate test-retest reliability over a three-week period. Study 2 (n?=?228) provided evidence for good convergent validity of the SRR, indexed by strong positive associations with scores on the Duke University Religion Index (DUREL). The Big Five dimensions of personality were measured using the Ten-Item Personality Inventory (TIPI). Moreover, the scores on the SRR were positively associated with Agreeableness (r?=?.23, p?<?.01) and Conscientiousness (r?=?.16, p?<?.05), while negatively associated with Openness to Experience (r?=??.25, p?<?.01). These findings are in line with cross-cultural findings on personality correlates of intrinsic religiosity. Limitations and future directions are discussed.     

Psychometric evaluation and normative data of the Swedish version of the 10‐item perceived stress scale

The perceived stress scale (PSS) has been translated to several languages and validated in many cultures. The longer 14‐item version (PSS‐14), has been translated to Swedish and validated for Swedish use. However, the Swedish version of the shorter 10‐item version (PSS‐10) has not been validated before. Therefore, the aim of this study was to evaluate the Swedish version of the PSS‐10 with regard to reliability and validity, and to provide normative data. Data from 3,406 individuals who took part in the Västerbotten Environmental Health Study in Sweden were used. The respondents constitute a random sample, aged 18 to 79 years, and stratified for age and sex. They responded to the Swedish version of the PSS‐10 as well as to the hospital anxiety and depression scale, and the Shirom Melamed burnout questionnaire for assessment of construct validity. The results show that the PSS‐10 provides approximately normally distributed data, has good internal reliability (Cronbach's alpha 0.84), and has good construct validity with anxiety (r = 0.68), depression (r = 0.57), and mental/physical exhaustion (r = 0.71). The favorable psychometric properties of the Swedish version of the PSS‐10 suggest use of the instrument for assessing perceived stress in Swedish and similar populations.     

Examination of the reliability and validity of the personality assessment inventory

The reliability, discriminant validity, and construct validity of the Personality Assessment Inventory (PAI) — a multidimensional self-report measure of abnormal personality traits — were examined within the Australian context. Subjects included 151 normals, 30 alcoholics, and 30 schizophrenic patients. A subsample of 70 nonpsychiatric adults responded to the PAI items twice over a test-retest interval of 28 days. The resulting median retest coefficient was 0.7, indicating less than optimal stability. The median alpha (KR₂₁) coefficient was 0.8, suggesting somewhat narrow measurement scales. A significant multivariate main effect was obtained across groups after the effects of age and gender were removed. Multiple comparisons for each of the PAI scales revealed significant differences between the respective groups, as discussed. A higher-order scale factoring did not strongly support the purported PAI structure. In reanalyses of the correlation matrices included in the Professional Manual, the purported PAI factor structure was unable to be replicated for the standardization clinical sample (N=1246), and a confirmatory factor analysis using the normative (validation) correlational data (N=1000) revealed poor fit indices, raising further concerns about construct validity.     

Further examination of the convergent and discriminant validity of the student–teacher relationship scale

Two studies extended psychometric research on the Student–Teacher Relationship Scale (STRS) with kindergarten and preschool children (N₁ = 60–71; N₂ = 35) and their teachers. These studies used a multi‐method approach to replicate and extend previous findings concerning the convergent validity of the STRS Closeness, Conflict, and Dependency scale and to further examine the discriminant validity of the STRS. Study 1 investigated convergence between the STRS scales and child‐ and peer‐reports of the same constructs based on a multi‐trait multi‐method approach. Study 2 examined the pattern of associations between the STRS and indicators of teacher–child relationship quality rated by external observers. Support was found for the convergent validity and to a lesser extent the discriminant validity of the STRS Closeness and Conflict scale. For the STRS Dependency scale, additional research remains necessary. Copyright © 2009 John Wiley & Sons, Ltd.     

MFDTool: A software program for designing optimal multifunction displays

This paper describes a software program called MFDTool. MFDTool is used to design multifunction displays (MFDs), which enable people to interact with computer information systems. MFDTool characterizes the problem of MFD design as the identification of how people interact with the system and what types of constraints should be imposed by the designer to shape the properties of the MFD. Once this information is provided, MFDTool uses an optimization procedure to build a variety of candidate MFD designs and to identify the MFD design that best satisfies the constraints. An example of MFD design is discussed.     

Validating self-reported compliance with COVID-19 regulations: Demonstrating group-level sociodemographic self-reported compliance that mirrors actual morbidity rates

Using a novel approach, in this work, we establish an association between self-reported compliance with COVID-19 preventive behaviors and fear of the virus with morbidity rates (i.e., actual tests and their outcome). In two nationally representative samples that were collected in Israel during the first (April 2020: N = 507) and second (August 2020: N = 515) waves of the COVID-19 pandemic, participants responded to items assessing their compliance with the COVID-19 preventive behaviors and their fear of contracting the virus. Participants' compliance and fear self-reports served as a proxy for morbidity rates. Specifically, we assessed the association between sociodemographic variables (gender, age, or belonging to a minority group), self-reports, and morbidity rates (as reported in publicly open databases of the Israeli health ministry). We found that self-reports of compliance and fear were mirrored and aligned with actual morbidity rates across sociodemographic variables and studies. By establishing a clear connection between specific behavior (i.e., compliance with covid regulations) and emotion (i.e., fear of getting infected by the virus), self-reports and sociodemographic variables represent a real related phenomena (i.e., covid 19 morbidity rates), our findings overall validate numerous studies that used self-reports to assess compliance with COVID-19 preventive behaviors.     

Convergent and Discriminant Validity of Trait and Source Effects in ADHD-Inattention and Hyperactivity/Impulsivity Measures Across a 3-Month Interval

Confirmatory factor analysis was used to model a multitrait (ADHD-inattention and hyperactivity/ impulsivity) by multisource (teachers and parents) design across a 3-month interval in a sample of 360 Australian elementary school children. The purpose was to evaluate the convergent and discriminant validity of the ADHD-inattention (IN) and hyperactivity/impulsivity (H/I) measures. Although similar traits and similar sources showed stronger correlations across time than dissimilar traits and dissimilar sources, the amount of source variance in the ADHD-IN and ADHD-H/I measures was substantial and consistent across the interval (M = 59%; range = 35–84%). This large amount of source variance raises the possibility that the correlations of the IN and H/I rating scales with other constructs (e.g., social competence, conduct problems) represent mostly source rather than trait effects. Multitrait by multisource analyses provide a means to answer this question and further advance understanding of ADHD.     

Validity of the SDS-17 measure of social desirability in the American context

In Germany, Stober et al. (1999, 2001) presented evidence for the validity of the SDS-17, a new measure of social desirability bias. In the current investigation, three experiments (n = 800) assessed the SDS-17’s validity in the US environment. In all conditions SDS-17 scores correlated highly with Marlowe–Crowne scores. In Study 1, a group administration of a paper and pencil booklet, SDS-17 scores of 327 college students were higher under Fake Good than Standard conditions, and both were higher than scores in the Honest condition. Study 2, an online survey of a demographically diverse adult sample (n = 257), showed that the increase in SDS-17 scores under Fake Good conditions occurs also in a Web survey and that SDS-17 scores were unrelated to one’s demographic profile. Study 3, a group administration to 216 college students, revealed again that scores under Fake Good were higher than those under Standard administration and that SDS-17 scores correlated more highly with the Impression Management than with the Self-Deception subscales of the BIDR. The SDS-17 appeared valid for the US environment as a measure of socially desirable responding. The evidence, however, encourages its further assessment as an index of social desirability bias per se.     

Convergent,Discriminant, and Incremental Validities of Person–Environment Fit Scale for Creativity in Predicting Innovative Behavior

This study examined the validity of a 14-item two-factor person–environment fit scale for creativity (PEFSC) to measure the personal and environmental components of creativity. A sample of 2,475 participants completed the PEFSC for evaluating the factor structure. For convergent, discriminant, and incremental validities, a subsample (N = 362) completed the creative self-efficacy scale, support for innovation subscale of the team climate inventory, and innovative behavior measure. Results indicated the two-factor correlated model showed a better goodness of fit than the one-factor model. Measurement invariance of PEFSC was observed across different genders and educational groups. Internal consistency reliabilities were satisfactory (α  ≥  .87). The personal dimension indicated stronger associations with creative self-efficacy than with support for innovation, whereas the environmental dimension was related more closely to support for innovation than to creative self-efficacy. Incremental validity was confirmed by significant and additional explanations from PEFSC in predicting innovative behavior. These results consolidated the application of person–environment fit theoretical framework in creativity research.     

Configural instability of data from the Life Orientation Test—Revised

Scores obtained with the Revised Life Orientation Test (LOT-R) are commonly interpreted according to the optimism–pessimism factorial model. Positive items would measure individual differences in positive outcome expectancy, and negative items would measure differences in negative outcome expectancy. Configural stability was assessed using four datasets from French adults, N₁ = 429, N₂ = 278, N₃ = 468, and N₄ = 909. Two times out of four the third positive item-variable could also be regressed on the pessimism factor, with a significant improvement of the goodness of fit. Moreover, the semantic content of the best items reveals that the positive vs. negative outcome expectancy interpretation of the factors was not self-consistent. Practical consequences for the use of the usual optimism composite score are discussed.     

The Five Factor Mindfulness Questionnaire in Norway

The aim of this study was to adapt the Five Factor Mindfulness Questionnaire (FFMQ) for use in Norway. Three studies involving three different samples of university students (mean age 22 years, total N = 792) were conducted. Confirmatory factor analyses showed that a five factor structure provided an acceptable fit to the data. All five factors loaded significantly on the overall mindfulness factor. As expected, correlations between the FFMQ total scores and subscales were positive and significant, ranging from 0.45 to 0.65. Correlations between FFMQ total/subscales and Mindful Attention Awareness Scale (MAAS) were significant and negative (since low scores on the MAAS indicate high mindfulness), ranging from r = ?0.17 to ?0.69. The Norwegian FFMQ total score was inversely correlated with all indicators of psychological health: neuroticism (r = ?0.61), ruminative tendencies (r = ?0.41), self‐related negative thinking (r = ?0.40), emotion regulation difficulties (r = ?0.66) and depression (r = ?0.46 to r = ?0.65). In contrast to the other FFMQ subscales, the FFMQ Observe subscale did not have a positive relation to psychological health in our mostly non‐meditating sample. However, being able to non‐judgmentally observe one's inner life and environment is a part of the mindfulness construct that might emerge more clearly with more mindfulness training. We conclude that the Norwegian FFMQ has acceptable psychometric properties and can be recommended for use in Norway, especially in studies seeking to differentiate between different aspects of mindfulness and how these may change over time.