The measurement of reliability of social relations components from round‐robin designs

The social relations model (SRM) is a useful tool for measuring relationship effects, defined as the unique perceptions or behaviors of 2 people. The sources of variance in SRM studies are persons (actors and partners), groups, and items; the relationship effect is defined as the actor–partner interaction. By removing variance because of persons and groups, a measure of a “pure” relationship effect is obtained. In this article, generalizability theory (G Theory) is applied to estimate the reliability of SRM components from round‐robin data structures. Using G Theory, reliability formulas for actor, partner, group, and relationship are developed and interpretations for the reliability estimates are provided. The authors also discuss how these formulas can be used in both planning and interpreting results from relationship research.     

Competencies,Personality Traits,and Organizational Rewards of Middle Managers: A Motive-Based Approach

Previous literature suggests that performance ratings are saturated with rater-related idiosyncratic variance. Given that modern psychometric theories relegate this source of variance to measurement error, it has not been the subject of much previous research. Of importance, identifying and estimating the variance components underlying idiosyncratic rater variance will inform our understanding of the nature of this variance. In a sample of managerial performance ratings we report on components of variance and find that the idiosyncratic rater variance component is about one third rater main effects variance, one third Rater × Ratee interaction effects variance, and one third upper-bound Rater × Ratee × Dimension interaction effects variance. Further, results indicate that variance components are moderated by the acquaintanceship time between the rater and the ratee.     

Direct and indirect measures of spider fear predict unique variance in children's fear-related behaviour

This study investigated whether direct and indirect measures predict unique variance components of fearful behaviour in children. One hundred eighty-nine children aged between 9 and 12 performed a pictorial version of the emotional Stroop task (EST), filled out the Spider Anxiety and Disgust Screening for Children (SADS-C), the Spider Phobia Questionnaire for Children (SPQ-C), and took part in a Behavioural Assessment Test (BAT). The EST did not correlate with self-reports. Correlations of the self-reports and the BAT remained significant after partialling out EST performance. Likewise, the EST and the BAT still correlated significantly with each other when controlling for the self-reports. This indicates that both direct and indirect measures are useful for predicting unique variance components of fearful behaviour in children. Moreover, it may explain why some previous studies have not found a relationship between self-reported fear and EST performance.     

Direct and indirect measures of spider fear predict unique variance in children's fear-related behaviour

This study investigated whether direct and indirect measures predict unique variance components of fearful behaviour in children. One hundred eighty-nine children aged between 9 and 12 performed a pictorial version of the emotional Stroop task (EST), filled out the Spider Anxiety and Disgust Screening for Children (SADS-C), the Spider Phobia Questionnaire for Children (SPQ-C), and took part in a Behavioural Assessment Test (BAT). The EST did not correlate with self-reports. Correlations of the self-reports and the BAT remained significant after partialling out EST performance. Likewise, the EST and the BAT still correlated significantly with each other when controlling for the self-reports. This indicates that both direct and indirect measures are useful for predicting unique variance components of fearful behaviour in children. Moreover, it may explain why some previous studies have not found a relationship between self-reported fear and EST performance.     

ESTIMATING CONTENT-ACQUIESCENCE CORRELATION BY COVARIANCE STRUCTURE ANALYSIS

A topic of continuing interest in the measurement area is response acquiescence. A recent study has demonstrated the feasibiliy of studying acquiescence or, more importantly, content/acquiescence correlation in the MMPI. Utilizing the components of variance approach, this study found that the variance due to acquiescence in scores on the Pt and Hg scales was small relative to content variance, but that the correlation between acquiescence and content may be substantial for the Pt scale. The present paper describes a general statistical procedure for investigating content variance, variance due to non-content characteristics of items, and the covariances of content and various item characteristics. The data from a previous paper are reanalyzed, using alternative covariance structure models. Maximum likelihood procedures which allow for a statistical test for parameters of interest are used. The results point to the significance of the content- acquiescence correlation in the Pt scale, but not in the Hy scale. The previous findings are verified statistically, and procedures which hold promise for other investigation into the properties of behavioral tests are described.     

Sexual satisfaction in long-term heterosexual relationships: The interpersonal exchange model of sexual satisfaction

This study examined the validity of the Interpersonal Exchange Model of Sexual Satisfaction (IEMSS) in long-term, heterosexual sexual relationships. The IEMSS proposes that sexual satisfaction depends on one's levels of rewards and costs in the sexual relationship, one's comparison levels (CL) for rewards/costs, and one's perceptions of the dyadic equality (EQ) of these rewards/costs. Sexual satisfaction is expected to be greater to the extent that, over time, levels of rewards (REW) exceed levels of costs (CST), relative reward levels (CLREW) exceed relative cost levels (CLcst ), and interpersonal equality of rewards (EQrew ) and of costs (EQCST) is perceived to exist. Married/cohabiting community volunteers and university alumni/staff completed two questionnaires, 3 months apart. The results obtained from this well-educated, relationally satisfied sample (N= 143) provided excellent support for the IEMSS. Hierarchical regression analysis revealed that each component of the model (REW - CST, CLrew - CLcst , and EQrew , EQcst ) added to the prediction of sexual satisfaction as expected, accounting for 75% of the variance. Repeated measurement of the IEMSS components offered a better prediction of sexual satisfaction than a one-time measure alone. Neither gender nor relationship satisfaction interacted with the IEMSS components. However, including relationship satisfaction (but not gender) in the model significantly improved the prediction of sexual satisfaction. It was concluded that the model should be revised to include relationship satisfaction. Both the exchange components of the IEMSS and sexual satisfaction uniquely predicted relationship satisfaction. The IEMSS offers a promising approach for understanding sexual satisfaction and its relationship to relationship satisfaction, as well as for reconciling inconsistent findings in the literature.     

The temporal factor of change in stressor-strain relationships: a growth curve model on a longitudinal study in east Germany

Several theoretical models describing how stressor-strain relationships unfold in time (e.g., M. Frese & D. Zapf, 1988) were tested with a longitudinal study, with 6 measurement waves, using multivariate latent growth curve models. The latent growth curve model made it possible to decompose trait and state components of strains and to show that both trait and state components are affected by work stressors. Because East Germany constitutes a high-change environment, it is an appropriate setting in which to study the relationship between work stressors and strains. The results showed that both the state and trait components of strains were affected by stressors. For example, individual trends in uncertainty (stressor) and worrying (strain) were related, whereas worrying also showed a short-term relationship with time pressure (another stressor). In particular, the decomposition into trait and state components was only possible with the growth curve method that was used.     

A Grammar of Love

Abstract

Recently researchers in the family therapy field have encouraged a focus on aspects of therapy common across all models that are important to therapeutic change. The purpose of this study was to build on the “common factors” literature by exploring clients' perspectives of what was useful to their therapeutic experience. Quantitative and qualitative measures were used to collect data from 41 clients who participated in therapy at a university-based family therapy clinic. Quantitative results indicated that therapeutic relationship, client motivation, extratherapeutic factors, and hope and expectancy accounted for 49% of the variance of clients' perception of change and 73% of the variance of clients' perceptions of therapy helpfulness. Qualitative results indicated the therapeutic relationship to be the most helpful aspect of clients' therapeutic experience.     

Validation of a component model of social skill with outpatient adults

Little social skills research has been generated from applied outpatient settings. The present study examined the relationship of behavioral social skill components to independent judges' social skill judgments. A secondary question was whether nonverbal components would demonstrate a curvilinear relationship to social skill ratings. Forty-two outpatient adults at a community mental health center were videotaped role-playing eight scenes (four commendatory and four refusal). Videotapes were viewed in random order by community members who rated the subject's social skill in the situation. Trained raters scored the videotapes on standard behavioral components. While both nonverbal and verbal components accounted for significant portions of unique variance, the percentage of eye contact was an overwhelmingly large contributor to skill judgments. No curvilinear trend was evidenced for the nonverbal components. The study extended prior findings with psychiatric inpatients into applied outpatient settings and indicated that a component social skills model is equally applicable with outpatient adults. The findings replicated with a second sample of outpatient adults.     

概化理论方差分量估计的跨分布分析

方差分量估计是进行概化理论分析的关键。采用MonteCarlo模拟技术,探讨心理与教育测量数据分布对概化理论各种方法估计方差分量的影响。数据分布包括正态、二项和多项分布,估计方法包括Traditional、Jackknife、Bootstrap和MCMC方法。结果表明:(1)Traditional方法估计正态分布和多项分布数据的方差分量相对较好,估计二项分布数据需要校正,Jackknife方法准确地估计了三种分布数据的方差分量,校正的Bootstrap方法和有先验信息的MCMC方法(MCMCinf)估计三种分布数据的方差分量结果较好;(2)心理与教育测量数据分布对四种方法估计概化理论方差分量有影响,数据分布制约着各种方差分量估计方法性能的发挥,需要加以区分地使用。     

Subjective Wellbeing and Homeostatically Protected Mood: Theory Validation With Adolescents

Researchers generally agree that Subjective Wellbeing (SWB) comprises both cognitive and affective components. However, the proportioning of their contributions, and the relationship between these constructs and personality, remain equivocal. This study investigated the relationship between these constructs, representing affect by Homeostatically Protected Mood (HPMood). Using a sample of 205 Victorian high-school students aged between 13 and 20 years, structural equation modeling determined that an HPMood-driven model of SWB was better fitting than either a personality-driven model of SWB or a cognition-driven model of SWB, explaining 80% of variance. These results support HPMood as the major component of SWB. They also reinforce the proposition that HPMood may be the driving force behind individual SWB set-points and the variable that SWB homeostasis seeks to defend.     

基于概化理论的方差分量变异量估计

概化理论广泛应用于心理与教育测量实践中, 方差分量估计是进行概化理论分析的关键。方差分量估计受限于抽样, 需要对其变异量进行探讨。采用蒙特卡洛(Monte Carlo)数据模拟技术, 在正态分布下讨论不同方法对基于概化理论的方差分量变异量估计的影响。结果表明: Jackknife方法在方差分量变异量估计上不足取; 不采取Bootstrap方法的“分而治之”策略, 从总体上看, Traditional方法和有先验信息的MCMC方法在标准误及置信区间这两个变异量估计上优势明显。     

Variance Estimation of Nominal-Scale Inter-Rater Reliability with Random Selection of Raters

Most inter-rater reliability studies using nominal scales suggest the existence of two populations of inference: the population of subjects (collection of objects or persons to be rated) and that of raters. Consequently, the sampling variance of the inter-rater reliability coefficient can be seen as a result of the combined effect of the sampling of subjects and raters. However, all inter-rater reliability variance estimators proposed in the literature only account for the subject sampling variability, ignoring the extra sampling variance due to the sampling of raters, even though the latter may be the biggest of the variance components. Such variance estimators make statistical inference possible only to the subject universe. This paper proposes variance estimators that will make it possible to infer to both universes of subjects and raters. The consistency of these variance estimators is proved as well as their validity for confidence interval construction. These results are applicable only to fully crossed designs where each rater must rate each subject. A small Monte Carlo simulation study is presented to demonstrate the accuracy of large-sample approximations on reasonably small samples.     

Testing Variance Components in Linear Mixed Modeling Using Permutation

Abstract

Inference of variance components in linear mixed modeling (LMM) provides evidence of heterogeneity between individuals or clusters. When only nonnegative variances are allowed, there is a boundary (i.e., 0) in the variances’ parameter space, and regular inference statistical procedures for such a parameter could be problematic. The goal of this article is to introduce a practically feasible permutation method to make inferences about variance components while considering the boundary issue in LMM. The permutation tests with different settings (i.e., constrained vs. unconstrained estimation, specific vs. generalized test, different ways of calculating p values, and different ways of permutation) were examined with both normal data and non-normal data. In addition, the permutation tests were compared to likelihood ratio (LR) tests with a mixture of chi-squared distributions as the reference distribution. We found that the unconstrained permutation test with the one-sided p-value approach performed better than the other permutation tests and is a useful alternative when the LR tests are not applicable. An R function is provided to facilitate the implementation of the permutation tests, and a real data example is used to illustrate the application. We hope our results will help researchers choose appropriate tests when testing variance components in LMM.     

Factor structure of the College Adjustment Scales

The present study examined the underlying structure of the College Adjustment Scales via principal components analysis. A correlation matrix of the nine subscales showed significant multicolinearity. A subsequent principal components analysis demonstrated that one factor accounted for 57% of the total variance and that the majority of subscales were moderately correlated with this single factor. The results suggest that the College Adjustment Scales may measure the same underlying construct and that the clinical distinctions implied by subscale scores should be regarded with caution. Conclusions are constrained by sample size and demographic characteristics, but the results suggest the need for further empirical validation of the College Adjustment Scales, which may be useful in college counseling centers.     

Internal representation of visual texture as the basis for the judgment of similarity

The relationship between Fourier spectra of visual textures (represented both by the actual frequency components and by the response of four hypothetical channels selectively sensitive to spatial frequency) and the perceptual appearance of the textures was investigated. Thirty textures were synthesized by combining seven spatial frequencies whose amplitudes were randomly chosen and then scaled to give an overall contrast of .9. Similarity judgments were collected using both the method of triadic comparison (two subjects, 4,060 trials each) and the method of paired comparison (six subjects, 435 trials each). The similarity judgments were subjected to MDSCAL and INDSCAL dimensions were found to be optimally oriented in terms of spatial frequency information without rotation. The seven spatial frequency components accounted for 90.6% of the variance in the 3-D INDSCAL space, while the four channels accounted for 91.8% of the variance in the first two dimensions. The data further suggest that the four channels may interact in an opponent process manner. The results support the idea that the visual internal representation of stimuli is based on spatial frequency analysis rather than feature extraction.     

Contribution of age, genes, and environment to the relationship between perceptual speed and cognitive ability

The aim of this study was to examine genetic influences on cognitive ability in adulthood in the context of the relationship between perceptual speed and cognitive aging. Quantitative genetic analysis of data from the Swedish Adoption/Twin Study of Aging allowed for estimation of the contribution of age, genetic, and environmental effects to the variance in a latent cognitive factor and to the covariance between the cognitive factor and perceptual speed. The sample included 292 pairs of monozygotic and dizygotic twins. both reared together and reared apart, ranging in age from 40 to 84 years. Analysis of components of total variance in the cognitive factor indicated that 90% of the age-related variance in the cognitive factor was shared with perceptual speed and 70% of the genetic variance in the cognitive factor was shared with perceptual speed. The correlation between the speed and cognitive factors was primarily genetically mediated.     

Stability and change model of job resources and work engagement: A seven-year three-wave follow-up study

Using the stability and change model, conservation of resources theory and the job demands-resources model, this study aimed to determine: (1) the extent to which work engagement and job resources can be explained by a component reflecting stability and a component reflecting change in these constructs, and (2) the strength and direction of the relationship between work engagement and job resources when their stable components are controlled for. The study was carried out among 1,964 Finnish dentists over a seven-year time period (2003–2010), using a three-wave dataset. Some of the dentists had changed jobs during the follow-up, and therefore the research questions were validated among groups of job stayers and job changers. The stability and change models were examined using structural equation modelling. The results showed that 69–77% of the variance of dentists’ work engagement, and 46–49% of the variance of job resources was explained by the component reflecting stability. However, although there was a positive relationship between job resources and work engagement, the primary direction of this relationship could not be determined. Either job resources or work engagement may be considered as the initiator of this relationship. Job change did not affect the results.     

Hidden Dimensions of Creativity Elements in Design Process

The aim of the study was to determine the items that can be evaluated as the components of creativity in design process. Factor analysis was applied to determine how well the items corresponded with the explored creativity characteristics. An overall component analysis was conducted to achieve a holistic approach to creative design process. It is found that the primary dimension responsible of 46% of the total variance is only composed of product components. The second dimension responsible of 19.54%, and the third dimension responsible of 14.46% of the total variance are both composed of the interaction of person and process components. Therefore, it can be concluded that the product is the strongest factor in determining creativity in design process.