Lower level mediation in multilevel models

Multilevel models are increasingly used to estimate models for hierarchical and repeated measures data. The authors discuss a model in which there is mediation at the lower level and the mediational links vary randomly across upper level units. One repeated measures example is a case in which a person's daily stressors affect his or her coping efforts, which affect his or her mood, and both links vary randomly across persons. Where there is mediation at the lower level and the mediational links vary randomly across upper level units, the formulas for the indirect effect and its standard error must be modified to include the covariance between the random effects. Because no standard method can estimate such a model, the authors developed an ad hoc method that is illustrated with real and simulated data. Limitations of this method and characteristics of an ideal method are discussed.     

The Mayman Form-Level Scoring Method: Scorer Reliability and Correlates of Form Level

A method of scoring the form level of Rorschach responses developed by Mayman (1962) was employed in a study of 100 twins and 95 of their parents. A method of training is described that led to generally adequate inter-scorer reliabilities. The relationship of mean form level to age, sex, and intellectual abilities is discussed, as are results relevant to the “heritability” of mean form level. It is concluded that mean form level is of complex determination and should be interpreted cautiously in developmental studies. It is argued that Mayman's highly differentiated approach to form level has unique value for qualitative analyses of Rorschach protocols.     

Reducing Measurement Error in Student Achievement Estimation

The achievement level is a variable measured with error, that can be estimated by means of the Rasch model. Teacher grades also measure the achievement level but they are expressed on a different scale. This paper proposes a method for combining these two scores to obtain a synthetic measure of the achievement level based on the theory developed for regression with covariate measurement error. In particular, the focus is on ordinal scaled grades, using the SIMEX method for measurement error correction. The result is a measure comparable across subjects with smaller measurement error variance. An empirical application illustrates the method.     

Proportion of third‐level variation in multi‐level studies: A note on an interval estimation procedure

An interval estimation procedure is outlined that can be used for evaluating the proportion of observed variance in a response variable, which is due to the third level of nesting in a hierarchical design. The approach is also useful when it is of concern to address the necessity of including a third level in analyses of data from a multi‐level study, relative to an alternative of proceeding with two‐level modelling. The proposed method is illustrated with an empirical example.     

TRAIT, RATER AND LEVEL EFFECTS IN 360-DEGREE PERFORMANCE RATINGS

Method and trait effects in multitrait-multirater (MTMR) data were examined in a sample of 2,350 managers who participated in a developmental feedback program. Managers rated their own performance and were also rated by two subordinates, two peers, and two bosses. The primary purpose of the study was to determine whether method effects are associated with the level of the rater (boss, peer, subordinate, self) or with each individual rater, or both. Previous research which has tacitly assumed that method effects are associated with the level of the rater has included only one rater from each level; consequently, method effects due to the rater's level may have been confounded with those due to the individual rater. Based on confirmatory factor analysis, the present results revealed that of the five models tested, the best fit was the 10-factor model which hypothesized 7 method factors (one for each individual rater) and 3 trait factors. These results suggest that method variance in MTMR data is more strongly associated with individual raters than with the rater's level. Implications for research and practice pertaining to multirater feedback programs are discussed.     

Multilevel metric rank match for person re-identification

Metric learning is one of the important ways to improve the person re-identification (ReID) accurate, of which triplet loss is the most effect metric learning method. However, triplet loss only ranks the extracted feature at the end of the network, in this paper, we propose a multilevel metric rank match (MMRM) method, which ranks the extracted feature on multilevel of the network. At each rank level, the extracted features are ranked to find the hard sample pairs and the backward dissemination triplet loss. Each rank level has different penalize value to adjust the network, in which the value is bigger with the deeper level of the whole network. Experiment results on CUHK03, Market1501 and DukeMTMC datasets indicate that The MMRM algorithm can outperform the previous state-of-the-arts.     

Predicting group-level outcome variables from variables measured at the individual level: a latent variable multilevel model

In multilevel modeling, one often distinguishes between macro-micro and micro-macro situations. In a macro-micro multilevel situation, a dependent variable measured at the lower level is predicted or explained by variables measured at that lower or a higher level. In a micro-macro multilevel situation, a dependent variable defined at the higher group level is predicted or explained on the basis of independent variables measured at the lower individual level. Up until now, multilevel methodology has mainly focused on macro-micro multilevel situations. In this article, a latent variable model is proposed for analyzing data from micro-macro situations. It is shown that regression analyses carried out at the aggregated level result in biased parameter estimates. A method that uses the best linear unbiased predictors of the group means is shown to yield unbiased estimates of the parameters.     

Some statistical treatments compatible with individual organism methodology

Consider experimental treatments with consequences so irreversible that baseline performance cannot be recovered. The conventional method of assessing the effects of such treatments by statistical means involves separate experimental and control groups. An alternative proposed here is to administer the experimental treatment to each subject, one subject at a time and in a random order; whenever any subject receives the experimental treatment, those subjects which have not yet received it receive a control treatment. This procedure permits results significant at the one-tailed 0.05 level to be obtained with four subjects; if a two-group procedure evaluated by means of the U test is used, a minimum of six subjects is needed for the same significance level. More generally, the procedure permits equal sensitivity to any experimental effect with over 30% fewer subjects than a two-group procedure. Extensions of the basic method are made to a variety of levels of the experimental treatment and to treatments without irreversible effects, and limitations of the method are discussed.     

教师背景变量对教师教学效果影响的多层线性分析

用《教师教学效果评价问卷(学生版)》问卷对高校181名教师的教学效果进行调查,用多层次分析法对影响教师教学效果的教师背景变量:教师性别、年龄、学历、职称、所教专业、年级、班级大小以及课程类别对教师教学效果影响程度进行分析,目的在于通过用多层分析法更合理分析教师背景变量对教学效果产生的影响,为客观比较教师教学效果之间的差异提供依据。研究结果表明:(1)多层次分析法得到比传统回归分析和方差分析更合理更准确的结果;(2)教师背景变量教师中性别、学历、专业以及所教班级的大小对于教师教学效果评价效果没有显著影响;(3)教师职称、年龄、所教学生年级、课程类别对教师的教学效果有显著影响;(4)所考察的教师水平背景变量对教学效果各个维度教师水平总变异的解释率介于3351%-4278%之间。     

领导人员选拔考试方法研究

考试在我国新时期领导人员选拔中起着很重要的作用。本文从如何进一步加强考试方法的研究做了一些探讨,并提出提高领导人员选拔考试水平的方法,即丰富考试方法,提高考试方法的信度和效度,提高考试命题的质量,加强对考试成果的分析等。     

Estimation of maximal reliability for multiple‐component instruments in multilevel designs

A procedure for point and interval estimation of maximal reliability of multiple‐component measuring instruments in multi‐level settings is outlined. The approach is applicable to hierarchical designs in which individuals are nested within higher‐order units and exhibit possibly related performance on components of a given homogeneous scale. The method is developed within the framework of multi‐level factor analysis. The proposed procedure is illustrated with an empirical example.     

Assessment of applied research and development: Diversification for science policy

In this paper a method is outlined for measuring the diversity of the results of applied R&D with the use of IPC (International Patent Classification). The method has been tested in the contexts of the academic physical, engineering, and chemical institutes. The trend of applied research at a given institute increases both at the level of classes and subclasses, and at the IPC level. Inventions developed within specializations at each institute have a greater efficiency than other forms of inventive activity. The objective was to seek the optimal extent of diversification of applied R&D, which would simultaneously ensure the preservation of the scientific specialization of an institute, the high level of scientific research associated with developing innovations, and the high overall efficiency of each institute.     

共同方法变异的影响及其统计控制途径的模型分析

共同方法变异(common method variance, CMV)指两个变量之间变异的重叠是因为使用同类测量工具而导致, 而不是代表潜在构念之间的真实关系。虽然以往研究显示CMV不一定导致研究结果的偏差, 在实际研究中应当加以考量。特别是在使用测量方法的研究中, 如果数据来源越单一, 测量方法越类似, CMV效应使研究结果产生偏差的可能性越大。CMV效应的控制方法包括过程控制法和统计控制法。在统计控制法的选择和使用上, 需要重点考虑该方法是否分离了三大变异(特质变异、方法变异和误差变异), CMV效应是在测量构念层面还是题目层面, CMV效应是加法效应还是乘法效应。控制潜在方法因子途径是统计控制方法中最重要的一类方法, 理解其模型是正确使用这类方法的前提。未来研究应当关注多个研究的CMV效应和侧重评估某个理论研究中CMV所引起的潜在的效度威胁。     

Results of self image studies in children and adolescents (11/12-years-old to 16/17-years-old)

The author in his present paper reports the results of studies made in an effort to reconstructively validate a method of self-imaging during childhood and adolescence. From the investigative results obtained it is apparent that during adolescence large self-image/ideal-image differences and low self-image values correlate with neuroticism, a situation which is similar to that which is usually observed in adults. Timid and introverted juveniles differ significantly from less timid and extroverted juveniles in both the self-image level and the self-image/ideal-image difference. Aside from the fact that the self-image level has been found to be relatively independent of intelligence, there are correlations between the maternal and child's self-image. It is of interest to note that the self-image level of children whose parents got a divorce is lower than that of children coming from intact families.     

Clinically significant but impractical? A response to Hageman and Arrindell

Hageman, and Arrindell [Hageman, W.J., & Arrindell, W.A. (in press). Establishing clinically significant change: increment of precision and the distinction between individual and group level of analysis. Behavior Research and Therapy.] suggest adaptations to the traditional clinical significance model originally developed by Jacobson, Follette, and Revenstorf [Jacobson, N.S., Follette, W.C., & Revenstorf, D. (1984). Toward a standard definition of clinically significant change. Behavior Therapy, 17, 308-311.]. They observe that one must distinguish between analysis at the individual and group level and based upon an alternative decision-making strategy have formulated different procedures for assessing clinically significant change that incorporate the unreliability inherent in testing measures. A comparison of the traditional method with Hageman and Arrindell's suggested approach is conducted utilizing data originally presented by Jacobson and Truax [Jacobson, N.S., & Truax, P., Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12-19.] and implications of this comparison for the method developed by Hageman and Arrindell's method are discussed. Although this revised method has much to recommend it, it seems to yield results at the individual level that are quite similar to those derived from the traditional method. Given the complexity of the revised method, the traditional model developed by Jacobson, Follette, and Revenstorf (1984) still seems to be preferable.     

英语阅读问题解决的认知诊断

本研究尝试将认知诊断技术应用于中学生英语阅读问题解决(ERPS),以实现对中学生英语阅读问题解决的认知诊断,探讨中学生英语阅读问题解决的认知发展特点及其所存在的问题,为中学生的相关认知发展和知识获取服务。研究发现:(1)基于文本表征和反应决策两个加工过程中的七个认知属性是影响中学生ERPS的主要认知成分(R2=0.792);(2)中学生对于文本表征加工过程所涉及的属性的掌握情况优于反应决策加工过程所涉及的属性,学生所面临的主要困主要难于在反应决策加工阶段;(3)对不同属性掌握情况上存在显著的学校类型差异。(4)学生认知掌握状态的类型主要集中在15种(占73%),最多的三种为(1111011)、(1111110)和(1111101)(占34%)。总体来说,学生的属性掌握还是比较好的。相对地,对推理、信息匹配和正确选项的加工水平三个属性掌握较差,应引起重视。     

The Analysis and Design of Mental Information Work: A Method Based on the Action Facilitation Approach

Abstract

Mental information work (MIW) can be characterized as work with information and information objects in which mental activities predominate. We examine some problems concerned with the analysis of MIW for (re)design purposes, related to: (1) the accessibility of mental activity for analysis; (2) the complexity of person-task interaction; and (3) the establishment and use of norms in evaluation and (re)design. Furthermore, we describe the structure and contents of a method for the analysis and design of MIW that is currently being developed within the theoretical framework of Action Theory and the Action Facilitation Approach. The focus of the method is on the “within-job” level, dealing with features of the actual performed work behaviour within its environment. The overall architectural level of jobs is taken into account as well. Criteria for the evaluation of work activity are defined on both levels. The method is developed in co-operation with field experts on the analysis and design of work.     

Capturing system level activities and impacts of mental health consumer-run organizations

Since the 1970s mental health consumer-run organizations have come to offer not only mutual support, but they have also adopted agendas for broader social change. Despite an awareness of the need for system level efforts that create supportive environments for their members, there has been limited research demonstrating how their system level activities can be documented or their impacts evaluated. The purpose of this paper is to feature a method of evaluating systems change activities and impacts. The paper is based on a longitudinal study evaluating four mental health consumer-run organizations in Ontario, Canada. The study tracked system level activities and impacts using both qualitative and quantitative methodologies. The article begins by describing the development and implementation of these methods. Next it offers a critical analysis of the methods used. It concludes by reflecting on three lessons learned about capturing system level activities and impacts of mental health consumer-run organizations.     

青少年未来取向三种测试途径的比较

考察未来取向测试新方法（作品分析法）有效性及对比已有测量方法(自陈问卷法、行为测试法)的优缺点。结果发现,问卷法测得青少年未来取向水平随年龄增长逐渐降低,行为测试法和作品分析法测得青少年未来取向水平随年龄增长逐渐提高;问卷法测得未来取向与学校投入相关密切,行为测试法测得未来取向与学业成绩相关密切,作品分析法测得未来取向与学校投入、学业成绩均相关。作品分析法是一种有效测量青少年未来取向的新途径。