In many educational tests which involve constructed responses, a traditional test score is obtained by adding together item scores obtained through holistic scoring by trained human raters. For example, this practice was used until 2008 in the case of GRE®General Analytical Writing and until 2009 in the case of TOEFL® iBT Writing. With use of natural language processing, it is possible to obtain additional information concerning item responses from computer programs such as e‐rater®. In addition, available information relevant to examinee performance may include scores on related tests. We suggest application of standard results from classical test theory to the available data to obtain best linear predictors of true traditional test scores. In performing such analysis, we require estimation of variances and covariances of measurement errors, a task which can be quite difficult in the case of tests with limited numbers of items and with multiple measurements per item. As a consequence, a new estimation method is suggested based on samples of examinees who have taken an assessment more than once. Such samples are typically not random samples of the general population of examinees, so that we apply statistical adjustment methods to obtain the needed estimated variances and covariances of measurement errors. To examine practical implications of the suggested methods of analysis, applications are made to GRE General Analytical Writing and TOEFL iBT Writing. Results obtained indicate that substantial improvements are possible both in terms of reliability of scoring and in terms of assessment reliability. 相似文献
This study examined the relationship between family context of middle school students on their educational and occupational ideals. Middle school students (N = 2000) responded to questions assessing family location, family structure, parental educational level and family economic status, as well as to the Middle School Students' Ideals Questionnaire. Multivariate analysis of variance indicated that life, educational and occupational ideals of female students and students in lower grades were higher than that of male students and students in higher grades. Regression analysis indicated that paternal education level have a positive association with educational and occupational ideals, but not life ideals, and family economic status have a positive relation to life ideals, but not educational and occupational ideals. Moreover, the interaction between family economic status and family location has a negative association with students' life, educational and occupational ideals. These results suggest that different factors predicted different ideals of adolescents, and that family economic status had a negative moderating effect on the relationship between family location and ideals of students. 相似文献
Body image comparisons on social networking sites (SNS) have been found to be associated with disordered eating among western young women, however, the inner mechanism driving this association is largely unknown. Based on social comparison, sociocultural, and objectification theories, the present study aimed to investigate the association between body image comparisons on SNS and restrained eating, as well as the mediating role of body shame and the moderating roles of body appreciation and body mass index (BMI) among Chinese young adult women. A sample of 567 Chinese college women were recruited to complete a questionnaire assessing body image comparisons on SNS, body shame, body appreciation, restrained eating, and information about weight and height. Results showed that body image comparisons on SNS were positively associated with restrained eating and that body shame significantly mediated this association. Furthermore, body appreciation and BMI each moderated the association between body shame and restrained eating as well as the association between body image comparisons on SNS and restrained eating. These results not only have theoretical implications, but also provide guidance for prevention interventions targeting negative body image and disordered eating among college women.