对物理概念图填图试题的应用研究

文章详细介绍了物理概念图填图试题的出题样式和评分的具体方法,并对物理概念图填图试题的难度、区分度、信度和效度进行了检验,计算了物理概念图填图试题与传统物理题型共同组成的期末物理测验的信度。研究表明物理概念图填图试题的得分与传统测验题型的得分呈显著正相关,物理概念图填图试题的得分对传统测验题型的得分有显著的预测力。     

用多元概化理论对普通话的测试

用多元概化理论 (MGT)研究了国家语委编制的普通话测验。在G研究中 ,利用香港人普通话测试的数据 ,估计了引起分数变异的各种来源的方差与协方差分量。在D研究中 ,首先估计了该测验 3个部分的全域分数和各自的概化系数等技术指标 ,然后估计了全域合成分数及其概化系数、信噪比等指标。结果表明 ,该测验的信度从总体上讲是较高的 ,把三个部分的全域分数进行合成也是合理的 ,但从细节上看其第 3部分的信度较低。另外 ,当评分者个数为 3、试题数量为 2 8时 ,测验的第 1、2部分的信度已经较高 ,因此 ,在实测时减少这两部分的题量并不会有太大问题     

3～6岁幼儿羞耻发展教师评定量表的编制

探索幼儿羞耻结构,编制3～6岁幼儿羞耻发展教师评定量表。经文献分析和开放式问卷编码,编制幼儿羞耻发展教师评定初始量表。通过项目分析、探索性因素分析、验证性因素分析修订初始量表,最终正式量表包含违规羞耻和失败羞耻两个维度。对正式量表进行信度检验,结果发现量表具有较高的分半信度、内部一致性信度、评分者一致性信度和重测信度。构建多质多法矩阵检验量表的构念效度,结果发现量表的构念效度良好。该量表达到心理测量学要求,可以作为测量幼儿羞耻的有效工具。     

高考历史试卷的多元概化理论研究

运用多元概化理论及其方法,本研究分析了上海市高考历史试卷(2006年),结果发现:(1)在试卷结构,各部分试题具有较好的测量信度,但在赋分比例存在问题;(2)在主观题评分,评阅者对分数影响微弱,说明分数能较为真实地反映不同考生之间的学科知识和能力差异。此外,研究还为将来提高高考命题和评阅质量提供合理化建议。     

中国人人格形容词评定量表(QZPAS)的信度、效度与常模

本研究的目的是建立中国人人格形容词评定量表(QZPAS)的信度、效度和常模。4000多名被试对由123个形容词组成的QZPAS的评定结果支持了中国人人格的“大七”模型,各因素有着良好的内部一致性和重测信度。自-他评定的相关以及自我总体评定与量表分数间的相关表明QZPAS有良好的效标效度。本研究所提供的常模也为该量表的应用提供了基础。     

质性研究中编码者信度的多种方法考察

质性研究中检验编码者信度的方法有归类一致性指数、编码信度系数、相关系数、中位数检验、概化系数等。基于教师胜任力访谈数据集,对编码者信度考察结果表明,归类一致性指数和编码信度系数受相同编码数影响而不稳定,相关系数受数据类型制约,中位数检验受研究设计影响,概化系数则受编码者和编码项目的数量影响。研究中须合理选用。     

提取练习在记忆保持与迁移中的优势效应：基于认知负荷理论的解释

提取练习比建构概念图更有利于记忆保持和迁移的研究结果尚存在争议。依据认知负荷的3个成分,设计两个实验探究前期知识水平与策略复杂性对以上两种学习策略有效性的影响。结果表明：(1)前期知识水平的主效应不显著,但是与学习策略之间存在交互作用：在提取练习策略条件下,高前期知识水平的被试与低前期知识水平的被试在记忆保持和迁移上的正确率没有显著差异,但是在建构概念图策略条件下,高前期知识水平的被试在记忆保持和迁移上的正确率显著地高于低前期知识水平的被试;(2)当降低概念图的难度后,被试使用建构部分概念图策略产生的认知负荷与使用提取练习策略相比显著降低,并且其在学习阶段学习到的知识量显著地高于使用提取练习策略的结果,但是在最终测试上,其记忆保持与迁移的正确率与使用提取练习策略并没有显著差异,策略的复杂性增加了学习者的额外负荷,但是对策略有效性的发挥却不具有决定性影响。以上结果说明提取练习策略之所以比建构概念图策略更具优势,不是因为其策略本身更易掌握,而是因为其与建构概念图策略相比不受学习者前期知识水平的影响。这意味着认知负荷理论可以很好地解释提取练习在记忆保持与迁移中产生优势效应的内部机制,并进一步证实提取练习与精细编码不同,具有独特的加工机制。     

档案袋评价中评分者信度的实证研究

档案袋评价因能充分发挥促进学生发展和教学改进的功能而受到青睐,但不佳的测评信度和效度限制了其在教学评价中的应用。本文对档案袋评分者信度的特点进行实证研究,4位评分者对152份档案袋进行了2次等级评分,运用多种统计方法计算评分者信度。结果表明,档案袋的评分有较高的关联性、中等偏弱的一致性和一定的稳定性,对档案袋整体水平的评分信度最高。本研究中,评分者个数为3时,对档案袋整体水平评分的概化系数和可靠性系数都在0.80以上。     

中国人人格量表的信度与效度

在初步确定中国人人格量表（Qingnian Zhongguo Personality Scale, QZPS）的基础上,通过对5000多被试的施测,确定了QZPS的项目构成及信度和效度。研究中对QZPS的项目重新进行探索性因素分析,确认了中国人人格的七因素结构,根据对每一个大因素的因素分析和项目鉴别度分析,确定了QZPS各个因素的项目构成和内部一致性系数,共180个项目。通过自-他评定的相关、自评与标尺评定的相关、以及对特殊群体分数分布的分析验证了QZPS的效度。研究结果确认QZPS有良好的信度和效度,可以应用于人格的理论和应用领域。     

中学教师工作积极性的测评研究

本文运用教师积极性测评表对42名中学教师进行了测量,并对测评表的信度和效度进行了检验。结果表明:运用量表对教师的工作积极性进行测评是可行的和有意义的,该量表具有一定的信度和效标关联效度,但还应在现有基础上作必要的增补和预测后,再用因素分析法进行筛选和归类。本文还提出,应建立一个统一的评分体系,使分数更具有可比性。     

学业成就、创造力与跨学科概念图创作能力的关系

为了从知识基础和创造性思维视角探讨跨学科知识整合的条件,以125名高二学生为被试采用相关研究设计考察了学业成就、创造力与跨学科概念图创造能力的关系。结果发现：（1）学业成就与跨学科概念图创作能力正相关;高成就组在命题、交叉和总分维度上的表现优于低成就组;而中成就组在命题和总分维度上的表现优于低成就组;（2）创造力与跨学科概念图创作能力正相关;创造力的流畅性和独创性与跨学科概念图的所有维度正相关;灵活性与概念图创作的命题、交叉、范例和总分正相关;（3）学业成就与创造力能够中等程度地预测跨学科概念图创作不同能力组被试的分布。这表明学业成就和创造力是跨学科知识整合的基础。     

Relationship of field dependence and color coding to female students' achievement.

This study examined the relationship of field dependence and differentially color coded instructional materials (black-and-white and colored) with 126 female students' achievement. Significant differences were found between field-independent and field-dependent students with the field-dependent students scoring higher on the Total Criterion measure. No significant interaction betWeen color coding and field dependence was found on the Total Criterion Test scores. Significant differences in achievement were found in favor of women who received the color-coded version of the Total Criterion Test. These results confirm previous findings relating to the importance of field dependence in visual information and points to the necessity for further systematic analysis of the unique contributions color-coded instructional strategies might have in facilitating the achievement of female students.     

Using network science to analyze concept maps of psychology undergraduates

Network science is an emerging area of complexity science that uses mathematical techniques to study complex systems and could represent a new way of quantifying and investigating the internal structure of domain‐specific knowledge as approximated by students' concept maps. Students enrolled in introductory psychology constructed concept maps to represent their understanding of a psychology chapter. Concept networks were constructed based on the concept maps generated by students. Network analysis revealed that the structure of concept networks differed across students (i.e., some networks were better connected than others), and network structure significantly predicted quiz scores, such that concept networks with larger average shortest path lengths (a network metric representing the average of the shortest paths between two nodes in a network) were associated with higher quiz scores, after controlling for network size. This paper illustrates how network science techniques can be used to quantify the conceptual structure of a learner's knowledge.     

Comparing continuous and dichotomous scoring of the balanced inventory of desirable responding

The Balanced Inventory of Desirable Responding (BIDR; Paulhus, 1994) is a widely used instrument to measure the 2 components of social desirability: self-deceptive enhancement and impression management. With respect to scoring of the BIDR, Paulhus (1994) authorized 2 methods, namely continuous scoring (all answers on the continuous answer scale are counted) and dichotomous scoring (only extreme answers are counted). In this article, we report 3 studies with student samples, and continuous and dichotomous scoring of BIDR subscales are compared with respect to reliability, convergent validity, sensitivity to instructional variations, and correlations with personality. Across studies, the scores from continuous scoring (continuous scores) showed higher Cronbach's alphas than those from dichotomous scoring (dichotomous scores). Moreover, continuous scores showed higher convergent correlations with other measures of social desirability and more consistent effects with self-presentation instructions (fake-good vs. fake-bad instructions). Finally, continuous self-deceptive enhancement scores showed higher correlations with those traits of the Five-factor model for which substantial correlations were expected (i.e., Neuroticism, Extraversion, and Conscientiousness). Consequently, these findings indicate that continuous scoring may be preferable to dichotomous scoring when assessing socially desirable responding with the BIDR.     

Effects of Concept Mapping on Creativity in Photo Stories

This research tested the use of concept map planning to support the development of creativity in photo stories, hypothesizing that skills taught to support organization would improve creativity. Concept maps are a type of graphic organizer, used to represent an ordering of ideas with nodes and linking words that form propositional statements. They were applied to story development under the assumption that the creative development of narrative elements requires organization. Undergraduate education students were randomly assigned to either concept map or text-based planning groups for the production of digital photo stories. Creativity was operationalized using dimensions of novelty, interest, clarity, and ability to be understood. A multivariate effect of planning method was found for these dimensions favoring the concept map group, due largely to greater clarity in the photo stories. Clarity in photo stories adds to their utility as creative products. This study represents first steps toward empirically assessing concept maps for a creative purpose, and further investigation, with a larger sample in an authentic context, over a longer period of planning time is recommended.     

Retrieval-based learning: The need for guided retrieval in elementary school children

Three experiments were aimed at adapting retrieval practice techniques that are effective with college students to work with elementary school children. Children participated in their classrooms and completed activities with educational texts selected from the school curriculum. In Experiment 1, when children were asked to freely recall the texts, they recalled very little of the material (about 10%) and showed almost no improvement after rereading. In another condition that involved creating concept maps, the children produced only about 20% of the ideas on their maps, even though they viewed the texts during the entire activity. Experiments 2 and 3 explored ways to provide support during retrieval activities. In Experiment 2, children were very successful at retrieving knowledge on concept maps that were partially completed. In Experiment 3, a question map activity, where questions were displayed in a relational map format, was effective for guiding retrieval practice and improving learning relative to repeated studying. The results demonstrate the importance of examining strategies that work with college students with young children in educational settings using authentic materials. The results also highlight the need for guided retrieval practice in young children.     

A Proposed Number Correct Scoring Procedure Based on Classical True-Score Theory and Multidimensional Item Response Theory

A hybrid procedure for number correct scoring is proposed. The proposed scoring procedure is based on both classical true-score theory (CTT) and multidimensional item response theory (MIRT). Specifically, the hybrid scoring procedure uses test item weights based on MIRT and the total test scores are computed based on CTT. Thus, what makes the hybrid scoring method attractive is that this method accounts for the dimensionality of the test items while test scores remain easy to compute. Further, the hybrid scoring does not require large sample sizes once the item parameters are known. Monte Carlo techniques were used to compare and contrast the proposed hybrid scoring method with three other scoring procedures. Results indicated that all scoring methods in this study generated estimated and true scores that were highly correlated. However, the hybrid scoring procedure had significantly smaller error variances between the estimated and true scores relative to the other procedures.     

Cognitive load and the imagination effect

When presented with a procedure or concept to learn, imagining the procedure or concept may be an effective instructional technique compared to conventional studying, thus generating an imagination effect. However, it was hypothesized that the importance of learning through imagining as an instructional technique depends on modes of presentation. Experiment 1 tested adults studying or imagining contour maps as participants and was designed to verify the generality of the imagination effect. Imagination instructions were superior to study instructions on subsequent test questions. Experiment 2 further investigated the effect by comparing much younger students (Grade 4), studying or imagining temperature/time graphs presented in either a split‐attention (spatially separated diagram and text) or an integrated (spatially combined diagram and text) format. Results on a subsequent test indicated that the Grade 4 students found imagining beneficial to their learning, compared with studying the material but the effect was only obtained using an integrated rather than a split‐attention format. Experiment 3 was conducted to obtain verbal protocols from Grade 4 imagination and study groups using the same instructional materials to throw light on the cognitive mechanisms behind the imagination effect. Copyright © 2004 John Wiley & Sons, Ltd.