变通的题组项目功能差异检验方法在篇章阅读测验中的应用

篇章形式的阅读测验在语文学科考试与语言能力测试中占有越来越重要的地位。篇章阅读测验是一种典型的题组测验, 因此需要采用能够处理题组效应的统计方法进行分析。在进行项目功能差异(DIF)检验时, 也需要采用与之匹配的DIF检验方法。目前能够处理题组效应的DIF检验方法主要包括变通的题组DIF检验方法和基于题组反应模型的DIF检验方法, 基于题组反应模型的DIF检验方法由于实现过程繁琐, 目前只停留在理论探讨阶段。本研究将变通的题组DIF检验方法及其效应值指标引入篇章阅读测验的DIF检验中, 能够解决篇章阅读测验中DIF检验与测量的问题, 效应值指标能够为如何处理有DIF效应的题组项目提供重要依据。本研究首先选用非题组DIF检验方法与变通的题组DIF检验方法对一份试卷进行DIF检验, 两种方法的比较结果体现了进行题组DIF检验的必要性与优越性, 然后选用变通的题组DIF检验方法中有代表性的四种方法对某阅读成就测验进行题组DIF检验。研究结果表明, 在篇章阅读测验中, 能够处理题组效应的DIF检验方法较传统的DIF检验方法具有较大的优越性。     

The Recovery of Correlation Between Latent Abilities Using Compensatory and Noncompensatory Multidimensional IRT Models

This research examined correlation estimates between latent abilities when using the two-dimensional and three-dimensional compensatory and noncompensatory item response theory models. Simulation study results showed that the recovery of the latent correlation was best when the test contained 100% of simple structure items for all models and conditions. When a test measured weakly discriminated dimensions, it became harder to recover the latent correlation. Results also showed that increasing the sample size, test length, or using simpler models (i.e., two-parameter logistic rather than three-parameter logistic, compensatory rather than noncompensatory) could improve the recovery of latent correlation.     

The impact of using forced decision-making strategies on post-decisional confidence

The impact of motivational and cognitive factors on post-decisional confidence (PDC) level was tested in two experiments. In the first experiment, subjects were first identified as having an intuitive preference toward using either a compensatory or a noncompensatory decision strategy and later on were forced to use either a compatible or a non-compatible strategy. PDC level decreased after using a noncompensatory strategy, and the decrease was higher when it was a noncompatible strategy. In a second experiment, subjects received feedback about their preferred strategy but were not later forced to use any specific strategy. Most subjects continued to utilize their preferred strategy and PDC level was not changed. Overall, intuitive PDC was not found to be sensitive to differences between compensatory and noncompensatory strategies. The result suggested that PDC is a function of an internal cost-benefit analysis which includes both cognitive and motivational factors.     

Ignorance or integration: the cognitive processes underlying choice behavior

The fast‐and‐frugal heuristic framework assumes noncompensatory tools for human preferences (i.e., priority heuristic) and inferences (i.e., take the best heuristic). According to this framework, these heuristics predict choice behavior as well as model the cognitive processes underlying such behavior. The current paper presents two studies that juxtapose predictions derived from these two simple heuristics with alternative predictions derived from compensatory principles. Dependent measures that included reaction time, choice pattern, confidence level, and accuracy were better predicted by compensatory indices than by noncompensatory indices. These findings suggest that people do not rely on limited arguments only, but tend to integrate all acquired information into their choice processes. This tendency was replicated even when the experimental task facilitated the use of noncompensatory principles. We argue that the fast and frugal heuristics can predict the final outcome only under certain conditions, but even in these particular situations they are not applicable to the processes underlying choice behavior. An integrative model for choice behavior is proposed that better represents the data. Copyright © 2009 John Wiley & Sons, Ltd.     

Self–other differences in multiattribute decision making: Compensatory versus noncompensatory decision strategies

When making decisions where options involve multiple attributes, a person can choose to use a compensatory, utility maximizing strategy, which involves consideration and integration of all available attributes. Alternatively, a person can choose a noncompensatory strategy that extracts only the most important and reliable attributes. The present research examined whether other‐oriented decisions would involve greater reliance on a noncompensatory, lexicographic decision strategy than self‐oriented decisions. In three studies (Mturk workers and college students), the difference in other‐oriented versus self‐oriented decisions in a medical decision context was explained by a subsample of participants that chose the death minimizing operation on all 10 decisions (Study 1) and a subsample of participants who self‐reported that they used a strategy that minimized the chance of death on every decision (i.e., a lexicographic mortality heuristic; Study 2). In Study 2, tests of mediation found that self‐reported use of the mortality heuristic completely accounted for the self–other effect on decisions. In Study 3, participants were more likely to report prospectively that they would adopt the mortality heuristic when making decisions for others than for themselves, suggesting that participants were not mistakenly inferring a lexicographic decision strategy from their past behavior. The results suggest that self–other effects in multiattribute choice involve differential use of compensatory versus noncompensatory decision strategies and that beyond this group difference, individual differences in the use of these strategies also exist within self‐oriented and other‐oriented decisions.     

From recognition to decisions: Extending and testing recognition-based models for multialternative inference

The recognition heuristic is a noncompensatory strategy for inferring which of two alternatives, one recognized and the other not, scores higher on a criterion. According to it, such inferences are based solely on recognition. We generalize this heuristic to tasks with multiple alternatives, proposing a model of how people identify the consideration sets from which they make their final decisions. In doing so, we address concerns about the heuristic’s adequacy as a model of behavior: Past experiments have led several authors to conclude that there is no evidence for a noncompensatory use of recognition but clear evidence that recognition is integrated with other information. Surprisingly, however, in no study was this competing hypothesis—the compensatory integration of recognition—formally specified as a computational model. In four studies, we specify five competing models, conducting eight model comparisons. In these model comparisons, the recognition heuristic emerges as the best predictor of people’s inferences.     

Interactive decision-making: effects of consultation before personal decisions on postdecision consolidation

Pre- and postdecision processes were studied in triads of participants, dyads of participants, and for individual decision-makers in two experiment (N = 57 and 50). Participants were students volunteering to take part in the study (21 men and 36 women with a mean age of 24 yr. and 25 men and 25 women with a mean age of 27 yr.). The purpose was to examine how much interactive versus individual social interaction (consultation with others before making a personal decision) affects postdecision consolidation. Predecision differentiation and postdecision consolidation have been defined as attractiveness changes over time in favour of the chosen alternative. Participants were coded into three categories (noncompensatory, compensatory, and nonclassified) according to their different decision strategies. For Exp. 1, postdecision consolidation effects were significant for participants who used a noncompensatory (no comparisons across attributes) decision strategy. For Exp. 2, postdecision consolidation effects were significant for participants who made a personal decision but not those who made an interactive decision. The differing results in these two experiments were discussed.     

Goals as Determinants of Nonlinear Noncompensatory Judgment Strategies: Leniency vs Strictness

A distinction is made between information processing variables and goals as determinants of nonlinear noncompensatory judgment strategies. The latter determinants are studied by manipulating judges′ goals to be lenient or strict in their judgment and examining the effects of these manipulations on the tendency to use disjunctive, conjunctive, or linear strategies. Implications for decision-making research are discussed.     

测验理论的新发展:多维项目反应理论

多维项目反应理论是基于因子分析和单维项目反应理论两大背景下发展起来的一种新型测验理论。根据被试在完成一项任务时多种能力之间是如何相互作用的,多维项目反应模型可以分为补偿性模型和非补偿性模型两类。本文在系统介绍了当前普遍使用的补偿性模型的基础上,指出后续研究者应关注多维项目反应理论中多级评分和高维空间的多维模型、补偿性和非补偿性模型的融合、参数估计程序的开发和多维测验等值四个方面的研究。     

认知老化对于老年人决策过程的影响:动机的调节作用

有关老化和决策制定的研究并没有发现一致的年龄差异。从决策过程的角度,论述了老化对于决策制定的多层面影响。从认知层面来讲,流体认知能力的衰减会使老年人在决策制定前搜索更少的信息,使用非补偿性策略,基于属性进行信息搜索和比较;晶体认知能力的相对保持则在一定情况下弥补了这种消极影响;从动机层面来讲,关注情绪管理目标的老年人会倾向于寻求更多积极的信息,为了避免权衡诱发的消极情绪而更多地使用非补偿性策略。动机对于认知老化的消极影响有调节作用。具体来说,社会情绪选择理论和选择性投入假设认为,当决策任务符合老年人的社会目标,即情绪管理目标时,能够激活老年人投入认知资源的动机,从而缓解认知资源的衰减对于老年人决策表现的消极影响。未来的研究需要通过实验设计进一步探索动机与认知的交互作用,将多种过程追踪技术结合起来,明晰动机和认知能力在老年人决策制定中的作用。另外考虑到在社会目标方面的年龄差异,对于老年人决策质量的衡量应该更加注重主观决策质量。     

Information search and choice accuracy as a function of task complexity and task structure

Previous research has consistently shown that subjects switch to noncompensatory information search behaviour when task complexity increases. However, a rather specific class of tasks was used in these studies for which complete information search is not necessary to attain accurate task performance. In the present study information search behaviour, choice accuracy, subjective difficulty and confidence were registered under various task complexity conditions in two different task environments. In the first task, subjects had to make a choice between apartments; in the second task, a choice was required between baskets containing groceries of different prices. Forty subjects made choices by means of computerized information boards. The results showed effects of both complexity and type of task on information search behaviour. The lowest proportion of requested information and the most variable search pattern was observed for the apartments task in the complex task condition. However, accuracy remained constant over all complexity conditions. Together, the results suggest that under high task complexity levels subjects try to work smarter rather than harder. In the context of a choice requirement the specific task structure may allow them to switch to noncompensatory strategies while maintaining accuracy and avoiding the integration of large amounts of information.     

Termination of information evaluation in auditing

A screening decision is about whether a candidate fails to meet a decision maker's criteria and must be rejected, or whether it meets the criteria and can be accepted. Image theory contends that screening decisions are based on a simple, noncompensatory process that focuses solely upon the candidate's negative attributes. This contention has received empirical support in a job screening context in which students role-played a hypothetical person seeking a job. But how robust is image theory's prediction? The present work was done in the context of professional auditors screening prospective clients. The client screening context is a particularly interesting setting to test the implications of image theory. If auditors reject clients with negative attributes, as predicted by image theory, this will indicate that some clients are being denied access to a socially useful service. Further, auditors can accept prospective clients with negative attributes and simply adjust the audit plan and fees to compensate for the client's riskiness. Thus, it is not clear that the preliminary findings obtained in a job screening context will generalize to the audit context. On the other hand, results consistent with the image theory prediction would suggest a robust theory. Even in the client screening context, where auditors used their own criteria to screen prospective clients, we found overwhelming support for image theory's view of screening. The results indicate the potential payoffs of image theory as a robust framework to address audit and other substantive problems. Implications of a noncompensatory, negative oriented, client screening strategy are discussed.     

Personality Testing in Personnel Selection: Adverse impact and differential hiring rates

Personality tests are often used in selection and have demonstrated predictive validity across a variety of occupational groups and performance criteria. Although different selection decision methods can be used to make selection decisions (e.g., compensatory top down, compensatory with sliding bands, noncompensatory) from personality test results, there is a paucity of research addressing the influence of these different selection decision methods on issues such as, adverse impact and differential hiring rates. This gap in the literature is redressed in the current study. Results from 398 bus operator candidates indicated that there may be adverse impact and differential hiring rate issues depending on the selection decision method used and the designated group being assessed. Implications and future research directions are discussed.     

Most people do not ignore salient invalid cues in memory-based decisions

Former experimental studies have shown that decisions from memory tend to rely only on a few cues, following simple noncompensatory heuristics like "take the best." However, it has also repeatedly been demonstrated that a pictorial, as opposed to a verbal, representation of cue information fosters the inclusion of more cues in compensatory strategies, suggesting a facilitated retrieval of cue patterns. These studies did not properly control for visual salience of cues, however. In the experiment reported here, the cue salience hierarchy established in a pilot study was either congruent or incongruent with the validity order of the cues. Only the latter condition increased compensatory decision making, suggesting that the apparent representational format effect is, rather, a salience effect: Participants automatically retrieve and incorporate salient cues irrespective of their validity. Results are discussed with respect to reaction time data.     

Decision making with the "adaptive toolbox": influence of environmental structure,intelligence, and working memory load

In 2 experiments with a total of 220 participants, the tendency to use simple heuristics such as the take the best heuristic in an adaptive manner was investigated. In a simulated stock market paradigm, the payoff structure of environments was varied, favoring either compensatory or noncompensatory decision strategies in terms of expected long-term payoff. In both experiments, the majority of participants were classified as using strategies that were adequate for the environment, supporting the notion of adaptive strategy selection. These strategy shifts were moderated by intelligence, as measured with common tests. Neither an additional learning phase (Experiment 1) nor working memory load or working memory capacity (Experiment 2) had additional effects on strategy selection.     

Mathematical models of foreign policy decision-making: Compensatory vs. noncompensatory

There are presently two leading foreign policy decision-making paradigms in vogue. The first is based on the classical or rational model originally posited by von Neumann and Morgenstern to explain microeconomic decisions. The second is based on the cybernetic perspective whose groundwork was laid by Herbert Simon in his early research on bounded rationality. In this paper we introduce a third perspective — thepoliheuristic theory of decision-making — as an alternative to the rational actor and cybernetic paradigms in international relations. This theory is drawn in large part from research on heuristics done in experimental cognitive psychology. According to the poliheuristic theory, policy makers use poly (many) heuristics while focusing on a very narrow range of options and dimensions when making decisions. Among them, the political dimension is noncompensatory. The paper also delineates the mathematical formulations of the three decision-making models.The authors thank Raymond Dacey for his helpful comments.     

On the role of recognition in decision making

In 2 experiments, the authors sought to distinguish between the claim that recognition of an object is treated simply as a cue among others for the purposes of decision making in a cue-learning task from the claim that recognition is attributed a special status with fundamental, noncompensatory properties. Results of both experiments supported the former interpretation. When recognition had a high predictive validity, it was relied on (solely) by the majority of participants; however, when other cues in the environment had higher validity, recognition was ignored, and these other cues were used. The results provide insight into when, where, and why recognition is used in decision making and also question the elevated status assigned to recognition in some frameworks (e.g., D. G. Goldstein & G. Gigerenzer, 2002).     

Assessing the empirical validity of the "take-the-best" heuristic as a model of human probabilistic inference

The boundedly rational 'Take-The-Best" heuristic (TTB) was proposed by G. Gigerenzer, U. Hoffrage, and H. Kleinb?lting (1991) as a model of fast and frugal probabilistic inferences. Although the simple lexicographic rule proved to be successful in computer simulations, direct empirical demonstrations of its adequacy as a psychological model are lacking because of several methodical problems. In 4 experiments with a total of 210 participants, this question was addressed. Whereas Experiment 1 showed that TTB is not valid as a universal hypothesis about probabilistic inferences, up to 28% of participants in Experiment 2 and 53% of participants in Experiment 3 were classified as TTB users. Experiment 4 revealed that investment costs for information seem to be a relevant factor leading participants to switch to a noncompensatory TTB strategy. The observed individual differences in strategy use imply the recommendation of an idiographic approach to decision-making research.