When mixed options are preferred in multiple‐trial decisions

We report three studies showing that in prospective multiple‐trial decisions people often select a mix of sure and risky options over pure bundles of either option. Such a preference is not ‘rational’ because a mixed option cannot be the EV‐maximizing choice. Experiment 1 confirmed a mixed‐option preference for gains but not for losses. Showing a graph of the multiple‐trial outcome distribution reduced but did not eliminate this effect, suggesting that it is not due purely to a failure to aggregate correctly over the multiple trials. Experiment 2 replicated the mixed option preference using a wider range of problems. Experiment 3 compared choices in the trinary choice conditions used in Experiments 1 and 2 with binary choices between pairs of the multiple‐trial sure, mixed, and risky options. In the binary choice condition the mixed option was no longer the modal choice, suggesting that the strong mixed option preference found in the trinary choice conditions is mainly due to a compromise effect. However, the binary choice probabilities did show violations of strong stochastic transitivity in a pattern that suggested a slight bias toward the mixed option. Copyright © 2006 John Wiley & Sons, Ltd.     

The effect of item feedback on multiple‐choice test responses

This study examines the effects of item feedback on multiple‐choice test responses. In the first experiment, a positive effect was predicted under instructions advising a penalty for errors; a larger beneficial effect on female scores was expected, given the (presumed) tendency of female participants toward omission when uncertain. Feedback effects were either negligible or negative, and the expected interaction effect with gender was not found. The second experiment was a high‐powered replication of the feedback effect on errors, controlling for participants' ability. The discussion takes into account other evidence to state that recommendations of providing item feedback in the context of testing are neither theoretically nor empirically founded.     

The test taker's fallacy: How students guess answers on multiple‐choice tests

Many students and applicants take multiple‐choice tests to demonstrate their competence and achievement. When they are unsure, they guess the most likely answer to maximize their score. Despite the impact of guessing on test reliability and individual performance, studies have not examined how patterns of answer sequences in multiple‐choice tests affect guessing. This research presents the test taker's fallacy, which refers to an individual's tendency to expect a different answer to appear for the next question given a run of the same answer choices. The test taker's fallacy exhibits negative recency, similar to the gambler's fallacy. However, extending the sequential judgment literature, the test taker's fallacy shows that negative recency arises even when sequences may or may not be randomly generated. In three studies, including a survey and experiments, the test taker's fallacy is robustly observed. The test taker's fallacy is consistent with the operation of the representativeness heuristic. This research explains what and how test takers guess given a streak of answers and extends judgment under uncertainty to the test‐taking context.     

Basis of metamemory judgments for text with multiple‐choice,essay and recall tests

Accuracy of metamemory for text was compared for multiple‐choice, essay and recall tests. Essay and recall tests were scored with Latent Semantic Analysis (LSA), number of correct idea units and number of word matches. Each measure was correlated with college students' predictions and posttest confidence judgments across texts to determine metamemory accuracy. Metamemory accuracy varied for different types of tests with multiple‐choice tests generally producing greater accuracy than essay tests. However, metamemory accuracy for essay and recall tests depended on the measure used to score them. Number of correct idea units produced the highest metamemory accuracy, word matches produced an intermediate level, and LSA produced the lowest accuracy. Students used the quantity of output in their judgments, so performance measures that related most strongly to quantity matched judgments better than measures based on answer quality. The results are compatible with an accessibility account of judgments about performance on text. Copyright © 2008 John Wiley & Sons, Ltd.     

A Monte Carlo evaluation of masked visual analysis in response‐guided versus fixed‐criteria multiple‐baseline designs

We developed masked visual analysis (MVA) as a structured complement to traditional visual analysis. The purpose of the present investigation was to compare the effects of computer‐simulated MVA of a four‐case multiple‐baseline (MB) design in which the phase lengths are determined by an ongoing visual analysis (i.e., response‐guided) versus those in which the phase lengths are established a priori (i.e., fixed criteria). We observed an acceptably low probability (less than .05) of false detection of treatment effects. The probability of correctly detecting a true effect frequently exceeded .80 and was higher when: (a) the masked visual analyst extended phases based on an ongoing visual analysis, (b) the effects were larger, (c) the effects were more immediate and abrupt, and (d) the effects of random and extraneous error factors were simpler. Our findings indicate that MVA is a valuable combined methodological and data‐analysis tool for single‐case intervention researchers.     

Self‐Control Moderates Decision‐Making Behavior When Minimizing Losses versus Maximizing Gains

We examined (1) whether people would be more responsive to the delayed consequences of their decisions when attempting to minimize losses than when attempting to maximize gains in a history‐dependent decision‐making task and (2) how trait self‐control would moderate such an effect. In two experiments, participants performed a dynamic decision‐making task where they chose one of two options on each trial. The increasing option always gave a smaller immediate reward but caused future rewards for both options to increase. The decreasing option always gave a larger immediate reward but caused future rewards for both options to decrease. In Experiment 1 where the two options had equivalent expected value in the long run, participants were more prone to select the increasing option, which yielded larger benefits on future trials, in the loss‐minimization condition than in the gain‐maximization condition. Trait self‐control moderated the effect of losses by enhancing the effect for low self‐control participants while attenuating it for high self‐control participants. In Experiment 2 where selecting the increasing option was suboptimal, low self‐control participants still attempted to reduce losses on future trials by selecting the increasing option more often than high self‐control participants. These results suggest that decision makers value delayed consequences of their actions more in a losses domain relative to a gains domain and low self‐control individuals are more susceptible to such an effect. Copyright © 2014 John Wiley & Sons, Ltd.     

Option weights should be determined empirically and not by experts when assessing knowledge with multiple‐choice items

Multiple‐choice tests are frequently used in personnel selection contexts to measure knowledge and abilities. Option weighting is an alternative multiple‐choice scoring procedure that awards partial credit for incomplete knowledge reflected in applicants’ distractor choices. We investigated whether option weights should be based on expert judgment or on empirical data when trying to outperform conventional number‐right scoring in terms of reliability and validity. To obtain generalizable results, we used repeated random sub‐sampling validation and found that empirical option weighting, but not expert option weighting, increased the reliability of a knowledge test. Neither option weighting procedure improved test validity. We recommend to improve the reliability of existing ability and knowledge tests used for personnel selection by computing and publishing empirical option weights.     

Evaluation of multiple‐alternative prompts during tact training

This study compared 2 methods of fading prompts while teaching tacts to 3 individuals who had been diagnosed with autism spectrum disorder (ASD). The 1st method involved use of an echoic prompt and prompt fading. The 2nd method involved providing multiple‐alternative answers and fading by increasing the difficulty of the discrimination. An adapted alternating‐treatments design showed that both procedures were more effective than a no‐intervention control condition. Providing multiple alternatives did not increase error rates or teaching time, and better maintenance was shown for tacts taught with the multiple‐alternative prompt.     

Recommendations for reporting multiple‐baseline designs across participants

Two recommendations are offered for reporting multiple‐baseline designs across participants. These recommendations will better enable readers to (a) distinguish concurrent from nonconcurrent multiple‐baseline designs and (b) determine the temporal order in which sessions were conducted in concurrent multiple‐baseline designs. Copyright © 2005 John Wiley & Sons, Ltd.     

The self‐choice effects on memory and individual differences in emotional intelligence

The present study examined the self‐choice effects on intentional memory and the relation between individual differences in emotional intelligence, and the size of the self‐choice effects. Word pairs were supplied to the participants in either a self‐choice or forced‐choice condition. In the self‐choice condition the participants were asked to choose one of the words that elicited more pleasant or more unpleasant episodes, and to remember the chosen word. In the forced‐choice condition one of the paired words was underlined to signify that it was the word to remember. For participants who chose a word that elicited more pleasant episodes, self‐choice effects were observed in pleasant‐pleasant and pleasant‐unpleasant word pairs. However, for participants who were asked to choose a word that elicited more unpleasant episodes, the effects were found in unpleasant‐unpleasant and pleasant‐unpleasant word pairs. The size of the self‐choice effects was determined by the level of emotional intelligence.     

A multiple‐stimulus‐without‐replacement assessment for sexual partners: Purchase task validation

The current study developed and tested a multiple‐stimulus‐without‐replacement (MSWO) assessment for potential sexual partners for use in research on human immunodeficiency virus. College students (N = 41) first completed an MSWO assessment and then completed a hypothetical purchase task for encounters with partners identified by the MSWO as high, median, and low preference. Overall, hypothetical purchase task responding was consistent with that from the MSWO, in that the highest valuation was observed for the high‐preference partner and the lowest for the low‐preference partner. Potentially interesting individual differences in purchase task responding, however, were obtained; some subjects showed differentiated responding among the 3 preference levels (n = 15), whereas others similarly valued high‐ and median‐preference partners (n = 5), and others similarly valued low‐ and median‐preference partners (n = 18).     

When goals constrain: Eye movements and memory for goal‐Oriented map study

Perspective goals, such as studying a map to learn a route through an environment or the overall layout of an environment, produce memory congruent with the goal‐directed rather than the studied perspective. One explanation for this finding is that perspective goals guide attention towards actively gathering relevant information during learning. A second explanation is that information is automatically organized into a goal‐congruent spatial model that guides retrieval. Both explanations predict goal‐congruent memory, but only the former one predicts eye movement differences during study. The present experiment investigated the effect of perspective goals on eye movement during map study and the flexibility of resulting spatial memories. Results demonstrate eye movements towards goal‐congruent map elements during learning, and lasting memory effects at test. These findings carry implications for the design of adaptive hand‐held and in‐vehicle navigation interfaces that accommodate for varied user goals. Copyright © 2008 John Wiley & Sons, Ltd.     

Further refinement of video‐based brief multiple‐stimulus without replacement preference assessments

We compared the results of a brief video‐based multiple‐stimulus without replacement preference assessment with no access to chosen activities (MSWO‐NO) to the results of the same assessment with access (MSWO‐WA) with four children with autism. We also compared instructor rankings of activities to MSWO‐WA results. Strong to moderate correlations between MSWO‐NO and MSWO‐WA assessment results were found across all participants. The correlation between MSWO‐WA and instructor rankings ranged from strong to low across all participants. Implications and directions for future research are discussed.     

Personality,expectations, and response strategies in multiple‐choice question examinations in university students: a test of Gray's hypotheses

The relation between personality and type of error made in multiple‐choice examinations when correction for guessing is applied was investigated across two studies. Our general hypothesis was that disinhibited subjects (those scoring high on the Sensitivity to Reward (SR) scale and/or low on the Sensitivity to Punishment (SP) scale) would make more incorrect responses and fewer omission errors (blanks) than inhibited subjects (those with high SP and/or low SR scores). The meta‐analyses of 19 examinations in study 1 confirmed our hypotheses for SP, SR, and extraversion. Regression analyses on effect sizes revealed that SP differences were obtained in examinations with low marks, whereas SR differences were obtained in examinations with more responses and fewer questions. Study 2 showed that a low‐mark expectation increased omissions in high‐SP subjects, whereas a high‐mark expectation increased incorrect responses in high‐SR subjects. These results suggest two different mechanisms mediating inhibition/disinhibition: one associated with aversive motivation, and the other with appetitive motivation. Copyright © 2003 John Wiley & Sons, Ltd.     

Connection‐based and object‐based grouping in multiple‐object tracking: A developmental study

Developmental research on Gestalt laws has previously revealed that, even as young as infancy, we are bound to group visual elements into unitary structures in accordance with a variety of organizational principles. Here, we focus on the developmental trajectory of both connection‐based and object‐based grouping, and investigate their impact on object formation in participants, aged 9–21 years old (N = 113), using a multiple‐object tracking paradigm. Results reveal a main effect of both age and grouping type, indicating that 9‐ to 21‐year‐olds are sensitive to both connection‐based and object‐based grouping interference, and tracking ability increases with age. In addition to its importance for typical development, these results provide an informative baseline to understand clinical aberrations in this regard.

Statement of contribution

What is already known on this subject?

• The origin of the Gestalt principles is still an ongoing debate: Are they innate, learned over time, or both?
• Developmental research has revealed how each Gestalt principle has its own trajectory and unique relationship to visual experience.
• Both connectedness and object‐based grouping play an important role in object formation during childhood.

What does this study add?

• The study identifies how sensitivity to connectedness and object‐based grouping evolves in individuals, aged 9–21 years old.
• Using multiple‐object tracking, results reveal that the ability to track multiple objects increases with age.
• These results provide an informative baseline to understand clinical aberrations in different types of grouping.

     

A post hoc analysis of multiple‐stimulus preference assessment results

Fifteen individuals with developmental disabilities participated in multiple‐stimulus without replacement preference assessments (seven assessment sessions, seven trials each). Twelve of 15 individuals completed a second set of preference assessments 6 months later. Post hoc analyses indicated that in 25 of 27 cases, the same most preferred stimulus was identified in the first three trials as the full seven trials. Additionally, five sessions of three trials each were sufficient to identify the most highly preferred stimulus in 22 of 27 instances. Copyright © 2002 John Wiley & Sons, Ltd.     

When two are a family: looking backward and looking forward in a group intervention with single‐by‐choice mothers

Objective: We describe a preventive short‐term group intervention with nine single‐by‐choice (SBC) mothers to provide maximal support for parental functioning and to minimize possible emotional and/or developmental difficulties in their children. Method: Dynamically oriented group work (fifteen one‐and‐a‐half‐hour sessions) focused on: elaboration of painful experiences in the peri‐natal period; reducing stress, tension and guilt; helping mothers with problematic aspects of parenting through work on parental self‐image and perceptions of the child and the dyadic interaction; and strengthening their acceptance of the chosen family model. Results: Therapeutic gains described by mothers and facilitators include: reduced tension, anxiety and guilt; improved integration of the mother's parental self‐image and perception of the child; reduced ambivalence in dyadic relationships; strengthening the mother's fantasized triadic relationships; better acceptance of chosen family pattern; mothers' willingness to tell children their birth story. Conclusion: Dynamically oriented preventive group intervention with SBC mothers can identify potential psychological risk factors and help mothers with sensitive aspects of parenting.     

Children's preference for mixed‐ versus fixed‐ratio schedules of reinforcement: A translational study of risky choice

Laboratory research has shown that when subjects are given a choice between fixed‐ratio and bi‐valued mixed‐ratio schedules of reinforcement, preference typically emerges for the mixed‐ratio schedule even with a larger ratio requirement. The current study sought to replicate and extend these findings to children's math problem completion. Using an ABCBC reversal design, four fourth‐grade students were given the choice of completing addition problems reinforced on either a fixed‐ratio 5 schedule or one of three mixed‐ratio schedules; an equivalent mixed‐ratio (1, 9) schedule, a mixed‐ratio (1, 11) schedule with a 20% larger ratio requirement, and an equally lean mixed‐ratio (5, 7) schedule without the small fixed‐ratio 1 component. This was followed by a reversal back to the preceding phase in which preference for the mixed‐ratio schedule had been observed, and a final reversal back to the mixed‐ratio (5, 7) phase. Findings were consistent with previous research in that all children preferred the mixed‐ratio (1, 9) schedule over the equivalent fixed‐ratio 5 schedule. Preference persisted for the leaner mixed‐ratio (1, 11) schedule for three of the four children. Indifference or preference for the fixed‐ratio 5 alternative was observed in phases containing the mixed‐ratio (5, 7) schedule. These results extend previous research on risky choice to children's math problem completion and highlight the importance of a small ratio component in the emergence of preference for bi‐valued mixed‐ratio schedules. Implications of these results for arranging reinforcement to increase children's academic responding are discussed.     

Examining change in maximal reliability for multiple‐component measuring instruments

A method for examining change in maximal reliability for pre‐specified sets of congeneric measures when developing a multi‐component instrument is outlined. The approach is applicable for purposes of estimation and testing of gain or loss in the maximal reliability coefficient as a consequence of adding or dropping one or more measures from a homogeneous composite with uncorrelated errors, as well as when one is concerned with optimal component choice for highest increase or correspondingly smallest drop in maximal reliability. The method is compared with a procedure for ascertaining change in unweighted sum score reliability, and implications for instrument construction and revision are discussed. The approach is illustrated with a numerical example.     

Estimation of maximal reliability for multiple‐component instruments in multilevel designs

A procedure for point and interval estimation of maximal reliability of multiple‐component measuring instruments in multi‐level settings is outlined. The approach is applicable to hierarchical designs in which individuals are nested within higher‐order units and exhibit possibly related performance on components of a given homogeneous scale. The method is developed within the framework of multi‐level factor analysis. The proposed procedure is illustrated with an empirical example.