Alternative theories of concept identification among older adults

The purpose of the present experiment was to investigate some predictions of hypothesis testing and S-R association (frequency) theories regarding memory for intratrial events on a conjunctive concept-identification task. They have received extensive study with young adults but not with older subjects. The individual events under investigation were feedback, responses, hypotheses, and stimuli. Hypothesis-testing theory requires subjects to retain information concerning the correct hypothesis from one trial to the next whereas frequency does not. 75 subjects (60-70 yr. old) participated in the study. Subjects had difficulty in recalling the correct hypothesis stated on previous trials. These errors occurred on problems with negative response trials, not with incorrect feedback. The results contradict predictions based on hypothesis-testing models but are consistent with frequency theory. Unlike in the studies based on younger adults, present subjects did not recall the hypothesis very well under the conditions in which hypothesis testing was made part of the primary task.     

Cognitive Biases In Sales Management Evaluations

Abstract

In a factorial experiment, subjects, most of whom possessed managerial experience, were given information about a salesperson and asked to rate his ability on the job. As predicted, the subjects tended to overutilize effort information and underutilize task difficulty information in making their evaluations. The research reveals that cognitive biases in information processing may influence a crucial sales management responsibility. The results are discussed in terms of their implications for employee promotions and the application of attribution theory to sales personnel evaluations.     

The role of collateral information about examinees in item parameter estimation

Standard procedures for estimating item parameters in item response theory (IRT) ignore collateral information that may be available about examinees, such as their standing on demographic and educational variables. This paper describes circumstances under which collateral information about examineesmay be used to make inferences about item parameters more precise, and circumstances under which itmust be used to obtain correct inferences.This work was supported by Contract No. N00014-85-K-0683, project designation NR 150-539, from the Cognitive Science Program, Cognitive and Neural Sciences Division, Office of Naval Research. Reproduction in whole or in part is permitted for any purpose of the United States Government. We are indebted to Tim Davey, Eugene Johnson, and three anonymous referees for their comments on earlier versions of the paper.     

The Influence of Attitude upon Scaling of Attitude Items

Summary

Subjects had their expectation of pay for serving in a conformity experiment disconfirmed by receiving amounts either greater or lesser than were expected, while control subjects received their expected pay. The dissonance theory prediction of an energization of either compliance or noncompliance was not obtained, nor support given to social-exchange-theory predictions of conformity as a direct function of pay level. No differences in conformity behavior or tendencies to respond to questionnaires in a socially desirable direction were obtained between high and low scoring Ss on the Marlowe-Crowne SD (7). The finding of no differences in conformity between Ss judged aware of the manipulations and those unaware might be mediated by a general predisposition to seek and comply with demands in an experimental setting.     

The generalized Logit-Linear Item Response Model for Binary-Designed Items

This paper introduces the generalized logit-linear item response model (GLLIRM), which represents the item-solving process as a series of dichotomous operations or steps. The GLLIRM assumes that the probability function of the item response is a logistic function of a linear composite of basic parameters which describe the operations, and the coefficients depend on three design matrices X, Y and Z. The GLLIRM provides a tool for testing hypotheses on the item-solving process and generalizes existing models. An empirical application is included, in which the model is applied to evaluate sources of difficulty and pairwise item interactions in a logical analysis test. This research was supported by the Comunidad de Madrid grant CCG06-UAM/ESP-0043.     

Inhibitory processes in young and older adults in a picture-word task

Abstract

The present study examines changes in healthy young and healthy older adults in the ability to inhibit partially activated information in a picture/word interference paradigm. On each trial, subjects received a cue (i.e., the word PICTURE or WORD) indicating which of two stimuli the subject should attend to in an upcoming picture/word display. the display always contained a superimposed picture and word (e.g., a picture of a DEER with the word TEA printed on it). Following display offset, and depending upon the initial precue, either a test picture (e.g., KETTLE) or a test word (e.g., MOOSE) was presented. the subject's task was to determine as quickly and as accurately as possible whether the test stimulus was related to the cued dimension of the earlier picture/word display. the speed to reject an unrelated test item (e.g., picture of a KETTLE when the precue was PICTURE) that was related to the ignored dimension of the picture/word display (e.g., the word TEA in the picture/word display) was used as an index of the efficiency of the inhibitory system. the results indicated that older adults had more difficulty than younger adults inhibiting a to-be-ignored word when it was related to a picture test item, but did not have more difficulty inhibiting a to-be-ignored picture when it was related to a word test item. the results indicate that an age-related deficit in the control of interfering information is dependent upon the fluency of the processing routes.     

Utilization of base-rate information during feeling-of-knowing judgments.

We examined whether subjects use base-rate information about item difficulty when making feeling-of-knowing judgments for items they failed to recall. First, the subjects attempted to recall the answers to general-information questions. Then, for those items they recalled incorrectly, half of the subjects received information about the normative probability of recall of each item while judging their feeling of knowing. The other subjects made their feeling-of-knowing judgments without receiving any base-rate information. Finally, all subjects had a forced-choice recognition test on those items to validate the accuracy of their feeling-of-knowing judgments. Relative to the no-base-rate information group, the base-rate group had lower feelings of knowing for normatively difficult items and higher feelings of knowing for normatively easier items. Subjects who had received base-rate information during the judgment state had greater feeling-of-knowing accuracy than subjects who did not receive base-rate information. However, even the predictions from subjects who received base-rate information were not significantly more accurate for predicting subsequent recognition than were the predictions derived from normative information alone.     

Conceptual knowledge of emotions includes somatosensory component: Evidence from modality-switch cost effect

Processing and storage constitute important aspects of working memory. However, the relationship between them remains unclear. If they constitute separate, independent capacities then manipulations of processing and storage load should have independent effects on task performance. In the present research, university students (N=84) were administered a reasoning task based on the Greco-Latin square task, in which processing (as defined by relational complexity) and storage load were orthogonally manipulated. Theoretical processing and storage load were each able to predict significant unique portions of the variance in both item difficulty and correct response time. However, no interaction term was able to significantly increase predictive power for either item difficulty or correct response time. This suggests that over the range of processing and storage load imposed by the task, processing and storage capacity are largely additive (i.e., independent). Implications for models of working memory are discussed.     

Conformity on a visual task as a function of personal novelty on attitudinal dimensions and being reminded of the object status of self

An experiment was conducted to test the proposition that a person's level of conformity on a visual task was related to his level of personal novelty on attitudinal dimensions and being reminded that he was an object in the world. Subjects were led to believe that either 95, 50, or 5% of a population of 10,000 held the same position as they did on 10 important attitudinal dimensions. Subjects were then asked to participate in an experiment on visual perception. In this portion of the study, subjects were led to believe that two other subjects consistently disagreed with their estimates and were either shown or not shown their live image on a television monitor. The results of the experiment indicated a positive relationship between novelty on the attitudinal dimensions and both frequency and intensity of conformity on the visual task. As novelty increased, conformity increased. In addition, subjects shown their image on a television monitor during the conformity trials conformed to the bogus others to a greater extent than subjects not shown their image on a television monitor.     

Percentage of pupillary dilation as a measure of item difficulty

The purpose of this study was to compare four measures of difficulty of mental multiplication items: percentage of pupillary dilation, latency of solution, number of correct responses, and judgment of item difficulty. Sixteen multiplication problems, classified into four levels of difficulty, were presented visually to 13 Ss, who verbalized their solutions to the problems. Analyses of variance and correlation coefficients were computed. It was concluded that all four measures of difficulty were useful but that judgment of difficulty and latency of solution were better measures of item difficulty than were the other two. A discussion of pupillary dilation and information processing is included.     

Recognition and position information in working memory for visual textures

In three experiments, we examined connections between item-recognition memory and memory for item-position information. With sequences of compound gratings as study and probe items, subjects made either item-position judgments (Experiments 1 and 2), by identifying the serial position of the study item that matched the probe, or recognition judgments (Experiment 3), by judging whether the probe had or had not been presented in the study series. Integrating a summed-similarity account of recognition into a signal detection framework shows that the variance of summed similarities on lure trials (probe not present in the study series) exceeds the variance on target trials (probe present in the study series). This prediction is borne out by the empirical zROC functions, all of which had slopes that were greater than 1. Additionally, about 25% of correct recognitions were accompanied by incorrect item position identification. Misidentifications of item position arose from two sources--structural similarity and positional similarity-which combined in an approximately additive fashion.     

Prospective memory in a language-trained chimpanzee (Pan troglodytes)

Prospective memory involves the encoding, retention, and implementation of an intended future action. Although humans show many forms of prospective memory, less is known about the future oriented processes of nonhuman animals, or their ability to use prospective memory. In this experiment, a chimpanzee named Panzee, who had learned to associate geometric forms called lexigrams with real-world referents, was given a prospective memory test. Panzee selected between two foods the one she wanted to receive more immediately. That food was scattered in an outdoor yard where she could forage for it. Also outdoors were lexigram tokens, one of which represented the food item that remained indoors throughout a 30 min period, and that could be obtained if Panzee brought in the token that matched that food item. After foraging for the selected food item, Panzee consistently remembered to retrieve and return the correct token when food was available indoors, whereas on control trials involving no indoor food she rarely returned a token. This indicated that Panzee encoded information relevant to the future action of token retrieval after extended delays for one type of food, even when a more immediately preferred food was available.     

Hindsight bias: An interaction of automatic and motivational factors?

If subjects are asked to recollect a former response after having been informed about the correct response, their recollection tends to approach the correct response. This effect has been termedhindsight bias. We studied hindsight bias in an experiment requiring numerical responses to almanac-type questions for physical quantities. We varied (1) the time at which the correct information was provided, (2) the encoding of the original responses by asking/not asking subjects to give a reason for the respective response, and (3) the motivation to recall correctly. We found that hindsight is less biased if reasons are given and if the correct information is provided at an earlier time. Motivation had only interactive effects: (1) With high motivation to recall correctly, the time the correct information was provided had no influence. (2) With reasons given, the variation of motivation showed no effect. These results rule out purely motivational and purely automatic explanations.     

Relearning movements: modification of an incorrectly timed reversal movement.

The main purpose of this study was to examine if an inaccurately acquired motor response can be relearned through the provision of a limited number of correct KR trials. 26 subjects were assigned to one of three experimental groups: a no-KR group, an erroneous KR group, and a relearning group who were given correct KR after 125 trials of erroneous KR. Analysis showed a significant temporal correction of the reversal movement when the erroneous KR was replaced by valid verbal information during acquisition. This adaptation, however, was attenuated during retention, indicating that the limited number of correct KR trials did not wash out the effect of the invalid information provided during the first phase of acquisition.     

Evidence in support of word unitization

In each of five experiments, the subjects viewed tachistoscopically presented pairs of letters and made speeded comparison judgments on the basis of name identity. On most trials, a noise letter string (word or anagram) was placed directly between the target letters. The results indicated that correct “same” RTs were a function of noise item type and its relation to target letters. Anagrams increased RTs more than their counterpart words, except when the noise word was either unmeaningflul or response incompatible with respect to the target letters (e.g., B Tea b). The interference effects were also found to be independent of sequence length. It was posited that the subjects were unable to completely ignore the irrelevant attributes of the displays and that under certain conditions, the subjects were able to identify the noise items in a holistic fashion. The data were interpreted in terms of a unitization hypothesis of word recognition, response competition, and a continuous-flow conception of information processing.     

Conflict and metacognitive control: the mismatch-monitoring hypothesis of how others' knowledge states affect recall

Information about others' success in remembering is frequently available. For example, students taking an exam may assess its difficulty by monitoring when others turn in their exams. In two experiments, we investigated how rememberers use this information to guide recall. Participants studied paired associates, some semantically related (and thus easier to retrieve) and some unrelated (and thus harder). During a subsequent cued recall test, participants viewed fictive information about an opponent's accuracy on each item. In Experiment 1, participants responded to each cue once before seeing the opponent's performance and once afterwards. Participants reconsidered their responses least often when the opponent's accuracy matched the item difficulty (easy items the opponent recalled, hard items the opponent forgot) and most often when the opponent's accuracy and the item difficulty mismatched. When participants responded only after seeing the opponent's performance (Experiment 2), the same mismatch conditions that led to reconsideration even produced superior recall. These results suggest that rememberers monitor whether others' knowledge states accord or conflict with their own experience, and that this information shifts how they interrogate their memory and what they recall.     

A Signal Detection Model for Multiple-Choice Exams

A model for multiple-choice exams is developed from a signal-detection perspective. A correct alternative in a multiple-choice exam can be viewed as being a signal embedded in noise (incorrect alternatives). Examinees are assumed to have perceptions of the plausibility of each alternative, and the decision process is to choose the most plausible alternative. It is also assumed that each examinee either knows or does not know each item. These assumptions together lead to a signal detection choice model for multiple-choice exams. The model can be viewed, statistically, as a mixture extension, with random mixing, of the traditional choice model, or similarly, as a grade-of-membership extension. A version of the model with extreme value distributions is developed, in which case the model simplifies to a mixture multinomial logit model with random mixing. The approach is shown to offer measures of item discrimination and difficulty, along with information about the relative plausibility of each of the alternatives. The model, parameters, and measures derived from the parameters are compared to those obtained with several commonly used item response theory models. An application of the model to an educational data set is presented.     

Dissecting the expanded cognitive reflection test: an item response theory analysis

This study presents a psychometric evaluation of the Expanded Cognitive Reflection Test (CRT7) based on item response theory. The participants (N?=?1204) completed the CRT7 and provided self-reported information about their cognitive styles through the Preference for Intuition and Deliberation Scale (PID). A two-parameter logistic model was fitted to the data to obtain the item difficulty and discrimination parameters of the CRT7. The results showed that the items had good discriminatory power (αs?=?.80 ? 2.92), but the range of difficulty was restricted (βs ranged from ?.60 to .32). Moreover, the CRT7 showed a pattern of correlations with the PID which was similar to that of the original CRT. When taken together, these results are evidence of the adequacy of the CRT7 as an expanded tool for measuring cognitive reflection; however, one of the newer items (the pig item) was consistently problematic across analyses, and so it is recommended that in future studies it should be removed from the CRT7.     

Focal changes in cerebral blood flow produced by monetary incentive during a mental mathematics task in normal and depressed subjects

The purpose of this experiment was to determine the effect of incentive-induced arousal on the diffuse and regional cerebral blood flow (rCBF) response during cognitive activation for normal and depressed groups. Two normal rest CBF measurements were followed by two mental mathematics activation CBF measurements. For the first activation measurement, half the subjects in each group were offered monetary incentive for correct performance and half the subjects received no monetary incentive. All subjects were offered monetary incentive on the final activation run. The effect of monetary incentive on the first activation run was to increase CBF activation at four detectors in the left hemisphere. Incentive did not affect the CBF activation response when introduced following practice on the activation task (on the final run). Depressed groups had lower resting blood flow than normals, but the distribution of flow and the CBF response to incentive were almost identical in the two groups.