An item gains and losses analysis of false memories suggests critical items receive more item-specific processing than list items

In a repeated testing paradigm, list items receiving item-specific processing are more likely to be recovered across successive tests (item gains), whereas items receiving relational processing are likely to be forgotten progressively less on successive tests. Moreover, analysis of cumulative-recall curves has shown that item-specific processing produces a slower, but steadier rate of recall than relational processing. The authors relied on these findings to determine the type of processing that both list items and critical lures receive in the Deese-Roediger-McDermott false memory procedure. The first 2 experiments revealed that critical lures produced more item gains, but only the list items resulted in a decrease in item losses across successive tests. The critical lures also produced slower but steadier cumulative recall. In Experiments 3 and 4, the critical items were physically presented during study, which resulted in the lures producing progressively fewer losses across successive tests. The authors concluded that critical items receive more item-specific processing than list items but that unless they are presented in the list, they do not become part of participants' organized retrieval scheme.     

Falsely recalled items are rich in item-specific information

Current theorizing suggests that critical lures in the Deese/Roediger-McDermott (DRM) procedure are often falsely remembered because they have received considerable relational processing (e.g., spreading activation or encoding of gist information). We used a repeated-testing paradigm to assess the amount of item-specific and relational processing given to the list items and the critical lures. Research has shown that items receiving item-specific processing are more likely to be recovered across successive tests. They are also output more slowly but more steadily throughout the recall period. In two experiments, we manipulated the processing performed on list items and then used item gains and cumulative recall curves to assess the amount of item-specific an drelational information encoded for both list items and lures. The results suggest that increasing the relational processing of list items increased item-specific processing of lures, whereas increasing item-specific processing of list items decreased item-specific processing of lures. We conclude that critical lures are typically rich in item-specific information, relative to list items.     

The ignoring paradox: Cueing distractor features leads first to selection, then to inhibition of to-be-ignored items

Observers find a target item more quickly when they have foreknowledge of target-defining attributes, such as identity, color, or location. However, it is less clear whether foreknowledge of nontarget attributes can also speed search. Munneke, Van der Stigchel, and Theeuwes Acta Psychologica 129:101?C107, (2008) found that observers found the target more quickly when they were cued to ignore a region of space where a target would not appear. Using a similar paradigm, we explored the effects of cueing nontarget features on search. We found that when we cued observers to ignore nontarget features, search was slowed. The results from a probe-dot detection task revealed that this slowing occurred because, paradoxically, observers initially selected an item appearing in the to-be-ignored color. Finally, we found that cueing nontarget features sped search when placeholders matching the location of the to-be-ignored color preceded presentation of the search display by at least 800?ms; thus, it appears that some limited inhibition of to-be-ignored items occurs following selection. Taken together, these results suggest that observers are unable to explicitly avoid selection of items matching known nontarget features. Instead, when nontarget features are cued, observers select the to-be-ignored feature or the locations of objects matching that feature early in search, and only inhibit them after this selection process.     

Qualitative variations in personality inventories: subjective understandings of items in a personality inventory

Most studies using personality inventories do not take individual, subjective understandings of the items into account. The present study is one of the few to have investigated the quality of individuals’ psychological processes when making the Likert-like responses often used in psychological inventories. Respondents were asked to elaborate verbally on their Likert item responses to the 10-item short version of the Big Five Inventory. A common assumption about personality inventories is that there is a relatively homogenous understanding of the items and, in particular, the rating scales across respondents. However, our results suggest that the same item responses to a given item can reflect a variety of qualities across individuals’ understandings. At the same time, similar understandings and ways of relating to an item can lead to different item responses. Such findings have substantial implications for quantitative personality studies as well as quantitative survey or questionnaire studies, in general.     

A dual process item response theory model for polytomous multidimensional forced-choice items

The use of multidimensional forced-choice (MFC) items to assess non-cognitive traits such as personality, interests and values in psychological tests has a long history, because MFC items show strengths in preventing response bias. Recently, there has been a surge of interest in developing item response theory (IRT) models for MFC items. However, nearly all of the existing IRT models have been developed for MFC items with binary scores. Real tests use MFC items with more than two categories; such items are more informative than their binary counterparts. This study developed a new IRT model for polytomous MFC items based on the cognitive model of choice, which describes the cognitive processes underlying humans' preferential choice behaviours. The new model is unique in its ability to account for the ipsative nature of polytomous MFC items, to assess individual psychological differentiation in interests, values and emotions, and to compare the differentiation levels of latent traits between individuals. Simulation studies were conducted to examine the parameter recovery of the new model with existing computer programs. The results showed that both statement parameters and person parameters were well recovered when the sample size was sufficient. The more complete the linking of the statements was, the more accurate the parameter estimation was. This paper provides an empirical example of a career interest test using four-category MFC items. Although some aspects of the model (e.g., the nature of the person parameters) require additional validation, our approach appears promising.     

Ego-syntonicity in responses to items in the California Psychological Inventory

Responding to items on a personality questionnaire can evoke a variety of feelings, from discomfort to indifference to pleasure. Harrison Gough reported that when he wrote items for the California Psychological Inventory (CPI; Gough & Bradley, 1996), he tried to make the items as ego-syntonic as possible. Ego-syntonic items are those “which a respondent finds congenial, and on which giving an opinion is a rewarding act” (Gough & Bradley, 1996, p. 10). The present study asked 79 respondents to report how they felt after answering each CPI item. Average affect ratings were above neutral for a majority of items, indicating that Gough had some success in writing ego-syntonic items. Differences in item ego-syntonicity were attributable to other item characteristics. Respondents disliked responding to relatively odd and ambiguous items, items with linguistic negations, and items referring to negative feelings and situations. As predicted by Gough, respondents enjoyed responding to items on the communality scale, items with which most people agree. They also enjoyed items that referred to positive emotions and attitudes and to items indicating extraversion, conscientiousness, low neuroticism, and openness to experience. Highly ego-syntonic items were found to be more valid than less ego-syntonic items. Individuals who reported disliking many items were found to be socially anxious. The relation between reports of liking or disliking items, identity, and reputation are discussed, and further research on item response dynamics and validity is proposed.     

Psychometric properties of reverse-scored items on the CES-D in a sample of ethnically diverse older adults

Reverse-scored items on assessment scales increase cognitive processing demands and may therefore lead to measurement problems for older adult respondents. In this study, the objective was to examine possible psychometric inadequacies of reverse-scored items on the Center for Epidemiologic Studies Depression Scale (CES-D) when used to assess ethnically diverse older adults. Using baseline data from a gerontologic clinical trial (n = 460), we tested the hypotheses that the reversed items on the CES-D (a) are less reliable than nonreversed items, (b) disproportionately lead to intraindividually atypical responses that are psychometrically problematic, and (c) evidence improved measurement properties when an imputation procedure based on the scale mean is used to replace atypical responses. In general, the results supported the hypotheses. Relative to nonreversed CES-D items, the 4 reversed items were less internally consistent, were associated with lower item-scale correlations, and were more often answered atypically at an intraindividual level. Further, the atypical responses were negatively correlated with responses to psychometrically sound nonreversed items that had similar content. The use of imputation to replace atypical responses enhanced the predictive validity of the set of reverse-scored items. Among older adult respondents, reverse-scored items are associated with measurement difficulties. It is recommended that appropriate correction procedures such as item readministration or statistical imputation be applied to reduce the difficulties.     

Social desirability scale values of locus of control scale items

Summaiy: Three groups of subjects rated each item in Rotter's I-E Scale for its social desirability value. Social desirability scale values (SDSV) of paired items were compared with one another. Results indicated that paired items are not sufficiently similar in their SDSVs, thus enabling subjects to respond on the basis of social desirability. All three groups rated internal items as being significantly more socially desirable than external items. The correlations between the SDSV ratings of the three groups were highly significant. The results indicate that the scale, as it is currently used, is seriously deficient.     

No retrieval-induced forgetting using item-specific independent cues: evidence against a general inhibitory account

Retrieval practice with particular items from memory can impair the recall of related items on a later memory test. This retrieval-induced forgetting effect has been ascribed to inhibitory processes (M. C. Anderson & B. A. Spellman, 1995). A critical finding that distinguishes inhibitory from interference explanations is that forgetting is found with independent (or extralist) cues. In 4 experiments, the authors tested whether the forgetting effect is cue-independent. Forgetting was investigated for both studied and unstudied semantically related items. Retrieval-induced forgetting was not found using item-specific independent cues for either studied or unstudied items. However, forgetting was found for both item types when studied categories were used as cues. These results are not in line with a general inhibitory account, because this account predicts retrieval-induced forgetting with independent cues. Interference and context-specific inhibition are discussed as possible explanations for the data.     

Generating items during testing: Psychometric issues and models

On-line item generation is becoming increasingly feasible for many cognitive tests. Item generation seemingly conflicts with the well established principle of measuring persons from items with known psychometric properties. This paper examines psychometric principles and models required for measurement from on-line item generation. Three psychometric issues are elaborated for item generation. First, design principles to generate items are considered. A cognitive design system approach is elaborated and then illustrated with an application to a test of abstract reasoning. Second, psychometric models for calibrating generating principles, rather than specific items, are required. Existing item response theory (IRT) models are reviewed and a new IRT model that includes the impact on item discrimination, as well as difficulty, is developed. Third, the impact of item parameter uncertainty on person estimates is considered. Results from both fixed content and adaptive testing are presented.This article is based on the Presidential Address Susan E. Embretson gave on June 26, 1999 at the 1999 Annual Meeting of the Psychometric Society held at the University of Kansas in Lawrence, Kansas. —Editor     

Short-term memory for repeated and non-repeated items

Digit sequences containing repeated items are retained differently in short-term memory from sequences containing no repeated items. The repeated items are remembered better or worse than items in the corresponding positions of “all-different” sequences depending on the number of times the item is repeated, the number of items repeated, the number of items intervening between the occurences of a repeated item, and the position of the repeated items in relation to the beginning and end of the sequence. In every type of repetition studied, except one, memory for the non-repeated items in sequences with repeated items is better than for the corresponding items of all-different sequences. This is true in some cases despite significant specific interference between the (non-repeated) items following the separated occurrences of repeated items. The negative effects in memory for repeated items and the positive effects in memory for non-repeated items are greater when the items are presented at the rate of five per sec. than at one per sec., contrary to the hypothesis that differential rehearsal is responsible for these effects. The results are interpreted as supporting an “associative,” as opposed to a “non-associative,” theory of short-term memory, as this distinction is defined in the paper.     

The use of subtle items in detecting deception

When subjects attempt to fake psychopathology on the MMPI, scores on subtle subscales tend to be lower than those of nonfaking subjects. Our study hypothesized that this paradox comes about because the subtle subscales have no predictive validity, but their face validity for psychopathology is the opposite of the keyed direction for psychopathology. Subjects who attempt to fake psychopathology do so on the basis of item content and thus achieve lower rather than higher scores. Three groups of 80 undergraduates took the MMPI under regular, faking-good, or faking-bad instructions. As expected, faking-bad subjects scored significantly lower than regular subjects on the 100 most subtle items, and this was due to their responses to those. 73 of the items whose face validity was misleading. The results are consistent with other work showing valid uses of subtle items in detecting deception.     

Item-specific processing reduces false memories

We examined the effect of item-specific and relational encoding instructions on false recognition in two experiments in which the DRM paradigm was used (Deese, 1959; Roediger & McDermott, 1995). Type of encoding (item-specific or relational) was manipulated between subjects in Experiment 1 and within subjects in Experiment 2. Decision-based explanations (e.g., the distinctiveness heuristic) predict reductions in false recognition in between-subjects designs, but not in within-subjects designs, because they are conceptualized as global shifts in decision criteria. Memory-based explanations predict reductions in false recognition in both designs, resulting from enhanced recollection of item-specific details. False recognition was reduced following item-specific encoding instructions in both experiments, favoring a memory-based explanation. These results suggest that providing unique cues for the retrieval of individual studied items results in enhanced discrimination between those studied items and critical lures. Conversely, enhancing the similarity of studied items results in poor discrimination among items within a particular list theme. These results are discussed in terms of the item-specific/ relational framework (Hunt & McDaniel, 1993).     

An analysis of two central stages underlying responding to personality items: The self-referent decision and response selection

A technique for isolating substages in a processing sequence (Sternberg, 1969) was used to examine two central stages in a postulated model of responding to personality items. The Self-Referent Decision (SRD) stage, where item content is compared to stored memory elements, and the Response Selection Stage, where the output of the SRD is mapped into available response alternatives, were analyzed to determine if they could be seen as separate stages. Results indicated that a modular model that viewed these two stages as being separate was supported. These results were also discussed in relation to existing models of item responding processes and the dichotomous/Likert response format issue.     

Generation and hypermnesia

The multifactor account of the generation effect makes detailed predictions about the effects of generation on item-specific and relational encoding, predictions confirmed in four experiments using a multiple-test methodology. In pure-list designs with unrelated study items, generation produced more interest item gains (indexing greater item-specific processing) and more interest item losses (indexing less relational processing) relative to the read condition. In a mixed-list design, generation produced more gains but did not affect losses. With categorically-related study items, generation produced more gains but fewer losses (indicating enhanced relational encoding). Generation consistently produced hypermnesia whereas reading did so only for related study items. Also, a significant generation effect emerged on later tests under conditions (between-subjects design, unrelated study items) which typically yield no generation effect.     

Memory for actions: Item and relational information in categorized lists

Enacting action phrases in subject-performed tasks (SPTs) leads to better free recall than hearing or reading the same materials in verbal tasks (VTs). This enactment effect is usually explained by better item-specific information in SPTs than in VTs. The role of relational information is controversial. In the present paper, we will take the multiple recall approach to study the role of item and relational information in memory for actions by computing the number of item gains and the number of item losses over trials. This approach has previously been applied to lists of unrelated action phrases. We applied it to categorically related lists, also allowing a measure of relational information by clustering scores. It was found that SPTs produced more item gains than VTs. This finding confirmed the assumption that SPTs provide better item-specific information than VTs. The number of item losses did not differ between VTs and SPTs. This finding suggests that relational information is equally provided by VTs and SPTs. However, the organizational scores showed a more differentiated picture. Clustering was greater in SPTs than in VTs with randomly presented lists, but not with blocked lists. We suggested that these results, as well as other findings from the literature, could be explained by distinguishing automatic and strategic processes and the types of item associations that are addressed by these processes.     

Maximum validity of a test with equivalent items

It is assumed that a scale of true scores on a function exists and that the probability of answering an item correctly is a curve of the type of the integral of the normal curve. The product moment correlation between the test score and true score is derived for a normal distribution of subjects and a test composed of equivalent items. Numerical examples demonstrate that the maximum correlation between test scores and true scores occurs for a one hundred item test when the point correlation between items is less than three tenths.     

No source memory for unrecognized items when implicit feedback is avoided

In a recent empirical study, Starns, Hicks, Brown, and Martin (Memory & Cognition, 36, 1–8 2008) collected source judgments for old items that participants had claimed to be new and found residual source discriminability depending on the old-new response bias. The authors interpreted their finding as evidence in favor of the bivariate signal-detection model, but against the two-high-threshold model of item/source memory. According to the latter, new responses only follow from the state of old-new uncertainty for which no source discrimination is possible, and the probability of entering this state is independent of the old-new response bias. However, when missed old items were presented for source discrimination, the participants could infer that the items had been previously studied. To test whether this implicit feedback led to second retrieval attempts and thus to source memory for presumably unrecognized items, we replicated Starns et al.’s (Memory & Cognition, 36, 1–8 2008) finding and compared their procedure to a procedure without such feedback. Our results challenge the conclusion to abandon discrete processing in source memory; source memory for unrecognized items is probably an artifact of the procedure, by which implicit feedback prompts participants to reconsider their recognition judgment when asked to rate the source of old items in the absence of item memory.     

Sensitivity of a linear composite of predictor items to differential item weighting

Many authors have demonstrated for idealized item configurations that equal item weights are often virtually as good for a particular predictive purpose as the item weights that are theoretically optimal. What has not been heretofore clear, however, is what happens to the similarity between weighted and unweighted composites of the same items when the item configuration's variance structure is complex.