Out of sight,out of mind: Occlusion and eye closure destabilize moving bistable structure-from-motion displays

Our brain constantly tries to anticipate the future by using a variety of memory mechanisms. Interestingly, studies using the intermittent presentation of multistable displays have shown little perceptual persistence for interruptions longer than a few hundred milliseconds. Here we examined whether we can facilitate the perceptual stability of bistable displays following a period of invisibility by employing a physically plausible and ecologically valid occlusion event sequence, as opposed to the typical intermittent presentation, with sudden onsets and offsets. To this end, we presented a bistable rotating structure-from-motion display that was moving along a linear horizontal trajectory on the screen and either was temporarily occluded by another object (a cardboard strip in Exp. 1, a computer-generated image in Exp. 2) or became invisible due to eye closure (Exp. 3). We report that a bistable rotation direction reliably persisted following occlusion or interruption only (1) if the pre- and postinterruption locations overlapped spatially (an occluder with apertures in Exp. 2 or brief, spontaneous blinks in Exp. 3) or (2) if an object’s size allowed for the efficient grouping of dots on both sides of the occluding object (large objects in Exp. 1). In contrast, we observed no persistence whenever the pre- and postinterruption locations were nonoverlapping (large solid occluding objects in Exps. 1 and 2 and long, prompted blinks in Exp. 3). We report that the bistable rotation direction of a moving object persisted only for spatially overlapping neural representations, and that persistence was not facilitated by a physically plausible and ecologically valid occlusion event.     

No evidence for binding of items to task-irrelevant backgrounds in visual working memory

When representing visual features such as color and shape in visual working memory (VWM), participants also represent the locations of those features as a spatial configuration of the locations of those features in the display. In everyday life, we encounter objects against some background, yet it is unclear whether the configural representation in memory obligatorily constitutes the entire display, including that (often task-irrelevant) background information. In three experiments, participants completed a change detection task on color and shape; the memoranda were presented in front of uniform gray backgrounds, a textured background (Exp. 1), or a background containing location placeholders (Exps. 2 and 3). When whole-display probes were presented, changes to the objects’ locations or feature bindings impacted memory performance—implying that the spatial configuration of the probes influenced participants’ change decisions. Furthermore, when only a single item was probed, the effect of changing its location or feature bindings was either diminished or completely extinguished, implying that single probes do not necessarily elicit the entire spatial configuration. Critically, when task-irrelevant backgrounds were also presented that may have provided a spatial configuration for the single probes, the effect of location or bindings was not moderated. These findings suggest that although the spatial configuration of a display guides VWM-based recognition, this information does not necessarily always influence the decision process during change detection.     

The concreteness effect on judgments of learning: Evaluating the contributions of fluency and beliefs

Researchers have often determined how cues influence judgments of learning (JOLs; e.g., concrete words are assigned higher JOLs than are abstract words), and recently there has been an emphasis in understanding why cues influence JOLs (i.e., the mechanisms that underlie cue effects on JOLs). The analytic-processing (AP) theory posits that JOLs are constructed in accordance with participants’ beliefs of how a cue will influence memory. Even so, some evidence suggests that fluency is also important to cue effects on JOLs. In the present experiments, we investigated the contributions of participants’ beliefs and processing fluency to the concreteness effect on JOLs. To evaluate beliefs, participants estimated memory performance in a hypothetical experiment (Experiment 1), and studied concrete and abstract words and made a pre-study JOL for each (Experiments 2 and 3). Participants’ predictions demonstrated the belief that concrete words are more likely to be remembered than are abstract words, consistent with the AP theory. To evaluate fluency, response latencies were measured during lexical decision (Experiment 4), self-paced study (Experiment 5), and mental imagery (Experiment 7). Number of trials to acquisition was also evaluated (Experiment 6). Fluency did not differ between concrete and abstract words in Experiments 5 and 6, and it did not mediate the concreteness effect on JOLs in Experiments 4 and 7. Taken together, these results demonstrate that beliefs are a primary mechanism driving the concreteness effect on JOLs.     

Updating metacognitive control in response to expected retention intervals

In five experiments, we investigated whether expected retention intervals affect subjects’ encoding strategies. In the first four experiments, our subjects studied paired associates consisting of words from the Graduate Record Exam and a synonym. They were told to expect a test on a word pair after either a short or a longer interval. Subjects were tested on most pairs after the expected retention interval. For some pairs, however, subjects were tested after the other retention interval, allowing for a comparison of performance at a given retention interval conditional upon the expected retention interval. No effect of the expected retention interval was found for 1 min versus 4 min (Exp. 1), 30 s versus 3 min (Exp. 2), and 30 s versus 10 min (Exps. 3 and 4), even when subjects were given complete control over the pacing of study items (Exp. 4). However, when the difference between the expected retention intervals was increased massively (10 min vs. 24 h; Exp. 5), subjects remembered more items that they expected to be tested sooner, an effect consistent with the idea that they traded off efforts to remember items for the later test versus items that were about to be tested. Overall, this set of results accords with much of the test-expectancy literature, revealing that subjects are often reluctant to adjust encoding strategies on an item-by-item basis, and when they do, they usually make quantitative, rather than qualitative, adjustments.     

The mere exposure effect for visual image

Mere exposure effect refers to a phenomenon in which repeated stimuli are evaluated more positively than novel stimuli. We investigated whether this effect occurs for internally generated visual representations (i.e., visual images). In an exposure phase, a 5 × 5 dot array was presented, and a pair of dots corresponding to the neighboring vertices of an invisible polygon was sequentially flashed (in red), creating an invisible polygon. In Experiments 1, 2, and 4, participants visualized and memorized the shapes of invisible polygons based on different sequences of flashed dots, whereas in Experiment 3, participants only memorized positions of these dots. In a subsequent rating phase, participants visualized the shape of the invisible polygon from allocations of numerical characters on its vertices, and then rated their preference for invisible polygons (Experiments 1, 2, and 3). In contrast, in Experiment 4, participants rated the preference for visible polygons. Results showed that the mere exposure effect appeared only when participants visualized the shape of invisible polygons in both the exposure and rating phases (Experiments 1 and 2), suggesting that the mere exposure effect occurred for internalized visual images. This implies that the sensory inputs from repeated stimuli play a minor role in the mere exposure effect. Absence of the mere exposure effect in Experiment 4 suggests that the consistency of processing between exposure and rating phases plays an important role in the mere exposure effect.     

How sublexical association strength modulates updating: Cognitive and strategic effects

In the current study, we investigated updating of long-term memory (LTM) associations. Specifically, we examined sublexical associations by manipulating preexisting LTM relations between consonant couplets (in encoding and updating phases), and explicitly instructed participants to engage with a specific strategy for approaching the task (item disjunction, grouping, or none). In two experiments, we used a multistep subject-based memory updating task in which we measured processing response times (RTs; Exp. 1, Exp. 2) and recognition RTs (Exp. 2). For the first time, in both experiments, we found costs in dismantling strong pre-existing associations from LTM and benefits in recreating strong preexisting associations. In addition, we found that control of irrelevant information was more difficult when this belonged to a strong association. Regarding task strategies, we showed that inducing a disjunction strategy enhanced updating, no matter the strength of the association. Results were discussed in the light of updating as a process of dismantling and recreating associations. The role of a specific strategic approach in enhancing the updating was also discussed.     

Sparing and impairing: Emotion modulation of the attentional blink and the spread of sparing in a 3-target RSVP task

The performance impairment (attentional blink, AB) on a second target (T2) when it is presented within 200-500 ms after a first target (T1) during rapid serial visual presentation (RSVP) is typically attributed to resource depletion. The AB does not occur when targets appear in immediate sequence (sparing). Recently, this account has been challenged by findings that the lag 1 sparing can spread to later lags when using a 3-target RSVP. Two experiments using the 3-targets RSVP investigated the relative contribution of resource depletion and attentional enhancement and/or inhibition on the AB and the sparing when T1 (Exp. 1) or T3 (Exp. 2) are emotionally salient. Findings showed a greater sparing for neutral T3s when preceded by negative compared with neutral T1s (Exp. 1) and for negative T3s (Exp. 2). In contrast, the AB on neutral T3s was greater after negative than after neutral T1s (Exp. 1), but it was reduced when T3 was negative (Exp. 2). The AB and the sparing also depended on how many targets before T3 were correctly reported. These findings indicate that although there is a cost for processing multiple targets, the emotional modulations of the AB and the sparing are better explained by an interplay between emotion-enhancement and capacity limitations on temporal selective attention.     

Trapped in a tight spot: Scaling effects occur when,according to the action-specific account,they should not,and fail to occur when they should

The action-specific account of perception claims that what we see is perceptually scaled according to our action capacity. However, it has been argued that this account relies on an overly confirmatory research strategy—predicting the presence of, and then finding, an effect (Firestone & Scholl, 2014). A comprehensive approach should also test disconfirmatory predictions, in which no effect is expected. In two experiments, we tested one such prediction based on the action-specific account, namely that scaling effects should occur only when participants intend to act (Witt, Proffitt, & Epstein, 2005). All participants wore asymmetric gloves in which one glove was padded with extra material, so that one hand was wider than the other. Participants visually estimated the width of apertures. The action-specific account predicts that the apertures should be estimated as being narrower for the wider hand, but only when participants intend to act. We found this scaling effect when it should not have occurred (Exp. 1, for participants who did not intend to act), as well as no effect when it should have occurred (Exp. 2, for participants who intended to act but were given a cover story for the visibility and position of their hands). Thus, the cover story used in Experiment 2 eliminated the scaling effect found in Experiment 1. We suggest that the scaling effect observed in Experiment 1 likely resulted from demand characteristics associated with using a salient, unexplained manipulation (e.g., telling people which hand to use to do the task). Our results suggest that the action-specific account lacks predictive power.     

Cue quality and criterion setting in recognition memory

Previous studies on how people set and modify decision criteria in old-new recognition tasks (in which they have to decide whether or not a stimulus was seen in a study phase) have almost exclusively focused on properties of the study items, such as presentation frequency or study list length. In contrast, in the three studies reported here, we manipulated the quality of the test cues in a scene-recognition task, either by degrading through Gaussian blurring (Experiment 1) or by limiting presentation duration (Experiment 2 and 3). In Experiments 1 and 2, degradation of the test cue led to worse old-new discrimination. Most importantly, however, participants were more liberal in their responses to degraded cues (i.e., more likely to call the cue “old”), demonstrating strong within-list, item-by-item, criterion shifts. This liberal response bias toward degraded stimuli came at the cost of increasing the false alarm rate while maintaining a constant hit rate. Experiment 3 replicated Experiment 2 with additional stimulus types (words and faces) but did not provide accuracy feedback to participants. The criterion shifts in Experiment 3 were smaller in magnitude than Experiments 1 and 2 and varied in consistency across stimulus type, suggesting, in line with previous studies, that feedback is important for participants to shift their criteria.     

Conflicting but close: Readers’ integration of information sources as a function of their disagreement

According to the documents model framework (Britt, Perfetti, Sandak, & Rouet, 1999), readers’ detection of contradictions within texts increases their integration of source–content links (i.e., who says what). This study examines whether conflict may also strengthen the relationship between the respective sources. In two experiments, participants read brief news reports containing two critical statements attributed to different sources. In half of the reports, the statements were consistent with each other, whereas in the other half they were discrepant. Participants were tested for source memory and source integration in an immediate item-recognition task (Experiment 1) and a cued recall task (Experiments 1 and 2). In both experiments, discrepancies increased readers’ memory for sources. We found that discrepant sources enhanced retrieval of the other source compared to consistent sources (using a delayed recall measure; Experiments 1 and 2). However, discrepant sources failed to prime the other source as evidenced in an online recognition measure (Experiment 1). We argue that discrepancies promoted the construction of links between sources, but that integration did not take place during reading.     

Miss it and miss out: Counterproductive nonspatial attentional capture by task-irrelevant,value-related stimuli

Recent studies of visual search suggest that learning about valued outcomes (rewards and punishments) influences the likelihood that distractors will capture spatial attention and slow search for a target, even when those value-related distractors have never themselves been the targets of search. In the present study, we demonstrated a related effect in the context of temporal, rather than spatial, selection. Participants were presented with a temporal stream of pictures in a fixed central location and had to identify the orientation of a rotated target picture. Response accuracy was reduced if the rotated target was preceded by a “valued” distractor picture that signaled that a correct response to the target would be rewarded (and an incorrect response punished), relative to a distractor picture that did not signal reward or punishment. This effect of signal value on response accuracy was short-lived, being most prominent with a short lag between distractor and target. Impairment caused by a valued distractor was observed if participants were explicitly instructed regarding its relation to reward/punishment (Exps. 1, 3, and 4), or if they could learn this relationship only via trial-by-trial experience (Exp. 2). These findings show that the influence of signal value on attentional capture extends to temporal selection, and also demonstrate that value-related distractors can interfere with the conscious perception of subsequent target information.     

Representational momentum and anisotropies in nearby visual space

The possibility of anisotropies in visual space in and near the final location of a moving target was examined. Experiments 1 and 2 presented a moving target, and after the target vanished, participants indicated the final location of the leading or trailing edge of the target. Memory for both edges was displaced forward from the actual final locations, and the magnitude of displacement was smaller for the leading edge. Experiments 3 and 4 also presented stationary objects in front of and behind the final location of the target, and participants indicated the location of the nearest or farthest edge of one of the stationary objects. Memory for the near or far edge of an object in front of the target was displaced backward, and memory for the near or far edge of an object behind the target was displaced forward; the magnitude of displacement was larger for objects in front of the target and when the edge was farther away. The findings (a) suggest representational momentum is associated with an anisotropy of visual space that extends across and outward from the moving target and (b) are consistent with previous findings regarding estimation of time-to-contact, anorthoscopic perception, and memory psychophysics.     

Relationship between vection and motion perception in depth

This study examined the effects of cues to motion in depth – namely, stereoscopic (i.e., changing-disparity cues and interocular velocity differences) and changing-size cues on forward and backward vection. We conducted four experiments in which participants viewed expanding or contracting optical flows with the addition of either or both cues. In Experiment 1, participants reported vection by pressing a button whenever they felt it. After each trial, they also rated the magnitude of the vection (from 0 to 100). In Experiments 2 and 3, the participants rated the perceived velocity and motion-in-depth impression of the flows relative to standard stimuli, respectively. In Experiment 4, the participants rated the perceived depth and distance of the display. We observed enhancements in vection, motion-in-depth impression, and perceived depth and distance when either or both types of cues indicated motion-in-depth, as compared to those when the cues did not (Experiments 1, 3, and 4). The perceived velocity changed with cue conditions only for the high velocity condition (Experiment 2). Correlational analyses showed that the vection can be best explained by the motion-in-depth impression. This was partially supported by the multiple regression analyses. These results indicate that the enhancement of vection caused by cues is related to the impression of motion-in-depth rather than the perceived velocity and perceived three-dimensionality.     

Numerosity estimates for attended and unattended items in visual search

The goal of this research was to examine memories created for the number of items during a visual search task. Participants performed a visual search task for a target defined by a single feature (Experiment 1A), by a conjunction of features (Experiment 1B), or by a specific spatial configuration of features (Experiment 1C). On some trials following the search task, subjects were asked to recall the total number of items in the previous display. In all search types, participants underestimated the total number of items, but the severity of the underestimation varied depending on the efficiency of the search. In three follow-up studies (Experiments 2A, 2B, and 2C) using the same visual stimuli, the participants’ only task was to estimate the number of items on each screen. Participants still underestimated the numerosity of the items, although the degree of underestimation was smaller than in the search tasks and did not depend on the type of visual stimuli. In Experiment 3, participants were asked to recall the number of items in a display only once. Subjects still displayed a tendency to underestimate, indicating that the underestimation effects seen in Experiments 1A-1C were not attributable to knowledge of the estimation task. The degree of underestimation depends on the efficiency of the search task, with more severe underestimation in efficient search tasks. This suggests that the lower attentional demands of very efficient searches leads to less encoding of numerosity of the distractor set.     

Task difficulty moderates the revelation effect

Tasks that precede a recognition probe induce a more liberal response criterion than do probes without tasks—the “revelation effect.” For example, participants are more likely to claim that a stimulus is familiar directly after solving an anagram, relative to a condition without an anagram. Revelation effect hypotheses disagree whether hard preceding tasks should produce a larger revelation effect than easy preceding tasks. Although some studies have shown that hard tasks increase the revelation effect as compared to easy tasks, these studies suffered from a confound of task difficulty and task presence. Conversely, other studies have shown that the revelation effect is independent of task difficulty. In the present study, we used new task difficulty manipulations to test whether hard tasks produce larger revelation effects than easy tasks. Participants (N = 464) completed hard or easy preceding tasks, including anagrams (Exps. 1 and 2) and the typing of specific arrow key sequences (Exps. 3–6). With sample sizes typical of revelation effect experiments, the effect sizes of task difficulty on the revelation effect varied considerably across experiments. Despite this variability, a consistent data pattern emerged: Hard tasks produced larger revelation effects than easy tasks. Although the present study falsifies certain revelation effect hypotheses, the general vagueness of revelation effect hypotheses remains.     

Whose hand is this? Differential responses of right and left extrastriate body areas to visual images of self and others’ hands

The extrastriate body area (EBA) is involved in perception of human bodies and nonfacial body parts, but its role in representing body identity is not clear. Here, we used on-line high-frequency repetitive transcranial magnetic stimulation (rTMS) to test the role of EBA in self–other distinction. In Experiments 1 and 2 we compared rTMS of right EBA with stimulation of left ventral premotor cortex (vPM), whereas in Experiment 3 we compared stimulation of right and left EBA. RTMS was applied during a hand laterality task in which self or others’ hand images were presented in first- versus third-person view (Experiments 1 and 3), or while participants had to explicitly recognize their own hands (Experiment 2) presented in first- versus third-person view. Experiment 1 showed that right EBA stimulation selectively speeded judgments on others’ hands, whereas no effect of left vPM stimulation was found. Experiment 2 did not reveal any effect of rTMS. Experiment 3 confirmed faster responses on others’ hands while stimulating right EBA and also showed an advantage when judging self with respect to others’ hands during stimulation of left EBA. These results would demonstrate that EBA responds to morphological features of human body contributing to identity processing.     

Dissociations of the number and precision of visual short-term memory representations in change detection

The present study dissociated the number (i.e., quantity) and precision (i.e., quality) of visual short-term memory (STM) representations in change detection using receiver operating characteristic (ROC) and experimental manipulations. Across three experiments, participants performed both recognition and recall tests of visual STM using the change-detection task and the continuous color-wheel recall task, respectively. Experiment 1 demonstrated that the estimates of the number and precision of visual STM representations based on the ROC model of change-detection performance were robustly correlated with the corresponding estimates based on the mixture model of continuous-recall performance. Experiments 2 and 3 showed that the experimental manipulation of mnemonic precision using white-noise masking and the experimental manipulation of the number of encoded STM representations using consolidation masking produced selective effects on the corresponding measures of mnemonic precision and the number of encoded STM representations, respectively, in both change-detection and continuous-recall tasks. Altogether, using the individual-differences (Experiment 1) and experimental dissociation (Experiment 2 and 3) approaches, the present study demonstrated the some-or-none nature of visual STM representations across recall and recognition.     

Postencoding cognitive processes in the cross-race effect: Categorization and individuation during face recognition

The cross-race effect (CRE) describes the finding that same-race faces are recognized more accurately than cross-race faces. According to social–cognitive theories of the CRE, processes of categorization and individuation at encoding account for differential recognition of same- and cross-race faces. Recent face memory research has suggested that similar but distinct categorization and individuation processes also occur postencoding, at recognition. Using a divided-attention paradigm, in Experiments 1A and 1B we tested and confirmed the hypothesis that distinct postencoding categorization and individuation processes occur during the recognition of same- and cross-race faces. Specifically, postencoding configural divided-attention tasks impaired recognition accuracy more for same-race than for cross-race faces; on the other hand, for White (but not Black) participants, postencoding featural divided-attention tasks impaired recognition accuracy more for cross-race than for same-race faces. A social categorization paradigm used in Experiments 2A and 2B tested the hypothesis that the postencoding in-group or out-group social orientation to faces affects categorization and individuation processes during the recognition of same-race and cross-race faces. Postencoding out-group orientation to faces resulted in categorization for White but not for Black participants. This was evidenced by White participants’ impaired recognition accuracy for same-race but not for cross-race out-group faces. Postencoding in-group orientation to faces had no effect on recognition accuracy for either same-race or cross-race faces. The results of Experiments 2A and 2B suggest that this social orientation facilitates White but not Black participants’ individuation and categorization processes at recognition. Models of recognition memory for same-race and cross-race faces need to account for processing differences that occur at both encoding and recognition.     

Revisiting von Restorff’s early isolation effect

An item that is conceptually or physically different from other items in a series is often remembered well. This isolation effect has been found independent of the position of the isolated item in the list, suggesting that special attention to or processing of the isolated item is not a necessary precondition of the effect. Three experiments are reported that challenge this conclusion. In Experiment 1a, we compared memory for conceptually isolated items to memory for the same items in unrelated and homogeneous lists. Under moderately distracting conditions, isolation effects were observed with midlist but not with early isolates. In fact, early isolation impaired memory for the conceptually distinct items relative to the same items in homogeneous lists. Experiment 1b replicated this memory impairment for early conceptual isolates and extended it to nondistracting conditions. In Experiment 2, we focused on early isolation, manipulating the type of isolation and whether or not participants performed judgments of learning (JOLs). An early isolation effect was observed for numbers isolated in lists of words (and vice versa), but not for conceptual isolates. Performing the JOL task reduced the size of the early isolation effect. These results suggest that number/word stimulus contrasts are coded automatically and support an isolation effect independent of list position. However, conceptual contrasts require relational processing and will only support an early isolation effect when such processing occurs. The results of Experiments 1a, 1b, and 2 suggest that attentional resources during list presentation and a favorable retrieval environment combine to support good memory for distinctive events.     

Spontaneous prospective-memory processing: Unexpected fluency experiences trigger erroneous intention executions

Event-based prospective memory is the ability to remember to execute an intention when an environmental cue occurs. It has been argued that, due to their special meaning, these cues are discrepant from their environment and therefore are sometimes spontaneously noticed. In line with this assumption, the likelihood that an intention will be executed increases with increased cue-discrepancy. It is not yet clear, however, whether these improvements are due to facilitated spontaneous noticing rather than to an increase in the efficiency of controlled cue-processing. To further investigate the spontaneous nature of cue-discrepancy benefits, we presented participants with stimuli that were unrelated to the intention but discrepant from other stimuli. Therefore, we experimentally increased the processing fluency of some stimuli for participants currently holding an intention by using different priming procedures. We found that stimuli whose fluency was increased via spaced repeated stimulus presentation (Experiment 1) or via short pre-exposure (Experiment 2a to 3) elicited a tendency to fulfill the intention despite its actual inappropriateness. Findings were inconsistent as to whether cue-memory uncertainty fosters the reliance on cue discrepancy for intention retrieval (Experiments 2a and 3). Taken together, the present findings provide converging evidence for a spontaneous discrepancy-based prospective-memory process which works independent of controlled processes.