Cue quality and criterion setting in recognition memory

Previous studies on how people set and modify decision criteria in old-new recognition tasks (in which they have to decide whether or not a stimulus was seen in a study phase) have almost exclusively focused on properties of the study items, such as presentation frequency or study list length. In contrast, in the three studies reported here, we manipulated the quality of the test cues in a scene-recognition task, either by degrading through Gaussian blurring (Experiment 1) or by limiting presentation duration (Experiment 2 and 3). In Experiments 1 and 2, degradation of the test cue led to worse old-new discrimination. Most importantly, however, participants were more liberal in their responses to degraded cues (i.e., more likely to call the cue “old”), demonstrating strong within-list, item-by-item, criterion shifts. This liberal response bias toward degraded stimuli came at the cost of increasing the false alarm rate while maintaining a constant hit rate. Experiment 3 replicated Experiment 2 with additional stimulus types (words and faces) but did not provide accuracy feedback to participants. The criterion shifts in Experiment 3 were smaller in magnitude than Experiments 1 and 2 and varied in consistency across stimulus type, suggesting, in line with previous studies, that feedback is important for participants to shift their criteria.     

Numerosity estimates for attended and unattended items in visual search

The goal of this research was to examine memories created for the number of items during a visual search task. Participants performed a visual search task for a target defined by a single feature (Experiment 1A), by a conjunction of features (Experiment 1B), or by a specific spatial configuration of features (Experiment 1C). On some trials following the search task, subjects were asked to recall the total number of items in the previous display. In all search types, participants underestimated the total number of items, but the severity of the underestimation varied depending on the efficiency of the search. In three follow-up studies (Experiments 2A, 2B, and 2C) using the same visual stimuli, the participants’ only task was to estimate the number of items on each screen. Participants still underestimated the numerosity of the items, although the degree of underestimation was smaller than in the search tasks and did not depend on the type of visual stimuli. In Experiment 3, participants were asked to recall the number of items in a display only once. Subjects still displayed a tendency to underestimate, indicating that the underestimation effects seen in Experiments 1A-1C were not attributable to knowledge of the estimation task. The degree of underestimation depends on the efficiency of the search task, with more severe underestimation in efficient search tasks. This suggests that the lower attentional demands of very efficient searches leads to less encoding of numerosity of the distractor set.     

The mere exposure effect for visual image

Mere exposure effect refers to a phenomenon in which repeated stimuli are evaluated more positively than novel stimuli. We investigated whether this effect occurs for internally generated visual representations (i.e., visual images). In an exposure phase, a 5 × 5 dot array was presented, and a pair of dots corresponding to the neighboring vertices of an invisible polygon was sequentially flashed (in red), creating an invisible polygon. In Experiments 1, 2, and 4, participants visualized and memorized the shapes of invisible polygons based on different sequences of flashed dots, whereas in Experiment 3, participants only memorized positions of these dots. In a subsequent rating phase, participants visualized the shape of the invisible polygon from allocations of numerical characters on its vertices, and then rated their preference for invisible polygons (Experiments 1, 2, and 3). In contrast, in Experiment 4, participants rated the preference for visible polygons. Results showed that the mere exposure effect appeared only when participants visualized the shape of invisible polygons in both the exposure and rating phases (Experiments 1 and 2), suggesting that the mere exposure effect occurred for internalized visual images. This implies that the sensory inputs from repeated stimuli play a minor role in the mere exposure effect. Absence of the mere exposure effect in Experiment 4 suggests that the consistency of processing between exposure and rating phases plays an important role in the mere exposure effect.     

Whose hand is this? Differential responses of right and left extrastriate body areas to visual images of self and others’ hands

The extrastriate body area (EBA) is involved in perception of human bodies and nonfacial body parts, but its role in representing body identity is not clear. Here, we used on-line high-frequency repetitive transcranial magnetic stimulation (rTMS) to test the role of EBA in self–other distinction. In Experiments 1 and 2 we compared rTMS of right EBA with stimulation of left ventral premotor cortex (vPM), whereas in Experiment 3 we compared stimulation of right and left EBA. RTMS was applied during a hand laterality task in which self or others’ hand images were presented in first- versus third-person view (Experiments 1 and 3), or while participants had to explicitly recognize their own hands (Experiment 2) presented in first- versus third-person view. Experiment 1 showed that right EBA stimulation selectively speeded judgments on others’ hands, whereas no effect of left vPM stimulation was found. Experiment 2 did not reveal any effect of rTMS. Experiment 3 confirmed faster responses on others’ hands while stimulating right EBA and also showed an advantage when judging self with respect to others’ hands during stimulation of left EBA. These results would demonstrate that EBA responds to morphological features of human body contributing to identity processing.     

Conflicting but close: Readers’ integration of information sources as a function of their disagreement

According to the documents model framework (Britt, Perfetti, Sandak, & Rouet, 1999), readers’ detection of contradictions within texts increases their integration of source–content links (i.e., who says what). This study examines whether conflict may also strengthen the relationship between the respective sources. In two experiments, participants read brief news reports containing two critical statements attributed to different sources. In half of the reports, the statements were consistent with each other, whereas in the other half they were discrepant. Participants were tested for source memory and source integration in an immediate item-recognition task (Experiment 1) and a cued recall task (Experiments 1 and 2). In both experiments, discrepancies increased readers’ memory for sources. We found that discrepant sources enhanced retrieval of the other source compared to consistent sources (using a delayed recall measure; Experiments 1 and 2). However, discrepant sources failed to prime the other source as evidenced in an online recognition measure (Experiment 1). We argue that discrepancies promoted the construction of links between sources, but that integration did not take place during reading.     

The contributions of visual and central attention to visual working memory

We investigated the role of two kinds of attention—visual and central attention—for the maintenance of visual representations in working memory (WM). In Experiment 1 we directed attention to individual items in WM by presenting cues during the retention interval of a continuous delayed-estimation task, and instructing participants to think of the cued items. Attending to items improved recall commensurate with the frequency with which items were attended (0, 1, or 2 times). Experiments 1 and 3 further tested which kind of attention—visual or central—was involved in WM maintenance. We assessed the dual-task costs of two types of distractor tasks, one tapping sustained visual attention and one tapping central attention. Only the central attention task yielded substantial dual-task costs, implying that central attention substantially contributes to maintenance of visual information in WM. Experiment 2 confirmed that the visual-attention distractor task was demanding enough to disrupt performance in a task relying on visual attention. We combined the visual-attention and the central-attention distractor tasks with a multiple object tracking (MOT) task. Distracting visual attention, but not central attention, impaired MOT performance. Jointly, the three experiments provide a double dissociation between visual and central attention, and between visual WM and visual object tracking: Whereas tracking multiple targets across the visual filed depends on visual attention, visual WM depends mostly on central attention.     

Local probability effects of repeating irrelevant attributes

We present two experiments in which participants classify stimuli having two potentially conflicting attributes, one of which is response-relevant whereas the other (“irrelevant”) attribute is logically and statistically independent of the response. We introduce a novel design not used with filtering tasks before in which the main factor is the local (i.e., one-step) transition probability π (= 0.25, 0.50, 0.75) that the irrelevant attribute is repeated from one trial to the next. Experiment 1 involved a visual Simon task in which the color of the stimulus is relevant and its location is irrelevant. Experiment 2 used a semantic classification task in which the parity of a digit presented is relevant and its numerical magnitude is irrelevant. The results of both experiments demonstrate that participants in the π = 0.75 group responded faster when the irrelevant attribute is in fact repeated rather than alternated; in contrast, participants in the π = 0.25 group responded faster (Experiment 1) or equally fast (Experiment 2) when the irrelevant attribute is alternated rather than repeated. These expectancy-related effects cannot be attributed to spurious design contingencies as the irrelevant attribute was independent of the relevant attribute (and thus of the response), of the congruency status, and also of their alternation/repetition. One interpretation of our findings is that information about the irrelevant attribute in the previous trial is used much as an informative central precue, so that participants can prepare early processing stages in the current trial, with the corresponding benefits and costs typical of standard cueing studies.     

Relationship between vection and motion perception in depth

This study examined the effects of cues to motion in depth – namely, stereoscopic (i.e., changing-disparity cues and interocular velocity differences) and changing-size cues on forward and backward vection. We conducted four experiments in which participants viewed expanding or contracting optical flows with the addition of either or both cues. In Experiment 1, participants reported vection by pressing a button whenever they felt it. After each trial, they also rated the magnitude of the vection (from 0 to 100). In Experiments 2 and 3, the participants rated the perceived velocity and motion-in-depth impression of the flows relative to standard stimuli, respectively. In Experiment 4, the participants rated the perceived depth and distance of the display. We observed enhancements in vection, motion-in-depth impression, and perceived depth and distance when either or both types of cues indicated motion-in-depth, as compared to those when the cues did not (Experiments 1, 3, and 4). The perceived velocity changed with cue conditions only for the high velocity condition (Experiment 2). Correlational analyses showed that the vection can be best explained by the motion-in-depth impression. This was partially supported by the multiple regression analyses. These results indicate that the enhancement of vection caused by cues is related to the impression of motion-in-depth rather than the perceived velocity and perceived three-dimensionality.     

Visual perspective taking for avatars in a Simon task

In modern digital applications, users often interact with virtual representations of themselves or others, called avatars. We examined how these avatars and their perspectives influence stimulus–response compatibility in a Simon task. Participants responded to light/dark blue stimuli with left/right key presses in the presence of a task-irrelevant avatar. Changes in stimulus–response compatibility were used to quantify changes in the mental representation of the task and perspective taking toward this avatar. Experiments 1 and 2 showed that perspective taking for an avatar occurred in orthogonal stimulus–response mappings, causing a compatibility effect from the avatar’s point of view. In the following two experiments we introduced a larger variety of angular disparities between the participant and avatar. In Experiment 3, the Simon effect with lateralized stimulus positions remained largely unaffected by the avatar, pointing toward an absence of perspective taking. In Experiment 4, after avatar hand movements were added in order to strengthen the participants’ sense of agency over the avatar, a spatial compatibility effect from the avatar’s perspective was observed again, and hints of the selective use of perspective taking on a trial-by-trial basis were found. Overall, the results indicate that users can incorporate the perspective of an avatar into their mental representation of a situation, even when this perspective is unnecessary to complete a task, but that certain contextual requirements have to be met.     

Age of avatar modulates the altercentric bias in a visual perspective-taking task: ERP and behavioral evidence

Despite being able to rapidly and accurately infer their own and other peoples’ visual perspectives, healthy adults experience difficulty ignoring the irrelevant perspective when the two perspectives are in conflict; they experience egocentric and altercentric interference. We examine for the first time how the age of an observed person (adult vs. child avatar) influences adults’ visual perspective-taking, particularly the degree to which they experience interference from their own or the other person’s perspective. Participants completed the avatar visual perspective-taking task, in which they verified the number of discs in a visual scene according to either their own or an on-screen avatar’s perspective (Experiments 1 and 2) or only from their own perspective (Experiment 3), where the two perspectives could be consistent or in conflict. Age of avatar was manipulated between (Experiment 1) or within (Experiments 2 and 3) participants, and interference was assessed using behavioral (Experiments 1–3) and ERP (Experiment 1) measures. Results revealed that altercentric interference is reduced or eliminated when a child avatar was present, suggesting that adults do not automatically compute a child avatar’s perspective. We attribute this pattern to either enhanced visual processing for own-age others or an inference on reduced mental awareness in younger children. The findings argue against a purely attentional basis for the altercentric effect, and instead support an account where both mentalising and directional processes modulate automatic visual perspective-taking, and perspective-taking effects are strongly influenced by experimental context.     

Encouraging top-down attention in visual search:A developmental perspective

Four experiments are reported in which 60 younger children (7–8 years old), 60 older children (10–11 years old), and 60 young adults (18–25 years old) performed a conjunctive visual search task (15 per group in each experiment). The number of distractors of each feature type was unbalanced across displays to evaluate participants’ ability to restrict search to the smaller subset of features. The use of top-down attention processes to restrict search was encouraged by providing external aids for identifying and maintaining attention on the smaller set. In Experiment 1, no external assistance was provided. In Experiment 2, precues and instructions were provided to focus attention on that subset. In Experiment 3, trials in which the smaller subset was represented by the same feature were presented in alternating blocks to eliminate the need to switch attention between features from trial to trial. In Experiment 4, consecutive blocks of the same subset features were presented in the first or second half of the experiment, providing additional consistency. All groups benefited from external support of top-down attention, although the pattern of improvement varied across experiments. The younger children benefited most from precues and instruction, using the subset search strategy when instructed. Furthermore, younger children benefited from blocking trials only when blocks of the same features did not alternate. Older participants benefited from the blocking of trials in both Experiments 3 and 4, but not from precues and instructions. Hence, our results revealed both malleability and limits of children’s top-down control of attention.     

Spontaneous prospective-memory processing: Unexpected fluency experiences trigger erroneous intention executions

Event-based prospective memory is the ability to remember to execute an intention when an environmental cue occurs. It has been argued that, due to their special meaning, these cues are discrepant from their environment and therefore are sometimes spontaneously noticed. In line with this assumption, the likelihood that an intention will be executed increases with increased cue-discrepancy. It is not yet clear, however, whether these improvements are due to facilitated spontaneous noticing rather than to an increase in the efficiency of controlled cue-processing. To further investigate the spontaneous nature of cue-discrepancy benefits, we presented participants with stimuli that were unrelated to the intention but discrepant from other stimuli. Therefore, we experimentally increased the processing fluency of some stimuli for participants currently holding an intention by using different priming procedures. We found that stimuli whose fluency was increased via spaced repeated stimulus presentation (Experiment 1) or via short pre-exposure (Experiment 2a to 3) elicited a tendency to fulfill the intention despite its actual inappropriateness. Findings were inconsistent as to whether cue-memory uncertainty fosters the reliance on cue discrepancy for intention retrieval (Experiments 2a and 3). Taken together, the present findings provide converging evidence for a spontaneous discrepancy-based prospective-memory process which works independent of controlled processes.     

Bindings in working memory: The role of object-based attention

Over the past decade, it has been debated whether retaining bindings in working memory (WM) requires more attention than retaining constituent features, focusing on domain-general attention and space-based attention. Recently, we proposed that retaining bindings in WM needs more object-based attention than retaining constituent features (Shen, Huang, & Gao, 2015, Journal of Experimental Psychology: Human Perception and Performance, doi: 10.1037/xhp0000018). However, only unitized visual bindings were examined; to establish the role of object-based attention in retaining bindings in WM, more emperical evidence is required. We tested 4 new bindings that had been suggested requiring no more attention than the constituent features in the WM maintenance phase: The two constituent features of binding were stored in different WM modules (cross-module binding, Experiment 1), from auditory and visual modalities (cross-modal binding, Experiment 2), or temporally (cross-time binding, Experiments 3) or spatially (cross-space binding, Experiments 4–6) separated. In the critical condition, we added a secondary object feature-report task during the delay interval of the change-detection task, such that the secondary task competed for object-based attention with the to-be-memorized stimuli. If more object-based attention is required for retaining bindings than for retaining constituent features, the secondary task should impair the binding performance to a larger degree relative to the performance of constituent features. Indeed, Experiments 1–6 consistently revealed a significantly larger impairment for bindings than for the constituent features, suggesting that object-based attention plays a pivotal role in retaining bindings in WM.     

The fate of unattended stimuli and emotional habituation: Behavioral interference and cortical changes

The interference produced by the viewing of emotional distractors has been interpreted as evidence that emotional cues are processed in a fairly mandatory fashion, and that they divert attention from the primary ongoing task. However, few studies have examined how behavioral emotional interference varies with repeated presentation of the same emotional distractors. In two experiments, while participants were engaged in a parity judgment task, we investigated the effects of repetition of task-irrelevant emotional pictures, as reflected in both behavioral interference (Experiments 1 and 2) and neural activity (Experiment 2). Both experiments showed that the slowing of reaction times that was observed when viewing emotional, compared to neutral, scenes disappeared after only a few repetitions, suggesting diminished attention allocation to repeated emotional pictures. Conversely, in Experiment 2, neural correlates of picture processing revealed that the late positive potential (LPP) amplitude continued to be enhanced for emotional, compared to neutral, distractors despite picture repetition and the presence of a concurrent task. Altogether, these findings suggest that while evaluative processes are mandatory, and continue to engage cortico-limbic appetitive and defensive systems even after massive repetition, as suggested by the affective modulation of the LPP, attentional processes are not necessary after several repetitions of the same stimulus, as indicated by the rapid decline of behavioral emotional interference.     

The texture of causal construals: Domain-specific biases shape causal inferences from discourse

We conducted five sets of experiments asking whether psychological and physical events are construed in broadly different manners concerning the underlying textures of their causes. In Experiments 1a–1d, we found a robust tendency to estimate fewer causes (but not effects) for psychological than for physical events; Experiment 2 showed a similar pattern of results when participants were asked to generate hypothetical causes and effects; Experiment 3 revealed a greater tendency to ascribe linear chains of causes (but not effects) to physical events; Experiment 4 showed that the expectation of linear chains was related to intuitions about deterministic processes; and Experiment 5 showed that simply framing a given ambiguous event in psychological versus physical terms is sufficient to induce changes in the patterns of causal inferences. Adults therefore consistently show a tendency to think about psychological and physical events as being embedded in different kinds of causal structures.     

Explaining the forgetting bias effect on value judgments: The influence of memory for a past test

People often feel that information that was forgotten is less important than remembered information. Prior work has shown that participants assign higher importance to remembered information while undervaluing forgotten information. The current study examined two possible accounts of this finding. In three experiments, participants studied lists of words in which each word was randomly assigned a point value denoting the value of remembering the word. Following the presentation of each list participants engaged in a free recall test. After the presentation of all lists participants were shown each of the words they had studied and asked to recall the point value that was initially paired with each word. Experiment 1 tested a fluency-based account by presenting items for value judgments in a low-fluency or high-fluency format. Experiment 2 examined whether value judgments reflect attributions based on the familiarity of an item when value judgments are made. Finally, in Experiment 3, we evaluated whether participants believe that forgotten words are less important by having them judge whether an item was initially recalled or forgotten prior to making a value judgment. Manipulating the fluency of an item presented for judgment had no influence on value ratings (Experiment 1) and familiarity exerted a limited influence on value judgments (Experiment 2). More importantly, participants’ value judgments appeared to reflect a theory that remembered information is more valuable than forgotten information (Experiment 3). Overall, the present work suggests that individuals may apply a theory about remembering and forgetting to retrospectively assess the value of information.     

Predictive visual search: Role of environmental regularities in the learning of context cues

Repeatedly searching through invariant spatial arrangements in visual search displays leads to the buildup of memory about these displays (contextual-cueing effect). In the present study, we investigate (1) whether contextual cueing is influenced by global statistical properties of the task and, if so, (2) whether these properties increase the overall strength (asymptotic level) or the temporal development (speed) of learning. Experiment 1a served as baseline against which we tested the effects of increased or decreased proportions of repeated relative to nonrepeated displays (Experiments 1b and 1c, respectively), thus manipulating the global statistical properties of search environments. Importantly, probability variations were achieved by manipulating the number of nonrepeated (baseline) displays so as to equate the total number of repeated displays across experiments. In Experiment 1d, repeated and nonrepeated displays were presented in longer streaks of trials, thus establishing a stable environment of sequences of repeated displays. Our results showed that the buildup of contextual cueing was expedited in the statistically rich Experiments 1b and 1d, relative to the baseline Experiment 1a. Further, contextual cueing was entirely absent when repeated displays occurred in the minority of trials (Experiment 1c). Together, these findings suggest that contextual cueing is modulated by observers’ assumptions about the reliability of search environments.     

Trapped in a tight spot: Scaling effects occur when,according to the action-specific account,they should not,and fail to occur when they should

The action-specific account of perception claims that what we see is perceptually scaled according to our action capacity. However, it has been argued that this account relies on an overly confirmatory research strategy—predicting the presence of, and then finding, an effect (Firestone & Scholl, 2014). A comprehensive approach should also test disconfirmatory predictions, in which no effect is expected. In two experiments, we tested one such prediction based on the action-specific account, namely that scaling effects should occur only when participants intend to act (Witt, Proffitt, & Epstein, 2005). All participants wore asymmetric gloves in which one glove was padded with extra material, so that one hand was wider than the other. Participants visually estimated the width of apertures. The action-specific account predicts that the apertures should be estimated as being narrower for the wider hand, but only when participants intend to act. We found this scaling effect when it should not have occurred (Exp. 1, for participants who did not intend to act), as well as no effect when it should have occurred (Exp. 2, for participants who intended to act but were given a cover story for the visibility and position of their hands). Thus, the cover story used in Experiment 2 eliminated the scaling effect found in Experiment 1. We suggest that the scaling effect observed in Experiment 1 likely resulted from demand characteristics associated with using a salient, unexplained manipulation (e.g., telling people which hand to use to do the task). Our results suggest that the action-specific account lacks predictive power.     

Estimating valence from the sound of a word: Computational,experimental, and cross-linguistic evidence

It is assumed linguistic symbols must be grounded in perceptual information to attain meaning, because the sound of a word in a language has an arbitrary relation with its referent. This paper demonstrates that a strong arbitrariness claim should be reconsidered. In a computational study, we showed that one phonological feature (nasals in the beginning of a word) predicted negative valence in three European languages (English, Dutch, and German) and positive valence in Chinese. In three experiments, we tested whether participants used this feature in estimating the valence of a word. In Experiment 1, Chinese and Dutch participants rated the valence of written valence-neutral words, with Chinese participants rating the nasal-first neutral-valence words more positive and the Dutch participants rating nasal-first neutral-valence words more negative. In Experiment 2, Chinese (and Dutch) participants rated the valence of Dutch (and Chinese) written valence-neutral words without being able to understand the meaning of these words. The patterns replicated the valence patterns from Experiment 1. When the written words from Experiment 2 were transformed into spoken words, results in Experiment 3 again showed that participants estimated the valence of words on the basis of the sound of the word. The computational study and psycholinguistic experiments indicated that language users can bootstrap meaning from the sound of a word.     

Multiple attentional control settings at distinct locations without the confounding of repetition priming

An attentional control setting (ACS), which is based on the task goal, induces involuntary attentional capture by a stimulus possessing a target-defining feature. It is unclear whether ACSs are maintained for multiple targets defined as conjunctions of a color and location. In the present study we examined the possibility of local ACSs for dual targets defined as combinations of color and location, using different paradigms: visual search in Experiment 1, and spatial cueing in Experiment 2. In Experiment 1, a distractor captured attention only when its features matched the ACSs. Likewise, in Experiment 2, a significant attentional capture effect was found only with a matching cue, whose color and location were in line with the conjunction of the target definition. Importantly, the identical pattern of attentional capture was also obtained for a neutral-color target, which was unlikely to be primed by any color of the cue. Thus, these findings imply that the attentional bias depending on the match between the cue and target did not result from cue–target repetition priming. The present study highlights that top-down attentional control can be set flexibly to accomplish a complex task goal efficiently.