Pictorial context and the recall of pronoun sentences

Summary Acting on the assumption that pictures affect the processing of sentences only when providing additional information, the authors used pictures, which in an earlier experiment had failed to influence the retention of noun sentences, as illustrations to semantically undefined pronoun sentences, thus establishing a distinct information gradient between sentence and picture. These pronoun sentences were presented to 48 subjects for recall, in four pictorial conditions: without picture, with unambiguous picture, with subject-ambiguous, and with object-ambiguous picture. As hypothesized, picture-less pronoun sentences were more poorly recalled than picture-enriched pronoun sentences. Moreover, sentences accompanied by subject-ambiguous pictures, in which the grammatical subject could not be clearly identified, scored lower than the same sentences with unambiguous or object-ambiguous pictures. The findings invite a communication-theory analysis of the experimental situation, for which Searle's theory of speech acts is invoked.The authors gratefully acknowledge the assistance of Mr. B. Jankowski in the translation of this paper from an original German version.     

Picture versus question elaboration on young children's learning of sentences containing high- and low-probability content

The main purpose of the two experiments reported here was to compare the potency of two types of elaboration on children's learning of sentence content: The effects of partial picture adjuncts were compared to the effects produced by answering "why"-questions about the relationships specified in the sentences. Five- to seven-year-old children heard sentences of the form, subject/verb/direct object/preposition/instrument. Sentences contained either a high-probability or a low-probability instrument given the semantic context. In Experiment 1, sentences either were accompanied by a partial picture depicting the sentence action but omitting the instrument or were presented without a partial picture accompaniment. Recall was improved by provision of partial pictures at study. In Experiment 2, the sentences were accompanied by complete pictures depicting the sentence content. In both experiments, questioning significantly reduced recall of high-probability sentences, with recall of instruments affected especially negatively. Evidence is presented that insufficient attention to instruments may have been one mechanism mediating depressed recall of high- compared to low-probability instruments in the questioned conditions. In summary, partial pictures improved cued recall of sentences in this study; in contrast, all significant effects produced by answering why-questions were negative ones (i.e., later recall was reduced following interrogation at study).     

Partial picture effects on children's memory for sentences containing implicit information

Two experiments were conducted examining the effects of partial picture adjuncts on young children's coding of information that was implied in sentences. In the two most critical conditions of these studies, subjects were presented sentences specifying a subject, an action, and a direct object with the instrument used to carry out the action not specified in the sentence (e.g., The workman dug a hole in the ground). Implicit-sentence-only subjects received only the sentences, whereas the implicit sentence + partial picture subjects also viewed a partial picture depicting the action in the sentence minus the implied instrument. The main hypothesis was that subsequent recall of the sentences given the implied instrument as a cue would be facilitated by the partial pictures provided at study, since they would lead the children to infer the instrument. That occurred with 6- to 7-year-old children, but not with preschool children. Consistent with the conclusion that the partial pictures prompted 6- to 7-year-olds to infer the instruments, implicit sentence + partial picture subjects recalled as much as subjects in two other conditions, one in which subjects were explicitly told the instruments at study and one in which subjects saw the instruments depicted in pictures at study. In contrast, preschool subjects who heard explicit sentences containing the instruments outperformed subjects who heard implicit sentences even when the implicit sentences were accompanied by pictures depicting the instruments. This failure of complete pictures to facilitate preschoolers' recall of information implied in sentences contrasts with the many demonstrations of prose learning facilitation when picture and sentence contents explicitly and completely overlap. In summary, there were developmental differences in whether (a) partial pictures significantly facilitated inferencing (and subsequent cued recall) and (b) complete pictures containing information not explicitly stated in sentences promoted cued recall of the sentences.     

How does verb aspect constrain event representations?

We investigated the relative contribution of perfective and imperfective aspectual cues on situation models. In Experiment 1, participants were more likely to choose pictures showing completed events than pictures showing ongoing events when they had read perfective sentences, but chose either picture after reading imperfective sentences. In Experiment 2, only one picture was presented and participants were faster to respond to completed pictures than to ongoing pictures when they had read perfective sentences, but showed no latency differences after reading the imperfective sentences. In Experiment 3, participants were faster to read perfective sentences after having seen completed pictures rather than intermediate pictures, but there was no difference for imperfective sentences. The consistent pattern of results demonstrates that readers construct mental representations of completed events when the perfective aspect is used to describe an event. The lack of effect on imperfective sentences and pictures suggests that each reader represents an in-progress event at varying stages of completion.     

Long-term memory for pictures and sentences

Two experiments were conducted to examine the fan effect in recognition memory for pictures and sentences. Subjects in the first experiment memorized sets of pictures (N= 13) or sentences (N=13) in which the study items comprised concept combinations (e.g., the clock is on the television) that could be unambiguously depicted in each modality. The fan effect, contrasting study items involving unique- and shared-concepts combinations, was observed in the recognition reaction time data for sentences but not for pictures. Subjects in the second experiment (N= 17) memorized sets of pictures and sentences in which, in addition to the unique and shared intramodality conditions used in Experiment 1, subjects memorized items in each modality that shared concepts with items in the alternative modality. Although the fan effect was reduced for sentences in the second experiment, the intramodality results were qualitatively comparable to those obtained in Experiment 1. The results in the intermodality conditions indicated that, although pictorial study items influenced reaction time to sentences with which they shared a concept, the reverse was not the case. The results were thought to be inconsistent with the view that pictures and sentences enjoy a common representational format in long-term memory.     

Does text–picture integration also occur with longer text segments?

Text–picture integration is one of the most important cognitive processes when reading illustrated text. There is empirical evidence that text‐picture integration takes place when learning with pictures combined with single sentences. The present experiment investigated whether text–picture integration also takes place when the single sentences are embedded into longer text segments and hence when materials become more complex. In a within‐subjects design, 43 participants read an illustrated story, in which the different combinations of general and specific sentences and pictures, respectively, were embedded. In line with previous findings, participants were more likely to falsely recognize specific versions of the sentences after having studied their general versions combined with specific pictures. Thus, the experiment shows that text–picture integration also occurs when learners have to read longer text passages combined with pictures.     

Pictorial encoding of sentences in sentence--picture comparison

Subjects are shown to verbally encode sentences for simultaneous comparison with pictures but pictorially encode sentences for later comparison with pictures. This is taken as further evidence that subjects adapt their encodings or representations of stimuli to demands of the task.     

PRODUCING GENERATIVE SENTENCE USAGE BY IMITATION AND REINFORCEMENT PROCEDURES1

Three retarded subjects and two developmentally normal toddlers were trained using imitation and reinforcement procedures to use correct sentences. The experimental task was to use sentences with correct subject-verb agreement to describe pictures that were presented to the subjects. Two classes of sentences were taught: those involving a plural subject that required the use of the verb “are” (for example, “the boys are running”) and those involving a singular subject that required the use of the verb “is” (for example, “the boy is running”). The basic design of the study involved multiple baselines for each class of sentences. Four of the subjects began to produce novel, untrained sentences of a particular type to generalization probe pictures when that particular class of sentence was currently being trained. Thus, the imitation and reinforcement procedures appeared to be functional in producing generative sentence usage for both types of sentences. One subject produced correct sentences to both singular and plural probe pictures when only “is” sentences had been taught. A reversal procedure and retraining phase indicated that for this subject, imitation and reinforcement procedures for training one class of sentence behavior seemed functional in producing generative responses of the other class of sentences.     

汉语确定性无界否定句模拟加工的时间进程

以往关于否定句理解的心理模拟过程是一步完成的还是两步完成的, 结果并不一致, 这与各个研究使用的实验材料类型有关。本研究以汉语确定性无界否定句为研究对象, 采用句-图匹配范式和2(句子类型：汉语确定性无界肯定句和汉语确定性无界否定句) × 2 (图片描绘事物状态与句子描述的事物状态的匹配类型：匹配与不匹配)被试内实验设计, 以对图片判断的反应时和正确率为指标, 探讨其理解的早期(250 ms)、中期(750 ms)和晚期(1500 ms)的心理模拟过程。研究结果表明：确定性无界否定句理解的心理模拟是分两步进行的, 首先模拟的是否定句的被否定状态, 随着加工时间的推进, 完成了对确定性无界否定句的第二步模拟即对实际状态的模拟。但是, 比其他类型否定句的模拟过程所用的时间要短, 即在阅读理解的中期就完成了心理模拟。     

THE ACQUISITION OF SIMPLE AND COMPOUND SENTENCE STRUCTURE IN AN AUTISTIC CHILD1

Contingent reinforcement and imitative prompts were used to teach an autistic child to use simple and compound sentences to describe a set of standard pictures. When imitative prompts and reinforcement were discontinued, correct use of simple sentences declined, but increased again when imitative prompts and reinforcement were re-instated. When imitative prompts and reinforcements were used to teach compound sentence structure, correct use of simple sentences declined and correct use of compound structure increased. At the end of training, the child also used novel compound sentences to describe a set of pictures on which he had received no direct training.     

Development of the ability to perceive ambiguities: Evidence for the task specificity of a linguistic skill

This study asked whether children's ability to perceive linguistic ambiguities was correlated with that of perceiving pictorial ambiguities. A total of 48 ambiguous sentences and 24 ambiguous pictures were selected for comprehensibility. Half the sentences and pictures were symbolic ambiguities (i.e., they contained symbols that stood for two different objects) and half were structural ambiguities (i.e., the structures of the sentences or pictures could be broken up two different ways). No significant correlations were found between the linguistic and pictorial modes. In both modes, correct performance on the symbolic ambiguities was better and was observed earlier than that for structural ambiguities. After taking into account certain methodological problems with nonsignificant correlations and ambiguous sentences, it was concluded that at least some nontrivial component of the linguistic ambiguity detector was task specific to language.     

Generation of a pictorial code

In Experiments I and II direct measures were obtained of the time required to convert a picture or a sentence to a report of visualization or to a simple drawing, latencies were faster for pictures than for sentences and were affected by the surface form of the sentence. In Experiment Ill, Ss matched pictures or sentences against a test picture under conditions of simultaneous or successive presentation. “Yes” and “No” response times were affected by sentence form under both conditions, although the difference between sentence-picture and picture-picture comparisons was virtually eliminated under the successive condition. In Experiment IV, Ss held a sentence or picture in memory over a 1,500-msec interval at the end of which a test picture or an instruction to draw the design was presented. Construction latencies were shorter in response to pictures than sentences, and there were effects of sentence form on verification time. Some implications of these results are discussed.     

状态不确定独立否定句的加工机制

采用自定步速阅读方法与图片核证范式(picture verification paradigm)探讨状态不确定独立否定句(如“裙子不是红色的”)的动态表征过程, 包括3个实验。结果发现：(1)在否定加工的初期, 即250 ms间隔时间条件下, 读者表征事件的否定状态; 肯定句已经通达事件的实际状态。(2)在否定加工的中期, 即750 ms间隔时间条件下, 读者仍然表征事件的否定状态, 但已开始对事件的备择选项进行搜索; 肯定句仍然保持对事件实际状态的表征。(3)在否定加工的后期, 即1500 ms间隔时间条件下, 读者表征否定标记与事件的否定状态, 同时完成对备择选项的搜索; 肯定句依旧保持对事件实际状态的表征。据此, 本文提出的锚激活与限制满足模型(anchor-based activation and satisfaction constrained model)得到初步证明。     

Central bottleneck influences on the processing stages of word production

Does producing a word slow performance of a concurrent, unrelated task? In 2 experiments, 108 participants named pictures and discriminated tones. In Experiment 1, pictures were named after cloze sentences; the durations of the word-production stages of lemma and phonological word-form selection were manipulated with high- and low-constraint cloze sentences and high- and low-frequency-name pictures, respectively. In Experiment 2, pictures were presented with simultaneous distractor words; the durations of lemma and phoneme selection were manipulated with conceptually and phonologically related distractors. All manipulations, except the phoneme-selection manipulation, delayed tone-discrimination responses as much as picture-naming responses. These results suggest that early word-production stages--lemma and phonological word-form selection--are subject to a central processing bottleneck, whereas the later stage--phoneme selection--is not.     

Syntax in pictures

It was hypothesised that pictures drawn to represent active and passive sentences would reflect this syntactic difference. Specifically, it was predicted that the reversal of the order in which the logical subject (LS) and the logical object (LO) occur in the change from active to passive form of sentence will affect the order in which they occur in their pictorial representations. A significant directional preference was found for placing the LO to the left of the LS in the pictorial representations of passive but not active sentences. This was discussed in terms of the marked status of the passive in relation to the active. In the case of sentences differing only in lexical marking there was no asymmetric directionality effect corresponding to that found for actives and passives. A significant tendency to match the surface order of the sentences in the pictures was found for both lexically marked and unmarked sentences. The possibility that other spatial or physical dimensions might be used to express syntactic and semantic factors in the pictorial representation of sentences is considered.     

The Role of Constraints in Creative Sentence Production

Two experiments explored how people create novel sentences referring to given entities presented either in line drawings or in nouns. The line drawings yielded more creative sentences than the words, both as rated by judges and objectively by a measure of the amount of information that the sentences conveyed. A hypothesis about the cognitive processes of creation predicted this result: Creativity depends on constraints. Line drawings of entities present more information about them than nouns denoting the same entities, and so the pictures provide more constraints than the nouns. Hence, line drawings yield more creative sentences than words.     

Situation models and retrieval interference: pictures and words

Previous studies have found that interference in long-term memory retrieval occurs when information cannot be integrated into a single situation model, but this interference is greatly reduced or absent when the information can be so integrated. The current study looked at the influence of presentation format-sentences or pictures-on this observed pattern. When sentences were used at memorisation and recognition, a spatial organisation was observed. In contrast, when pictures were used, a different pattern of results was observed. Specifically, there was an overall speed-up in response times, and consistent evidence of interference. Possible explanations for this difference were examined in a third experiment using pictures during learning, but sentences during recognition. The results from Experiment 3 were consistent with the organisation of information into situation models in long-term memory, even from pictures. This suggests that people do create situation models when learning pictures, but their recognition memory may be oriented around more "verbatim", surface-form memories of the pictures.     

The interaction of veracity and syntax in the processing of sentences1

The reaction times of 80 Ss in judging sentences true or false with respect to pictures were analyzed, and it was noted (a) that true sentences containing an expected surface structure required less time than false sentences of the same structure, (b) that latencies to true sentences containing an unexpected surface structure were longer than latencies to the same sentences when their structure was identical to that of previous sentences, and (c) that transitive-verb constructions appeared easier to judge than predicate nominatives of the same length.