Meaning above the head: combinatorial constraints on the visual vocabulary of comics |
| |
Authors: | Neil Cohn Beena Murthy Tom Foulsham |
| |
Institution: | 1. Center for Research in Language, University of California, San Diego, CA, USA;2. Department of Psychology, University of Essex, Colchester, Essex, UK |
| |
Abstract: | “Upfixes” are “visual morphemes” originating in comics where an element floats above a character’s head (ex. lightbulbs or gears). We posited that, similar to constructional lexical schemas in language, upfixes use an abstract schema stored in memory, which constrains upfixes to locations above the head and requires them to “agree” with their accompanying facial expressions. We asked participants to rate and interpret both conventional and unconventional upfixes that either matched or mismatched their facial expression (Experiment 1) and/or were placed either above or beside the head (Experiment 2). Interpretations and ratings of conventionality and face–upfix matching (Experiment 1) along with overall comprehensibility (Experiment 2) suggested that both constraints operated on upfix understanding. Because these constraints modulated both conventional and unconventional upfixes, these findings support that an abstract schema stored in long-term memory allows for generalisations beyond memorised individual items. |
| |
Keywords: | Visual language visual morphology visual metaphor emotion comics |
|
|