Metacognition in psychophysical judgment: an unfolding view of comparative judgments of mental workload.

An experiment is reported in which it was found that when subjects were required to indicate which of two visual extents was more difficult to categorize as "long" or "short," they executed these categorizations and then measured the distance of the representation of each stimulus from the long-short category boundary; the stimulus nearer the boundary was judged to be the more difficult. When they were requested to indicate which was easier to categorize, they selected the alternative that was farther. Coombs's theory of data (1952, 1964) and his unfolding theory of preferential choice (1950, 1964) provided the conceptualization of metacognition in this psychophysical task context. Strong support for the probabilistic version of unfolding theory was obtained from the observed selective effects of laterality on the levels of stochastic transitivity attained for various classes of triples and the reliably longer times for comparisons with bilateral pairs than with unilateral pairs. The semantic congruity effects obtained, together with the changes in the form of the relationship between probability and response time as a function of practice, can be best accounted for by an evidence accrual theory in which the distances from the active reference point are measured and compared with a criterion on each evidence accrual. No support is provided for the view that propositionally based semantic "ease"-"difficulty" codes serve as the basis for these metacognitive comparative judgments of ease and difficulty.     

Semantic congruity effects in perceptual comparisons

Semantic congruity effects occur when, as in Experiment 1, for example, the time to select the shorter of two relatively short lines is faster than the time to select the longer; conversely, selection of the longer of two relatively long lines is faster than selection of the shorter. Semantic congruity effects are also demonstrated in experiments requiring comparisons of the heaviness of weights (Experiment 2) and horizontal extent (Experiment 3). In Experiment 1, the magnitude of the semantic congruity effect was larger under conditions emphasizing accuracy rather than speed and when the comparison was difficult. In fact, when comparisons were errorless, the effect was minimal (20 msec), thereby replicating previous failures to obtain the effect with supraliminal perceptual comparisons (Banks, Mermelstein, & Yu, 1982; Marschark & Paivio, 1981; Petrusic & Baranski, 1988a). In confirmation of Henmon's (1911) introspective analyses of psychophysical comparisons, Experiments 2 and 3 extend the range of the semantic congruity effect to include judgments of confidence. However, in each of the three experiments, semantic congruity effects were not evident with the response-accuracy measure. Finally, using highly confusable stimuli, in Experiment 3 the magnitude of the semantic congruity effect was shown to be larger for error than for correct response times. The implications of these findings for a decisional locus of the effect and for the semantic coding theory are discussed.     

The calibration and resolution of confidence in perceptual judgments

Carleton University, Ottawa, Ontariot Canada Confidence rating based calibration and resolution indices were obtained in two experiments requiring perceptual comparisons and in a third with visual gap detection. Four important results were obtained. First, as in the general knowledge domain, subjects were underconfident when judgments were easy and overconfident when they were difficult. Second, paralleling the clear dependence of calibration on decisional difficulty, resolution decreased with increases in decision difficulty arising either from decreases in discriminability or from increasing demands for speed at the expense of accuracy. Third, providing trial-by-trial response feedback on difficult tasks improved resolution but had no effect on calibration. Fourth, subjects can accurately reportsubjective errors (i.e., trials in which they have indicated that they made an error) with their confidence ratings. It is also shown that the properties of decision time, conditionalized on confidence category, impose a rigorous set of constraints on theories of confidence calibration.     

Effects of instruction presentation mode in comparative judgments

In each of two experiments, the comparative instructions in a symbolic comparison task were either varied randomly from trial to trial (mixed blocks) or left constant (pure blocks) within blocks of trials. In the first experiment, every stimulus was compared with every other stimulus. The symbolic distance effect (DE) was enhanced, and the semantic congruity effect (SCE) was significantly larger, when the instructions were randomized than when they were blocked. In a second experiment, each stimulus was paired with only one other stimulus. The SCE was again larger when instructions were randomized than when they were blocked. The enhanced SCE and DE with randomized instructions follow naturally from evidence accrual views of comparative judgments.     

Pairing effects and time-order errors in duration discrimination

Attention, Perception, & Psychophysics - The effects, measured in terms of reproductions, of pairing 4-sec-duration stimuli were examined for six ISIs varying between 1 and 26 sec. The results...     

Probability assessment with response times and confidence in perception and knowledge

In both a perceptual and a general knowledge comparison task, participants categorized the time they took to decide, selecting one of six categories ordered from “Slow” to Fast”. Subsequently, they rated confidence on a six-category scale ranging from “50%” to “100%”. Participants were able to accurately scale their response times thus enabling the treatment of the response time (RT) categories as potential confidence categories. Probability assessment analyses of RTs revealed indices of over/underconfidence, calibration, and resolution, each subject to the “hard-easy” effect, comparable to those obtained with the actual confidence ratings. However, in both the perceptual and knowledge domains, resolution (i.e., the ability to use the confidence categories to distinguish correct from incorrect decisions) was significantly better with confidence ratings than with RT categorization. Generally, comparable results were obtained with scaling of the objective RTs, although subjective categorization of RTs provided probability assessment indices superior to those obtained from objective RTs. Taken together, the findings do not support the view that confidence arises from a scaling of decision time.     

Reading habits for both words and numbers contribute to the SNARC effect

This study compared the spatial representation of numbers in three groups of adults: Canadians, who read both English words and Arabic numbers from left to right; Palestinians, who read Arabic words and Arabic-Indic numbers from right to left; and Israelis, who read Hebrew words from right to left but Arabic numbers from left to right. Canadians associated small numbers with left and large numbers with right space (the SNARC effect), Palestinians showed the reverse association, and Israelis had no reliable spatial association for numbers. These results suggest that reading habits for both words and numbers contribute to the spatial representation of numbers.     

Semantic congruity effects and theories of the comparison process.

Two experiments requiring comparisons of point locations on the line demonstrate that the magnitude of the response-time-based congruity effect parallels the form of the macro and the micro speed-accuracy trade-off function. This is predicted from the evidence accrual class of theories but is contrary to either the propositionally based semantic coding theory or the expectancy view. Very large accuracy-based congruity effects with comparisons of point locations in the plane are evident. Congruity effects arise because the duration of each evidence accrual is increased and the quality of the information is reduced as the distance of the stimulus representations from the instruction-activated reference point increases. This evidence accrual view is extended to account for the properties of perceptual and symbolic comparisons.     

Metacognition in psychophysical judgment: An unfolding view of comparative judgments of mental workload

An experiment is reported in which it was found that when subjects were required to indicate which of two visual extents was more difficult to categorize as “long” or “short,” they executed these categorizations and then measured the distance of the representation of each stimulus from the long-short category boundary; the stimulus nearer the boundary was judged to be the more difficult. When they were requested to indicate which was easier to categorize, they selected the alternative that was farther. Coombs’s theory of data (1952, 1964) and his unfolding theory of preferential choice (1950, 1964) provided the conceptualization of metacognition in this psychophysical task context. Strong support for the probabilisitic version of unfolding theory was obtained from the observed selective effects of laterality on the levels of stochastic transitivity attained for various classes of triples and the reliably longer times for comparisons with bilateral pairs than with unilateral pairs. The semantic congruity effects obtained, together with the changes in the form of the relationship between probability and response time as a function of practice, can be best accounted for by an evidence accrual theory in which the distances from the active reference point are measured and compared with a criterion on each evidence accrual. No support is provided for the view that propositionally based semantic “ease”- “difficulty” codes serve as the basis for these metacognitive comparative judgments of ease and difficulty.