Hybrid value foraging: How the value of targets shapes human foraging behavior

In hybrid foraging, observers search visual displays for multiple instances of multiple target types. In previous hybrid foraging experiments, although there were multiple types of target, all instances of all targets had the same value. Under such conditions, behavior was well described by the marginal value theorem (MVT). Foragers left the current “patch” for the next patch when the instantaneous rate of collection dropped below their average rate of collection. An observer’s specific target selections were shaped by previous target selections. Observers were biased toward picking another instance of the same target. In the present work, observers forage for instances of four target types whose value and prevalence can vary. If value is kept constant and prevalence manipulated, participants consistently show a preference for the most common targets. Patch-leaving behavior follows MVT. When value is manipulated, observers favor more valuable targets, though individual foraging strategies become more diverse, with some observers favoring the most valuable target types very strongly, sometimes moving to the next patch without collecting any of the less valuable targets.

     

Selective and nonselective inhibition of competitors in picture naming

The present study examined the relation between nonselective inhibition and selective inhibition in picture naming performance. Nonselective inhibition refers to the ability to suppress any unwanted response, whereas selective inhibition refers to the ability to suppress specific competing responses. The degree of competition in picture naming was manipulated by presenting targets along with distractor words that could be semantically related (e.g., a picture of a dog combined with the word cat) or unrelated (tree) to the picture name. The mean naming response time (RT) was longer in the related than in the unrelated condition, reflecting semantic interference. Delta plot analyses showed that participants with small mean semantic interference effects employed selective inhibition more effectively than did participants with larger semantic interference effects. The participants were also tested on the stop-signal task, which taps nonselective inhibition. Their performance on this task was correlated with their mean naming RT but, importantly, not with the selective inhibition indexed by the delta plot analyses and the magnitude of the semantic interference effect. These results indicate that nonselective inhibition ability and selective inhibition of competitors in picture naming are separable to some extent.     

Principlism and its alleged competitors.

Principles that provide general normative frameworks in bioethics have been criticized since the late 1980s, when several different methods and types of moral philosophy began to be proposed as alternatives or substitutes. Several accounts have emerged in recent years, including: (1) Impartial Rule Theory (supported in this issue by K. Danner Clouser), (2) Casuistry (supported in this issue by Albert Jonsen), and (3) Virtue Ethics (supported in this issue by Edmund D. Pellegrino). Although often presented as rival methods or theories, these approaches are consistent with and should not be considered adversaries of a principle-based account.     

A bayesian optimal foraging model of human visual search

Real-world visual searches often contain a variable and unknown number of targets. Such searches present difficult metacognitive challenges, as searchers must decide when to stop looking for additional targets, which results in high miss rates in multiple-target searches. In the study reported here, we quantified human strategies in multiple-target search via an ecological optimal foraging model and investigated whether searchers adapt their strategies to complex target-distribution statistics. Separate groups of individuals searched displays with the number of targets per trial sampled from different geometric distributions but with the same overall target prevalence. As predicted by optimal foraging theory, results showed that individuals searched longer when they expected more targets to be present and adjusted their expectations on-line during each search by taking into account the higher-order, across-trial target distributions. However, compared with modeled ideal observers, participants systematically responded as if the target distribution were more uniform than it was, which suggests that training could improve multiple-target search performance.     

Choice and foraging

In Experiment 1, six naive pigeons were trained on a foraging schedule characterized by different states beginning with a search state in which completion of a fixed-interval on a white key led to a choice state. In the choice state the subject could, by appropriate responding on a fixed ratio of three, either accept or reject the schedule of reinforcement that was offered (either a variable-interval five-second or a variable-interval 20-second). If the subject accepted the schedule, it entered a “handling state” in which the appropriate variable-interval schedule was presented. Completion of the variable-interval schedule produced food. The independent variable was the fixed-interval value in the search state, and the dependent variable was the rate of acceptance of the long variable-interval in the choice state. Experiment 2 was identical except that the search state required completion of a variable-interval, instead of a fixed-interval, schedule. The rate of acceptance of the long variable-interval schedule in both experiments was a direct function of the length of the search state, in accordance with both optimality theory and the delay-reduction hypothesis.     

Delay reduction and optimal foraging: variable-ratio search in a foraging analogue.

The present study investigated conditions under which the conditioned reinforcement principles of delay-reduction theory and views based on simple maximization of reinforcement rate make ordinally opposing predictions with respect to foraging-related choice behavior. The use of variable-ratio schedules in the choice phase also represents an extension of delay-reduction theory to schedules that may better mimic the effort involved in searching. Pigeons responded on modified concurrent-chains schedules in which equal variable-ratio schedules led to unequal variable-interval outcomes and unequal reinforcer amounts. All 4 subjects completed a minimum of two replications of conditions for which the predictions of delay-reduction theory and a simple rate-maximizing theory were opposed. Results were consistent with delay reduction's ordinal predictions in 11 of 11 replications of the divergent predictions favoring the smaller, more immediate alternative. The predictions of rate maximization were upheld only when they were consistent with those of delay reduction. Results are discussed in terms of conditioned reinforcement, sensitivity to reductions in delay to food, and possible rules of thumb that may be useful in characterizing foraging.     

Older adults can inhibit high-probability competitors in speech recognition

Younger and older adults identified a series of target words spoken in sentence contexts from their onsets only (i.e., word-onset gating). Sentences were drawn from published norms so that the contextual probabilities of the final words were known. the target words were always the second most probable responses to the sentence contexts, and the probabilities of the target words and the most likely alternatives were systematically varied. Results showed that older adults required more word-onset information for correct recognition, and their responses were more affected by the probability of the occurrence of the target word, supporting previous suggestions that older listeners differentially rely on contextual support in spoken word recognition. Contrary to the Inhibition Hypothesis, however, that older adults have especial difficulty suppressing irrelevant information once it is activited, elders' ability to recognize the target was not particularly disrupted by the presence of a high-probability competitor.     

Size of defeat and liking for superior and similar ability competitors

Data are reported supporting the view that a competitor's pronounced superiority in ability can serve the positive function of reducing threat to self-esteem stemming from severe negative comparisons by rendering these comparisons irrelevant. Females of apparently comparable ability, compared their performances on a test said to measure cognitive fluency. A competitor's promotion to a higher level of ability (i.e., being designated as incomparably superior by an outside agent) caused an initially comparable competitor who decisively defeated the subject to be eliminated as a relevant comparison threat and to be liked more than a nonpromoted competitor who only marginally defeated the subject and hence remained comparable. A promoted competitor who marginally defeated the subject and a nonpromoted competitor who decisively defeated the subject were relatively disliked. Perceived ability and threat data together with observer control group findings indicated that this liking pattern was a function of differential comparison threat and not of the competitors' objective stimulus characteristics.     

Optimal foraging in semantic memory

Do humans search in memory using dynamic local-to-global search strategies similar to those that animals use to forage between patches in space? If so, do their dynamic memory search policies correspond to optimal foraging strategies seen for spatial foraging? Results from a number of fields suggest these possibilities, including the shared structure of the search problems-searching in patchy environments-and recent evidence supporting a domain-general cognitive search process. To investigate these questions directly, we asked participants to recover from memory as many animal names as they could in 3 min. Memory search was modeled over a representation of the semantic search space generated from the BEAGLE memory model of Jones and Mewhort (2007), via a search process similar to models of associative memory search (e.g., Raaijmakers & Shiffrin, 1981). We found evidence for local structure (i.e., patches) in memory search and patch depletion preceding dynamic local-to-global transitions between patches. Dynamic models also significantly outperformed nondynamic models. The timing of dynamic local-to-global transitions was consistent with optimal search policies in space, specifically the marginal value theorem (Charnov, 1976), and participants who were more consistent with this policy recalled more items.     

Discrimination learning in a foraging situation

Rats were allowed to forage in a simulated natural environment made up of eight food sources (patches) each containing a fixed number of pellets. Two of the eight contained an extra supply of peanuts. The peanut patches were signaled by an olfactory/visual cue located at the bottom of the ladder leading to the patch. In successive phases the number of sessions per day, height of the patches, and availability of peanuts were manipulated. Subjects showed evidence of discrimination learning under these conditions, although the degree of discriminatory behavior varied as a function of environmental manipulations. Assessment of behavior within foraging sessions showed that subjects systematically changed their patterns of utilization of patches across time. Sampling or exploration, as well as food reinforcement, seem implicated in these results.     

Fishing for the right words: decision rules for human foraging behavior in internal search tasks

Animals depleting one patch of resources must decide when to leave and switch to a fresh patch. Foraging theory has predicted various decision mechanisms; which is best depends on environmental variation in patch quality. Previously we tested whether these mechanisms underlie human decision making when foraging for external resources; here we test whether humans behave similarly in a cognitive task seeking internally generated solutions. Subjects searched for meaningful words made from random letter sequences, and as their success rate declined, they could opt to switch to a fresh sequence. As in the external foraging context, time since the previous success and the interval preceding it had a major influence on when subjects switched. Subjects also used the commonness of sequence letters as a proximal cue to patch quality that influenced when to switch. Contrary to optimality predictions, switching decisions were independent of whether sequences differed little or widely in quality.     

Knowledge mediates the timeframe of covariation assessment in human causal induction

How do humans discover causal relations when the effect is not immediately observable? Previous experiments have uniformly demonstrated detrimental effects of outcome delays on causal induction. These findings seem to conflict with everyday causal cognition, where humans can apparently identify long-term causal relations with relative ease. Three experiments investigated whether the influence of delay on adult human causal judgements is mediated by experimentally induced assumptions about the timeframe of the causal relation in question, as suggested by Einhorn and Hogarth (1986). Causal judgements generally decreased when a delay separated cause and effect. This decrease was less pronounced when the thematic context of the causal relation induced participants to expect a delay. Experiment 3 ruled out an alternative explanation of the effect based on variations of cue and outcome saliencies, and showed that detrimental effects of delay are reduced even more when instructions explicitly mentioned the timeframe of the causal relation in question. Knowledge thus mediates the impact of delay on human causal judgement. Implications for contemporary theories of human causal induction are discussed.     

Human foraging behavior in a virtual environment

We have developed an experimental platform that allows a large number of human participants to interact in real time within a common virtual world. Within this environment, human participants foraged for resources distributed in two spatially separated pools. In addition to varying the relative replenishment rate for the two pools (50-50, 65-35, or 80-20), we manipulated whether the participants could see each other and the entire resource distribution or had their vision restricted to resources at their own location. Two empirical deviations from an optimal distribution of the participants were found. First, the participants were more scattered within a resource pool than the resources were themselves. Second, there was systematic underutilization of the richer pool. For example, the participants distributed themselves 73% and 27% to resource pools that had replenishment rates of 80% and 20%, respectively. In addition, there were oscillations in the harvesting rate of the pools across time, revealed by a Fourier analysis with prominent power near 50 sec per cycle. The suboptimalities and oscillations were more apparent when the locations of the participants and the food were not visible. Individual participant knowledge thus affects the efficiency with which a population of participants harvests resources.     

Risk-sensitive foraging theory and operant psychology.

Hastjarjo, Silberberg, and Hursh (1990) have presented data on the foraging behavior of rats and discussed it in terms of risk-sensitive foraging theory. Because risk-sensitive foraging theory is comprised of several different models, it does not lead to general predictions about when an organism should prefer a foraging option with high variance to a foraging option with low variance. Any comparison of data with the predictions of the theory must be based on an appropriate model. I draw attention to various experiments that are potentially relevant to the results reported by Hastjarjo et al. and show how the time period over which the organism must survive can influence a model's predictions about risk sensitivity.     

Assessment and choice: an operant simulation of foraging in patches

Pigeons were presented with an operant simulation of two prey patches using concurrent random-ratio schedules of reinforcement. An unstable patch offered a higher initial reinforcement probability, which then declined unpredictably to a zero reinforcement probability in each session. A stable patch offered a low but unvarying reinforcement probability. When the reinforcement probability declined to zero in a single step, the birds displayed shorter giving-up times in the unstable patch when the ratio between the initial reinforcement probabilities in the unstable and stable patches was greater and when the combined magnitude of the reinforcement probabilities in the two patches was greater. When the unstable patch declined in two steps, the birds behaved as if their giving-up times were influenced heavily by events encountered during the most recent step of the double-step change. This effect was observed, however, only when the reinforcement probability in that step was .04, not when it was .06. All of these data agree with the predictions of a capture-probability model based on a comparison of the estimated probability of receiving a reinforcer in the current patch with that in alternative patches.     

Visual search and foraging compared in a large-scale search task

It has been argued that visual search is a valid model for human foraging. However, the two tasks differ greatly in terms of the coding of space and the effort required to search. Here we describe a direct comparison between visually guided searches (as studied in visual search tasks) and foraging that is not based upon a visually distinct target, within the same context. The experiment was conducted in a novel apparatus, where search locations were indicated by an array of lights embedded in the floor. In visually guided conditions participants searched for a target defined by the presence of a feature (red target amongst green distractors) or the absence of a feature (green target amongst red and green distractors). Despite the expanded search scale and the different response requirements, these conditions followed the pattern found in conventional visual search paradigms: feature-present search latencies were not linearly related to display size, whereas feature-absent searches were longer as the number of distractors increased. In a non-visually guided foraging condition, participants searched for a target that was only visible once the switch was activated. This resulted in far longer latencies that rose markedly with display size. Compared to eye-movements in previous visual search studies, there were few revisit errors to previously inspected locations in this condition. This demonstrates the important distinction between visually guided and non-visually guided foraging processes, and shows that the visual search paradigm is an equivocal model for general search in any context. We suggest a comprehensive model of human spatial search behaviour needs to include search at a small and large scale as well as visually guided and non-visually guided search.     

Choice, foraging, and reinforcer duration.

Pigeons were exposed to a foraging schedule characterized by three different states, beginning with a search state in which completion of a variable interval on a white key led to a choice state. In the choice state the subject could, by appropriate responding on a fixed ratio of three, either accept or reject the schedule offered. If the subject accepted the schedule, it entered a handling state in which the appropriate reinforcer amount was presented according to a variable-interval schedule. In Experiment 1 the shorter duration reinforcer was more likely to be accepted the longer the duration of the search state and the shorter the equal durations of the handling states. In Experiment 2 the shorter duration reinforcer was more likely to be accepted the longer the handling time preceding the longer duration reinforcer. All of the results were in qualitative--and some were in quantitative--agreement with those predicted by the delay-reduction hypothesis and the optimal-diet model.