Developing an outcome-based assessment for family therapy training: the Rochester Objective Structured Clinical Evaluation (ROSCE)

This paper addresses a growing need for cost-effective, outcome-based assessment in family therapy training. We describe the ROSCE, a structured, evidence-informed, learner-centered approach to the assessment of clinical skills developed at the University of Rochester Medical Center. The ROSCE emphasizes direct observation of trainees demonstrating clinical competencies. The format integrates both formative and summative assessment methods. It can readily be adapted to a wide variety of educational and training settings.     

Dissociative effects of orthographic distinctiveness in pure and mixed lists: an item-order account

We apply the item-order theory of list composition effects in free recall to the orthographic distinctiveness effect. The item-order account assumes that orthographically distinct items advantage item-specific encoding in both mixed and pure lists, but at the expense of exploiting relational information present in the list. Experiment 1 replicated the typical free recall advantage of orthographically distinct items in mixed lists and the elimination of that advantage in pure lists. Supporting the item-order account, recognition performances indicated that orthographically distinct items received greater item-specific encoding than did orthographically common items in mixed and pure lists (Experiments 1 and 2). Furthermore, order memory (input–output correspondence and sequential contiguity effects) was evident in recall of pure unstructured common lists, but not in recall of unstructured distinct lists (Experiment 1). These combined patterns, although not anticipated by prevailing views, are consistent with an item-order account.     

Do monkeys think in metaphors? Representations of space and time in monkeys and humans

Research on the relationship between the representation of space and time has produced two contrasting proposals. ATOM posits that space and time are represented via a common magnitude system, suggesting a symmetrical relationship between space and time. According to metaphor theory, however, representations of time depend on representations of space asymmetrically. Previous findings in humans have supported metaphor theory. Here, we investigate the relationship between time and space in a nonverbal species, by testing whether non-human primates show space–time interactions consistent with metaphor theory or with ATOM. We tested two rhesus monkeys and 16 adult humans in a nonverbal task that assessed the influence of an irrelevant dimension (time or space) on a relevant dimension (space or time). In humans, spatial extent had a large effect on time judgments whereas time had a small effect on spatial judgments. In monkeys, both spatial and temporal manipulations showed large bi-directional effects on judgments. In contrast to humans, spatial manipulations in monkeys did not produce a larger effect on temporal judgments than the reverse. Thus, consistent with previous findings, human adults showed asymmetrical space–time interactions that were predicted by metaphor theory. In contrast, monkeys showed patterns that were more consistent with ATOM.     

Spontaneous analog number representations in 3‐year‐old children

When enumerating small sets of elements nonverbally, human infants often show a set‐size limitation whereby they are unable to represent sets larger than three elements. This finding has been interpreted as evidence that infants spontaneously represent small numbers with an object‐file system instead of an analog magnitude system ( Feigenson, Dehaene & Spelke, 2004 ). In contrast, non‐human animals and adult humans have been shown to rely on analog magnitudes for representing both small and large numbers ( Brannon & Terrace, 1998 ; Cantlon & Brannon, 2007 ; Cordes, Gelman, Gallistel & Whalen, 2001). Here we demonstrate that, like adults and non‐human animals, children as young as 3 years of age spontaneously employ analog magnitude representations to enumerate both small and large sets. Moreover, we show that children spontaneously attend to numerical value in lieu of cumulative surface area. These findings provide evidence of young children’s greater sensitivity to number relative to other quantities and demonstrate continuity in the process they spontaneously recruit to judge small and large values.     

State preferences for the ACT versus SAT complicates inferences about SAT-derived state IQ estimates: A comment on Kanazawa (2006)

Kanazawa [Kanazawa, S. (2006). IQ and the wealth of states. Intelligence, 34, 593–600.] offered estimates of state IQ derived from SAT data. The purpose of this commentary is to argue that state preferences for the use of the ACT versus the SAT create biased estimates of SAT-derived state IQ for states where the ACT is more frequently used than the SAT. This error can be reduced by using both ACT and SAT data to estimate state IQ. An IQ estimate based on a ACT-SAT composite and a NAEP-derived state IQ estimate were compared as predictors of three wealth variables. Both IQ estimates cause one to conclude that states with higher mean IQ have larger gross state product per capita, higher median incomes, and a lower percentage of their population in poverty.     

Model-guided search for optimal natural-science-category training exemplars: A work in progress

Psychonomic Bulletin & Review - Under the guidance of a formal exemplar model of categorization, we conduct comparisons of natural-science classification learning across four conditions in...     

Evaluating Factorial Invariance: An Interval Estimation Approach Using Bayesian Structural Equation Modeling

In this study, we introduce an interval estimation approach based on Bayesian structural equation modeling to evaluate factorial invariance. For each tested parameter, the size of noninvariance with an uncertainty interval (i.e. highest density interval [HDI]) is assessed via Bayesian parameter estimation. By comparing the most credible values (i.e. 95% HDI) with a region of practical equivalence (ROPE), the Bayesian approach allows researchers to (1) support the null hypothesis of practical invariance, and (2) examine the practical importance of the noninvariant parameter. Compared to the traditional likelihood ratio test, simulation results suggested that the proposed Bayesian approach could offer additional insight into evaluating factorial invariance, thus, leading to more informative conclusions. We provide an empirical example to demonstrate the procedures necessary to implement the proposed method in applied research. The importance of and influences on the choice of an appropriate ROPE are discussed.     

Implementation intentions facilitate prospective memory under high attention demands

An implementation intention is a planning technique that involves specifying a situation for initiating an intended action and linking these specific cues to the intention. In two experiments with young adults, we found significant increases in prospective memory with implementation intentions. With an implementation intention, but not with standard instructions, prospective memory performance was maintained under demanding attentional conditions (Experiment 2). Ongoing task performance did not decline, however, in relation with a no prospective memory control. Positive effects were not observed when the imagery component of the implementation intention was isolated from the verbal component. We suggest that implementation intention planning (relative to standard instructions) increases the likelihood that people will encode a robust associative link between the target cue and the intended action, thereby promoting reflexive triggering of the intended action on presentation of the target cue.     

Monkeys match and tally quantities across senses

We report here that monkeys can actively match the number of sounds they hear to the number of shapes they see and present the first evidence that monkeys sum over sounds and sights. In Experiment 1, two monkeys were trained to choose a simultaneous array of 1-9 squares that numerically matched a sample sequence of shapes or sounds. Monkeys numerically matched across (audio-visual) and within (visual-visual) modalities with equal accuracy and transferred to novel numerical values. In Experiment 2, monkeys presented with sample sequences of randomly ordered shapes or tones were able to choose an array of 2-9 squares that was the numerical sum of the shapes and sounds in the sample sequence. In both experiments, accuracy and reaction time depended on the ratio between the correct numerical match and incorrect choice. These findings suggest monkeys and humans share an abstract numerical code that can be divorced from the modality in which stimuli are first experienced.     

The involvement of executive functions in prospective memory performance of adults

The present study examines the relationship between prospective memory performance and executive functioning. The four phases of the prospective memory process—intention formation, intention retention, reinstantiation of the intention, and intention execution—are assumed to require different amounts of executive processing, most of which is demanded in the phases of intention formation and intention execution. At present, though, it is still unclear whether, and to what extent, prefrontal executive systems are involved in different kinds of prospective memory tasks, as some findings suggest that prospective memory might rather rely on nonstrategic processes that are unlikely to depend on prefrontal executive systems. Therefore, this study focuses on the following questions: (1) to what degree does executive functioning predict prospective memory performance in different standard prospective memory tasks and, furthermore, are certain executive measures better predictors than others; (2) are age‐related effects in different prospective memory measures due to individual differences in executive functioning; and (3) do age‐related differences in prospective memory exist that are not explained by individual differences in executive functioning. In a sample of 80 adults (20‐80 years), we applied four instruments to measure prospective memory: a traditional single‐task paradigm, two more complex tasks—one time‐based and one event‐based—and a highly complex multi‐task paradigm. We further assessed a broadly defined construct of executive functioning using several standard neuropsychological tests. Results showed that executive functioning did not predict performance in the simple single‐task paradigm. However, executive functioning, but not age, predicted performance in the two more complex standard tests of prospective remembering, and both executive functioning and age predicted performance in the most complex paradigm. In sum, the obtained data underline the assumption that frontal/ executive functions are related to prospective memory performance across a range of prospective paradigms. It also seems clear that age differences in prospective memory performance partially depend on age‐related individual differences in frontal/executive functions.