Curriculum-based measurement and literature-based reading: Is curriculum-based measurement meeting the needs of changing reading curricula?

This study examined the extent to which curriculum-based measurement (CBM) procedures could be implemented in a nonbasal reading curricula. Participants included 160 students from 31 second, third, fourth, and fifth grades, located in two school districts. Half of the students (20 from each grade) were instructed primarily in a literature-based reading series, while the remaining 80 participants (20 from each grade) were instructed primarily in a traditional skills-based reading program. CBM passage probes from each reading series were administered to all students twice weekly over an 8-week period. Students' rate of progress in each reading series was indexed using the slope of their data series' calculated by ordinary least squares regression. Results showed small yet significant main effects for the type of probe used for progress monitoring; however, this effect was not consistent across grades. In addition, significant main effects were found for grade. Students' growth in oral reading rate was found to increase linearly with grade until fifth grade where a leveling off in growth rate was observed. Results are discussed in relation to CBM as an applied measurement methodology for use in both practical and research applications.     

The ‘catchphrase’ approach to attitude measurement

This paper reviews reasons for preferring a short-item format over traditional statement-form questions in the measurement of personality characteristics that underline social attitude patterns. In particular, it is argued that this approach is better able to separate item content from item context. The confusion of attitude position with response artefacts has in the past led to misunderstandings concerning the structure of social attitudes. Wilson-Patterson questionnaires are easy for Ss to complete, show high reliability and construct validity, are relatively free of acquiescence response bias and social desirability effects and are readily for cross-cultural comparisons.     

Łukasiewicz logic and the foundations of measurement

The logic of inexactness, presented in this paper, is a version of the Łukasiewicz logic with predicates valued in [0, ∞). We axiomatize multi-valued models of equality and ordering in this logic guaranteeing their imbeddibility in the real line. Our axioms of equality and ordering, when interpreted as axioms of proximity and dominance, can be applied to the foundations of measurement (especially in the social sciences). In two-valued logic they provide theories of ratio scale measurement. In multivalued logic they enable us to treat formally errors arising in nominal and ordinal measurements.     

What next in the psychology of musical measurement?

The Psychological Record -     

Noninvasive measurement of smokers’ tar and nicotine intake

A simple device for monitoring cigarette smokers’ intake of tar and nicotine is described. This device divided the mainstream smoke into two parallel paths, one containing seven parallel capillary tubes and the other containing one capillary tube; a Cambridge filter trapped the smoke passing through the path containing one tube. Analyses of both tar and nicotine trapped in the filter were performed by gravimetric and chemical methods. Calibration tests verified that a constant fraction of the tar and nicotine was retained in the apparatus over a wide range of conditions, allowing the calculation of smoke intake into the mouth. With supplementary methods for measuring the amount of smoke exhaled, the apparatus can be used to measure smoke deposition in the respiratory tract.     

Comments on “the measurement of factorial indeterminacy”

Guttman's index of indeterminacy (2² – 1) measures the potential amount of uncertainty in picking the right alternative interpretation for a factor. When alternative solutions for a factor are equally likely to be correct, then the squared multiple correlation ² for predicting the factor from the observed variables is the average correlation _AB between independently selected alternative solutionsA andB, while var ( _AB )=(1 – ²)²/s, wheres is the dimensionality of the space in which unpredicted components of alternative solutions are to be found. When alternative solutions for the factor are not equally likely to be chosen, ² is the lower bound for E( _AB ); however, E( _AB ) need not be a modal value in the distribution of _AB . Guttman's index and E( _AB ) measure different aspects of the same indeterminacy problem.     

Motivation×Expectancy×Value: A functional measurement approach

Functional measurement methodology was applied to test theMotive×Expectancy×Value (MEV) model of human motivation. Subjects judged the value of hypothetical games of chance in which hunger, chance of winning a sandwich, and sandwich preference were varied along with similar information concerning a drink. Graphical tests showed excellent agreement between the data and the theoretical properties of parallelism and linear fan shape. Exact statistical tests of goodness of fit confirmed these graphical tests. Despite the complexity of the task, which required integration of six pieces of information, subjects' judgments obeyed a simple cognitive algebra. Applications of functional measurement were suggested for approach-avoidance conflict, level of aspiration, work motivation, and achievement motivation. These methods can provide exact tests of the behavior models in terms of the subjective values at the level of the individual. They thus provide a unified nomothetic-ideographic approach to motivation theory.This work was supported by National Science Foundation grants MBS 74-19124 and BNS 75-21235, and by grants from the National Institute of Mental Health to the Center for Human Information Processing, University of California, San Diego. We wish to thank Donna Rodes for her assistance in the conduct of this experiment.     

Task switching and the measurement of “switch costs”

The measurement of “switch costs” is held to be of interest because, as is widely believed, they may reflect the control processes that are engaged when subjects switch between two (or more) competing tasks. [In task-switching experiments, the reaction time (RT) switch cost is typically measured as the difference in RT between switch and non-switch (repeat) trials.] In this report we focus on the RT switch costs that remain even after the subject has had some time to prepare for the shift of task, when the switch cost may be approximately asymptotic (so-called residual switch costs). Three experiments are presented. All three experiments used Stroop colour/word, and neutral stimuli. Participants performed the two tasks of word-reading and colour-naming in a regular, double alternation, using the “alternating runs” paradigm (R. D. Rogers & S. Monsell, 1995). The experiments were designed to test the hypothesis that RT switch costs depend on a form of proactive interference (PI) arising from the performance of a prior, competing task. A. Allport, E. A. Styles and S. Hsieh (1994) suggested that these PI effects resulted from “task-set inertia”, that is, the persisting activation-suppression of competing task-sets, or competing task-processing pathways. The results confirmed the existence of long-lasting PI from the competing task as a major contributor to switch costs. Non-switch trials, used as the baseline in the measurement of switch costs, were also shown to be strongly affected by similar PI effects. However, task-set inertia was not sufficient to account for these results. The results appeared inconsistent also with all other previous models of task switching. A new hypothesis to explain these between-task interference effects was developed, based on the stimulus-triggered retrieval of competing stimulus-response (S-R) associations, acquired (or strengthened) in earlier trials. Consistent with this retrieval hypothesis, switch costs were shown to depend primarily on the S-R characteristics of the preceding task (the task that was switched from) rather than the upcoming task. Further, the effects of the other, competing task were found to persist over many successive switching trials, affecting switch costs long after the stimulus overlap (and hence the principal S-R competition) between the current tasks had been removed. Switch costs were also found to be affected by recent, item-specific experience with a given stimulus, in either the same or the competing task. Finally, the results showed that switch costs were massively affected by the ratio of the number of prior trials, in response to the same stimuli, that had implemented either the currently intended or the competing S-R mappings. None of these effects are predicted by current models of residual switch costs, which appeal to the differences in control processes assumed to be engaged in switch versus non-switch trials. Received: 31 March 1999 / Accepted: 23 July 1999     

Fractal 1/ƒ dynamics suggest entanglement of measurement and human performance

Variability of repeated measurements in human performances exhibits fractal 1/? noise. Yet the relative strength of this fractal pattern varies widely across conditions, tasks, and individuals. Four experiments illustrate how subtle details of the conditions of measurement change the fractal patterns observed across task conditions. The results call into question whether measurement noise and measured signal can be distinguished in human performance, suggesting that human performance is inextricably entangled with measurement context. Perhaps, though, a hypothesis of soft assembly of human performance can circumvent the conundrum (e.g., Turvey, 2007).     

How heritable is empathy? Differential effects of measurement and subcomponents

Empathy is an important psychological concept influencing social interaction. However, knowledge about its etiological components is still scarce. Estimates for the heritability of empathy range between 0 and 70 % depending on the sample, method of measurement, and level of aggregation. In this study, we investigated the heritability of empathy using an extended twin design. We employed the self-report questionnaire Interpersonal Reactivity Index and an emotion recognition task (Reading the Mind in the Eyes Test). N = 742 twins and non-twin siblings were investigated. For affective empathy and the behavioral paradigm, we found heritability estimates between 52 and 57 %. For cognitive empathy, genetic variance was smaller (27 %), indicating that the heritability of empathy depends on the measured subcomponent, which could be relevant for intervention programs like empathy or compassion trainings. Environmental influences on empathy are mainly effects of non-shared environment, which is an important finding for our understanding of the development of empathy.     

Can positive affect induce self-focused attention? Methodological and measurement issues

Some studies find that positive affect can induce self-focused attention, but other studies find no effect. We suggest that the contrary findings result from how self-awareness was measured. One group of participants listened to happy or neutral music; another group imagined and described a happy or neutral event. Two measures of self-focus were then taken. The experiment replicated past findings: Positive affect increased self-focus on a pronoun selection task, but had no effect on a modified private self-consciousness scale. The results were slightly stronger when affect was induced using music. Implications for future research are discussed.     

On the measurement of priming: What is the correct baseline?

Abstract

We argue, contrary to Ostergaard (this issue), that the baseline for measuring priming effects in “recognition/identification” experiments is correctly estimated by the subjects’ performance with non-primed items. There is no reason to assume, as Ostergaard (this issue) does, that priming that occurs in a single presentation of the target item is qualitatively different from priming that occurs, in the same experimental situation, in two or more presentations, or that empirical findings, such as stochastic independence between recognition and primed identification, are affected by the number of presentations of the target items at study.     

Is the DOSPERT gender invariant? A psychometric test of measurement invariance

It is well established in the risk literature that men tend to take more risks than women. This gender difference, however, is often qualified by its domain specificity. Considering recent research on the domain generality of risk taking as a disposition, there is a need to examine the degree to which men take more risks than women, in general. In order to make substantive conclusions about the gender differences in risk‐taking propensity, one must first establish measurement invariance, which is required for the meaningful interpretation of observed group differences. In this paper, we examined the measurement invariance of the Domain‐Specific Risk‐Taking scale (DOSPERT)—one of the most popular measures of individual differences in risk taking. We found that the DOSPERT violated configural invariance in a bifactor model, indicating that the underlying factor structure of the DOSPERT differs between men and women. Even after removing the social risk dimension, DOSPERT still failed to reach scalar invariance. Taken together, these findings suggest that score differences in the DOSPERT may be due to response artifacts rather than true differences in the latent construct. Therefore, gender differences in the DOSPERT must be interpreted with caution. Implications for the measurement of risk taking are discussed.     

The measurement of simulated stealing behaviour and moral judgement — a technique

A technique is described which attempts to measure the responses of children in hypothetical stealing dilemmas. A technique embodying two forms, a so-called “did do” version and a “should do” version, was constructed. The “did do” version was an attempt to represent the child in an “actual” though hypothetical stealing dilemma and through the use of the first person pronoun “I”, contrast this with a situation in which the child could respond in terms of how he or she thought he or she should. A series of highly significant differences within the groups on the “did do” and “should do” versions was noted, together with significant differences between the “delinquent” and “normal” populations. It was argued that such differences indicated that the procedure had good validity as well as acceptable reliability.     

When does dissonance fail? The time dimension in attitude measurement1

Results of previous research dealing with the effect of differential monetary reinforcement (for the composition of a counterattitudinal essay) upon attitude change have been contradictory Cohen (1962), for example, discovered a negative relationship between reinforcement and attitude change, results consistent with dissonance theory expectations, Rosenberg (1965) explained these findings in terms of evaluation apprehension and, eliminating this factor through the spatial and temporal separation of the conflict-induction, attitude-measurement sections of his experiment, obtained a positive relationship In the present study, an attempt was made to integrate these findings through the systematic variation of the time lag between conflict arousal and attitude measurement, a variable on which the Cohen and Rosenberg studies differed Consistent with the hypothesis, the present research disclosed a dissonance effect (p < 03) in the immediate measurement condition and a reinforcement effect (p < 002) with delayed attitude measurement. These results were employed in a discussion of the complex nature of human conceptual functioning     

Sex differences in jealousy: evolutionary mechanism or artifact of measurement?

Two studies are presented that challenge the evidentiary basis for the existence of evolved sex differences in jealousy. In opposition to the evolutionary view, Study I demonstrated that a sex difference in jealousy resulting from sexual versus emotional infidelity is observed only when judgments are recorded using a forced-choice response format. On all other measures, no sex differences were found; both men and women reported greater jealousy in response to sexual infidelity. A second study revealed that the sex difference on the forced-choice measure disappeared under conditions of cognitive constraint. These findings suggest that the sex difference used to support the evolutionary view of jealousy (e.g., D. M. Buss, R. Larsen, D. Westen, & J. Semmelroth, 1992; D. M. Buss et al., 1999) likely represents a measurement artifact resulting from a format-induced effortful decision strategy and not an automatic, sex-specific response shaped by evolution.     

The measurement of body-image dissatisfaction–satisfaction: Is rating importance important?

Some researchers have argued that evaluative body image may be better assessed by measures that weight dissatisfaction–satisfaction ratings by their subjective importance to individuals. The Body Areas Satisfaction Scale (BASS) is a frequently used, standardized assessment of evaluative body image, albeit one that does not use differential item weights. This investigation, with 410 female and male college students, examined whether an importance-weighted revision of the BASS would have incremental validity relative to the original version in the prediction of multiple criterion variables. Results confirmed the reliability and validity of unweighted and weighted versions. However, the validity of weighted versions did not surpass that of the original BASS. The extremity of individuals’ satisfaction and dissatisfaction ratings appears inherently to reflect the importance placed on physical attributes for self-evaluation. Moderated regression analyses offered only weak support for the interaction of average satisfaction and average importance ratings beyond their main effects. The simpler, unweighted BASS is an acceptable assessment of evaluative body image.     

Peas in a pod: biases in the measurement of sibling temperament?

The authors of the present study addressed the measurement of temperament by examining the convergence between observational and questionnaire measures and the occurrence of contrast effects in parental ratings of non-twin siblings on the Children's Behavior Questionnaire. Fathers', mothers', and observers' ratings of 94 early-school-age sibling pairs were obtained longitudinally such that siblings were rated at the same time and when they were the same ages. Convergence between laboratory observations and questionnaires was generally modest to moderate for shyness and activity level; low to modest for positive emotionality, fear, and interest; and low for anger and sadness. We found some evidence of contrast effects for activity level and fathers' ratings of shyness and of assimilation effects for anger and sadness. The results highlight the complexity of measuring temperament and suggest that rater biases should be evaluated according to the measurement instrument used.     

Are assessment center behaviors' meanings consistent across exercises? A measurement invariance approach

To examine the appropriateness of a Multi‐Trait–Multi‐Method framework for testing construct validity of Assessment Centers (ACs) and get practical implications for the improved AC design, degree to which the AC dimension‐related performance behaviors consistently manifest across multiple AC rating situations was investigated. The present study used a large sample (N = 5,006) to apply a measurement invariance analysis. AC rating situations generally produced consistent factor loadings for items on AC dimensions, item residuals, dimension factor variances, and covariance between dimensions. The AC rating situation of interview tended to produce higher ratings and less item residuals. These findings support the consistency in constructs assessed across different AC rating situations, while some exercises may be better for teasing apart particular dimensions than others.