A weak symmetry condition for probabilistic measures of confirmation

This paper presents a symmetry condition for probabilistic measures of confirmation which is weaker than commutativity symmetry, disconfirmation commutativity symmetry but also antisymmetry. It is based on the idea that for any value a probabilistic measure of confirmation can assign there is a corresponding case where degrees of confirmation are symmetric. It is shown that a number of prominent confirmation measures such as Carnap’s difference function, Rescher’s measure of confirmation, Gaifman’s confirmation rate and Mortimer’s inverted difference function do not satisfy this condition and instead exhibit a previously unnoticed and rather puzzling behavior in certain cases of disconfirmation. This behavior also carries over to probabilistic measures of information change, causal strength, explanatory power and coherence.     

General and Specific Question Sequence Effects in Satisfaction Surveys: Integrating Directional and Correlational Effects

Researchers investigate relationships between well-being variables and the antecedents to well-being by examining statistical results from survey data. A common measurement approach in survey designs is to include measures of more specific aspects (i.e., facets) and more global assessments of well-being in the same survey. Research shows, however, that the sequence of specific and general measures within the survey affects the magnitude of relationships between specific and general measures. In the current study, we extend such general-specific sequence research by offering an alternative explanation for the occurrence of such sequence effects. Specifically, we propose that having the specific measure before the more general one can shift the mean-level of the specific measure toward the extremes, thereby yielding restricted variance and, ultimately, attenuated correlations between the two measures. We test our proposal on two separate samples examining job-related well-being. Our findings show that the general-specific measure relationship is stronger and the mean-level of satisfaction is lower when the general measure is read first. Our findings suggest important theoretical implications for the study and measurement of well-being. Most importantly, our study suggests that placing general measures before specific measures could avoid sequence-related bias.     

The development of the Children's Empathic Attitudes Questionnaire using classical and Rasch analyses

Empathic responding is implicated in antisocial behaviors such as bullying, sexual offending, and violent crime. Identifying children and adolescents at risk for antisocial behavior and evaluating interventions designed to address problem behaviors require valid and reliable measures. Definitional controversies and limited measurement models have hindered measurement. This study describes the development and analysis of the Children's Empathic Attitudes Questionnaire (CEAQ) using both classical and modern techniques. Rasch analyses provided probabilistic results over large item and person groups, enabling meaningful inferences from patterns of responses at the construct level. Analyses of fifth through seventh graders' responses to the final version of the CEAQ provide support for its reliability, validity, and functionality. Four meaningful item clusters were identified, each reflecting more cognitively advanced empathic attitudes. These analyses suggest that the CEAQ provides a theoretically sound, hierarchically meaningful measure of empathic attitudes that will be useful in identification and intervention with children and adolescents at risk for antisocial behavior.     

Alternative Approaches for Measuring Values: Direct and Indirect Assessments in Performance Prediction

Two general approaches have been used to measure human values. In one approach, a direct approach, people are asked to endorse value statements. In the other approach, an indirect approach, people are asked to make choices indicative of their values. The intent of the current study was to compare these two general approaches to the measurement of values. Initially, 195 undergraduates were asked to complete both a direct measure and an indirect measure of their values before starting work on three performance tasks: an entrepreneurial task, a consulting task, and a marketing task. When scores on these performance tasks were regressed on the value measures, it was found that both types of measures yielded effective prediction. The indirect measures, however, appeared to yield better prediction and better discrimination of cross-task performance differences than the direct measures. The implications of these findings with respect to the identification and assessment of values are discussed.     

A comparative study of association measures

This paper discusses the general problem of measuring the association between an independent nominal-scaled variableX and a dependent variableY whose scale of measurement may be interval, ordinal or nominal. The theoretical foundations of a wide range of asymmetric association measures are discussed. Some new measures are also suggested. Fifteen of these association measures, some previously suggested, some new, are singled out for a computer-assisted numerical study in which we compute the value actually taken by each measure under a wide variety of conditions. This comparative study provides important insights into the behavior of the measures.     

An evaluation of time-sample measures of behavior

Continuous and time-sample measures of the in-seat behavior of a secretary were obtained. Measurement error, i.e., the extent to which the sample measures deviated from the continuous measure, was a function of the frequency of the sample measurements and the criterion used to score an example of the behavior. If the behavior had to be exhibited throughout the observational interval (whole-interval time sampling), there was a consistent underestimate of the continuous measure. If the behavior had to be exhibited only briefly within the observational interval (partial-interval time sampling), there was a consistent overestimate of the continuous measure. And, if the behavior had to be exhibited at the end of the observational interval (momentary time sampling), overestimations and underestimations of the continuous measure occurred about equally often. As expected, the more frequently the sample measures were made the closer was the agreement between the sample and continuous measures. Two conclusions concerning measurement error in interval time sampling were made. The first was that the error will be a function of the mean time per response. The second is that this error will not be consistent across experimental conditions.     

Taking a closer look: time sampling and measurement error

A person manufactured his in-seat behavior for 15, 30-min sessions so that there were three blocks of five sessions where the behavior occurred 20%, 50%, and 80% of the time. Whole interval, partial interval, and momentary time-sample measures of the behavior were taken and compared to the continuous measure of the behavior i.e., per cent of time the behavior occurred. For interval time sampling, the difference between the continuous and sample measures i.e., measurement error, was: (1) extensive, (2) unidirectional, (3) a function of the time per response, and (4) inconsistent across changes in the continuous measure. A procedural analysis demonstrated that the frequency and duration of behavior are confounded in interval time sampling. Momentary time sampling was found to be superior to interval time sampling in estimating the duration a behavior occurs.     

Problems with Priors in Probabilistic Measures of Coherence

Two of the probabilistic measures of coherence discussed in this paper take probabilistic dependence into account and so depend on prior probabilities in a fundamental way. An example is given which suggests that this prior-dependence can lead to potential problems. Another coherence measure is shown to be independent of prior probabilities in a clearly defined sense and consequently is able to avoid such problems. The issue of prior-dependence is linked to the fact that the first two measures can be understood as measures of coherence as striking agreement, while the third measure represents coherence as agreement. Thus, prior (in)dependence can be used to distinguish different conceptions of coherence.     

“… And How About Now?”: Effects of Item Redundancy on Contextualized Self‐Reports of Personality

A common method of studying cross-situational variation in personality involves asking people to describe their behavior in several different contexts. Although this approach is intuitively appealing, it introduces a great deal of redundancy into the measurement process and may affect the interpretation of contextualized self-reports. Specifically, when participants are asked the same questions repeatedly in a single questionnaire, they may be compelled to focus on how their behavior is different. We tested this hypothesis by experimentally manipulating the number of contexts that were included in a measure of role-related personality. In 2 experiments (Study 1 N=377, Study 2 N=524), we found that multiple-role questionnaires produced greater variation in trait levels across roles, larger differences between general and role-specific ratings, and weaker correlations between general and role-specific ratings than single-role questionnaires. These findings illustrate how the measurement process can have an effect on the variability of responses to contextualized self-reports.     

Coherence measures and inference to the best explanation

This paper considers an application of work on probabilistic measures of coherence to inference to the best explanation (IBE). Rather than considering information reported from different sources, as is usually the case when discussing coherence measures, the approach adopted here is to use a coherence measure to rank competing explanations in terms of their coherence with a piece of evidence. By adopting such an approach IBE can be made more precise and so a major objection to this mode of reasoning can be addressed. Advantages of the coherence-based approach are pointed out by comparing it with several other ways to characterize ‘best explanation’ and showing that it takes into account their insights while overcoming some of their problems. The consequences of adopting this approach for IBE are discussed in the context of recent discussions about the relationship between IBE and Bayesianism.     

Probabilistic measures of coherence: from adequacy constraints towards pluralism

The debate on probabilistic measures of coherence flourishes for about 15 years now. Initiated by papers that have been published around the turn of the millennium, many different proposals have since then been put forward. This contribution is partly devoted to a reassessment of extant coherence measures. Focusing on a small number of reasonable adequacy constraints I show that (i) there can be no coherence measure that satisfies all constraints, and that (ii) subsets of these adequacy constraints motivate two different classes of coherence measures. These classes do not coincide with the common distinction between coherence as mutual support and coherence as relative set-theoretic overlap. Finally, I put forward arguments to the effect that for each such class of coherence measures there is an outstanding measure that outperforms all other extant proposals. One of these measures has recently been put forward in the literature, while the other one is based on a novel probabilistic measure of confirmation.     

Diversity of ideas about diversity measurement

Measurement of diversity is important in several sciences but has evolved mainly within ecology. An ecological community with many species is more diverse than one with few but the way the total number of individuals is distributed among the species also influences the degree of diversity or heterogeneity. Although not always explicitly used, it can be shown that diversity is a concept of some importance in psychology, too. In general terms quantification of diversity is related to the apportionment of some quantity into a number of well-defined classes. The dual-concept type of diversity index reflects both the number of classes and the degree of evenness (homogeneity) of the apportionment. The quantity that is distributed has commonly been a population of elements and apportionment homogeneity measures population heterogeneity. The statistical context has dominated the thinking about the measurement of diversity, heterogeneity, and homogeneity. Some well-known indices of diversity and the ideas behind them are discussed. It is concluded that the general geometric representation of homogeneity (similarity) and heterogeneity (dissimilarity) (Junge, 1978; 1991) offers a more general approach to the measurement of diversity.     

The exchangeable multinomial model as an approach to testing deterministic axioms of choice and measurement

The multinomial (Dirichlet) model, derived from de Finetti's concept of exchangeability, is proposed as a general Bayesian framework to test axioms on data, in particular, deterministic axioms characterizing theories of choice or measurement. For testing, the proposed framework does not require a deterministic axiom to be cast in a probabilistic form (e.g., casting deterministic transitivity as weak stochastic transitivity). The generality of this framework is demonstrated through empirical tests of 16 different axioms, including transitivity, consequence monotonicity, segregation, additivity of joint receipt, stochastic dominance, coalescing, restricted branch independence, double cancellation, triple cancellation, and the Thomsen condition. The model generalizes many previously proposed methods of axiom testing under measurement error, is analytically tractable, and provides a Bayesian framework for the random relation approach to probabilistic measurement (J. Math. Psychol. 40 (1996) 219). A hierarchical and nonparametric generalization of the model is discussed.     

COMPUTER‐ASSISTED MEASUREMENT OF WOUND SIZE ASSOCIATED WITH SELF‐INJURIOUS BEHAVIOR

We evaluated an inexpensive, efficient, and noninvasive technique for measuring tissue damage produced by self‐injurious behavior (SIB). The technique involved computerized measurement of wound surface area (WSA) based on digital photographs. In Study 1, we compared photographic measurement to a more commonly used procedure, transparency measurement, in estimating WSA of 20 wound models. Results showed that both methods were reliable and that there was a high degree of correspondence between the 2 sets of measures. In Study 2, we compared photographic WSA measures to direct‐observation measures in documenting changes over time in the SIB exhibited by a woman with Prader‐Willi syndrome. Results showed that increases and decreases in observed SIB during baseline and treatment conditions corresponded with changes in WSA measures, indicating that the computer‐assisted photographic technique may be useful as a corroborative measure or as a primary measure when direct observation of SIB is not feasible.     

TRAINING TEACHERS IN GENERALIZED WRITING OF BEHAVIOR MODIFICATION PROGRAMS FOR MULTIHANDICAPPED DEAF CHILDREN

In contrast to previous studies where teachers were instructed how to implement behavior modification programs designed by an experimenter, teachers in the present experiment were taught how to write as well as implement behavior modification programs. The generalized effects of two training conditions on teacher and pupil behaviors were assessed by a multiple baseline design where, following baseline, two teachers of multihandicapped deaf children were taught to set objectives and measure pupil performance (measurement training). Later, through a training manual, they learned a general problem-solving approach to writing behavior modification programs (programming training). After both training conditions, experimenter feedback was given for teachers' application of training to a target behavior for one pupil and generalization was measured across target behaviors for the same pupil and across pupils. It was found that measurement training had little general effect on either teacher behavior or pupil behavior. However, after programming training, teachers increased their program writing and correct use of behavior modification procedures and generalized this training across pupils and target behaviors. Along with these effects, there was improvement in pupil behaviors. Possible explanations for generalized effects of teacher training were considered.     

A multidimensional measure of work valences

Work valence is derived from expectancy-valence theory and the literature on children's vocational development and is presumed to be a general appraisal of work that emerges during the childhood period. Work valence serves to promote and inhibit the motivation and tasks associated with vocational development. A measure of work valence, composed of perceptions about future work experiences and affects, is developed and tested employing samples of high school and university students. Multi-group confirmatory factor models demonstrated that the Work Valence Scale (WVS) conformed to a hierarchical measurement model and may be employed to yield a general work valence construct or more specific positive and negative work valences. The WVS demonstrated metric invariance across the high school and university years. Criterion validity tests demonstrated that the general work valence was positively associated with work approach motivation and in-depth career exploration and negatively associated with work avoidance. Discriminant validity tests demonstrated that the positive and negative work valences and affectivities were only weakly correlated with general measures of affectivity.     

The development, validation, and application of a video-based technique for measuring an everyday risk-taking behavior: drivers' speed choice

Drivers' choice of speed is an important aspect of everyday risk-taking behavior because it has been shown to be one of the most important predictors of road accident involvement. This research developed, validated, and applied a measure of drivers' speed choice that combined a high degree of experimental control with external and ecological validity. In Study 1, a video-simulation measure of drivers' speed choice was developed and found to relate specifically to speed-related accident involvement, implying a degree of external validity. In Study 2, the measure was used to investigate the effect of auditory feedback on drivers' speed choice. It was found that increasing the level of internal car noise decreased drivers' preferred speeds. Further analyses indicated that this was likely due to perceptual effects on speed estimation. Results are discussed in terms of road safety and the ability of video-based measures to facilitate experimental control over tasks involving complex ecological stimuli.     

A systematic review and content analysis of bullying and cyber-bullying measurement strategies

Bullying has emerged as a behavior with deleterious effects on youth; however, prevalence estimates vary based on measurement strategies employed. We conducted a systematic review and content analysis of bullying measurement strategies to gain a better understanding of each strategy including behavioral content. Multiple online databases (i.e., PsychInfo, MedLine, ERIC) were searched to identify measurement strategies published between 1985 and 2012. Included measurement strategies assessed bullying behaviors, were administered to respondents with ages of 12 to 20, were administered in English, and included psychometric data. Each publication was coded independently by two study team members with a pre-set data extraction form, who subsequently met to discuss discrepancies. Forty-one measures were included in the review. A majority used differing terminology; student self-report as primary reporting method; and included verbal forms of bullying in item content. Eleven measures included a definition of bullying, and 13 used the term “bullying” in the measure. Very few definitions or measures captured components of bullying such as repetition, power imbalance, aggression, and intent to harm. Findings demonstrate general inconsistency in measurement strategies on a range of issues, thus, making comparing prevalence rates between measures difficult.     

Optimizing the validity of personality assessments: The importance of aggregation and item content

The predictive validity of a psychological measure can be improved by minimizing measurement errors through increases in the length of the assessment (aggregation) and, for an assessment of finite length, by making use of objective strategies for choosing from all available component measures. Two prominent considerations in selecting individual measures to be aggregated involve standards of (a) item content (construct approach) and (b) item/criterion association (empirical approach). Personality trait scales of different lengths were assembled for this study in order to represent features of the construct and empirical methods of selection. It was observed that (a) although reliability and validity generally increased with test length, aggregation beyond a certain point can fail to be expedient; and (b) although the prediction performance of empirically derived measures initially surpassed that of construct based assessments, the superiority of the empirical scales did not generalize to trait criteria that were not used as a basis for item selection. The data are interpreted as providing support for a theory-based program of test development where substantive considerations involving item content play a major role. The findings are also viewed as encouragement for conventional conceptualizations about organized dimensions of behavior.     

Measurement of Trust in Salesperson–Customer Relationships in Direct Selling

No readily available scales exist that are appropriate to the measurement of trust in direct selling. This paper presents a conceptualization of trust that focuses on its nature and presents it as an affect—that is, a combination of attitudes and emotions. To develop a scale that reflects this approach, a two-country study is conducted looking at the perceptions of buyers regarding the trust they place in direct selling salespeople. Three distinct measures of trust and two related measures, based on scales developed for use in contexts other than direct selling, are utilized. The measurement properties of all five are shown to be adequate; however, differences are apparent in their robustness and in the pattern of responses in the two countries. Moreover, one measure (Trust 3) clearly is inferior to the other measures. The paper concludes with a discussion of the effectiveness of these measures of trust and suggestions for future refinements to them.