Espbase: A microsoft access tool for selecting symbol and icon sets for usability

The ESPbase provides a tool for storing symbols and icons along with information about their characteristics. Information about a wide range of symbol characteristics is included on the database to facilitate the selection of symbol sets for research and design. The database includes information about the graphical characteristics and functions of symbols. It also includes ratings of symbol concreteness, complexity, familiarity, and meaningfulness. Symbols and icons can be accessed on the basis of each of these characteristics or any combination of characteristics. This makes it easier to select symbols on the basis of usability and design requirements. It also means that symbols can be easily selected for research while controlling their characteristics on a number of dimensions.     

Parental depression,parenting behaviours,and behaviour problems in young children

In the past, research has demonstrated that parental depression and parenting practices are related. More recently, there has been an increase in research examining child outcomes as they are related to maternal and paternal psychopathology. To continue with this line of research, this study examined the relationships among mothers' and fathers' symptoms of depression, characteristics of their parenting practices, and their ratings of their young children's internalizing and externalizing behaviour problems. The results of this study demonstrated that these variables are related significantly. Further, the results of this study suggested that mothers' parenting, particularly their limit setting with their young children, is an important predictor of their ratings of their young children's externalizing behaviour problems in the context of their own symptoms of depression. A different pattern of relationships may be present for fathers, as both their symptoms of depression and their parenting characteristics predicted their ratings of their young children's externalizing behaviour problems. Such findings were not supported for young children's internalizing behaviour problems. These findings suggested that interventions should have different targets for mothers and fathers. Copyright © 2009 John Wiley & Sons, Ltd.     

Leader-Member Exchange, Objective Performance, Employment Duration, and Supervisor Ratings: Testing for Moderation and Mediation

As part of a constructive replication of research by Duarte et al. (1993, 1994), objective performance measures, supervisor ratings, duration of employment, and leader-member exchange (LMX) scores were analyzed for 45 bank tellers and 12 bank branch managers. Hierarchical regression tests of LMX as a moderator of the relationship between objective performance measures and supervisor ratings failed to replicate the previously reported interaction among these variables. Further tests of LMX as a mediator of the relationship between objective performance measures and supervisor ratings also failed to support a hypothesized role for LMX in the appraisal process. Additionally, regression analyses did not reaffirm a prior report of short-run and long-run employment duration interacting with LMX in influencing the relationship between objective performance measures and supervisor ratings. Instead, increases in employment duration were found to be associated with more favorable supervisor ratings and superior objective performance. The need for additional replications and construct refinement is highlighted.     

Norms of valence,arousal, concreteness,familiarity, imageability,and context availability for 1,100 Chinese words

In the present study, we collected valence, arousal, concreteness, familiarity, imageability, and context availability ratings for a total of 1,100 Chinese words. The ratings for all variables were collected with 9-point Likert scales. We tested the reliability of the present database by comparing it to the extant Chinese Affective Word System, and performed split-half correlations for all six variables. We then evaluated the relationships between all variables. Regarding the affective variables, we found a typical quadratic relation between valence and arousal, in line with previous findings. Likewise, significant correlations were found between the semantic variables. Importantly, we explored the relationships between ratings for the affective variables (i.e., valence and arousal) and concreteness ratings, suggesting that valence and arousal ratings can predict concreteness ratings. This database of affective norms will be a valuable source of information for emotion research that makes use of Chinese words, and will enable researchers to use highly controlled Chinese verbal stimuli to more reliably investigate the relation between cognition and emotion.     

Parental affect and childrearing beliefs uniquely predict mothers' and fathers' ratings of children's behavior problems

The focus of this study was to examine the relations between parental characteristics and ratings of children's behavior problems. Although there is a considerable body of research that indicates that parental reports of children's behavior are biased by the characteristics of the parent, a number of limitations of past research have precluded definitive conclusions about the impact of individual characteristics. This study examined the role of parental affect and childrearing beliefs in determining parental ratings of child behavior in a selected sample of the National Institute of Child Health and Human Development Study of Early Child Care and Youth Development. A series of analyses was specified in which teachers' and co-parents' ratings were controlled to examine the unique associations between parental characteristics and ratings of child behavior. After controlling for the co-parents' and teachers' ratings, both mothers' and fathers' psychological characteristics uniquely contributed to variation in their ratings of children's behavior problems. The specific affective and childrearing belief variables that accounted for variation in parental ratings varied by parent sex and the broadband rating analyzed. These analyses indicate the role that rater-specific characteristics may play in determining parents' assessments of child behavior.     

Self-Ratings of Personality: A Naturalistic Comparison of Normative, Ipsative, and Idiothetic Standards

ABSTRACT The purpose of this research is to examine some of the implicit standards that individuals may use when they rate themselves on personality dimensions Specifically, we compared ratings based on instructions that specified normative, ipsative, or idiothetic creteria with ratings obtained when subjects used their own (implicit) standards In a series of three studies, we found that each of the explicit ratings was highly similar to the implicit-standard ratings and that there were substantial individual differences in the relative similarity of each of the explicit ratings to the implicit ratings However, because the normative instructions elicited less extreme responses than any of the other instructions, there was a small but consistent tendency for them to be less similar to the ratings based on implicit standards than the ipsative or idiothetic ratings The implications of this research for personality assessment and self-evaluation are discussed     

RATINGS OF MANAGERIAL CHARACTERISTICS: EVALUATION DIFFICULTY, CO-WORKER AGREEMENT, AND SELF-AWARENESS

This research examined variables contributing to self-awareness and coworker agreement on 30 managerial characteristics. The first study collected data from 233 management students on the difficulty of rating different characteristics. It also developed reliable measures of self-protection mechanisms that may negatively influence self-awareness. Four self-protection factors were identified: Denial, Giving Up, Self-Promotion, and Fear of Failure. The second study collected self-, supervisor, peer, and subordinate ratings of the managerial characteristics to derive multiple measures of self-awareness. There was a total of 283 co-worker ratings for 36 target middle managers. The results showed that within-sample co-worker disagreement measures from Study 2 were higher for items that were perceived by the sample in Study 1 as more difficult to rate. Self-ratings were more highly related to the average of co-worker ratings than to the ratings provided by any one co-worker alone. Co-workers' ratings of the target's use of self-protection mechanisms were negatively associated with self-awareness measures. Ideas are discussed for other correlates of self-awareness and ways to enhance the value of feedback processes.     

Cognitive differentiation between self,ingroup, and outgroup: The roles of identification and perceived intergroup conflict

Several models predict that persons ascribe opposite characteristics to self and ingroups on the one hand and outgroups on the other (outgroup contrast). However, only few studies have found this effect. This study explored its boundary conditions. Sixty‐two students rated (a) characteristics of themselves, an ingroup (own study major), and an outgroup (other study major), (b) ingroup identification, and (c) perceived intergroup conflict. Participants who were relatively high in ingroup identification and who perceived relatively high levels of intergroup conflict displayed outgroup contrast, as indicated by negative correlations between trait ratings for self and ingroup and between trait ratings for ingroup and outgroup. The other participants showed weaker or no outgroup contrast. Thus, this study is one of the few empirical demonstrations of outgroup contrast and points to moderators that should be considered in future research on this effect. Copyright © 2004 John Wiley & Sons, Ltd.     

Word norms for blind and sighted subjects: Familiarity,concreteness, meaningfulness,imageability, imagery modality,and word associations

Normative values for word characteristics were obtained from a sample of 12 college-educated, totally congenitally blind subjects on the basis of their ratings of 161 nouns on scales of familiarity, concreteness, meaningfulness, and imageability. The dominant modality of imagery for each image-evoking word and the strongest word associate for each item also were recorded. The same data were collected for a group of sighted subjects, both to provide a comparison group for the blind subjects and to test the comparability of sighted subjects’ ratings with existing norms. Ratings for sighted subjects correlated strongly with those norms, although the coefficients were slightly higher for ratings of concreteness and imageability than for ratings of familiarity and meaningfulness. Ratings of blind subjects correlated only slightly lower with existing norms for imagery and concreteness, but considerably lower for familiarity and meaningfulness.     

Norms for 439 action events: Familiarity,emotionality, motor activity,and memorability

A total of 128 male and female university students having Swedish as their mother tongue rated 439 actions on a 7-point scale in the dimensions of Familiarity, Emotionality, Motor Activity, and Memorability under instructions to imagine themselves performing each action (e.g., “to roll a ball”, “to break a match”). Overall mean ratings were higher for women than for men in all four dimensions. High reliabilities were obtained in each scale. Intercorrelations between the dimensions were low to moderate, indicating that different characteristics of the actions were assessed. It is demonstrated that the ratings of the four dimensions are in agreement with previous categorisations of actions along the same or similar dimensions and with findings related to memory performance. Furthermore, control studies performed on the Familiarity dimension show that norm values are highly correlated with ratings given by participants in standard enacting and nonenacting conditions and with ratings in a condition where objects were present. These norms offer possibilities to control for and vary item characteristics of importance in the study of actions and the memory of actions.     

A Determination of the Symbolic Meanings of the Kahn Test of Symbol Arrangement Objects

This study was undertaken to determine the validity of the postulated common meanings for the KTSA symbols using the semantic differential to determine empirically Ss' reactions to the KTSA symbol objects. These responses were then used to confirm Kahn's postulated “popular meanings for the symbols. The connotative meanings for the KTSA symbols were determined by the semantic differential ratings of 48 male and 48 female preadolescents. The findings confirmed Kahn's postulated meanings for some of the symbol, while others only partially confirmed and still others were not confirmed at all. The semantic differential ratings were statistically significant 260 out of 336 possible times. The interpretive meaning of the results is discussed.     

Context and Prior Impression Effects on Attention, Judgment Standards, and Ratings: Contrast Effects Revisited

The present study extended research on contrast effects by (a) examining the effect of context performances on ratings of a target performance when a prior impression of the target performer already exists, and (b) clarifying the issue of whether contrast is caused by attention to context-discrepant behavior or shifts in judgment standards. The results demonstrated that the existence of a prior impression mitigates the influence of context performances on ratings. Judgment standards were found to be unstable and dependent on information provided to raters by the experimental manipulations. Regression analyses showed that both attention and standards of judgment mediate the relationship between context and ratings. Implications of these findings for contrast effects, performance ratings, and the importance of reliable judgment standards for real-world performance appraisals are discussed.     

Norms for two types of manipulability (graspability and functional usage), familiarity,and age of acquisition for 320 photographs of objects

There is increasing interest in the role that manipulability plays in processing objects. To date, Magnié, Besson, Poncet, and Dolisi’s (2003) manipulability ratings, based on the degree to which objects can be uniquely pantomimed, have been the reference point for many studies. However, these ratings do not fully capture some relevant dimensions of manipulability, including whether an object is graspable and the extent to which functional motor associations above and beyond graspability are present. To address this, we collected ratings of these dimensions, in addition to ratings of familiarity and age of acquisition (AoA), for a set of 320 black-and-white photographs of objects. Familiarity and AoA ratings were highly correlated with previously reported ratings of the same dimensions (r =.853, p<.001, and r=.771, p<.001, respectively), validating the present norms. Grasping and functional use ratings, in contrast, were more moderately correlated with Magnié et al.’s pantomime manipulability ratings (r=.507, p<.001). These results were taken as evidence that the new manipulability ratings collected in this research capture distinct aspects of object manipulability. The complete stimuli and norms from this study may be downloaded from http://brm.psychonomic-journals.org/content/supplemental.     

Comparing the Psychometric Characteristics of Ratings of Face‐to‐Face and Videotaped Structured Interviews

Videotaped interviews are used for both research and for making selection decisions in organizations. However, little research has examined the extent to which the psychometric characteristics of ratings of videotaped interviews are comparable with those of ratings made on the basis of face‐to‐face (FTF) interviews. Within a simulated selection setting, we compared ratings of interviewers who conducted FTF structured interviews to ratings of interviewers who viewed videotapes of those interviews. Results revealed that FTF ratings were significantly higher than video ratings of the same interviewees. We also found that the two sets of interviewers rated the relative performance of interviewees differently. For example, the correlation between FTF and video ratings (r=.31) was significantly smaller than the correlation between ratings of interviewers who conducted FTF panel interviews with the same interviewees (r=.73). Overall results suggest that researchers and practitioners should be cautious about generalizing research findings and selection decisions made on the basis of videotaped interviews to FTF interviews.     

Taboo,emotionally valenced,and emotionally neutral word norms

Although taboo words are used to study emotional memory and attention, no easily accessible normative data are available that compare taboo, emotionally valenced, and emotionally neutral words on the same scales. Frequency, inappropriateness, valence, arousal, and imageability ratings for taboo, emotionally valenced, and emotionally neutral words were made by 78 native-English-speaking college students from a large metropolitan university. The valenced set comprised both positive and negative words, and the emotionally neutral set comprised category-related and category-unrelated words. To account for influences of demand characteristics and personality factors on the ratings, frequency and inappropriateness measures were decomposed into raters’ personal reactions to the words versus raters’ perceptions of societal reactions to the words (personal use vs. familiarity and offensiveness vs. tabooness, respectively). Although all word sets were rated higher in familiarity and tabooness than in personal use and offensiveness, these differences were most pronounced for the taboo set. In terms of valence, the taboo set was most similar to the negative set, although it yielded higher arousal ratings than did either valenced set. Imageability for the taboo set was comparable to that of both valenced sets. The ratings of each word are presented for all participants as well as for single-sex groups. The inadequacies of the application of normative data to research that uses emotional words and the conceptualization of taboo words as a coherent category are discussed. Materials associated with this article may be accessed at the Psychonomic Society’s Archive of Norms, Stimuli, and Data, www.psychonomic.org/archive.     

Liking, Arousal Potential, and the Emotions Expressed by Music

Previous research indicates that the specific emotions expressed by stimuli may be closely associated with their pleasing and arousing qualities, and this parallels psychomusicological research on the relationship between these two stimulus qualities. In light of this, the present research contends that the emotions expressed by musical stimuli are associated with their pleasing and arousing qualities. Sixty subjects rated 32 musical excerpts on 11-point scales representing the expression of eight specific emotions. Statistical analyses showed that these emotion ratings were predictable on the basis of 60 additional subjects' ratings of each excerpt in terms of 'liking' and 'arousal potential'. This indicates that ratings of liking and arousal potential are essentially similar to ratings of the specific emotions expressed by musical stimuli. These results are discussed in terms of the relationship between liking and arousal potential, and the implications that this may have for research on affective processes.     

Designs for evaluating the validity and accuracy of performance ratings

For many jobs, objective measures of performance are not available or are impractical to obtain, such that ratings are the sole source of information. Unfortunately, performance ratings are a distorted source of information. The multitrait-multimethod and person perception designs have been used to investigate the distortions in ratings. The purpose of using these research designs is to isolate the factors that distort the ratings and to use this knowledge to improve the quality of performance ratings. The goal of the present research was to develop a design that combined both the multitrait-multimethod and person perception designs. Each design was discussed, and examples were presented to illustrate that design. The combination design was used to isolate the influence of rater, ratee, and context factors on the quality of performance ratings. Future research was recommended to understand and utilize these factors to improve performance ratings.     

The effect of performance trend on performance ratings occurs through observer attributions,but depends on performance variability

Research regarding the influence of dynamic performance characteristics on performance ratings suggests that raters are remarkably susceptible to observed trends in performance over time, such that systematic trends or patterns in performance can have an undue influence on how performance is evaluated. However, research in this domain has not fully explained how dynamic performance characteristics influence performance judgments. Drawing on attribution theory, we introduce a model whereby the impact of dynamic performance characteristics on subsequent performance judgments occurs through attributions for performance. Then, in three experimental studies, we show that dynamic performance characteristics influence attributions for performance, which in turn affect performance ratings.     

Effect of first-grade classroom environment on shy behavior,aggressive behavior,and concentration problems

Investigates the effect of the first-grade classroom environment on the shy behavior, aggressive behavior, and concentration problems of 609 children in 19 East Baltimore public schools. First-grade classroom environment was assessed in terms of dominant pattern of classroom achievement and behavior. Structured teacher ratings assessed child shy behavior, aggressive behavior, and concentration problems at the end of first grade. Children in low-achieving classroom environments had significantly higher teacher ratings of shy behavior and aggressive behavior than children in mixed-achieving or high-achieving environments, even after controlling for potentially confounding child characteristics and classroom behavior environment effects. Analyses controlling for child characteristics and classroom achievement environment effects indicated that children in poor-behaving classroom environments also had significantly higher teacher ratings of shy behavior than children who were not in poor-behaving environments. Subgroup analyses indicated that repeaters in mixed-achieving environments had significantly higher levels of shy behavior compared with nonrepeaters, and repeaters in poor-behaving environments had significantly higher levels of aggressive behavior compared with nonrepeaters. Implications for prevention research are discussed.     

Differences in inter-rater reliability and accuracy for a treatment adherence scale

Inter-rater reliability and accuracy are measures of rater performance. Inter-rater reliability is frequently used as a substitute for accuracy despite conceptual differences and literature suggesting important differences between them. The aims of this study were to compare inter-rater reliability and accuracy among a group of raters, using a treatment adherence scale, and to assess for factors affecting the reliability of these ratings. Paired undergraduate raters assessed therapist behavior by viewing videotapes of 4 therapists' cognitive behavioral therapy sessions. Ratings were compared with expert-generated criterion ratings and between raters using intraclass correlation (2,1). Inter-rater reliability was marginally higher than accuracy (p = 0.09). The specific therapist significantly affected inter-rater reliability and accuracy. The frequency and intensity of the therapists' ratable behaviors of criterion ratings correlated only with rater accuracy. Consensus ratings were more accurate than individual ratings, but composite ratings were not more accurate than consensus ratings. In conclusion, accuracy cannot be assumed to exceed inter-rater reliability or vice versa, and both are influenced by multiple factors. In this study, the subject of the ratings (i.e. the therapist and the intensity and frequency of rated behaviors) was shown to influence inter-rater reliability and accuracy. The additional resources needed for a composite rating, a rating based on the average score of paired raters, may be justified by improved accuracy over individual ratings. The additional time required to arrive at a consensus rating, a rating generated following discussion between 2 raters, may not be warranted. Further research is needed to determine whether these findings hold true with other raters and treatment adherence scales.