MEASUREMENT ERROR IN RESEARCH ON HUMAN RESOURCES AND FIRM PERFORMANCE: ADDITIONAL DATA AND SUGGESTIONS FOR FUTURE RESEARCH

Gerhart and colleagues (2000) and Huselid and Becker (2000) recently debated the presence and implications of measurement error in measures of human resource practices. This paper presents data from 3 more studies, 1 of large organizations from different industries at the corporate level, 1 from commercial banks, and the other of autonomous business units at the level of the job. Results of all 3 studies provide additional evidence that single respondent measures of HR practices contain large amounts of measurement error. Implications for future research into the HR firm performance relationship are discussed.     

Friends' sexual orientation,relational quality,and mental health among gay,lesbian, and bisexual youth

Abstract The existing literature on gay, lesbian, and bisexual (GLB) youth emphasizes unique benefits of having GLB friends, but empirical studies have shown no or only small mental health advantages of having them. To unravel this contradiction, this study tested a common assumption that GLB youth develop better relational quality with their GLB friends than with straight friends. Statistical analysis used interview data from community organization participants in Indianapolis, Indiana, USA (n = 84) and employed analysis of variance and ordinary least squares regression models. GLB youth's friendships with GLB and straight peers did not differ in contact frequency, emotional closeness, and hassles. Further, GLB and straight friends were similar in the degree to which each relational quality dimension was associated with mental health.     

MEASUREMENT ERROR IN RESEARCH ON HUMAN RESOURCES and FIRM PERFORMANCE: HOW MUCH ERROR IS THERE AND HOW DOES IT INFLUENCE EFFECT SIZE ESTIMATES?

Studies of the relationship between human resource (HR) practices and firm performance typically use a single respondent to assess firm level HR practices or HR effectiveness. However, previous research in other substantive areas suggests that rater differences are a potentially important source of measurement error. We demonstrate analytically the potential consequences of both random and systematic measurement error in research on HR and firm performance. However, our main focus is on random error and we show how generalizability theory can be applied to obtain better estimates of reliability by simultaneously recognizing multiple sources (e.g., items, raters) of random measurement error. These more inclusive reliability estimates, in turn, offer the possibility of more precisely quantifying substantive relationships in the HR and firm performance literature. In our sample, reliabilities (as estimated by generalizability coefficients) for single-rater assessments of HR variables were generally below .50. This degree of measurement error, if present in substantive studies on HR and firm performance, could lead to considerable bias, given that an unstandardized regression coefficient is corrected for measurement error in the independent variable by dividing by its reliability coefficient (not its square root). We also found only limited convergent validity between HR and line managers ratings of a second type of HR measure, HR effectiveness. In general, our findings suggest that future researchers need to devote greater attention to measurement error and construct validity issues. Our study provides an example of how generalizability theory can be useful in this pursuit.     

Outcome Expectancies and Expectancy Accessibility in Exercise Behavior

Most people do not engage in recommended levels of physical activity. Social cognition research indicates that self‐reported outcome expectancies (OEs) are associated with exercise behavior, but self‐report assessments have limitations. We investigated whether reaction times (RTs) to endorse outcome expectancies would capture unique information about spontaneous cognitive processes associated with exercise behavior. Exercisers and sedentary participants were randomly assigned to complete an exercise test or to rest. Participants completed an OE questionnaire and RT task before and after the test/rest. On the RT task, exercisers endorsed exercise positive outcomes more rapidly than sedentary participants. Furthermore, reported OEs and RTs were independently associated with exercise status. RTs may afford a more comprehensive assessment of the cognitive processes associated with exercise behavior.