Using Narrow Facets of an Integrity Test to Predict Safety: A test validation study

This paper describes the development and validation of an integrity test, the WorkKeys Performance Assessment, designed specifically to measure two domains: employee risk reduction (i.e., safety behavior) and general work attitudes. These domains were hypothesized to differentially predict multiple work outcomes, including task performance, organizational citizenship, counterproductive behavior, and safety. The study used a large sample of workers whose performance was rated by their supervisors. Results suggest that both integrity domains predict employee behavior, with risk reduction providing incremental validity over general work attitudes when predicting counterproductive and safety behavior. The findings support the value of measuring both domains of integrity.     

Using Response Times and Response Accuracy to Measure Fluency Within Cognitive Diagnosis Models

Psychometrika - The recent “Every Student Succeed Act" encourages schools to use an innovative assessment to provide feedback about students’ mastery level of grade-level content...     

Sallie McFague and an Ecotheological Response to Artificial Intelligence

Military, commercial, and industrial application of artificial intelligence (AI) presents distinct historical challenges for theological reasoning. To date, interdisciplinary theological responses have been limited. Contextual and ecological theologies provide an understanding of the human that is helpful in theological responses to AI. These theologies emphasize a relational, embodied view of the human that responds to and resolves many of the shortcomings found in AI research and related theological responses. Sallie McFague's emphasis on embodiment and the world as God's body is an especially useful contribution to these efforts.     

Effects of Language of Instruction on Response Accuracy and Challenging Behavior in a Child with Autism

Discrete trial training was delivered using English and Spanish languages to a student with autism from a Spanish-speaking family. An alternating treatments design was used to examine the effects of language of instruction on the child’s response accuracy and challenging behavior. More correct responses and fewer challenging behaviors occurred when instruction was delivered in Spanish compared to English. Results suggest that the language of instruction may be an important variable even when a student initially presents with very little spoken language and comparable scores on English and Spanish standardized language assessments.     

The Effects of Video-Taped Feedback on Form,Accuracy, and Latency in an Open and Closed Environment

40 college women performed a modification of the classical fencing lunge against 2 laterally-arranged targets, under closed and open environmental conditions. Form (rating scale), accuracy (proximity to target center), and response latency were taken to measure the effects of video-taped feedback (VT). Administration of VT with specific instructions to direct S’s attention to parts of the display resulted in closer approximation of the externally-imposed form, higher accuracy, and shorter response latency. Performing the skill in the closed environmental condition resulted in less deviation from the imposed form, higher accuracy scores, and longer response latency. No significant correlations were found between imposed form and accuracy.     

Using Kindergarten Language,Dialect Variation,and Child Behavior to Predict Second Grade Reading Ability in African American Children

Previous research has demonstrated mixed findings pertaining to the risk conferred by variation from Mainstream American English (MAE) for African American children in our education system. Based on the research on language, behavior, and reading, the present study sought to examine the relative and combined contributions of culturally appropriate measures of risk status for disordered language and density of dialect use and classroom behavior (both competencies and problems) in predicting reading ability in a sample of typically developing African American elementary school students. 53 African American Kindergartner's (27 boys, 26 girls) were followed up with two years later in 2nd grade. In Kindergarten, children were screened for density of dialect use and risk of language impairment; teachers rated each child on behavior, social/emotional adjustment, and academic performance. Reading achievement was assessed in 2nd grade. Risk for disordered language development was the best predictor of 2nd grade reading, outperforming density of dialect use. Positive classroom behaviors were more predictive of reading than negative behaviors. This research supports the notion that language, classroom behavior, and reading achievement are intertwined in a complex manner and that when designing interventions for one, the entire system must be considered.     

Consumers’ Response to an Advertisement Using Brand Popularity in a Foreign Market

Abstract : This research examined how domestic consumers respond to an advertisement using brand popularity in a foreign market. By using structural equation modeling, it shows that the consumers’ response can change as a function of three characteristics of brand popularity in a foreign market: (a) expertise of foreign consumers, (b) similarity between domestic consumers and foreign consumers, and (c) animosity to a foreign country. Meanwhile, the similarity effect is found to be stronger for high‐preference heterogeneity than low‐preference heterogeneity. This research documents the importance of understanding the underlying mechanism to determine the effects of brand popularity in a foreign market on brand attitude and purchase intention.     

Using Wellness and Resilience to Predict Age Perception in Older Adulthood

The authors surveyed 210 adults ages 56 to 97 to better understand which variables affect perceptions of aging. A correlational design was used to determine whether wellness and resilience predicted positive age perception and internalized ageism among this group. Both variables were found to significantly predict age perception, and the data supported an interaction effect between age and resilience when predicting internalized ageism. Results may inform counselors, counselor educators, and other professionals who work with older adults.     

ADHD and Depression Symptoms in Parent Couples Predict Response to Child ADHD and ODD Behavior

Parents of children with attention-deficit hyperactivity disorder (ADHD) and oppositional defiant disorder (ODD) often have elevated ADHD and depressive symptoms, both of which increase the risk of ineffective parenting and interparental discord. However, little is known about whether child ADHD/ODD behavior and parent ADHD or depressive symptoms uniquely or synergistically predict the quality of parenting and interparental communication during triadic (mother-father-child) interactions. Ninety parent couples, including 51 who have children diagnosed with ADHD, were randomly assigned to interact with a 9–12 year-old confederate child (84 % male) exhibiting either ADHD/ODD-like behavior or typical behavior. Parents reported their own ADHD and depressive symptoms, and parents and observers rated the quality of parenting and interparental communication during the interaction. Actor-partner interdependence modeling indicated that child ADHD/ODD behavior predicted less positive and more negative parenting and communication, independent of adult ADHD and depressive symptoms. Parent couples including two parents with elevated ADHD communicated more positively while managing children exhibiting ADHD/ODD behavior than couples managing children behaving typically or couples with only one parent with elevated ADHD symptoms. Couples including one parent with, and one parent without, elevated ADHD or depressive symptoms parented less positively and more negatively, and communicated more negatively, when managing children exhibiting ADHD/ODD behavior than when managing children behaving typically. Taken together, depending on the similarity of ADHD and depressive symptom levels in parent couples, adults managing children exhibiting ADHD/ODD behavior may parent or communicate positively or negatively. Findings highlight the need to consider the psychopathology of both parents when treating children with ADHD in two-parent homes.     

Using a Response Time–Based Expected A Posteriori Estimator to Control for Differential Speededness in Computerized Adaptive Test

This study investigates using response times (RTs) with item responses in a computerized adaptive test (CAT) setting to enhance item selection and ability estimation and control for differential speededness. Using van der Linden’s hierarchical framework, an extended procedure for joint estimation of ability and speed parameters for use in CAT is developed following van der Linden; this is called the joint expected a posteriori estimator (J-EAP). It is shown that the J-EAP estimate of ability and speededness outperforms the standard maximum likelihood estimator (MLE) of ability and speededness in terms of correlation, root mean square error, and bias. It is further shown that under the maximum information per time unit item selection method (MICT)—a method which uses estimates for ability and speededness directly—using the J-EAP further reduces average examinee time spent and variability in test times between examinees above the resulting gains of this selection algorithm with the MLE while maintaining estimation efficiency. Simulated test results are further corroborated with test parameters derived from a real data example.     

Increasing Active Student Responding in a University Applied Behavior Analysis Course: The Effect of Daily Assessment and Response Cards on End of Week Quiz Scores

The study compared the effects of daily assessment and response cards on average weekly quiz scores in an introduction to applied behavior analysis course. An alternating treatments design (Kazdin 1982, Single-case research designs. New York: Oxford University Press; Cooper et al. 2007, Applied behavior analysis. Upper Saddle River: Merrill/Prentice Hall) was used to analyze the effects of response cards and daily assessment on average weekly quiz scores. Differential treatment effects were found between the daily assessment and response card conditions. When compared to baseline, students’ consistently earned higher quiz scores on end of week quizzes in the daily assessment condition. Response cards produced mixed results. More substantial effects were revealed when analyzing individual student performance. In some cases, twice as many students earned 90% or better when either response cards or daily assessment were used compared to baseline. We discuss the implications of these results for other content areas and student demographics.     

Using the MMPI-2 to Predict Symptom Reduction During Psychotherapy in a Sample of Community Outpatients

In the present study, potential MMPI-2 predictors of psychotherapy outcome were examined in a community clinical sample of 51 patients seeking treatment at a university training clinic. Results indicated that particular MMPI-2 scales (L, F, Pd, Pa, Sc, Trt) were the most predictive of initial levels of patient distress, whereas three other clinical scales (Hs, D, Hy) were significantly associated with actual symptom reduction over time. The clinical implications of these data include the use of the MMPI-2 in clinical practice as a means to frame the provision of direct feedback to patients regarding the likelihood of treatment response, which in turn, might actually have therapeutic benefits. The limitations of the study are reviewed and suggestions for future research are offered, including the potential use of widely known and utilized instruments in helping to predict response to psychotherapy.     

Using Biodata to Predict Turnover,Organizational Commitment,and Job Performance in Healthcare

The purpose of the present study was to test whether or not a biodata instrument could be used to predict turnover, organizational commitment, and job performance in healthcare organizations. A criterion‐related, predictive validation strategy was used using a sample of 672 employees from two different hospitals in the southeastern United States. Supervisory ra0tings of organizational commitment and job performance were highly correlated with responses to the organizational commitment scale and the total score on the biodata instrument, respectively. Actual turnover was correlated with responses to the retention scale, although the effect size was small. Additionally, the study examined the fairness of biodata in this context as it relates to differences in performance among minority and non‐minority candidates. The findings in this study suggest that using such an instrument may provide organizations with the potential to improve organizational commitment and job performance, while reducing turnover with minimal group differences.     

Classical Test Theory as a first-order Item Response Theory: Application to true-score prediction from a possibly nonparallel test

We give an account of Classical Test Theory (CTT) in terms of the more fundamental ideas of Item Response Theory (IRT). This approach views classical test theory as a very general version of IRT, and the commonly used IRT models as detailed elaborations of CTT for special purposes. We then use this approach to CTT to derive some general results regarding the prediction of the true-score of a test from an observed score on that test as well from an observed score on a different test. This leads us to a new view of linking tests that were not developed to be linked to each other. In addition we propose true-score prediction analogues of the Dorans and Holland measures of the population sensitivity of test linking functions. We illustrate the accuracy of the first-order theory using simulated data from the Rasch model, and illustrate the effect of population differences using a set of real data.This research is collaborative in every respect and the order of authorship is alphabetical. It was begun when both authors were on the faculty of the Graduate School of Education at the University of California, Berkeley.We would like to thank both Neil Dorans, Skip Livingston and two anonymous referees for many suggestions that have greatly improved this paper.     

The Reduction of Adverse Impact in an Employment Setting Using a Short-Term Memory Test

Research suggests that less adverse impact should result from the use of employment tests assessing memory abilities than is obtained from tests assessing cognitive abilities. To test the application of this principle, a Short-Term Memory test and a Reading Comprehension test were administered as part of a selection battery for entry level police. Subjects were 1423 police officer applicants for a Midwestern city in the U.S. The results for the overall sample showed a smaller standardized difference between the scores of Blacks and Whites on the Short-Term Memory test than on the Reading Comprehension test, a difference which was further reduced when a subsample of Blacks and Whites was created which had been matched on gender, years of education and age.     

Using General Mental Ability and Personality Traits to Predict Job Performance in Three Chilean Organizations

Although the field of personnel selection has amounted around 100 years of research, there has been an overrepresentation of American and Western European samples in these studies. In particular, samples from Latin America have been almost entirely absent from industrial and organizational psychology journals. Thus, it is unknown whether well‐documented findings, such as the prediction of job performance based on general mental ability and conscientiousness, replicate in this region. This research intended to address this gap in the literature with three studies conducted in Chilean organizations, using different research designs, and different operationalizations of predictors and criteria. Results are generally consistent with previous studies, showing that conscientiousness and general mental ability significantly predict job performance in these Chilean samples.     

A Delineation of Schizophrenic Language and Thought in a Test of Imagination

The preferences between father and television and between mother and television for the children of Mexican-American migrant farm laborers (N = 164) between the ages of three and 21 were measured by using a series of questions involving two alternatives in a structured interview situation. Both parents were found to be significantly (p < .01) preferred over television by their children. However, groups of children were shown to differ in their preferences for parents versus television as a function of age.     

Accuracy of Predicting a Child's Response to Potential Threat: A Comparison of Children and Their Mothers

Considerable research has indicated that children and their parents often demonstrate marked discrepancies in their reporting of anxiety-related phenomena. In such cases, the question arises as to whether children are capable of accurately reporting on their anxiety. In the present study, 50 children (aged 5 to 14 years) were asked to approach a large, German Shepherd dog. Prior to the task, both the mother and child independently predicted the closest point likely to be reached by the child and the degree of anxiety likely to be experienced. These predictions were then compared with the actual phenomena displayed by the child during the task. On the behavioural measure (closest step reached), both the child and mother demonstrated equivalent predictive accuracy. On the subjective measure (fear ratings) children were considerably more accurate than their mothers. The data were not influenced by gender, age, or clinical status. The results indicate the ability of children to accurately predict their anxious responses, and support the value of incorporating children's self-reports in the assessment of emotional disorders.     

Using Sex-Related Alcohol Expectancies to Predict Condom Use Among a General Sample of Men and Women in the United States

Sex-related alcohol expectancies (SRAE) are known to moderate the relationship between alcohol use and risky sexual behavior in high risk populations; however, SRAEs have not been thoroughly explored in populations traditionally viewed at lower risk for HIV and/or STI. Participants (n = 649) were recruited through internet-based direct marketing in the United States. Predictors of SRAE vary by gender. Controlling for alcohol use and other predictors, age predicted condom use among women, and SRAE was correlated with condom use for men. Sexual health programming geared towards non-traditionally identified high-risk populations is necessary and provides unique opportunities to increase condom usage.