Using a Sharp Instrument to Parse Apart Strategy and Consistency: An Evaluation of PPT and Its Assumptions

Potential Performance Theory (PPT) is a general theory for parsing observed performance into the underlying strategy and the consistency with which it is used. Although empirical research has supported that PPT is useful, it is desirable to have more information about the bias and standard errors of PPT findings. It also is beneficial to know the effects of violations of PPT assumptions. The authors present computer simulations that evaluate bias and standard errors at varying levels of strategy, consistency, and number of trials per participant. The simulations show that, when the assumptions are true, there is very little bias and the standard errors are low when there are moderate or large numbers of trials per participant (e.g., N = 50 or N = 100). But when the independence assumption is violated, PPT provides biased findings, although the bias is quite small unless the violations are large.     

Finite Mixtures for Simultaneously Modeling Differential Effects and Nonnormal Distributions

Regression mixture models have been increasingly applied in the social and behavioral sciences as a method for identifying differential effects of predictors on outcomes. Although the typical specification of this approach is sensitive to violations of distributional assumptions, alternative methods for capturing the number of differential effects have been shown to be robust. Yet, there is still a need to better describe differential effects that exist when using regression mixture models. This study tests a new approach that uses sets of classes (called differential effects sets) to simultaneously model differential effects and account for nonnormal error distributions. Monte Carlo simulations are used to examine the performance of the approach. The number of classes needed to represent departures from normality is shown to be dependent on the degree of skew. The use of differential effects sets reduced bias in parameter estimates. Applied analyses demonstrated the implementation of the approach for describing differential effects of parental health problems on adolescent body mass index using differential effects sets approach. Findings support the usefulness of the approach, which overcomes the limitations of previous approaches for handling nonnormal errors.     

Revisiting Case IV: A reassessment of bias and standard errors of Case IV under range restriction

In 2004, Hunter and Schmidt proposed a correction (called Case IV) that seeks to estimate disattenuated correlations when selection is made on an unmeasured variable. Although Case IV is an important theoretical development in the range restriction literature, it makes an untestable assumption, namely that the partial correlation between the unobserved selection variable and the performance measure is zero. We show in this paper why this assumption may be difficult to meet and why previous simulations have failed to detect the full extent of bias. We use meta‐analytic literature to investigate the plausible range of bias. We also show how Case IV performs in terms of standard errors. Finally, we give practical recommendations about how the contributions of Hunter and Schmidt (2004) can be extended without making such stringent assumptions.     

Perceived Consensus in Estimates of the Prevalence of Driving Errors and Violations

This paper reports a study of perceptions of the prevalence of certain driving errors and violations in a large ( N = 1,656) sample of drivers. In keeping with previous research on perceptions of social consensus, it was predicted that (a) drivers who reported that they themselves regularly commit these errors and violations would make larger estimates of the percentage of other road users who regularly engage in these behaviors, by comparison with drivers who reported that they do not regularly commit these errors and violations; (b) comparison of estimates of social consensus for own behavior with the actual numbers of respondents reporting that they did or did not engage in these behaviors would show that those who do commit the behaviors regularly would overestimate consensus for their position, while those who do not commit the behaviors regularly would underestimate consensus for their position; and (c) these tendencies to overestimate or underestimate actual consensus for own position would be correlated with the perceived offensiveness to others of the behavior concerned, such that departures from actual consensus would be greater for behaviors rated as more offensive. The results provide strong support for the first two predictions but none for the third; indeed, the degree of over- or underestimation tended to be inversely related to offensiveness. In addition, there were unanticipated but highly consistent sex and age differences in perceptions of the prevalence of the target behaviors, with female and younger respondents making higher estimates than male and older respondents, respectively. The theoretical and practical implications of these findings are discussed.     

Maybe not so independent after all: The possibility,prevalence, and consequences of violating the independence assumptions in psychometric meta-analysis

Psychometric meta-analysis assumes that moderators are unrelated to study artifacts (e.g., criterion reliability), and that study artifacts are independent of true validities. Meeting these assumptions is important for researchers seeking to accurately partition the variance in effect sizes due to study artifacts from the variance due to meaningful moderators. Despite the critical role of these assumptions, we know very little about their tenability. To address this basic gap in the literature, we conducted three studies to determine if there are potential violations of the independence assumptions (Study 1), the prevalence of such violations (Study 2), and the consequences of violating the independence assumptions via a series of Monte Carlo simulations (Study 3). We found that violations of the independence assumptions are not only plausible but also routinely detected across a wide array of topics. Simulation results indicate that violating the independence assumptions can result in biases under certain circumstances, which are further accentuated due to the lack of stability in the estimators. We offer suggestions for the future use of psychometric meta-analysis and discuss the implications for research focused on refining psychometric meta-analysis.     

Diverging diamond interchanges: A driving simulator study

This study assessed driver performance while navigating a Diverging Diamond Interchange (DDI) compared to a standard intersection in a driving simulator. A total of 201 Western Australian (WA) drivers aged 18–80 years completed the simulator drive and questionnaire. Measures of driving simulator performance assessed included time spent out of lane, number of lane excursions, compliance to the speed limit, crashes and near misses. Other driving measures, which were recorded by the researcher, included driver errors/violations such as red-light violations, wrong way violations and navigation errors. Qualitative information was also obtained in a post exit interview with each participant regarding the difficulties they experienced when driving through the DDI. A repeated-measure analysis of variance (r-ANOVA) was undertaken to examine differences in intersection type (DDI versus standard intersection) and driving performance measures from the driving simulator. The only significant result was compliance to the speed limit (F (1, 656) = 160.11, p < 0.001) on the driving simulator. A higher proportion of red-light violations were observed by the researcher as participants navigated through the DDI, compared to the standard intersection. Qualitative comments from participants also highlighted the need for better signage and road markings. Recommendations when DDIs are implemented include community education on speed limit compliance, avoidance of red-light violations and design improvements regarding signage and road markings.     

Additivity and expected utility in risky multiattribute preferences

This experiment analyzed human preferences among even chance gambles for commodity bundles. The purpose of the experiment was to test several independence assumptions that distinguish between models for risky multiattribute preferences. In particular, the additivity and the expected utility part of the additive expected utility model were tested symmetrically. The degree and form of model violations were established, and the effects of instructions and of response modes were examined. All independence assumptions were violated by a bias to prefer a gamble or a commodity bundle that was previously matched against a standard. Systematic and strong violations that superseded this bias questioned the validity of the additive expected utility model. In violation of the additivity part of that model subjects consistently preferred the gamble with more balanced outcomes when comparing gambles with identical marginal probability distributions. This trend, called multiattribute risk aversion, was independent of subjects' single attribute risk attitude. Instructions and response modes had no noticeable impacts on these response patterns.     

暴力犯罪者对负性情绪信息注意偏向的ERP研究

采用视觉搜索范式,探讨了暴力犯罪者对情绪刺激（愤怒面孔与高兴面孔）的注意偏向特点。行为数据显示,相比非暴力组,暴力组对愤怒面孔的反应要显著快于高兴面孔,初步验证了暴力犯罪者对负性情绪信息存在注意偏向。ERP数据进一步表明,当目标刺激为愤怒面孔时,暴力组N2pc的潜伏期要显著小于非暴力组,说明暴力犯罪者对愤怒面孔的觉察早于高兴面孔,对负性情绪刺激更为敏感。由于N2pc的波幅不存在显著差异,差异主要表现在反应时和潜伏期,说明暴力犯能够更快的觉察到负性情绪面孔,但并没有对其投入更多的注意资源,出现回避模式,表明暴力犯对负性情绪信息的加工是一种警觉—回避模式。     

Combination Scores for the Humm-Wads-Worth Temperament Scale

In an attempt to assess the degree to which specific stimulus-response associations are gradually acquired in learning a serial list, the order of the middle items was altered during acquisition. Five groups with 16 Ss per group had either no items switched, two items switched after four or eight test trials, or four items switched after four or eight test trials. The nonsense syllables were presented with slide projectors by means of standard serial anticipation procedures. Contrary to hypotheses, there were no overall differences between the four experimental groups and the control in trials to criterion or in total errors. However, although few experimental Ss reported noticing the switch, they made more errors on the trials immediately following the switch in comparison with the control group. These results are interpreted as disconfirming continuous, stimulus-specific association assumptions and supporting noncontinuous, nonassociative approaches.     

The specific role of spatial orientation skills in predicting driving behaviour

How people acquire environmental information brings out individual differences that are extremely large and robust. We assume that different spatial strategies used to represent, explore and move through the environment may predict risky driving behaviour.Here, we investigated spatial strategies and driving behaviour in 167 college students (86 women) using the following tests: the Spatial Cognitive Style Test, aimed at assessing spatial strategies characterized by different degrees of spatial competences (ranging from landmark, route to survey); the Manchester Driver Behavior Questionnaire, aimed at assessing errors, lapses, ordinary and aggressive Highway Code violations; the Attitude toward Road Safety Issues, aimed at assessing road safety attitudes related to driving.A series of regression analysis showed that spatial strategy used by drivers predicted the number of errors, lapses, ordinary and aggressive violations, as well as the number of road-safety behaviours. In conclusion, our results suggest that drivers preferring a survey strategy are much more able to make correct spatial decisions. Specifically, they are more confident about their spatial competence that in turn makes them less aggressive towards other drivers. Our findings suggest that good navigators travel without incurring in violations and fines. Implications regarding the possibility to use spatial navigational training to improve driving skills and release driving licence, as well as limitations of the study are discussed.     

潜变量交互效应标准化估计：方法比较与选用策略

标准化估计对模型的解释和效应大小的比较有重要作用。虽然潜变量交互效应的恰当标准化估计公式已经面世超过10年, 国内外都在使用和引用, 但至今未见到关于不同估计方法得到的恰当标准化估计的系统比较。通过模拟实验, 比较了乘积指标法、潜调节结构方程(LMS)、无先验信息和有先验信息的贝叶斯法的潜变量交互效应标准化估计在不同条件下的表现。结果发现, 在正态条件下, LMS和有信息贝叶斯法表现较好; 而在非正态条件下, 乘积指标法比较稳健, 但需要较大的样本(不小于500), 小样本且外生潜变量之间相关很低时可使用无信息贝叶斯法。     

Influence of two types of information trials on the formation of a discrimination-reversal learning set in Japanese monkeys

Abstract: Three groups of male adult Japanese monkeys were trained in 30 discrimination-reversal learning-set (LS) problems using the Wisconsin General Test Apparatus. A control group ( N = 3) was trained in the standard procedure: acquisition of up to 12 consecutive correct responses, reversal to the same criterion, and then shift to a new problem. To the other two groups, three information trials signaling the stimulus value in reversal were given after they reached the criterion in acquisition. Subjects in the positive-stimulus information (PSI) group ( N = 4) were exposed only to the reversal positive stimulus, and a response to it was rewarded. Subjects in the negative-stimulus information (NSI) group ( N = 4) were exposed only to the reversal negative stimulus, and any response to it was not rewarded. Information trials reduced reversal errors and NSI trials were more effective than PSI trials in error reduction ( p < .05). Information trials also aided in acquisition: the NSI and PSI groups learned the acquisition phase of the problems with significantly fewer errors than control group ( p < .01) in the last stage of training. The implications of these results are discussed in relation to strategy learning and attention learning in LS formation.     

Sequence-sensitive exemplar and decision-bound accounts of speeded-classification performance in a modified Garner-tasks paradigm

Among the most fundamental results in the area of perceptual classification are the “correlated facilitation” and “filtering interference” effects observed in Garner’s (1974) speeded categorization tasks: In the case of integral-dimension stimuli, relative to a control task, single-dimension classification is faster when there is correlated variation along a second dimension, but slower when there is orthogonal variation that cannot be filtered out (e.g., by attention). These fundamental effects may result from participants’ use of a trial-by-trial bypass strategy in the control and correlated tasks: The observer changes the previous category response whenever the stimulus changes, and maintains responses if the stimulus repeats. Here we conduct modified versions of the Garner tasks that eliminate the availability of a pure bypass strategy. The fundamental facilitation and interference effects remain, but are still largely explainable in terms of pronounced sequential effects in all tasks. We develop sequence-sensitive versions of exemplar-retrieval and decision-bound models aimed at capturing the detailed, trial-by-trial response-time distribution data. The models combine assumptions involving: (i) strengthened perceptual/memory representations of stimuli that repeat across consecutive trials, and (ii) a bias to change category responses on trials in which the stimulus changes. These models can predict our observed effects and provide a more complete account of the underlying bases of performance in our modified Garner tasks.     

The time-saving bias, speed choices and driving behavior

When drivers are asked to estimate how much time can be saved by increasing speed, they generally underestimate the time saved when increasing from a relatively low speed and overestimate the time saved when increasing from a relatively high speed. This time-saving bias has been demonstrated to affect drivers’ estimations of driving speed as well as drivers’ personal choice of speed. Specifically, drivers with a high time-saving bias chose unduly high speeds, which sometimes results in speeding, more frequently than drivers with a lower degree of the bias. This study sought to determine whether this relationship would be mediated by individual differences in driving behavior – including drivers’ attitudes, norms and habits regarding speeding behavior as well as their level of aberrant driving behavior (committing aggressive or ordinary violations, errors or lapses in driving, measured by the Driver Behaviour Questionnaire). The results showed that the time-saving bias predicted estimations of required speed better than any of these factors, and also better than drivers’ age, gender, education and income, as well as the number of years they have had a license and their monthly driving kilometrage, their prior speeding violations and crash involvement. In predicting drivers’ personal speed choices, the time-saving bias was second only to the frequency of committing ordinary violations.     

Neural and behavioral effects of regulating emotional responses to errors during an implicit racial bias task

Affect regulation plays a key role in several theories of racial bias reduction. Here, we tested whether engaging in emotion regulation strategies while performing an implicit racial bias task (Weapons Identification Task; WIT) would alter neural and behavioral manifestations of bias. Participants either suppressed or reappraised in a positive light the distress associated with making errors during the WIT, while an electroencephalogram (EEG) was recorded. We hypothesized that engaging in emotion regulation strategies would reduce the distress associated with making errors indicative of bias, resulting in smaller error-related negativity (ERN) amplitude during errors and increased expression of racial bias. Results of within-subjects comparisons (Experiment 1) generally supported these predictions. However, when emotion regulation strategies were manipulated between subjects (Experiment 2) there was no effect of suppression or reappraisal on bias expression. Across both experiments, engaging in emotion regulation led to larger ERNs for errors occurring on Black- relative to White-primed trials. In addition, a number of significant order effects were observed, indicating important differences in the effects of engaging in emotion regulation strategies when those strategies are attempted in participants’ first versus second block of trials. No such order effects were evident when a second trial block was completed with no emotion regulation instructions. Findings are discussed in terms of the need for greater specificity in experimental tests of emotion regulation on error processing and cognitive performance.     

Strategy use,the development of automaticity,and working memory involvement in complex multiplication

Participants practiced a set of complex multiplication problems (e.g., 3 x 18) in a pre-/postpractice design. Before, during, and after practice, the participants gave self-reports of problem-solving strategies. At prepractice, the most common strategy was a mental version of the standard multidigit algorithm, and dual tasks revealed that working memory load was high and heavier for problems solved via nonretrieval strategies. After practice, retrieval was used almost exclusively, and participant variability, automaticity level of problems (proportion of trials on which retrieval was used over the entire experiment), and error rates were significant predictors of problem-solving latencies. Practice reduced working memory involvement to minimal levels, and there was no relationship between automaticity level and working memory load. The commonalities between the present findings and findings related to automaticity development in simple arithmetic are discussed.     

Errors in subtractions: judged and observed frequencies

In a first study 10 adults, aged 24-44 years, solved all 105 subtraction problems in the form M - N = , where 0 < or = M < or = 13, 0 < or = N < or = 13 and N < or = M. Each participant solved every problem 10 times and in total there were 10 500 answers. Answers, response latencies and errors were registered. Retrospective verbal reports were also given, indicating how a solution was reached: (1) via a (conscious) reconstructive cognitive process or (2) via an (unconscious) reproductive (retrieval) process. The participants made 291 errors (2.8%) when solving the subtractions in study 1. The rate of self-correction was very high, 92%. In a second study 27 undergraduate students estimated overall error rates, including self-corrected errors for the 105 subtraction problems used in the first study. Judged and actual error rates were compared. The participants systematically underestimated error rates for error prone problems and overestimated error rates for error free problems. The participants were fairly accurate when they predicted problems that were most error prone, with a hit rate of 0.67 for the (18) problems predicted as the most error prone ones. In contrast, predictions of which problems were error free were very poor with a hit rate of only 0.20 of the problems predicted as error free really having no errors in study 1. The correlation between judged error rates and frequencies for actually made errors was 0.69 for answers belonging to reconstructive solutions. In contrast, there was no significant correlation between judged and actual error rates at all for retrieved solutions, possibly reflecting the inaccessibility to consciousness of quick retrieval processes.     

Measures of sensitivity based on a single hit rate and false alarm rate: the accuracy, precision, and robustness of d', Az, and A'

Signal detection theory offers several indexes of sensitivity (d', Az, and A') that are appropriate for two-choice discrimination when data consist of one hit rate and one false alarm rate per condition. These measures require simplifying assumptions about how target and lure evidence is distributed. We examine three statistical properties of these indexes: accuracy (good agreement between the parameter and the sampling distribution mean), precision (small variance of the sampling distribution), and robustness (small influence of violated assumptions on accuracy). We draw several conclusions from the results. First, a variety of parameters (sample size, degree of discriminability, and magnitude of hits and false alarms) influence statistical bias in these indexes. Comparing conditions that differ in these parameters entails discrepancies that can be reduced by increasing N. Second, unequal variance of the evidence distributions produces significant bias that cannot be reduced by increasing N-a serious drawback to the use of these sensitivity indexes when variance is unknown. Finally, their relative statistical performances suggest that Az is preferable to A'.     

Psychologische Mess- und Testverfahren

The use of psychological assessment methods is flawed by incorrect assumptions of their capacity. Some of these assumptions are discussed. It is argued that psychological tests are necessary to expand the database for expert reports about the impact of mental disorders on work and different levels of functioning. Tests help to protect psychological assessments against errors and chance bias. With respect to levels of functioning, examples of German tests and questionnaires are given. Test-based information requires objective validation methods and should not be subordinated to an intuitive assessment strategy.     

Ethical beliefs and behaviors in applied sport psychology: The AAASP ethics survey

Abstract

AAASP members (N = 508) were surveyed to obtain preliminary data on ethical beliefs and behaviors specific to the practice of applied sport psychology. Completed surveys were received from 165 individuals. On the structured response portion of the survey, there were few differences in ethical beliefs and behaviors as a function of gender, professional/student status, and academic discipline. Nevertheless, a large number of controversial behaviors (N = 24) and difficult judgments (N = 8) were identified. Results of the open-ended portion of the survey indicated that most of the questionable ethical practices cited by respondents corresponded to violations of American Psychological Association (APA) Ethical Standards. The findings lend initial support for AAASP to adopt the APA Ethical Standards and suggest the need for ethics training specific to applied sport psychology.