Using aptitude measurements for the optimal assignment of subjects to treatments with and without mastery scores

For assigning subjects to treatments the point of intersection of within-group regression lines is ordinarily used as the critical point. This decision rule is critized and, for several utility functions and any number of treatments, replaced by optimal monotone, nonrandomized (Bayes) rules. Both treatments with and without mastery scores are considered. Moreover, the effect of unreliable criterion scores on the optimal decision rule is examined, and it is illustrated how qualitative information can be combined with aptitude measurements to improve treatment assignment decisions. Although the models in this paper are presented with special reference to the aptitude-treatment interaction problem in education, it is indicated that they apply to a variety of situations in which subjects are assigned to treatments on the basis of some predictor score, as long as there are no allocation quota considerations.     

Apparatus for Smoking Kymograph Drum Papers

In a computer simulation study, random samples from a uniform density were substituted for each of two independent samples from normal and various nonnormal densities. This procedure was compared with conventional ranking and with Bell and Doksum's (1965) procedure, which substituted random normal deviates for initial sample values. After performing the Student t test, the program transformed the initial scores and performed additional t tests on ranks, random uniform scores, and random normal scores. For several distributions, the test on random normal scores was more powerful than the others, consistent with known asymptotic results. The probabilities of Type I and Type II errors of the test on random uniform scores were nearly the same as those of the Mann-Whitney-Wilcoxon test, for all distributions examined.     

METHODS OF IMPROVING EMPLOYMENT TEST CRITICAL SCORES DERIVED BY JUDGING TEST CONTENT: A REVIEW AND CRITIQUE

Setting critical scores on content valid tests may involve making judgments about test content. A conclusion which has been reached in the testing literature is that the Angoff method is preferred as this type of judgmental method of setting standards or critical scores. The current paper reflects this conclusion, but also discusses several limitations of the Angoff method, and outlines why less than optimal data may be obtained using this preferred method or similar methods. Several techniques are reviewed and critiqued that may be used in conjunction with the Angoff method or similar methods to attempt improvement of the psychometric quality of the critical score data. Components from two psychometric frameworks (generalizability theory and Cronbach's, 1955, accuracy scores) are integrated and applied in assessing the impact that each of the techniques may have on Angoff critical score data. The techniques reviewed can be roughly divided into: (a) procedural methods (involved in the judgment process), and (b) psychometric methods (involved in data analysis following judgment). The present review is intended as a resource to personnel testing specialists who may be interested in methods of bolstering the process of judgmentally deriving critical scores.     

Exploratory factor analysis: its role in item analysis

The special characteristics of items-low reliability, confounds by minor, unwanted covariance, and the likelihood of a general factor-and better understanding of factor analysis means that the default procedure of many statistical packages (Little Jiffy) is no longer adequate for exploratory item factor analysis. It produces too many factors and precludes a general factor even when that means the factors extracted are nonreplicable. More appropriate procedures that reduce these problems are presented, along with how to select the sample, sample size required, and how to select items for scales. Proposed scales can be evaluated by their correlations with the factors; a new procedure for doing so eliminates the biased values produced by correlating them with either total or factor scores. The role of exploratory factor analysis relative to cluster analysis and confirmatory factor analysis is noted.     

Demand characteristics and self-report measures of imaginary audience sensitivity: implications for interpreting age differences in adolescent egocentrism.

Self-consciousness during early adolescence has been explained as an outcome of adolescent egocentrism, in which adolescents create an imaginary audience (IA) of attentive, critical peers. The possibility that such self-consciousness might result from contact with peers who are more attentive and critical than those encountered during childhood or adulthood has not been considered. Study 1 tested whether young adults, who are not theoretically susceptible to IA, could be made to receive high scores on IA and self-consciousness measures by having them complete a procedure in 1 of 3 laboratory conditions-a critical audience, a noncritical audience, or no audience. However, participants in the critical-audience condition received significantly lower IA and self-consciousness scores than participants in the no-audience condition did. Study 2 tested whether the directions given to Study 1 participants might have been responsible for the unexpected findings. Results indicated that participants instructed to give mature-sounding responses received lower IA/self-consciousness scores than did those asked to report their honest opinions. Together, the results of Studies 1 and 2 indicated that survey measures of IA are subject to demand characteristics and highlighted the need to interpret with caution age differences in IA as traditionally assessed.     

Demand Characteristics and Self-Report Measures of Imaginary Audience Sensitivity: Implications for Interpreting Age Differences in Adolescent Egocentrism

Self-consciousness during early adolescence has been explained as an outcome of adolescent egocentrism, in which adolescents create an imaginary audience (IA) of attentive, critical peers. The possibility that such self-consciousness might result from contact with peers who are more attentive and critical than those encountered during childhood or adulthood has not been considered. Study I tested whether young adults, who are not theoretically susceptible to IA, could be made to receive high scores on IA and self-consciousness measures by having them complete a procedure in 1 of 3 laboratory conditions—a critical audience, a noncritical audience, or no audience. However, participants in the critical-audience condition received significantly lower IA and self-consciousness scores than participants in the no-audience condition did. Study 2 tested whether the directions given to Study I participants might have been responsible for the unexpected findings. Results indicated that participants instructed to give mature-sounding responses received lower IA/self-consciousness scores than did those asked to report their honest opinions. Together, the results of Studies 1 and 2 indicated that survey measures of IA are subject to demand characteristics and highlighted the need to interpret with caution age differences in IA as traditionally assessed.     

The selected response procedure: a variation on Appelbaum's altered atmosphere procedure for the Rorschach

This article introduces the Selected Response Procedure, which is a supplementary technique for expanding the scope of the Rorschach test. The procedure is conducted as follows: After the standard administration of the Rorschach test, patients are asked to look through all of the cards a second time and select one more response from any card of their choice. A rationale for this procedure is developed through a comparison to another supplementary Rorschach technique, the Altered Atmosphere Procedure. The importance of understanding the selected response within a theoretical framework, as well as the clinical context of each selected response, is highlighted by a clinical example using object relations theory. Finally, a number of didactic questions are offered as potential ways to query the possible meaning of selected responses.     

The Selected Response Procedure: A Variation on Appelbaum's Altered Atmosphere Procedure for the Rorschach

This article introduces the Selected Response Procedure, which is a supplementary technique for expanding the scope of the Rorschach test. The procedure is conducted as follows: After the standard administration of the Rorschach test, patients are asked to look through all of the cards a second time and select one more response from any card of their choice. A rationale for this procedure is developed through a comparison to another supplementary Rorschach technique, the Altered Atmosphere Procedure. The importance of understanding the selected response within a theoretical framework, as well as the clinical context of each selected response, is highlighted by a clinical example using object relations theory. Finally, a number of didactic questions are offered as potential ways to query the possible meaning of selected responses.     

THE DEVELOPMENT OF BEHAVIORAL OBSERVATION SCALES FOR APPRAISING THE PERFORMANCE OF FOREMEN

Behavioral observation scales (BOS) were developed for first line foremen. BOS are similar to behavioral expectation scales (BES) in that both are based on a job analysis procedure known as the critical incident technique. However, the BOS differ from BES in that, in developing BOS, (a) a group of individuals is observed and rated on a five-point scale as to the frequency with which they engage in the behavior described by each incident/statement, (b) a total score for each individual is determined by summing the observer's responses for each behavioral item, and (c) an item analysis (or factor analysis, depending upon the sample size) is conducted to select the most discriminating items. Those items with the highest correlations with the total score on a scale are retained to form one behavioral criterion or scale (BOS).     

Measuring Creativity with Planned Missing Data

This paper introduces a method for the assessment of creativity that relies on creativity tasks, a subjective evaluation procedure, and a planned missing data design that offers a drastic reduction in the overall implementation costs (administration time and scoring procedure). This method was tested on a sample of 149 people, using three creativity tasks as a basis. Participants were instructed to produce several ideas in each task and then to select what they considered to be their best two ideas (i.e., “Top 2” procedure; Silvia, Winterstein, Willse, Barona, et al., Psychology of Aesthetics, Creativity, and the Arts, 2 , 2008 and 68). These ideas were then evaluated by a panel of peers and experts. Creativity ratings were analyzed with structural equations; measurement models were estimated for each task and correlations between factor-scores across the three tasks were investigated. Further insights regarding validity are provided through systematic investigation of the relationship between fluency scores, creativity ratings, intelligence tasks, self-reported idea generation abilities, and creative activities and achievements. Overall, the results support the viability of this new approach, providing evidence of convergent and discriminant validity. They are discussed in relation to past research and avenues for further extension are proposed.     

Rohling's Interpretive Method and Inherent Limitations on the Flexibility of “Flexible Batteries”

Miller and Rohling (2001) proposed a 24-step algorithm, the Rohling Interpretive Method (RIM), for quantitative interpretation of results from flexible neuropsychological test batteries. We believe that the RIM as presented in that paper has several conceptual problems, including (a) a failure to distinguish "statistically significant" from pathological differences, (b) an assumption that declines in specific abilities can be inferred when a particular test score deviates from an estimate of general premorbid ability, and (c) confusion between the standard deviation associated with individual test scores versus that of a composite of those scores. As an alternative, we suggest the value of developing and using co-normed comprehensive neuropsychological test batteries from which test users might select subsets of tests.     

BRIEF REPORT: THE EQUIVALENCE OF TWO MULTIVARIATE CLASSlFICATION SCHEMES

The equivalence of two multivariate classification schemes is shown when the sizes of the samples drawn from the populations to which assignment is required are identical. One scheme is based on posterior probabilities determined from a Bayesian density function; the second scheme is based on likelihood ratio discriminated scores. Both of these procedures involve prior probabilities; if estimates of these priors are obtained from the identical sample sizes, the equivalence follows.     

Depressive attributions: selection of different causes or assignment of dimensional meanings?

Attributional models of depression suggest that depression is associated with internal, stable, and global causal explanations of events. However, the models do not specify whether the depressive attributional process involves the selection of certain causes, the assignment of dimensional meanings to those causes, or both. A distinction between these two processes was suggested by the findings that the choice of causes does not reliably indicate the perceived dimensions and that there is poor convergence between existing methods that assess causes and those that assess dimensions. When causes and dimensions were each measured in a manner that avoided confounding by the other, each made a unique contribution to the prediction of depression scores. Cause ratings alone were significantly associated with depression scores, but the optimal prediction of depression included both causes and dimensions. The implications of the distinction between these two processes for experimental manipulations of attributions and for reattribution training programs are discussed.     

Measuring automatic retrieval

A variety of procedures have been used to assess automatic retrieval effects on memory, including implicit memory tests and the process dissociation approach. Theoretical concerns with each are summarized prior to describing a procedure for evaluating automatic retrieval that is based on retrieval speed. Specifically, in a speeded implicit task, participants were encouraged to complete word stems using strictly automatic retrieval by presenting several practice test trials that did not allow responding based on previously studied items and by encouraging speed of responding. This speeded implicit task was compared with a condition in which conscious retrieval of studied information was not possible and a condition in which conscious retrieval was required, providing converging evidence to support the hypothesis that the speeded implicit procedure can yield pure estimates of automatic retrieval. Furthermore, evidence from a standard implicit memory task yielded comparable data that suggests that participants engaged automatic retrieval processes on this task also.     

Templates for rejection: configuring attention to ignore task-irrelevant features

Theories of attention are compatible with the idea that we can bias attention to avoid selecting objects that have known nontarget features. Although this may underlie several existing phenomena, the explicit guidance of attention away from known nontargets has yet to be demonstrated. Here we show that observers can use feature cues (i.e., color) to bias attention away from nontarget items during visual search. These negative cues were used to quickly instantiate a template for rejection that reliably facilitated search across the cue-to-search stimulus onset asynchronies (SOAs), although negative cues were not as potent as cues that guide attention toward target features. Furthermore, by varying the search set size we show a template for rejection is increasingly effective in facilitating search as scene complexity increases. Our findings demonstrate that knowing what not to look for can be used to configure attention to avoid certain features, complimenting what is known about setting attention to select certain target features.     

Time scores and factor analysis

The assumption of specific operation times leads to equations similar to those which are the basis for a factor analysis but in which the time scores replace item scores. An analysis of time scores is shown to lead to results equivalent, in a first approximation, to those obtained from an analysis of item scores. It is suggested that by modifying the factor technique it may be possible to use additional information to check with the results from an analysis.     

中文阅读之句法分析历程初探

该文报告的是香港中文大学心理学系的认知心理实验室中最近完成的两个与句法分析有关的实验。第一个实验探讨阅读中文时词汇、句法以及语意资料之触发和运用的时序问题。第二个实验研究的是中文读者所使用的句法分析策略。在两个实验中,基本的作业是让被试阅读在电脑屏幕上呈现的短文。文中每个字的阅读时间则由电脑记录作为反映阅读理解即时处理历程的指标。文中除了报告实验的结果外,还依据这些结果讨论了读者在阅读中文时所使用的句法分析策略以及句法资料的触发和使用历程。     

THE VALIDATION OF PROCEDURES TO ASSESS PREVOCATIONAL TASK PREFERENCES IN RETARDED ADULTS

Three severely retarded young adults between the ages of 19 and 21 years participated in a prevocational training program, and worked regularly on six different tasks during the scheduled six-hour day. The study attempted to assess each subject's preferences for the six tasks: collating, stuffing, sorting, pulley assembly, flour-sifter assembly, and circuit-board stuffing. In Phase I, the procedure consisted of randomly pairing each task with all other tasks in a two-choice situation that required the subjects to select one task from each pair combination to work for a seven-minute period. The selection procedure consisted of presenting two representative task objects on a tray and requesting the subject to pick up one object and place it on the work table. The object selected represented the task worked for that period. The 15 possible pair combinations were presented randomly every two days for a period of 34 days to determine the preferences. During the validation phase (Phase II), each subject's least- and most-preferred tasks were paired separately with moderately-preferred tasks. As expected, these manipulations confirmed the baseline data, as choices for the moderately-preferred tasks decreased when consistently paired with the preferred tasks and increased when consistently paired with the least-preferred tasks.     

A test of interpersonal theory of depression in children and adolescents using a projective technique

Using a projective technique among child and adolescent psychiatric inpatients, we tested several hypotheses derived from Coyne's (1976b) interpersonal theory of depression. First, we predicted that depression would be associated with rejection, even controlling for the effects of aggression. Depression and rejection were associated only when aggression effects were covaried. Second, we hypothesized that the depression-rejection relation would display symptom specificity. Consistent with this hypothesis, we found that depression, but not anxiety, was related to rejection. Third, we assessed whether an index of interpersonal style—reliance on others—moderated the depression-rejection relation. Results suggested that depression and overreliance were both associated with high rejection scores, whereas the combination of low depression and low reliance on others was associated with low rejection scores. We found that results held across age groups. The implications of our findings for the interpersonal theory of depression in youngsters are discussed.