Retention and Recall: Incidental Learning of Visual and Auditory Material

This study examined the effect on observer agreement of switching from a system of overt reliability assessment to two successive systems of covert reliability measurement. A primary purpose was to see whether agreement obtained with the use of covert data checks would improve over time if observers were provided with accurate feedback regarding their level of agreement. Seventeen undergraduate psychology students served as Ss. They observed instructional interactions between preschool children and their teachers. During the two week “overt” check period (Phase I), observers were aware of when their observations were being “checked” by a previously designated reliability assessor. In the subsequent covert phases (weeks 3–7) this information was not available to them during the observational sessions. When covert monitoring was implemented, agreement rates initially dropped significantly below the “overt” measurement phase. Gradually agreement rates improved until, in weeks 6 and 7, they were not significantly different from the initial overt measures. Es should be aware that an overt check on observer agreement may not reflect the true reliability of an observational system. However, when observers are given accurate feedback on their level of agreement, they are able significantly to improve their vigilance and consistency in the use of the observational system.     

Overt and covert parental conflict and adolescent problems: observed marital interaction in clinic and nonclinic families.

When adolescents behave in socially unacceptable ways, overt interparental conflict is widely held to be the cause. Empirical studies, however, have been inconsistent in supporting this assumption. Some researchers therefore have speculated that covert conflict also plays a role. In the current observational study, evidence was found that both overt parental conflict and some forms of covert conflict play roles. During problem-solving family discussions, parents of adolescents whom they had brought into an outpatient clinic for treatment overtly disagreed with each other significantly more often than did parents with adolescents who did not require treatment. Families of clinic adolescents also exhibited significantly more silence during their discussions, and mothers spent significantly less time talking than did their nonclinic counterparts. The implications that both the overt and covert conflict may have for adolescent behavior are discussed.     

Overt and Covert Dimensions of Antisocial Behavior in Early Childhood

The present study was designed to assess both the prevalence and structure of antisocial behavior in a normative sample of preschoolers. Prevalence estimates suggested that 40% of preschoolers exhibit at least one antisocial behavior each day. Furthermore, 10% of preschoolers exhibit six or more antisocial behaviors each day. Consistent with research based on older children, factor analyses provided support for conceptualizing antisocial behavior in early childhood as consisting of both overt and covert dimensions. While both overt and covert behaviors had acceptable test–retest reliability, only overt behaviors had acceptable interrater reliability. Finally both overt and covert dimensions of antisocial behavior were uniquely related to general measures of conduct problems, hyperactivity, and adult and peer conflict in the classroom setting. Findings are discussed with regard to early assessment and the developmental course of antisocial behavior.     

A review of the observational data-collection and reliability procedures reported in The Journal of Applied Behavior Analysis

The research published in the Journal of Applied Behavior Analysis (1968 to 1975) was surveyed for three basic elements: data-collection methods, reliability procedures, and reliability scores. Three-quarters of the studies reported observational data. Most of these studies' observational methods were variations of event recording, trial scoring, interval recording, or time-sample recording. Almost all studies reported assessment of observer reliability, usually total or point-by-point percentage agreement scores. About half the agreement scores were consistently above 90%. Less than one-quarter of the studies reported that reliability was assessed at least once per condition.     

儿童外显视空间注意转移

采用提示范式探讨了三、六年级儿童的外显视空间注意转移。实验结果表明：内源性提示下儿童表现出显著的提示效度效应,其效度效应量在年龄组间没有显著差异;较短SOAs的外源性提示下,儿童表现出显著的提示效度效应;较长SOAs的外源性提示下儿童没有表现出返回抑制效应。用注意的过滤器理论和对象文件模型讨论了本研究的结果     

Overt and covert identification of fragmented objects inferred from performance and electrophysiological measures

The authors investigated visual processing leading to object identification by manipulating the number of fragments and nature of the study. During the study, participants either named or drew objects in Experiment 1 and drew them all in Experiment 2. During the test, participants made an identification judgment at each of 6 different fragmentation levels for studied and new objects. Fewer fragments were needed to identify studied than unstudied objects. Reaction times were faster for studied than unstudied objects both at identification and at the preceding level. Event-related brain potentials (ERPs) to unidentified objects were characterized by a late negativity in contrast to a positivity to identified objects. ERPs to studied but not to new objects contained a smaller and later version of the identification positivity at level just prior to identification, which was not due to differential response confidence. Much covert visual analysis and even object identification may precede overt identification, depending on the nature of prior experience.     

Correspondence of teacher ratings and direct observations of classroom behavior of psychiatric inpatient children

The present investigation examined the correspondence of teacher ratings and direct observations of classroom behavior. Techers, extraclass raters, and observers completed standard rating scales and/or measures of overt classroom behaviors of psychiatric inpatient children (N=32). The study assessed if the correspondence between ratings and direct observations was influenced by who evaluates the child (teachers, raters) and the assessment format (general ratings, discrete behaviors). The results indicated that (1) measures from different assessors correlated in the low to moderate range, (2) data from extraclass raters corresponded more closely with direct observations than with data from teachers, (3) teacher and rater estimates of overt child behavior did not correlate more highly with direct observations than did standard rating scales, and (4) teachers and raters viewed child behavior as more appropriate than direct observations indicated. Measures from teachers, raters, and observers readily distinguished attention deficit disorder children with hyperactivity from their peers. However, teacher evaluations delineated these children more sharply than other assessors.Completion of this paper was facilitated by a Research Scientist Development Award (MH00353) to the first author from the National Institute of Mental Health.     

Shaping data collection congruent with experimental hypotheses

The influence of instructions and feedback from an experimenter on observational recordings of disruptive behavior was evaluated. Four subject-observers recorded four categories of disruptive behavior from videotapes of children in a classroom setting. Two sets of videotapes, labelled "baseline" and "treatment", were matched for rates of disruptive behavior in each category. The observers were told that two target behaviors were expected to decrease and the other two control behaviors were not expected to change during the treatment condition. During observational recording of treatment videotapes, the observers were given positive feedback when they reported decreases in the two target behaviors, and negative feedback when they reported either to change or increases in the two control behaviors. The target behaviors were recorded less frequently by observers, while recordings of control behaviors were unaffected during the treatment phase. These results suggest that contingent feedback to observers should be avoided as a possible source of bias in behavioral recordings.     

Analyzing Judgments of Ethnically Diverse Applicants During Personnel Selection: A study at the Dutch police

A judgment‐analysis study was used to investigate assessors' judgment processes, evaluating ethnic minority vs ethnic majority applicants. Sixteen ethnic majority assessors judged 5089 applicants during the Dutch police officer selection procedure, with each assessor judging 30 ethnic minority applicants minimally. Information from an employment interview, an assessment center, and a Big Five personality test were combined into a final selection advice. Results showed that as much as or more information sources were used to judge ethnic minority than ethnic majority applicants. Furthermore, a larger number of irrelevant cues were used for the judgment of ethnic minority applicants. Finally, when judging ethnic minority applicants, assessors based their decision to a lesser extent on their own ratings than on ratings of others.     

The separate and combined effects of covert and overt rehearsal in developing assertive behavior

The present investigation evaluated the separate and combined effects of covert modeling and overt rehearsal as a means of developing assertive behavior. Nonassertive clients (n = 66) received one of three treatments: covert modeling, overt rehearsal and covert modeling-overt rehearsal combined. A delayed-treatment group was included in the design to serve as a no-treatment control condition before clients were reassigned randomly to one of the three treatments. Treatments led to significant improvements on self-report and behavioral measures of assertiveness and self-efficacy. Although covert and overt rehearsal treatments were equally effective, the combined procedure led to significantly greater improvements which were evident at posttreatment and at an 8-month follow-up assessment. Treatment effects generalized to novel role-play situations and brought clients to the level of other persons who regarded themselves as adept in social situations requiring assertive behavior.     

Programmed Instruction: Construction Responding, Discrimination Responding, and Highlighted Keywords

Skinner (1958) expressed the need for an increase in the effectiveness and efficiency of education. In particular, he suggested that programmed instruction could provide such efficiency. The present study used a within-subject design to compare the effects of four types of instructional materials; those requiring overt construction responses, overt discrimination responses, covert reading of text with highlighted key words, and covert reading of standard text. The materials requiring overt responding produced greater learning than did the covert reading materials, with or without highlighting. There was no difference found between the two types of overt responding; nor were there differences between the two types of covert reading materials. Thus, this study supports the assumption that overt responding is more effective. However, the overt response materials also required proportionately more time. Therefore, this showed no benefit of overt responding in terms of efficiency.     

Individual differences in neural regions functionally related to real and imagined stuttering

Recent brain imaging investigations of developmental stuttering show considerable disagreement regarding which regions are related to stuttering. These divergent findings have been mainly derived from group studies. To investigate functional neurophysiology with improved precision, an individual-participant approach (N = 4) using event-related functional magnetic resonance imaging and test–retest reliability measures was performed while participants produced fluent and stuttered single words during two separate occasions. A parallel investigation required participants to imagine stuttering or not stuttering on single words. The overt and covert production tasks produced considerable within-subject agreement of activated voxels across occasions, but little within-subject agreement between overt and covert task activations. However, across-subject agreement for regions activated by the overt and covert tasks was minimal. These results suggest that reliable effects of stuttering are participant-specific, an implication that might correspond to individual differences in stuttering severity and functional compensation due to related structural abnormalities.     

How crucial is the response format for the testing effect?

Combining study and test trials during learning is more beneficial for long-term retention than repeated study without testing (i.e., the testing effect). Less is known about the relative efficacy of different response formats during testing. We tested the hypothesis that overt testing (typing responses on a keyboard) during a practice phase benefits later memory more than covert testing (only pressing a button to indicate successful retrieval). In Experiment 1, three groups learned 40 word pairs either by repeatedly studying them, by studying and overtly testing them, or by studying and covertly testing them. In Experiment 2, only the two testing conditions were manipulated in a within-subjects design. In both experiments, participants received cued recall tests after a short (~19 min) and a long (1 week) retention interval. In Experiment 1, all groups performed equally well at the short retention interval. The overt testing group reliably outperformed the repeated study group after 1 week, whereas the covert testing group performed insignificantly different from both these groups. Hence, the testing effect was demonstrated for overt, but failed to show for covert testing. In Experiment 2, overtly tested items were better and more quickly retrieved than those covertly tested. Further, this does not seem to be due to any differences in retrieval effort during learning. To conclude, overt testing was more beneficial for later retention than covert testing, but the effect size was small. Possible explanations are discussed.     

Two for the Price of One: Assessment Center Training to Focus on Behaviors Can Transfer to Performance Appraisals

The purpose of this study was to evaluate whether the training and experience of assessors to record behaviors as part of an actual organizational assessment center (AC) would transfer to another context: performance appraisals. Specifically, we examined the effects of transfer of training on managers' behavioral specificity in comments on performance evaluations. Performance appraisal comments from managers who had received training and participated as an assessor and from managers who had not were compared. Analyses revealed significant differences between managers who were trained as assessors compared with managers who were not, suggesting transfer of training effects. Results provide the first empirical evidence for an added benefit of AC assessor participation and training.     

Moderators of sex- and race-based subgroup differences in assessment center ratings: A meta-analysis

This meta-analysis tested a series of moderators of sex- and race-based subgroup differences using assessment center (AC) field data. We found that sex-based subgroup differences favoring female assessees were smaller among studies that reported: combining AC scores with other tests to compute overall assessment ratings, lower mean correlations between rating dimensions, using more than one assessor to rate assessees in exercises, and providing assessor training. In contrast, we found larger sex-based subgroup differences favoring female assessees among studies that reported: lower proportions of females in assessee pools, conducting a job analysis to design the AC, and using multiple observations of AC dimensions across exercises. We also observed a polynomial effect showing that subgroup differences most strongly favored female assessees in jobs with the highest and lowest rates of female incumbents. We found race-based subgroup differences favoring White assessees were smaller on less cognitively loaded rating dimensions and for jobs with lower rates of Black incumbents. Studies reporting greater overall methodological rigor also showed smaller subgroup differences favoring White assessees. Regarding specific rigor features, studies reporting use of highly qualified assessors and integrating dimension ratings from separate exercises into overall dimension scores showed significantly lower differences favoring White assessees.     

驾驶经验和危险类型对年轻驾驶员危险知觉的影响

结合反应时和眼动测量方法,采用驾驶经验分组2（年轻新手驾驶员,年轻有经验驾驶员）× 危险类型2（明显危险,隐藏危险）的混合实验设计,探索年轻驾驶员危险知觉的经验优势是否随着危险类型的不同而变化。使用一个基于真实交通情境视频的驾驶员危险知觉任务,对27名年轻新手驾驶员和22名年轻有经验驾驶员进行测试,并使用Tobbi T120记录眼动数据。结果发现,总体上,年轻新手驾驶员对潜在道路危险的反应次数比年轻有经验驾驶员更少,反应时间也更慢。两组驾驶员反应时间的差异,随着危险类型的不同而来源于不同的加工阶段。具体来说：一方面,年轻新手驾驶员对明显危险的反应时间慢,是因为他们对该类危险的评估时间长。另一方面,年轻新手驾驶员对隐藏危险的反应时间慢,是因为他们对该类危险的识别时间长。两组驾驶员对危险的平均注视时间受测试中危险类型的影响但不受驾驶经验的影响。这些研究结果表明,在对年轻新手驾驶员进行危险知觉训练或测试时,应重视危险类型对他们危险知觉的影响。     

The effect of overt and covert narcissism on self-esteem and self-efficacy beyond self-esteem

Past literature has suggested a dual nature of trait based narcissism, comprising overt and covert forms. While several studies have examined the two subtypes in relation to self-esteem, very few studies have examined narcissistic subtypes and self-efficacy. 115 Psychology undergraduates filled in self-report measures of overt narcissism, covert narcissism, self-esteem and self-efficacy. Results demonstrated no significant relationship between overt and covert narcissism, suggesting two distinct subtypes. Overt and covert forms of narcissism were found to significantly contribute to self-efficacy beyond self-esteem. Further, overt narcissism positively predicted both self-esteem and self-efficacy beyond self-esteem. Conversely, covert narcissism was found to negatively predict self-esteem and self-efficacy beyond self-esteem. Overt narcissism subscale associations were also computed, with Power being associated with higher self-efficacy but not self-esteem, suggesting Power to be a more adaptive subscale. The Special Person subscale was associated with higher self-esteem but not self-efficacy, suggesting it forms the maladaptive core of overt narcissism. Exhibitionism was not associated with either self-esteem or self-efficacy. Results appear congruent with past literature, and have given an additional insight into the implications of trait based narcissism regarding self-efficacy. Findings appear to suggest trait based overt narcissism is a more adaptive construct to individual self-concept than covert narcissism.     

Development of covert and overt hostility scales from the Buss-Durkee Inventory

The purpose of this study was to develop covert and overt hostility scales from the Buss-Durkee Inventory. First, 22 covert hostility and 29 overt hostility items were identified by the authors. Second, an item analysis was done to assess the content saturation of the individual items on these scales. This analysis yielded the final form for 7 items for covert hostility and 14 for overt hostility. Cronbach alphas for the covert and overt scales were .67 and .77, respectively, and their intercorrelation was .08. Correlations for these Buss-Durkee scales with several existing measures of anger expression were consistent with expectations.     

The effects of covert and overt modeling on assertive behavior

Three modeling therapy formats (overt modeling with a standard hierarchy of situations. covert modeling with the standard hierarchy, and covert modeling with a self-tailored hierarchy) were compared to assess their relative efficacy in developing assertive skills. Half the subjects in each treatment condition received or did not receive generalization training. Significant within-group improvement was indicated on four self-report measures. Overall, the results suggest that covert modeling was as effective as overt modeling or covert modeling plus self-tailoring for instating assertion among nonassertive college women.     

Fluency misattribution and visual hindsight bias

We tested a fluency-misattribution theory of visual hindsight bias, and examined how perceptual and conceptual fluency contribute to the bias. In Experiment 1a observers identified celebrity faces that began blurred and then clarified (Forward baseline), or indicated when faces that began clear and then blurred were no longer recognisable (Backward baseline). In surprise memory tests that followed, observers adjusted the degree of blur of each face to match what the faces looked like when identified in the corresponding baseline condition. Hindsight bias was observed in the Forward condition: During the memory test observers adjusted the faces to be more blurry than when originally identified during baseline. These same observers did not show hindsight bias in the Backward condition: Here, they adjusted faces to the exact blur level at which they identified the faces during baseline. Experiment 1b tested a combined condition in which faces were viewed in a Forward progression at baseline but in a Backward progression at test. Hindsight bias was observed in this condition but was significantly less than the bias observed in the Experiment 1a Forward condition. Experiments 1a and 1b provide support for the fluency-misattribution account of visual hindsight bias: When observers are made aware of why fluency has been enhanced (i.e., in the Backward condition) they are better able to discount it, and as a result show reduced or no hindsight bias. In Experiment 2, observers viewed faces in a Forward progression at baseline and then in a Forward upright or inverted progression at test. Hindsight bias occurred in both conditions, but was greater for upright than inverted faces. We conclude that both conceptual and perceptual fluency contribute to visual hindsight bias.