Driving tests with older patients: effect of unfamiliar versus familiar vehicle

The aim of the study was to study the effect, for older license holders, of taking a driving test with an unfamiliar vehicle, as compared to their own cars. The study population consisted of licensed patients 65–85 years referred to the Traffic Medicine Centre (TrMC), Huddinge University Hospital, for an evaluation of their medical and cognitive fitness to drive. In the clinical practice of TrMC, driving tests have been used since 1997, with inspectors from the Swedish National Road Administration (SNRA) acting as evaluators. Initially, patients were allowed to use their own cars. From the beginning of the year 2000, however, dual brakes were made mandatory and most evaluations were then made with SNRA cars. When comparing the outcomes of driving tests from the period prior to 2000 (n=96) and after 2000 (n=69), it was found that the number of drivers who failed the test increased by 16%. Also, those who passed the test after more than one trial decreased by 20%. The potential of the neuropsychological assessment to correctly classify drivers in outcome groups was considerably reduced in the period after 2000. These results support the view that, for older drivers with cognitive deterioration, the need to adapt to an unfamiliar vehicle represents a supplementary cognitive load that may compromise their driving ability and the validity of the assessment. A measure aimed only at increasing the safety of examiners and examinees thus had an unintended side-effect that is detrimental to older clinical populations.     

Rorschach Comprehensive System data for a sample of 357 Portuguese children at five ages

Eighteen examiners, well trained in the Comprehensive System (CS; Exner, 2003), administered the Rorschach to 357 Portuguese children, in the first through fifth grades, attending schools located in Lisbon and the surrounding neighborhood. Coding was done by 5 of the examiners, each one having more than 5 years of experience with the CS. For this study, coding was reviewed by the authors. Five records were randomly selected from each age group to assess intercoder reliability. Janson and Olsson's (2004) iota was used to assess reliability of the main variable categories. Results are high, with iota ranging from 0.87 to 0.98 across the coding categories. CS variables are presented and key data were chosen and reviewed. A discussion of some data and their comparison with corresponding American data are made, permitting some interesting developmental and cross-cultural questions to be addressed.     

Investigating Test-Taking Behaviors Using Timing and Process Data

The use of computer-based assessments makes the collection of detailed data that capture examinees’ progress in the tests and time spent on individual actions possible. This article presents a study using process and timing data to aid understanding of an international language assessment and the examinees. Issues regarding test-taking strategies, test speededness, test design, and their relationship to examinees’ demographic backgrounds and performance are also discussed.     

Driving examiners’ views on data-driven assessment of test candidates: An interview study

Vehicles are increasingly equipped with sensors that capture the state of the driver, the vehicle, and the environment. These developments are relevant to formal driver testing, but little is known about the extent to which driving examiners would support the use of sensor data in their job. This semi-structured interview study examined the opinions of 37 driving examiners about data-driven assessment of test candidates. The results showed that the examiners were supportive of using data to explain their pass/fail verdict to the candidate. According to the examiners, data in an easily accessible form such as graphs of eye movements, headway, speed, or braking behavior, and color-coded scores, supplemented with camera images, would allow them to eliminate doubt or help them convince disagreeing test-takers. The examiners were skeptical about higher levels of decision support, noting that forming an overall picture of the candidate’s abilities requires integrating multiple context-dependent sources of information. The interviews yielded other possible applications of data collection and sharing, such as selecting optimal routes, improving standardization, and training and pre-selecting candidates before they are allowed to take the driving test. Finally, the interviews focused on an increasingly viable form of data collection: simulator-based driver testing. This yielded a divided picture, with about half of the examiners being positive and half negative about using simulators in driver testing. In conclusion, this study has provided important insights regarding the use of data as an explanation aid for examiners. Future research should consider the views of test candidates and experimentally evaluate different forms of data-driven support in the driving test.     

Facial comparison behaviour of forensic facial examiners

Facial examiners make visual comparisons of face images to establish the identities of persons in police investigations. This study utilised eye-tracking and an individual differences approach to investigate whether these experts exhibit specialist viewing behaviours during identification, by comparing facial examiners with forensic fingerprint analysts and untrained novices across three tasks. These comprised of face matching under unlimited (Experiment 1) and time-restricted viewing (Experiment 2), and with a feature-comparison protocol derived from examiner casework procedures (Experiment 3). Facial examiners exhibited individual differences in facial comparison accuracy and did not consistently outperform fingerprint analysts and novices. Their behaviour was also marked by similarities to the comparison groups in terms of how faces were viewed, as evidenced from eye movements, and how faces were perceived, based on the made feature judgements and identification decisions. These findings further understanding of how facial comparisons are performed and clarify the nature of examiner expertise.     

允许检查并修改答案的计算机化自适应测验

采用计算机模拟程序对允许检查并修改答案的计算机化自适应测验（CAT）进行研究,并采用新的评分方式对付Wainer策略。结果表明：综合考虑被试的两次作答信息可以得到更精确的能力估计值。大部分被试进行了修改,只有少部分答案被修改,在被修改的答案中大部分是由错误改为正确;综合Wainer策略CAT的后验分布期望值（EAP）和极大似然估计值（MLE）可以“粗糙”对付Wainer策略     

Depressed mothers' assessments of their neonates' behaviors

Neonates were assessed at delivery and again at 1 month by examiners and by their depressed or nondepressed mothers. Examiner assessments were conducted using the Brazelton Neonatal Behavioral Assessment Scale (NBAS). Maternal assessments were conducted by mothers using a simplified version of the NBAS, the Mother's Assessment of the Behavior of her Infant (MABI). Examiners rated neonates of depressed mothers lower than infants of nondepressed mothers on state organization. At delivery, newborn infants of depressed mothers were given lower state regulation scores by their mothers than by the examiners and, 1 month later, examiners’ state regulation ratings were as negative as those of the depressed mothers. Conversely, infants of nondepressed mothers were given higher social interaction scores by their mothers than by the examiners, and 1 month later, examiner ratings of social interaction were as positive as those of the nondepressed mothers. These findings suggest that infants of depressed mothers may be placed at risk by prenatal influences and by risks associated with maternal perceptions. Perceptions of infants appear to be colored by maternal depression status as early as the immediate postpartum period and, though “subjective,” these perceptions are predictive of infant outcomes.     

In the eye of the examinee: likable examiners interfere with performance

We investigated effects of examiners’ ascribed likability and examiners’ gender on test performance during a standardized face-to-face testing situation assessing self-estimated and de facto verbal knowledge. One hundred fourteen nonpsychology students were individually tested by one of 22 examiners. A moderated regression analysis revealed a significant three-way interaction of test taker’s gender, examiner’s gender, and examiner’s likability on de facto knowledge: Men and women showed lower scores on de facto knowledge with a same-gender examiner rated as likable compared to their performance with a likable opposite-gender examiner or in interaction with a nonlikable examiner.     

Computerized adaptive testing,anxiety levels,and gender differences

This study compares the amount of test anxiety experienced on a computerized adaptive test (CAT) to a paper-and-pencil test (P&P), as well as the state test anxiety experienced between males and females. Ninety-four middle school CAT examinees were compared to 65 middle school P&P examinees on their responses to the State-Trait Anxiety Inventory for Children (STAIC) after taking a standardized achievement test. Results of a multiple regression showed that P&P examinees had a higher mean STAIC score than CAT examinees after controlling for trait test anxiety and computer anxiety. Evidence of neither a main nor a moderator effect of gender was found. However, a subsequent path analysis gave evidence of an indirect effect of gender on STAIC score mediated by trait test anxiety. Results are discussed in the context of stereotype threat and the implications for the use of CAT in schools, given the digital divide between race and socioeconomic status. Recommendations for future research and practice are offered.     

The effects of prior expectations and outcome knowledge on polygraph examiners' decisions

The present study deals with the question of whether judgments made by experts working in familiar contexts are affected by prior expectations and beliefs. Two experiments in which prior expectations were manipulated were designed to determine whether and to what extent polygraph examiners are affected by their prior expectations when analyzing and interpreting polygraph charts. Prior expectations affected the examiners' judgments when the polygraph charts did not include clear indications of guilt or innocence, but when the objective physiological evidence included strong indications which clearly contradicted the examiner's expectations, judgments were not affected by these expectations. Theoretical and practical implications of these results are discussed.     

Heuristic cognitive diagnosis when the Q‐matrix is unknown

Cognitive diagnosis models of educational test performance rely on a binary Q‐matrix that specifies the associations between individual test items and the cognitive attributes (skills) required to answer those items correctly. Current methods for fitting cognitive diagnosis models to educational test data and assigning examinees to proficiency classes are based on parametric estimation methods such as expectation maximization (EM) and Markov chain Monte Carlo (MCMC) that frequently encounter difficulties in practical applications. In response to these difficulties, non‐parametric classification techniques (cluster analysis) have been proposed as heuristic alternatives to parametric procedures. These non‐parametric classification techniques first aggregate each examinee's test item scores into a profile of attribute sum scores, which then serve as the basis for clustering examinees into proficiency classes. Like the parametric procedures, the non‐parametric classification techniques require that the Q‐matrix underlying a given test be known. Unfortunately, in practice, the Q‐matrix for most tests is not known and must be estimated to specify the associations between items and attributes, risking a misspecified Q‐matrix that may then result in the incorrect classification of examinees. This paper demonstrates that clustering examinees into proficiency classes based on their item scores rather than on their attribute sum‐score profiles does not require knowledge of the Q‐matrix, and results in a more accurate classification of examinees.     

The relationship of individual and communal state-trait coping and interpersonal resources as trust,empathy and responsibility

Prior research and theoretical considerations revealed important information about the role of individual state-trait coping and personal resources for coping with an examination. However, the relationship between communal coping strategies and interpersonal resources has yet to be investigated. In order to understand the relationship between state-trait coping and interpersonal resources, several statistical analyses were used. The German Strategic Approach to Coping Scale (GSACS, GSACS-Exam), the Interpersonal Trust Scale (ITS), and exam-specific Empathy and Responsibility Scales (RESP-Exam, EMP-Exam) were combined for collecting data from a sample of 122 examiner-examinee-dyads. Data on empathy and responsibility of examiners were gathered as well as dispositional coping styles and trust of examinees eight weeks prior to an oral examination. Dispositional coping predicted comparable situational coping, reported immediately after the examination at a low-moderate level. Communal coping strategies tended to vary more than individual ones. Interpersonal resources were found to predict specific communal coping responses and a path model revealed the mediating effect of interpersonal trust. The results are discussed in the light of communal coping theory and educational significance.     

Optimal appropriateness measurement

The test-taking behavior of some examinees may be so idiosyncratic that their test scores may not be comparable to the scores of more typical examinees. Appropriateness measurement attempts to use answer patterns to recognize atypical examinees. In this report appropriateness measurement procedures are viewed as statistical tests for choosing between a null hypothesis of normal test-taking behavior and an alternative hypothesis of atypical test-taking behavior. Most powerful tests for inappropriateness are described together with methods for computing their power. A recursion greatly simplifying the calculation of optimal test statistics is described and illustrated.The work reported in this article was supported by United States Office of Naval Research contracts N00014-79C-0752, NR 154-445 and N00014-83K-0397, NR 150-518, Michael V. Levine, Principal Investigator.     

RETEST EFFECTS ON IDENTICAL AND PARALLEL FORMS IN CERTIFICATION AND LICENSURE TESTING

Examinees who take credentialing tests and other types of high-stakes assessments are usually provided an opportunity to repeat the test if they are unsuccessful on initial attempts. To prevent examinees from obtaining unfair score increases by memorizing the content of specific test items, testing agencies usually assign an alternate form to repeat examinees. Given that the use of multiple forms presents both practical and psychometric challenges, it is important to determine if unwarranted score gains occur. Most research indicates that repeat examinees realize score gains when taking the same form twice; however, the research is far from conclusive, particularly within the context of credentialing. For the present investigations, two samples of repeat examinees were randomly assigned to receive either the same test form or a different, but parallel, form on the second occasion. Study 1 found score gains of about 0.79 SD units for 71 examinees who repeated a certification examination in computed tomography. Study 2 found gains of 0.48 SD units for 765 examinees who repeated a radiography certification examination. In both studies score gains for examinees receiving the parallel test were nearly indistinguishable from score gains for those who received the same test. Factors are identified that may influence the generalizability of these findings to other assessment contexts.     

Blame game in private investigation reports: The case of Deloitte examination at Telenor VimpelCom

Business and public organisations hire fraud examiners to conduct private investigations when there is suspicion of misconduct or financial crime. Fraud examiners carry out their investigation based on a mandate. Often, individuals in the organisation are suspects. The blame game hypothesis is concerned with factors that cause blame attribution to some individuals but not to others. In this case study, only executives were blamed who had not disclosed corruption information to a major shareholder and to the chief executive officer.     

The Loneliness Questionnaire–Short Version: An Evaluation of Reverse-Worded and Non-Reverse-Worded Items Via Item Response Theory

Two Rorschachs were inadvertently administered to the same client within a period of three months. Although the ensuing personality pictures were very similar, an important difference appeared. The first Rorschach report stopped with the client's present condition. The second report saw the protocol as an interim Rorschach, suggesting the possibility that positive changes could lie ahead, if the client were given the appropriate help. The point is made that unwittingly, examiners may do their clients harm by not thinking ahead, in a way which the Rorschach uniquely makes possible. The Rorschach record and graph are presented, along with the various evidences of potential change. In conclusion, a problem is raised concerning the obligation inherent in the examiner-client relationship.     

New application of psychology to law: Improving forensic evidence and expert witness contributions

Psychology has made a tremendous contribution to law by showing the malleability of eyewitness perception and memory, and developing best practices for obtaining eyewitness identifications. We suggest that even expert scientific witnesses, which the court heavily relies on as objective and impartial, are also susceptible to bias from various psychological influences. For example, forensic examiners’ interactions with detectives and exposure to information about the case can bias their judgments. We discuss the ten commentaries on these issues across a range of forensic science domains, and affirm what reforms are needed.     

ON THE NEED FOR QUALITY CONTROL IN VALIDATION RESEARCH

The aptitude tests used to help make personnel decisions about military recruits were validated against hands-on tests of job performance in two Marine Corps occupational specialties, radio repairers and automotive mechanics. The tests were administered by Marine Corps noncommissioned officers. Marine Corps units provided the test administrators, testing facilities, and examinees. Data collected under such conditions are filled with errors that reduce the accuracy of validity coefficients. This paper shows how validity coefficients can be made more accurate by exercising quality control during the statistical analysis.     

THE EFFECTS OF REQUIRED ELABORATION OF ANSWERS TO BIODATA QUESTIONS

The impact of a request that examinees elaborate on their answers to a subset of items in a biodata instrument was evaluated. Four forms of a test in which different subsets of items are elaborated were randomly administered to 4 groups of examinees taking a pilot form of a selection instrument for a civil service position. Results indicated significantly lower scores on items for which elaborations were requested than the items for which no elaborations were requested. Lower scores were also observed for nonelaborated items when these items were embedded among those that were elaborated, and lower scores were found when the elaborated items were presented only in the first half of the test. Although the results suggest that requiring elaborated answers may reduce scores on biodata items, several practical and theoretical questions should be investigated to determine the utility of this approach as a method of reducing socially desirable responding.