Cheating,Reactions, and Performance in Remotely Proctored Testing: An Exploratory Experimental Study

Purpose

We sought to provide empirical insight and develop theory for a new organizational phenomenon: remote proctoring for Internet-based tests. We examined whether this technology is effective at decreasing cheating and whether it has unintended effects on test-taker reactions, performance, or selection procedures.

Design/methodology/approach

Participants (582) were randomly assigned to a webcam proctored or honor code condition and completed two (one searchable, one non-searchable) cognitive ability tests online. Complete data were collected from 295 participants. We indirectly determined levels of cheating by examining the pattern of test-score differences across the two conditions. We directly measured dropout rates, test performance, and participants’ perceived tension and invasion of privacy.

Findings

The use of remote proctoring was associated with more negative test-taker reactions and decreased cheating. Remote proctoring did not directly affect test performance or interact with individual differences to predict test performance or test-taker reactions.

Implications

Technological advances in selection should be accompanied by empirical evidence. Although remote proctoring may be effective at decreasing cheating, it may also have unintended effects on test-taker reactions. By outlining an initial classification of remote proctoring technology, we contribute to the theoretical understanding of technology-enhanced assessment, while providing timely insight into the practice of Internet-based testing.

Originality/value

We provide timely insight into the development and evaluation of remotely proctored tests. The current study utilizes a unique randomized experimental design in order to indirectly determine levels of cheating across two conditions. Following the results of the current study, we outline an integrative model for future research on remotely proctored tests.     

Addressing Barriers to Change in the Treatment of Childhood Obsessive Compulsive Disorder

Although considerable evidence supports the use of cognitive behavior therapy (CBT) for the treatment of childhood obsessive compulsive disorder, large numbers of youth fail to respond and clinical remission is often elusive. Poor family functioning frequently is implicated as an obstacle for youth undergoing CBT, with features such as symptom accommodation, family conflict, and blame known to attenuate outcomes. These features are common in child and adolescent obsessive compulsive disorder (OCD) and they may pose particular challenges for exposure-based treatments. Nonetheless, interventions that focus specifically on family functioning have, to date, been limited. This paper reviews the literature on family features associated with childhood OCD and discusses their links to treatment outcome. It then describes the development of a brief family intervention tailored to address the needs of highly distressed families of youth with OCD in the service of improving individual child CBT outcomes. Preliminary pilot data are presented and clinical implications are discussed.     

Assessing Stability and Change in a Second-Order Confirmatory Factor Model of Meaning in Life

Research indicates that meaning in life is an important correlate of health and well-being. However, relatively little is known about the way a sense of meaning may change over time. The purpose of this study is to explore two ways of assessing change in meaning within a second-order confirmatory factor analysis framework. First, tests are conducted to see if the first and second-order factor loadings and measurement error terms are invariant over time. Second, a largely overlooked technique is used to assess change and stability in meaning at the second-order level. Findings from a nationwide survey reveal that the first and second-order factor loadings are invariant of time. Moreover, the second-order measurement error terms, but not the first-order measurement error terms, are invariant, as well. The results further reveal that standard ways of assessing stability mask significant change in meaning that is due largely to regression to the mean.     

Personalized Genomic Results: Analysis of Informational Needs

Use of genomic information in healthcare is increasing; however data on the needs of consumers of genomic information is limited. The Coriell Personalized Medicine Collaborative (CPMC) is a longitudinal study investigating the utility of personalized medicine. Participants receive results reflecting risk of common complex conditions and drug—gene pairs deemed actionable by an external review board. To explore the needs of individuals receiving genomic information we reviewed all genetic counseling sessions with CPMC participants. A retrospective qualitative review of notes from 157 genetic counseling inquiries was conducted. Notes were coded for salient themes. Five primary themes; “understanding risk”, “basic genetics”, “complex disease genetics”, “what do I do now?” and “other” were identified. Further review revealed that participants had difficulty with basic genetic concepts, confused relative and absolute risks, and attributed too high a risk burden to individual single nucleotide polymorphisms (SNPs). Despite these hurdles, counseled participants recognized that behavior changes could potentially mitigate risk and there were few comments alluding to an overly deterministic or fatalistic interpretation of results. Participants appeared to recognize the multifactorial nature of the diseases for which results were provided; however education to understand the complexities of genomic risk information was often needed.     

Use of Psychiatric Medications in Juvenile Detention Facilities and the Impact of State Placement Policy

The use of psychotropic medications is a significant factor in the overall effort to respond to detained youth with mental illness, yet there are very few studies of psychotropic medication use in juvenile detention settings. It is important to understand the factors that influence the use of mental health services and psychoactive medications in these settings since youth with emotional problems are overrepresented in them. This paper addresses the proportion of youth in these settings who receive mental health services and psychoactive medications. In addition, the impact of a major statewide policy change—the shift of juvenile placement responsibility from the state to local government—on these proportions was examined using 8 years of publicly available data from county probation departments. Multivariate regression analyses of 1,760 observations of quarterly reports from 55 counties showed that the use of both mental health services and psychoactive medications in detention facilities increased concurrently with the policy change. While these proportions had already been gradually increasing in these facilities, it appears that after the policy change they increased even more. This contradicts the aim of most juvenile justice planners—to divert non-violent youth offenders with emotional problems away from incarceration settings and towards community based treatment alternatives. If adequately available, these support services could provide diversion alternatives to prevent inappropriate detentions, and to provide post-detention treatment to prevent lapses in continuity of care and, ultimately, to prevent reoffending.     

Aggression Norms in the Classroom Social Network: Contexts of Aggressive Behavior and Social Preference in Middle Childhood

In a cross‐sectional sample of African‐American 2nd–4th grade students (N = 681), we examine the moderating effects of classroom overt and relational aggression norms on peers’ social acceptance of classmates who exhibit overt and relational aggression in urban schools. Extending theory and research on classroom norms, we integrate social network data to adjust aggression norms based on children’s direct and indirect connections in the classroom. Results of multilevel models indicate that network‐based classroom aggression norms moderated relations between children’s aggressive behavior and their social preference. Specifically, children benefited socially when their form of aggressive behavior fit with what was normative in the classroom social context. The moderating effect of classroom aggression norms was stronger for the association between overt aggression and social preference than relational aggression and social preference. Relationally aggressive youth were socially preferred by peers regardless of the classroom norm, although this positive association was magnified in classrooms with higher levels of relational aggression. Future research focused on aggression norms within classroom social networks are discussed and implications for school prevention efforts are considered.     

Waiting When Both Certainty and Magnitude Are Increasing: Certainty Overshadows Magnitude

In everyday decision making, people often face decisions with outcomes that differ on multiple dimensions. The trade‐off in preferences between magnitude, temporal proximity, and probability of an outcome is a fundamental concern in the decision‐making literature. Yet, their joint effects on behavior in an experience‐based decision‐making task are understudied. Two experiments examined the relative influences of the magnitude and probability of an outcome when both were increasing over a 10‐second delay. A first‐person shooter video game was adapted for this purpose. Experiment 1 showed that participants waited longer to ensure a higher probability of the outcome than to ensure a greater magnitude when experienced separately and together. Experiment 2 provided a precise method of comparing their relative control on waiting by having each increase at different rates. Both experiments revealed a stronger influence of increasing probability than increasing magnitude. The results were more consistent with hyperbolic discounting of probability than with cumulative prospect theory's decision weight function. Copyright © 2014 John Wiley & Sons, Ltd.     

Grounding the Luck Objection

Many object to libertarianism by arguing that it manages to solve one problem of luck (the threat of determinism) only by falling prey to another (the threat from indeterminism). According to this objection, there is something freedom-undermining about the very circumstances that the libertarian thinks are required for freedom. However, it has proved difficult to articulate precisely what it is about these circumstances that is supposed to undermine freedom—the absence of certain sorts of explanations has perhaps been the most common complaint. In this paper, however, I argue that recent work on the metaphysics of ontological dependence provides the resources for formulating the luck objection in its strongest form.