Internet-Based,Unproctored Assessments on Mobile and Non-Mobile Devices: Usage,Measurement Equivalence,and Outcomes

Purpose

The purpose of this study was to determine the usage rates, measurement equivalence, and potential outcome differences between mobile and non-mobile device-based deliveries of an unproctored, non-cognitive assessment.

Design/Methodology/Approach

This study utilized a quasi-experimental design based on archival data obtained from applicants who completed a non-cognitive assessment on a mobile (n = 7,743; e.g., smartphones, tablet computers) or non-mobile (n = 929,341; e.g., desktop computers) device as part of an operational, high-stakes pre-employment selection process.

Findings

One percent of applicants used mobile devices to complete the assessment. Multiple-group confirmatory factor analysis indicated the assessment was equivalent across mobile and non-mobile devices at the configural, metric, scalar, and latent mean levels. A comparison of observed score means using one-way and factorial ANOVAs demonstrated that the use of mobile and non-mobile devices did not produce any practically significant score differences on the assessment across devices or applicant demographic subgroups.

Implications

Industry and technological trends suggest mobile device usage will only increase. Thus, demonstrating that mobile device functionality and hardware characteristics do not change the psychometric functioning or applicant outcomes for a non-cognitive, text-based selection assessment is critical to talent assessment.

Originality/Value

This study provides the first empirical examination of the usage of mobile devices to complete talent assessments and their impact on assessment properties and applicant outcomes, and serves as the foundation for future research and application of this growing technological trend in pre-employment assessment.

     

Critical Theory as an Approach to the Ethics of Information Security

Information security can be of high moral value. It can equally be used for immoral purposes and have undesirable consequences. In this paper we suggest that critical theory can facilitate a better understanding of possible ethical issues and can provide support when finding ways of addressing them. The paper argues that critical theory has intrinsic links to ethics and that it is possible to identify concepts frequently used in critical theory to pinpoint ethical concerns. Using the example of UK electronic medical records the paper demonstrates that a critical lens can highlight issues that traditional ethical theories tend to overlook. These are often linked to collective issues such as social and organisational structures, which philosophical ethics with its typical focus on the individual does not tend to emphasise. The paper suggests that this insight can help in developing ways of researching and innovating responsibly in the area of information security.     

Lemurs and macaques show similar numerical sensitivity

We investigated the precision of the approximate number system (ANS) in three lemur species (Lemur catta, Eulemur mongoz, and Eulemur macaco flavifrons), one Old World monkey species (Macaca mulatta) and humans (Homo sapiens). In Experiment 1, four individuals of each nonhuman primate species were trained to select the numerically larger of two visual arrays on a touchscreen. We estimated numerical acuity by modeling Weber fractions (w) and found quantitatively equivalent performance among all four nonhuman primate species. In Experiment 2, we tested adult humans in a similar procedure, and they outperformed the four nonhuman species but showed qualitatively similar performance. These results indicate that the ANS is conserved over the primate order.     

Establishing the Cross-Situational Convergence of the Ability to Identify Criteria: Consistency and Prediction Across Similar and Dissimilar Assessment Center Exercises

In selection contexts, applicants’ ability to identify criteria (ATIC) refers to individual differences in the accuracy of perceptions with regard to what is required to be successful in evaluative situations. Despite promising findings regarding this construct, the cross-situational consistency necessary to infer that ATIC is a stable characteristic has generally been assessed in situations that have similar demands in terms of the competencies required for success. The purpose of this study was to provide a strong test of the theory underlying the construct by examining convergence in ATIC scores across assessment center (AC) exercises with very different demands. Participants (N?=?173) of a developmental AC completed 6 exercises and made ATIC judgments following the completion of each exercise. These judgments were used to create ATIC scores and to examine the consistency of these scores across exercises with similar and dissimilar demands. Results showed that ATIC scores converged across both similar and dissimilar exercises. Furthermore, participants who shifted their perceptions across dissimilar exercises the most were those who scored high in ATIC, whereas across similar exercises those who scored high in ATIC were those who evaluated the situations more similarly. Overall, ATIC demonstrated strong predictive ability, as it correlated with overall AC performance (r = .40) and predicted performance equally well across pairs of similar and dissimilar exercises.     

Effects of Applicant Personality on Resume Evaluations

Purpose

This study examined the extent that personality information in resumes impacts hiring judgments through applicant’s resumes. Study 1 examined lay theories regarding relationships between resume cues and the applicant’s personality and hireability. Study 2 examined how the applicant’s personality impacted hiring judgments through resumes.

Design/Methodology/Approach

Data for both studies were collected in the context of a managerial position. For Study 1, participants assessed resume cues in regards to their relationship with personality and hireability. For Study 2, Human Resource personnel evaluated each resume in regards to personality and hireability.

Findings

Results for Study 1 highlight several connections between applicants’ personality and resumes, with strong links between resume content and perceptions of conscientiousness and agreeableness. Results for Study 2 indicate that personality was largely unrelated to ratings of hireability but perceptions of personality were strongly linked to hireability; actual personality was linked to the variability in cue information related to hireability, and conscientiousness was indirectly related to hireability through judgments of conscientiousness.

Implications

Results from these studies suggest that personality and perceptions of personality play a greater role in resume development and screening than has been previously suggested. The pattern of results reported suggest that there are a number of resumes cues that accurately reflect an applicant’s personality and influence perceptions of hireability.

Originality/Value

By taking an exploratory approach, the current studies were able to explore a large variety of cues linked to personality and ratings of hireability. Results have implications for both applicants and HR personnel evaluating resumes.     

Establishing the Measurement Equivalence of Online Selection Assessments Delivered on Mobile versus Nonmobile Devices

Recent usage data suggest job applicants are completing online selection assessments using mobile devices (e.g., smartphones) in greater numbers. To determine the appropriateness of this new technology, this study examined the measurement equivalence of selection assessments delivered on mobile and nonmobile devices (e.g., personal computers). Measurement invariance tests conducted with multigroup confirmatory factor analysis suggest mobile versions of a cognitive ability‐type assessment, two biodata assessments, a multimedia work simulation, and a text‐based situational judgment test appear to be equivalent to nonmobile versions. However, mobile device user latent means were half a standard deviation lower than their nonmobile counterparts for the situational judgment test. Implications for mobile device usage within selection and assessment are discussed.     

Knowledge and Other Norms for Assertion,Action, and Belief: A Teleological Account

Here I advance a unified account of the structure of the epistemic normativity of assertion, action, and belief. According to my Teleological Account , all of these are epistemically successful just in case they fulfill the primary aim of knowledgeability, an aim which in turn generates a host of secondary epistemic norms. The central features of the Teleological Account are these: it is compact in its reliance on a single central explanatory posit, knowledge‐centered in its insistence that knowledge sets the fundamental epistemic norm, and yet fiercely pluralistic in its acknowledgment of the legitimacy and value of a rich range of epistemic norms distinct from knowledge. Largely in virtue of this pluralist character, I argue, the Teleological Account is far superior to extant knowledge‐centered accounts.     

On Representations of Intended Structures in Foundational Theories

Journal of Philosophical Logic - Often philosophers, logicians, and mathematicians employ a notion of intended structure when talking about a branch of mathematics. In addition, we know that there...     

Can a mind have two time lines? Exploring space-time mapping in Mandarin and English speakers

Spatial representations of time are a ubiquitous feature of human cognition. Nevertheless, interesting sociolinguistic variations exist with respect to where in space people locate temporal constructs. For instance, while in English time metaphorically flows horizontally, in Mandarin an additional vertical dimension is employed. Noting that the bilingual mind can flexibly accommodate multiple representations, the present work explored whether Mandarin–English bilinguals possess two mental time lines. Across two experiments, we demonstrated that Mandarin–English bilinguals do indeed employ both horizontal and vertical representations of time. Importantly, subtle variations to cultural context were seen to shape how these time lines were deployed.     

The Arguments of the Tombs of the Unknown: Relationality and National Legitimation

In the wake of the First World War, a new form of commemoration emerged internationally, but in each case focused upon a new kind of national “hero”—the unknown soldier or warrior. The first instances appeared in France and Britain in 1920, followed by the United States in 1921, and Belgium in 1922. Other nations followed suit over the years, with the most recent WWI Unknown Soldier monument dedicated in 2004, in New Zealand. The motivational calculus of these national tombs was, of course, the massive number of combatant dead whose remains could not be identified. This paper takes up the two very different arguments composed by these commemorative sites. The first argument was directed to surviving family members and was articulated most explicitly by the French as a hypothetical enthymeme “this could be your husband, your father, your brother,” etc. The second argument has been directed to national and international collectives as a constitutive proclamation of legitimated nation-state or Empire Although this argument is particularly explicit in postcolonial gestures of independence on the part of former dominions of old empires, it was evident in even the earliest cases of the tombs of the unknown.