Rater Model Using Signal Detection Theory for Latent Differential Rater Functioning

Differential rater functioning (DRF) occurs when raters show evidence of exercising differential severity or leniency when scoring examinees within different subgroups. Previous studies of DRF have examined rater bias using manifest variables (e.g., use of covariates) to determine the subgroups. These manifest variables include gender and the ethnicity of the examinee. For example, a rater may score males more severely. Ideally, each rater’s severity should be invariant across subgroups. This study examines DRF in the context of latent subgroups that classify possible sources of DRF based on raters’ scoring behavior rather than manifest factors. An extension of the latent class signal detection theory (LC-SDT) model for identifying DRF is proposed and examined using real-world data and simulations. Results from real-world data show that the signal detection approach leads to an effective method to identify latent DRF. Simulations with varying sample sizes and conditions of rater precision were shown to recover parameters at an adequate level, supporting its use to identify latent DRF in large-scale data. These findings suggest that the DRF extension of the LC-SDT can be a useful model to examine characteristics of raters and add information that can aid rater training.     

Out-of-bag Prediction Error: A Cross Validation Index for Generalized Structured Component Analysis

Cross validation is a useful way of comparing predictive generalizability of theoretically plausible a priori models in structural equation modeling (SEM). A number of overall or local cross validation indices have been proposed for existing factor-based and component-based approaches to SEM, including covariance structure analysis and partial least squares path modeling. However, there is no such cross validation index available for generalized structured component analysis (GSCA) which is another component-based approach. We thus propose a cross validation index for GSCA, called Out-of-bag Prediction Error (OPE), which estimates the expected prediction error of a model over replications of so-called in-bag and out-of-bag samples constructed through the implementation of the bootstrap method. The calculation of this index is well-suited to the estimation procedure of GSCA, which uses the bootstrap method to obtain the standard errors or confidence intervals of parameter estimates. We empirically evaluate the performance of the proposed index through the analyses of both simulated and real data.     

Why does impression management positively influence interview ratings? The mediating role of competence and warmth

Though interviews assess job applicants' skills and abilities, they can be influenced by extraneous factors, including impression management (IM) tactics. Interviewees’ self‐promotion and ingratiation IM tactics predict higher interview ratings; however, researchers have yet to determine why these tactics work. We assessed whether two fundamental dimensions of social perception, competence and warmth, mediate the relationship between IM tactics and interview ratings. We hypothesized that interviewee competence mediates the relationship between self‐promotion and interview ratings, and interviewee warmth mediates the relationship between ingratiation and interview ratings. Using real employment interviews, we found that competence mediates the relationship between self‐promotion and interview ratings, but warmth did not mediate the relationship between ingratiation and interview ratings in the way we expected.     

Item response theory analyses of the Delis-Kaplan Executive Function System card sorting subtest

In the current study, we examined the dimensionality of the 16-item Card Sorting subtest of the Delis-Kaplan Executive Functioning System assessment in a sample of 264 native English-speaking children between the ages of 9 and 15 years. We also tested for measurement invariance for these items across age and gender groups using item response theory (IRT). Results of the exploratory factor analysis indicated that a two-factor model that distinguished between verbal and perceptual items provided the best fit to the data. Although the items demonstrated measurement invariance across age groups, measurement invariance was violated for gender groups, with two items demonstrating differential item functioning for males and females. Multigroup analysis using all 16 items indicated that the items were more effective for individuals whose IRT scale scores were relatively high. A single-group explanatory IRT model using 14 non-differential item functioning items showed that for perceptual ability, females scored higher than males and that scores increased with age for both males and females; for verbal ability, the observed increase in scores across age differed for males and females. The implications of these findings are discussed.     

How Power States Influence the Persuasiveness of Top‐Dog versus Underdog Appeals

Although both top‐dog and underdog positioning appeals are widely used in marketing and advertising, little is known about which strategy is more effective in persuading consumers. By introducing a sense of power, a social variable that is inherently relevant to the nature of the top‐dog versus underdog classification, we propose that consumers' responses to these two appeals are influenced by their psychological experience of power. Specifically, low‐power consumers will respond to top‐dog appeals more favorably because associating with top dogs facilitates power restoration. In contrast, high‐power consumers will respond to underdog appeals more favorably because supporting underdogs facilitates power expression. In four experimental studies, we provide consistent support for our main predictions as well as the underlying processes. Studies 1 and 2 demonstrate the differential effect of consumers' power states on their attitudes toward top‐dog versus underdog appeals. Providing process evidence, Studies 3 and 4 identify boundary conditions under which the basic effect was eliminated. These findings contribute to the persuasion literature and power research and provide important implications for positioning strategy and advertisement development.     

The effect of presentation format and encoding strategy on associative memory distortion

IntroductionPrevious studies using semantically related words revealed more accurate memory when the items were encoded visually rather than auditorily and when mental images were created during encoding. However, how the level of memory distortion is affected by the creation of different mental imagery formats or by techniques that should suppress generation of mental images has rarely been investigated.ObjectiveThe aim of the present studies was to investigate the ways in which the encoding strategy affects the accuracy of memory reports for two presentation formats of semantically related words: verbal and pictorial.MethodIn experiment 1, the participants were asked to memorize either pictures or their verbal equivalents (words) from the same category, using one of two encoding strategies: uttering the words or counting backwards. In experiment 2, pictorially or auditory presented material was encoded together with the creation of either visual or auditory mental images of the items. The results of the experimental groups were compared to control groups that received no specific instruction.ResultsHigher levels of false recognition, together with lower rates of correct recognition, were observed for words, presented either visually or auditory, relative to pictures. Moreover, self-generation of additional code during the processing of information favored the reduction of false recognitions.ConclusionEncoding strategies that engaged dual coding reduced false recognition. The results are discussed within the distinctiveness heuristic phenomenon.     

Children’s scale errors are a natural consequence of learning to associate objects with actions: A computational model

Young children sometimes attempt an action on an object, which is inappropriate because of the object size—they make scale errors. Existing theories suggest that scale errors may result from immaturities in children's action planning system, which might be overpowered by increased complexity of object representations or developing teleofunctional bias. We used computational modelling to emulate children's learning to associate objects with actions and to select appropriate actions, given object shape and size. A computational Developmental Deep Model of Action and Naming (DDMAN) was built on the dual‐route theory of action selection, in which actions on objects are selected via a direct (nonsemantic or visual) route or an indirect (semantic) route. As in case of children, DDMAN produced scale errors: the number of errors was high at the beginning of training and decreased linearly but did not disappear completely. Inspection of emerging object–action associations revealed that these were coarsely organized by shape, hence leading DDMAN to initially select actions based on shape rather than size. With experience, DDMAN gradually learned to use size in addition to shape when selecting actions. Overall, our simulations demonstrate that children's scale errors are a natural consequence of learning to associate objects with actions.     

Same face,same place,different memory: manner of presentation modulates the associative deficit in older adults

One of the more severe and consequential memory impairments experienced by older adults is the loss of the ability to form and remember associations. Although the associative deficit is often assumed to be unitary, memory episodes may contain different types of associations (e.g., item–item, item–context). Research in younger adults suggests that these different association types may involve different neural mechanisms. This raises the possibility that different association types are not equally affected by aging. In order to investigate this, the current study directly compared memory across item–item and item–context associations in younger and older adults by manipulating the manner of presentation of the associations. Results indicate that the associative deficit in aging is not uniform and that aging has a greater impact on item–context compared to item–item associations. The results have implications for theories of associative memory, age-related cognitive decline, and the functional organization of the medial temporal lobe in aging.