Combining mixture distribution and multidimensional IRTree models for the measurement of extreme response styles

Personality constructs, attitudes and other non-cognitive variables are often measured using rating or Likert-type scales, which does not come without problems. Especially in low-stakes assessments, respondents may produce biased responses due to response styles (RS) that reduce the validity and comparability of the measurement. Detecting and correcting RS is not always straightforward because not all respondents show RS and the ones who do may not do so to the same extent or in the same direction. The present study proposes the combination of a multidimensional IRTree model with a mixture distribution item response theory model and illustrates the application of the approach using data from the Programme for the International Assessment of Adult Competencies (PIAAC). This joint approach allows for the differentiation between different latent classes of respondents who show different RS behaviours and respondents who show RS versus respondents who give (largely) unbiased responses. We illustrate the application of the approach by examining extreme RS and show how the resulting latent classes can be further examined using external variables and process data from computer-based assessments to develop a better understanding of response behaviour and RS.     

Poisson Multilevel Models with Small Samples

Recent methodological studies have investigated the properties of multilevel models with small samples. Previous work has primarily focused on continuous outcomes and little attention has been paid to count outcomes. The estimation of count outcome models can be difficult because the likelihood has no closed-form solution, meaning that approximation methods are required. Although adaptive Gaussian quadrature (AGQ) is generally seen as the gold standard, its comparative performance has been investigated with larger samples. AGQ approximates the full likelihood, a function that is known to produce biased estimates with small samples with continuous outcomes. Conversely, penalized quasi-likelihood (PQL) is considered to be a less desirable approximation; however, it can approximate the restricted likelihood function, a function that is known to perform well with smaller samples with continuous outcomes. The goal of this paper is to compare the small sample bias of full likelihood methods to the linearization bias of PQL with restricted likelihood. Simulation results indicate that the linearization bias of PQL is preferable to the finite sample bias of AGQ with smaller samples.     

Students' Ethical Decision‐Making When Considering Boundary Crossings With Counselor Educators

Counselor education students (N = 224) rated 16 boundary‐crossing scenarios involving counselor educators. They viewed boundary crossings as unethical and were aware of power differentials between the 2 groups. Next, they rated the scenarios again, after reviewing 1 of 4 ethical informational resources: relevant standards in the ACA Code of Ethics (American Counseling Association, 2014), 2 different boundary‐crossing decision‐making models, and a placebo. Although participants rated all resources except the placebo as moderately helpful, these resources had little to no influence on their ethical decision‐making. Only 47% of students in the 2 ethical decision‐making model groups reported they would use the model they were exposed to in the future when contemplating boundary crossings     

A step forward: Bayesian hierarchical modelling as a tool in assessment of individual discrimination performance

Individual assessment of infants’ speech discrimination is of great value for studies of language development that seek to relate early and later skills, as well as for clinical work. The present study explored the applicability of the hybrid visual fixation paradigm (Houston et al., 2007) and the associated statistical analysis approach to assess individual discrimination of a native vowel contrast, /aː/ - /eː/, in Dutch 6 to 10-month-old infants. Houston et al. found that 80% (8/10) of the 9-month-old infants successfully discriminated the contrast between pseudowords boodup - seepug. Using the same approach, we found that 12% (14/117) of the infants in our sample discriminated the highly salient /aː/ -/eː/ contrast. This percentage was reduced to 3% (3/117) when we corrected for multiple testing. Bayesian hierarchical modeling indicated that 50% of the infants showed evidence of discrimination. Advantages of Bayesian hierarchical modeling are that 1) there is no need for a correction for multiple testing and 2) better estimates at the individual level are obtained. Thus, individual speech discrimination can be more accurately assessed using state of the art statistical approaches.     

Does attitude acquisition in evaluative conditioning without explicit CS-US memory reflect implicit misattribution of affect?

Research that dissociates different types of processes within a given task using a processing tree approach suggests that attitudes may be acquired through evaluative conditioning in the absence of explicit encoding of CS-US pairings in memory. This research distinguishes explicit memory for the CS-US pairings from CS-liking acquired without encoding of CS-US pairs in explicit memory. It has been suggested that the latter effect may be due to an implicit misattribution process that is assumed to operate when US evocativeness is low. In the present research, the latter assumption was supported neither by two high-powered experiments nor by complementary meta-analytic evidence, whereas evocativeness exerted an influence on explicit memory. This pattern of findings is inconsistent with the view that CS-liking acquired without encoding of CS-US pairs in explicit memory reflects an implicit misattribution process at learning. Hence, the underlying learning process is awaiting further empirical scrutiny.     

The stability of self-esteem variability: A real-time assessment

The present study investigates stability and variability as distinct features of state self-esteem change. The amount of variance attributable to stable individual differences, the association between successive self-esteem experiences, and situational and/or person × situation interaction effects were estimated in repeated measures of self-esteem whilst considering measurement invariance. N = 160 adolescents reported momentary self-esteem in an experience sampling study, (i.e., three assessments a day, over a 2-day period). Latent state-trait analysis indicate that change in state self-esteem is a stable process largely determined by interindividual differences in trait self-esteem, while the impact of occasion-specific influences is small. These intrinsic dynamics ensure consistent self-referential experiences. Results reveal experience sampling as a suitable method to track short-term changes of self-esteem.     

Using network science to analyze concept maps of psychology undergraduates

Network science is an emerging area of complexity science that uses mathematical techniques to study complex systems and could represent a new way of quantifying and investigating the internal structure of domain‐specific knowledge as approximated by students' concept maps. Students enrolled in introductory psychology constructed concept maps to represent their understanding of a psychology chapter. Concept networks were constructed based on the concept maps generated by students. Network analysis revealed that the structure of concept networks differed across students (i.e., some networks were better connected than others), and network structure significantly predicted quiz scores, such that concept networks with larger average shortest path lengths (a network metric representing the average of the shortest paths between two nodes in a network) were associated with higher quiz scores, after controlling for network size. This paper illustrates how network science techniques can be used to quantify the conceptual structure of a learner's knowledge.     

形声字的语义透明度和结构类型对义符语音激活进程的影响

采用启动命名任务考察形声字的语义透明度和结构类型对义符语音激活进程的影响。结果发现,透明汉字和不透明汉字的义符语音在SOA=50 ms时都出现了激活;在SOA=100 ms时,透明汉字的义符语音激活仍然显著,不透明汉字的义符语音激活消退了;到SOA=300 ms时,两类汉字的义符语音激活完全消退。左形右声结构汉字的义符语音在SOA=50 ms和SOA=100 ms时都出现了激活,右形左声结构汉字的义符语音只在SOA=50 ms时出现了微弱的激活。     

Adolescents' music preferences and personality characteristics

The present paper examined the structure of Dutch adolescents' music preferences, the stability of music preferences and the relations between Big‐Five personality characteristics and (changes in) music preferences. Exploratory and confirmatory factor analyses of music‐preference data from 2334 adolescents aged 12–19 revealed four clearly interpretable music‐preference dimensions: Rock, Elite, Urban and Pop/Dance. One thousand and forty‐four randomly selected adolescents from the original sample filled out questionnaires on music preferences and personality at three follow‐up measurements. In addition to being relatively stable over 1, 2 and 3‐year intervals, music preferences were found to be consistently related to personality characteristics, generally confirming prior research in the United States. Personality characteristics were also found to predict changes in music preferences over a 3‐year interval. Copyright © 2007 John Wiley & Sons, Ltd.