Three-level meta-analysis of dependent effect sizes

Although dependence in effect sizes is ubiquitous, commonly used meta-analytic methods assume independent effect sizes. We describe and illustrate three-level extensions of a mixed effects meta-analytic model that accounts for various sources of dependence within and across studies, because multilevel extensions of meta-analytic models still are not well known. We also present a three-level model for the common case where, within studies, multiple effect sizes are calculated using the same sample. Whereas this approach is relatively simple and does not require imputing values for the unknown sampling covariances, it has hardly been used, and its performance has not been empirically investigated. Therefore, we set up a simulation study, showing that also in this situation, a three-level approach yields valid results: Estimates of the treatment effects and the corresponding standard errors are unbiased.     

Learning Impacts of a Digital Augmentation in a Science Museum

ABSTRACT

This study investigated the effects of using digital augmentation to enhance an exhibit device to influence conceptual understanding about a science topic in a science museum setting. In particular, the study considered how students in Grades 6–8 engaged with the device that was available in both augmented and nonaugmented (control) conditions. Results show increased cognitive (critical thinking) skills when the digital augmentation was present that we hypothesize led to increased conceptual gains. We illustrate how this research contributes to three important areas of need identified in informal science literature: the need for evidence of conceptual and cognitive gains; the need for understanding how digital platforms improve the learning experience; and the need to demonstrate how designed interactive devices may impact higher order skills such as critical thinking and theorizing.     

A cross-cultural study of hindsight bias and conditional probabilistic reasoning

Hindsight bias is a mistaken belief that one could have predicted a given outcome once the outcome is known. Choi and Nisbett (2000 Choi, I. and Nisbett, R. E. 2000. Cultural psychology of surprise: Holistic theories and recognition of contradiction. Journal of Personality and Social Psychology, 79: 890–905. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) reported that Koreans showed stronger hindsight bias than Americans, and explained the results using the distinction between analytic cognition (Westerners) and holistic cognition (Easterners). The purpose of the present study was to see whether hindsight bias is stronger among Easterners than among Westerners using a probability judgement task, and to test an “explicit–implicit” hypothesis and a “rule-dialectics” hypothesis. We predicted that the implicit process is more active among Easterners to generate hindsight bias, and that Easterners are more dialectical thinkers, whereas Westerners are more rule-based thinkers. French, British, Japanese, and Korean participants were asked to make probabilistic judgements in a Good Samaritan scenario (Experiment 1) and in a scenario including conditional probabilistic judgement (Experiment 2). In both Experiments, we presume that the implicit revision of causal models is made just by being given unexpected outcome information, and that explicit revision is made by being asked to point out possible factors for an unexpected outcome. In the results Easterners showed greater hindsight bias generally and it was greater in the Good Samaritan scenario. We conclude that the reason why hindsight bias was lower among Westerners is primarily that they tried to follow a rule to suppress the bias.     

A randomised Monty Hall experiment: The positive effect of conditional frequency feedback

The Monty Hall dilemma (MHD) is a notorious probability problem with a counterintuitive solution. There is a strong tendency to stay with the initial choice, despite the fact that switching doubles the probability of winning. The current randomised experiment investigates whether feedback in a series of trials improves behavioural performance on the MHD and increases the level of understanding of the problem. Feedback was either conditional or non-conditional, and was given either in frequency format or in percentage format. Results show that people learn to switch most when receiving conditional feedback in frequency format. However, problem understanding does not improve as a consequence of receiving feedback. Our study confirms the dissociation between behavioural performance on the MHD, on one hand, and actual understanding of the MHD, on the other. We discuss how this dissociation can be understood.     

Not all job demands are equal: Differentiating job hindrances and job challenges in the Job Demands–Resources model

This study aimed to integrate the differentiation between two types of job demands, as made in previous studies, in the Job–Demands Resources (JD-R) model. Specifically, this study aimed to examine empirically whether the differentiation between job hindrances and job challenges, next to the category of job resources, accounts for the unexpected positive relationships between particular types of job demands (e.g., workload) and employees' work engagement. Results of confirmatory factor analyses supported the differentiation between the three categories of job characteristics in two samples (N ₁ = 261 and N ₂ = 441). Further, structural equation modelling confirmed the hypotheses that job hindrances associate positively with exhaustion (i.e., the main component of burnout) and negatively with vigour (i.e., the main component of work engagement). Job resources displayed the reversed pattern of relations. Job challenges were positively related to vigour. Rather unexpectedly, they were unrelated to exhaustion. Based on these findings, we discuss the importance of the differentiation between different types of job demands in the JD-R model for both theory and practice.     

Leaders’ receptivity to subordinates’ creative input: The role of achievement goals and composition of creative input

We identified leaders’ achievement goals and composition of creative input as important factors that can clarify when and why leaders are receptive to, and supportive of, subordinates’ creative input. As hypothesized, in two experimental studies, we found that relative to mastery goal leaders, performance goal leaders were less receptive to subordinates’ voiced creative input. In Study 1, we further showed that image threat appraisal and learning opportunity appraisal mediated this effect. In Study 2, we demonstrated that when merely creative ideas were expressed by the subordinate, performance goal leaders responded like mastery goal leaders. However, as in Study 1, performance goal leaders were less receptive to, and less supportive of, subordinates’ creative input than mastery goal leaders when the composition of subordinates’ creative input included both problem identifications and creative ideas.     

Cognitive styles and person–environment fit: Investigating the consequences of cognitive (mis)fit

There is currently considerable interest in the key elements of person–environment fit to understand vocational behaviour and to develop strategic human resource management practices. In the light of this interest, we wanted to investigate (1) whether people within similar functions have similar cognitive styles, and (2) what the consequences of cognitive (mis)fit are on three work attitudes, using two large-scale databases (N = 24,267 and N = 2,182). We identified a knowing-oriented cognitive climate in finance, information technology (IT), and research and development (R&D) functions; a planning-oriented cognitive climate in administrative and technical and production functions; and a creating-oriented cognitive climate in sales and marketing functions and general management. Furthermore, we found that the relationship between people's cognitive styles and work attitudes (i.e., job satisfaction, job search behaviour, and intention to leave) does not depend on the cognitive climate in which they work. However, we did find that people with a higher creating style on average score higher on intention to leave and job search behaviour in comparison with people who score lower on the creating style, irrespective of the cognitive climate they are working in. The cognitive climate also partially affects job satisfaction and intention to leave after controlling for cognitive styles. In summary, cognitive styles and cognitive climate seem to have separate influences on people's work attitudes. Our findings are relevant for selection and recruitment policies of organizations and in the context of training, job design, and workforce planning.     

Recruitment sources and organizational attraction: A field study of Belgian nurses

Previous research on recruitment sources has mostly focused on posthire instead of prehire outcomes and has typically applied a very rudimentary classification of sources on the basis of the formal–informal distinction. The present study relied on a theory-driven taxonomy to identify four major types of recruitment sources (recruitment advertising, recruitment events, publicity, and word of mouth) and applied a source credibility perspective to predict differential relationships of these sources with organizational attractiveness. In a sample of 184 job-seeking nurses in Belgium, characterized by a high labour market demand, it was found that job seekers who spent more time on receiving employment information through experiential recruitment sources such as events and word of mouth perceived this information as more credible. In addition, job seekers' exposure to word of mouth was strongly positively related to their attraction to organizations as an employer. This relationship was partially mediated by the perceived credibility of the received employment information. Therefore, the results of this field study suggest that to enhance their attractiveness as an employer for job seekers, especially those in high demand on the labour market, recruiting organizations should provide credible employment information and stimulate the use of word of mouth as a recruitment source.     

The role of prior knowledge in error correction for younger and older adults

Previous work has demonstrated that, when given feedback, younger adults are more likely to correct high-confidence errors compared with low-confidence errors, a finding termed the hypercorrection effect. Research examining the hypercorrection effect in both older and younger adults has demonstrated that the relationship between confidence and error correction was stronger for younger adults compared with older adults. However, recent work suggests that error correction is largely related to prior knowledge, while confidence may primarily serve as a proxy for prior knowledge. Prior knowledge generally remains stable or increases with age; thus, the current experiment explored how both confidence and prior knowledge contributed to error correction in younger and older adults. Participants answered general knowledge questions, rated how confident they were that their response was correct, received correct answer feedback, and rated their prior knowledge of the correct response. Overall, confidence was related to error correction for younger adults, but this relationship was much smaller for older adults. However, prior knowledge was strongly related to error correction for both younger and older adults. Confidence alone played little unique role in error correction after controlling for the role of prior knowledge. These data demonstrate that prior knowledge largely predicts error correction and suggests that both older and younger adults can use their prior knowledge to effectively correct errors in memory.