The role of secondary covariates when estimating latent trait population distributions

The U.S. National Assessment of Educational Progress (NAEP), the Third International Mathematics and Science Study (TIMSS), and the U.S. Adult Literacy Survey collect probability samples of students (or adults) who are administered brief examinations in subject areas such as mathematics and reading (cognitive variables), along with background demographic (primary) and educational environment (secondary) questions. The demographic questions are used in the primary reporting, while the numerous explanatory secondary variables, or covariates, are only directly utilized in subsequent secondary analyses. The covariates are also used indirectly to create the plausible values (multiple imputations) that are an integral part of analyses because of the use of sparse matrix sampling of cognitive items. The improvement in the precision of the primary reporting due to the inclusion of the covariates is assessed here and contrasted with the precision of reporting using plausible values created using only the primary demographic variables.The results demonstrate that the improvement in precision depends on the matrix sampling designs for the cognitive assessments. The improvements range from essentially none for the most common designs, to moderate for some less common designs. Consequently, two potential changes in the reporting procedures that could improve the statistical and operational efficiency of primary reporting are (a) eliminate or reduce the collection of covariates and increase the number of cognitive items, (b) to avoid delays, eliminate the covariates from the creation of plausible values used for the primary reports, but include them later when creating public-use files for secondary analyses. The potential improvements in statistical and operational efficiency must be weighed against the intrinsic interest in the covariates, and the potential for small discrepancies in the primary and secondary reporting.Thanks to Donald Rubin, Robert Mislevy, and John Barnard for their helpful comments and computing assistance. This work was supported by NCES Grant 84.902B980011.     

The role of Improv in enhancement of Meaning in Life in youth: An explanatory sequential design

“A global mental health crisis” was sparked by the pandemic, especially for the youth as it exposed them to serious existential crises related to grief, loss, death and dying, deep psychological insecurities, etc. Additionally, this crisis came as a call for greater meaning in the personal and professional lives of youth. To deal with these issues in youth, Improv intervention is being used as an effective contemporary psychological technique to improve holistic perspective-taking. This pilot study investigated the efficacy of Improv intervention in enhancing Meaning in Life in youth using an explanatory sequential design. The sample comprised 80 youth (age range 18–25 years). The study was carried out in two phases—quantitative and qualitative. In the quantitative phase, a randomised control trial design was used to assess the efficacy of the intervention; this was followed by semistructured interviews to identify crucial themes that highlighted participants’ perceptions of Meaning in Life and the benefits of the intervention. Results revealed potential usefulness of Improv in Meaning enhancement.     

Supervisees' perspectives on the contribution of supervision to psychotherapy outcomes

Objective

The aim of this study was to examine supervisees' perspectives about the contribution of two predefined aspects of supervision, supervisory bond (SB) and didactic input of supervisor (DI), to their ascribed outcome of therapy.

Method

Supervisees anonymously assessed the SB, supervisors' DI and their contribution to therapy outcome. Assessment was quantitative and qualitative. The supervisory aspects were assessed using a questionnaire constructed for this study. Perceived contribution was evaluated by two scaled questions, and themes generated by an open question. Supervisees (n = 111) evaluated 16 supervisors and supervision’s contribution to psychotherapy outcomes of 111 clients.

Findings

Hierarchical regression showed that supervisees' age, supervisors' status and frequency of supervision accounted for 24% of the variance ascribed to outcome. SB and DI accounted for 51% of the variance. These values, which are higher than reported in the literature, may be attributed to the assessment of predefined aspects of supervision by the same assessor. Thematic analysis of the didactic input produced more themes than for the supervisory bond.

Conclusion

Sociodemographic variables and supervisory relationship variables determine supervisees' evaluations of supervision’s contribution to outcome.

Implications for practice

Training and supervision may benefit from information obtained from quantitative and qualitative measures regarding these and other predefined variables related to supervision. The in-depth look at views and experiences shared by supervisees may advance training, practice and research.     

Building blocks of idea generation and implementation in teams: A meta-analysis of team design and team creativity and innovation

Although organizations increasingly rely on teams to innovate, little systematic knowledge exists about how to design teams to do so. Building on the model of collaborative creativity and innovation and synthesizing findings from published and unpublished studies, this meta-analysis examines the role of team design on team creativity and innovation. We used random-effects meta-analysis to cumulate the correlations between different features of team design and team creativity or team innovation from 134 field studies representing 11,353 teams and 35 studies representing 2,485 student teams. We found that team tenure is curvilinearly related, autonomy-supportive leadership, task interdependence, and goal interdependence are positively related, and demographic diversity and team size are unrelated to team creativity and innovation. Examining meta-analytic path models, we found that task interdependence and supportive leadership positively relate to team creativity and innovation via team collaboration and team potency. In accounting for the literature, we found a dearth of studies examining team processes, some types of diversity such as racial diversity, and the role of team member turnover. We conclude by providing directions for future research and practical guidance about increasing team creativity and innovation through team design.     

The backstage of urban ambiances: When atmospheres pervade everyday experience

This paper explores a new way of designing and experimenting with the city. How are we to conceptualize the changes in contemporary cities on the basis of their ambiances? What about the sensory and emotional production of urban territories? What is at stake when our aim is no longer to design space but also to install an atmosphere? In order to answer such questions, rather than offering a formal definition of what an ambiance may be, I intend to show from what it proceeds, on what it is based, what it produces and transforms in urban life. The focus is exploring five ambiance operating modes in the province of urban design: establishing the sensory as a field of action, composing with affective tonalities, giving consistency to urban situations, maintaining spaces over time and playing with imperceptible transformations. Each of these operating modes can account for how a physical environment manages to become a lived ambiance, how a world of built forms manages to become a world of sensory atmospheres. Starting with the sensory environment itself, I show how it is increasingly becoming a domain of design and research. Then I emphasize on the role of affect in everyday urban situations and daily social activities. Thirdly I explore the pervasive character of an ambiance and question its capacity to unify an experience. I continue by pointing out the temporal dynamic of an ambiance and the necessity to sustain a sense of continuity of the environment. Finally I emphasize on the importance of micro-phenomena in the quality and immersive power of an ambiance. These five operating modes of ambiance enables us to focus on the very ordinary sensory fabric of urban life and its issues.     

The shared online whiteboard: An assistance tool to synchronous collaborative design

IntroductionThe work presented in this paper comes from an industrial need for the development of new support tools for remote collaborative design. Within this framework, we present a literature review on this concept and propose the development of an online collaborative whiteboard.ObjectiveThis study aims to determine whether or not shared whiteboards can be used for remote design task collaboration, in conjunction with online chat interactions. It additionally seeks to discover if the organization of relationships and interactions within groups alter the structure of task completion.MethodThis tool was evaluated through the remote design task of a data structure diagram with data collected from 42 computer science students. This approach was carried out through students in triads, separated into different rooms who communicated via online chat and/or whiteboard. There were two variables in this experimental design, the presence or absence of a project leader and the sequencing of exchanges (each member asked permission to use the tool). This experiment aimed to determine whether the task requested could be performed and if similarities to a natural situation could be observed. Data was collected from actions performed on the whiteboard and chat interactions. The observations were conducted using a verbal interactions observation grid that was taken from a natural synchronous collaborative design situation. It included different dimensions such as cognitive synchronization, the proposal and evaluation of solutions and non-task oriented interactions.ResultsThe results show that the tool allows students to collaborate. A variety of behaviors can be observed in terms of whiteboard usage and chat interactions that depend on the experimental conditions. This study shows that the tool may be used in a natural situation and that group consciousness and coordination are very important factors in this type of task. It is clear that the nature of the chat interaction depends on the role of the subject within the group. We also observed a high level of non-task oriented communication, which was more than we expected.ConclusionThe shared online whiteboard designed in this study allows for the completion of a collaborative design task with different groups structures.     

THE CHRISTIAN CORE OF INTELLIGENT DESIGN

Intelligent design (ID) theorists assert that ID is a scientific theory that is merely consistent with some religious beliefs. Many critics point to the circumstantial evidence of the apparent development of ID from creation science and the affiliation of ID with mainstream evangelical organizations to assert its religious orientation. This article suggests that the position of ID proponents is a substantial understatement, and that beyond the circumstantial evidence of critics, fundamental Christian doctrine constitutes the essence of ID theory. The bulk of scholarship on ID is polarized into those for and against, as most focus on adjudicating ID truth claims, but this adversarial structure elides some important complexities. This article sets aside the truth claims of ID and focuses more broadly on the discourse in which it is situated to show the Christian core of ID and to examine several hallmarks of religion apparent from this perspective.     

JEAB Research Over Time: Species Used,Experimental Designs,Statistical Analyses,and Sex of Subjects

We examined the species used as subjects in every article published in the Journal of the Experimental Analysis of Behavior (JEAB) from 1958 through 2013. We also determined the sex of subjects in every article with human subjects (N = 524) and in an equal number of randomly selected articles with nonhuman subjects, as well as the general type of experimental designs used. Finally, the percentage of articles reporting an inferential statistic was determined at 5-year intervals. In all, 35,317 subjects were studied in 3,084 articles; pigeons ranked first and humans second in number used. Within-subject experimental designs were more popular than between-subjects designs regardless of whether human or nonhuman subjects were studied but were used in a higher percentage of articles with nonhumans (75.4 %) than in articles with humans (68.2 %). The percentage of articles reporting an inferential statistic has increased over time, and more than half of the articles published in 2005 and 2010 reported one. Researchers who publish in JEAB frequently depart from Skinner’s preferred research strategy, but it is not clear whether such departures are harmful. Finally, the sex of subjects was not reported in a sizable percentage of articles with both human and nonhuman subjects. This is an unfortunate oversight.     

ICT – the new frontier? Pushing the boundaries of careers practice

Much progress has been made in integrating information and communications technology (ICT) into careers practice, but there is still room for improvement. An international lens is adopted to examine some key elements that contribute to the successful integration of ICT into careers practice. We start by exploring the role of policy, using the UK as a case study. Next, the perceptions that Finnish career practitioners have of ICT are reviewed using research findings into the different ways they think about social media and its purpose in career services. Finally, lessons learned from the design and integration of online services within career development programming in Canada are discussed that ensure accessibility both to practitioners and their clients.