Generalizability theory: A practical guide to study design,implementation, and interpretation

Generalizability Theory (GT) offers increased utility for assessment research given the ability to concurrently examine multiple sources of variance, inform both relative and absolute decision making, and determine both the consistency and generalizability of results. Despite these strengths, assessment researchers within the fields of education and psychology have been slow to adopt and utilize a GT approach. This underutilization may be due to an incomplete understanding of the conceptual underpinnings of GT, the actual steps involved in designing and implementing generalizability studies, or some combination of both issues. The goal of the current article is therefore two-fold: (a) to provide readers with the conceptual background and terminology related to the use of GT and (b) to facilitate understanding of the range of issues that need to be considered in the design, implementation, and interpretation of generalizability and dependability studies. Given the relevance of this analytic approach to applied assessment contexts, there exists a need to ensure that GT is both accessible to, and understood by, researchers in education and psychology. Important methodological and analytical considerations are presented and implications for applied use are described.     

A Life Domains Perspective on Acculturation and Psychological Adjustment: A Study of Refugees from the Former Soviet Union

The study articulates a contextual approach to research on acculturation of immigrants, suggesting that the relationship between acculturation and adjustment is dependent on the cultural demands of the life domains considered. Specifically, the study investigated the mediating effects of adjustment in occupational and social life domains on the relationship between acculturation and psychological adjustment for 391 refugees from the former Soviet Union. The study used bilinear measures of acculturation to the host (American) and heritage (Russian) cultures. Using Structural Equation Modeling, the study confirmed the hypothesized relationships, such that the positive effects of American acculturation on psychological adjustment were mediated by occupational adjustment, and the effects of Russian acculturation on psychological adjustment were mediated by satisfaction with co-ethnic social support. Psychological adjustment was measured in two ways, as psychological well-being, using a measure of life satisfaction, and as symptoms of depression and anxiety, using the Hopkins symptom checklist (HSCL). Life satisfaction served as a mediator between adjustment in occupational and social domains and HSCL, suggesting that it may be an intervening variable through which environmental stress associated with immigration contributes to the development of symptoms of mental disorder.     

The effects of environmental support and secondary tasks on visuospatial working memory

In the present experiments, we examined the effects of environmental support on participants’ ability to rehearse locations and the role of such support in the effects of secondary tasks on memory span. In Experiment 1, the duration of interitem intervals and the presence of environmental support for visuospatial rehearsal (i.e., the array of possible memory locations) during the interitem intervals were both manipulated across four tasks. When support was provided, memory spans increased as the interitem interval durations increased, consistent with the hypothesis that environmental support facilitates rehearsal. In contrast, when environmental support was not provided, spans decreased as the duration of the interitem intervals increased, consistent with the hypothesis that visuospatial memory representations decay when rehearsal is impeded. In Experiment 2, the ratio of interitem interval duration to intertrial interval duration was kept the same on all four tasks, in order to hold temporal distinctiveness constant, yet forgetting was still observed in the absence of environmental support, consistent with the decay hypothesis. In Experiment 3, the effects of impeding rehearsal were compared to the effects of verbal and visuospatial secondary processing tasks. Forgetting of locations was greater when presentation of to-be-remembered locations alternated with the performance of a secondary task than when rehearsal was impeded by the absence of environmental support. The greatest forgetting occurred when a secondary task required the processing visuospatial information, suggesting that in addition to decay, both domain-specific and domain-general effects contribute to forgetting on visuospatial working memory tasks.     

Professional Counseling in Hong Kong

The authors provide an overview of recent developments in professional counseling as related to schools, career counseling, and community services in Hong Kong. The strategic position of counseling professionals, counseling associations, and counselor certification is discussed. The future development of counseling in Hong Kong is also considered.     

Influence of emotional valence and arousal on the spread of activation in memory

Controversy still persists on whether emotional valence and arousal influence cognitive activities. Our study sought to compare how these two factors foster the spread of activation within the semantic network. In a lexical decision task, prime words were varied depending on the valence (pleasant or unpleasant) or on the level of emotional arousal (high or low). Target words were carefully selected to avoid semantic priming effects, as well as to avoid arousing specific emotions (neutral). Three SOA durations (220, 420 and 720 ms) were applied across three independent groups. Results indicate that at 220 ms, the effect of arousal is significantly higher than the effect of valence in facilitating spreading activation while at 420 ms, the effect of valence is significantly higher than the effect of arousal in facilitating spreading activation. These findings suggest that affect is a sequential process involving the successive intervention of arousal and valence.     

A model‐based approach to limb apraxia in Alzheimer's disease

Limb apraxia is a neurological deficit characterized by an inability to pantomime and/or imitate gestures, which can result from neurodegenerative disorders such as Alzheimer's disease (AD). The major goal of the study was to describe comprehensively the apraxia deficits observed in AD patients and to relate those deficits to general cognitive status, measures of daily activity, and other neuropsychological measures. Limb apraxia was assessed on a variety of conceptual and gesture production tasks in 30 AD patients. As a group, AD patients were impaired across gesture production tasks: of note was the greater impairment in imitation, as opposed to pantomime, which was especially pronounced when patients were imitating with a delay. Imitation performance was best predicted by measures of visuospatial processing, while imitation with delay was best predicted by measures of working memory. In addition, pantomime in response to pictures of tools was less accurate than Pantomime to Verbal Command and holding the tool during performance did not decrease the participants' impairment, while introducing a verbal cue during imitation increased the severity of deficits. Furthermore, investigation into patterns of deficits clearly demonstrated that the nature of limb apraxia deficits observed in AD can be quite heterogeneous and that dissociations between the conceptual and the production system exist. Finally, we also report on significant correlations between general cognitive status and limb apraxia.     

Quality of Life of the Hidden Youth in Hong Kong

Hidden youth was a phenomenon which originated in Japan and later spread to Hong Kong. The youth were described as being in a state of social isolation, marginalization, and prone to emotional disturbances. This may imply that they were suffering from a poor quality of life. However, direct contact with the hidden youth found that some of them are satisfied with their lives. The present study aims to investigate the relationship between the hidden youth’s quality of life and their period and level of social withdrawal. A total of 588 of the hidden youth took part in the study. With the use of mean plots in ANOVA, correlation analysis, regression analysis, and mediation analysis, it was found that the longer the period of social withdrawal, the better the quality of life. The positive correlation between the two variables was mediated by positive emotions derived from social support. On the other hand, as the level of social withdrawal increased, the quality of life decreased. The negative association between the two variables was mediated by negative emotions caused by low levels of social support and a high sense of loneliness. These findings suggest that being “hidden” is the preferred lifestyle of young people and it should not be regarded as a problem that undermines their quality of life.     

Impact of Well-being Interventions for Siblings of Children and Young People with a Chronic Physical or Mental Health Condition: A Systematic Review and Meta-Analysis

Siblings of children and young people with a chronic illness are at increased risk of poor psychological functioning. A number of studies have attempted to implement and evaluate interventions targeting the psychological well-being of this at-risk group. This systematic review summarises the evidence regarding psychological functioning of siblings following an intervention targeting their well-being. The meta-analysis considered behaviour and knowledge, two of the most frequently studied outcomes. The following databases were used: PsycINFO, EMBASE, CINAHL, PubMed, Scopus and Web of Science. Seventeen studies were eligible to be included in the systematic review and eight in the meta-analysis. Results from the systematic review reflected the inconsistency of intervention evaluations in this area with a high level of heterogeneity and a total of 23 outcomes considered across the 17 included studies. The meta-analysis estimated effect sizes using a standardised mean difference (SMD) approach. Pre-post analysis suggested significant improvement in behavioural outcomes and knowledge of their sibling’s health conditions with a SMD of ? 0.44 [95% CI (? 0.6, ? 0.29); p = 0.000] and 0.69 [(95% CI = 0.42, 0.96); p = 0.000], respectively. The SMD was not significant for behavioural outcomes when considering treatment–control studies. In conclusion, the findings suggest interventions for well-being have a positive effect on the psychological functioning of siblings of children and young people with a chronic illness, but their specificity needs to be established. There is a need for further, more methodologically robust research in this area.