What constitutes globalised evidence? Cultural tensions and critical reflections of the evidence-based movement in New Zealand

The evidence-based movement (EBM) is grounded in a well-intentioned desire to ensure resources are invested in high quality initiatives that generate the intended impact. Nevertheless, recent critiques contest the appropriateness of translating an approach rooted in a medical model to socially complex initiatives. Globalised notions of evidence can also be damaging for programs operating in small, culturally diverse countries with limited resources. Given these polemic views, our aim was to examine local perceptions of the EBM in New Zealand, a small, vibrant, bicultural society with a mix of homegrown and imported programs. Using a snowball sampling approach, 79 professionals working in the education and social sectors completed an anonymous online survey that contained a series of closed and open-ended questions. The results show that although participants positively endorsed a variety of quality evidence markers, traditionally positivist methodological leanings received lower and more varied endorsements compared to more inclusive and pluralistic approaches. Many also expressed concern that the EBM emphasises a narrow and colonised view of evidence that does not align with Māori and Pacific worldviews, and undermines innovation. We discuss the implications as an avenue for advancing intervention and social programming research in an increasingly multicultural and globalised world.     

Strategic and tactical limits of comparison studies

A comparison study is an experiment whose primary purpose is to compare directly (regardless of experimental design) at least two different procedures for changing behavior or two or more components of such a procedure. This paper argues that, in spite of their popularity, such studies typically lead to inappropriate inferences with poor generality based on improper evidence gathered in support of the wrong question, thus wasting the limited experimental resources. The discussion considers problems concerning the functions of comparison studies, the nature of the comparisons that are attempted, the generality of their findings, and the limited role that they can play in technological research.     

Reliability of parental reports using the Katz Adjustment Scales: before and after hospital admission for schizophrenia

We examined the interrater and test-retest reliability of the KATZ Adjustment Scale (Relative rated or R form) longitudinally in a sample of schizophrenic patients, assessing their function before hospital admission, as well as at 1 and 9 mo. after discharge. Changes in mean scores over those assessments suggested sensitivity to change while mothers and fathers both completed the measure with moderate consistency over time. Interrater reliability was moderate at best and quite poor at initial testing, when the subjects were most disturbed clinically, suggesting that the scales may be acceptable when the individual is stable but that ratings may be unreliable when there is an exacerbation in clinical state.     

Is dependence on phonological information in children's reading a product of instructional approach?

Eight-year-old British children were found to be less accurate at rejecting pseudohomophones than ordinary nonwords in a lexical decision task, but 8-year-old New Zealand children did not show this effect. A subsequent homophone decision task showed that this difference was not due to the New Zealand children being unable to distinguish pseudohomophones from other nonwords. The New Zealand children, however, were less accurate than the British children in pronouncing the pseudohomophones they had identified. It was argued that the British children tended to sound out the items before making a choice in the lexical decision task, which gave salience to phonological rather than visual information, resulting in increased errors to the pseudohomophones. It was concluded that where the British children showed this dependency on use of phonological information it was a product of the teaching approach they had experienced.     

Levels of selection and capacity limits

Subjects performed a visual target-detection task in eight experiments. We examined the effects of word relevancy (word in relevant or irrelevant location) and display load (1-4 words) on physical, semantic, and controlled processing of nontargets. Interwoven with the detection task was a test-word identification task that was used to measure priming potency of nontargets. Physical and semantic levels of processing were measured in terms of identity and semantic priming, respectively. Nontarget primes were repeated as test words in identity priming. Nontarget primes were semantic associates of test words in semantic priming. Controlled processing of nontargets was measured in terms of recognition memory on a subsequent test. All measures increased with word relevancy and decreased with display load. The priming effects remained intact even when word presentation was speeded up and controlled processing was sharply curtailed. The data indicate that all levels of processing are selective and capacity limited.     

A developmental study of destereotyping and androgynous activity preferences of tomboys,nontomboys, and males

A study of 210 fourth, sixth, eighth, and tenth graders and adults was conducted to determine developmental trends in both destereotyping of traditionally gender-typed activities and preferences for those activities, and to compare activity preferences of tomboys with other females and with males at different ages. Tenth graders destereotyped less than the other age levels. Additionally, female subjects destereotyped traditionally boys' activities more than girls' activities and more than male subjects. Although nontomboys and boys showed a preference for gender-traditional activities, tomboys preferred traditional girls' and boys' activities equally. Self-defined tomboys do not reject traditionally female activities; instead, they expand their repertoire of activities to include both gender-traditional and nontraditional activities. It is suggested that girls who are able to transcend gender-role behavior in childhood may be the ones who will grow into androgynous adult women.