Test-retest reliability of the functional rotation test in healthy adults

Test-retest reliability and concurrent validity for a Functional Rotation Test, developed as a clinical tool for quantifying the extent of body rotation while sitting or standing, were evaluated with healthy adults in this study. Participants, ages 20 to 72 years (n = 36) donned laser-pointing devices, stood or sat in the center of a room calibrated for the test, and actively turned and pointed to the right (or left) as far as they could comfortably. The locations of the lasers were recorded and subsequently scored. Testing was repeated after a brief rest. Concurrent measurements between a clinical goniometer and the Functional Rotation Test were also compared. Intraclass correlation coefficients (ICCs) indicated good to excellent test-retest reliability indices, ranging from .89 to .96 for standing and .87 to .95 for sitting tests. Agreement between the Functional Rotation Test and the goniometer was excellent (ICC = 1.0). The relevance and possible applications of the Functional Rotation Test are discussed.     

Test-retest reliability of the test of nonverbal intelligence (TONI)

Test-retest reliability of the Test of Nonverbal Intelligence (TONI) was investigated. Fifty students randomly selected from first and second grades were administered Form A and Form B of the TONI on two occasions 3 weeks apart. Test-retest correlation coefficients were calculated for all 50 subjects. The results showed high test-retest reliability: Correlation coefficients were .89 (Form A) and .83 (Form B). Parallel form reliability was also high: Form A correlated with Form B .88 on the first administration and .86 on the second administration.     

Reliability of a sentence completion measure of ego development.

Studied the reliability of the Washington University Sentence Completion Test by giving 51 9th graders and 26 college students the test twice, a week apart. For 9th graders the design included a test-retest group and two groups given half of the test at each session. Although test-retest correlations were high for the 9th graders, retest scores dropped significantly. With college students (a) test-retest correlations through positive and significant were lower, (b) retest scores did not change systematically, and (c) percentage agreement between test and retest scores was high. Discrepant results were related to motivational set and variance in test scores. Split-half correlations and internal consistency coefficients were high. Likelihood of lower retest scores makes problematic the use of this test for short term pretest-posttest studies seeking to stimulate ego development.     

Does memory contaminate test-retest reliability?

The Wonderlic Personnel Test (1983) was administered twice over a 3-week period under conditions in which the activity of the second test was experimentally manipulated. Data from 302 undergraduates were analyzed. The standard test-retest reliability coefficient, .872, was not significantly different from the coefficients obtained from three other groups that, on the second test, were each given specific instructions: (a) to reason out the answers (pure reassess condition); (b) to use reasoning, memory of their initial responses, or both (reassess and memory); or (c) to take an alternate form of the test (parallel). However, the standard test-retest reliability coefficient was higher, p less than .10, than the coefficient obtained from a condition (pure memory) in which subjects were instructed to duplicate their previous responses, using only memory. Although the subjects in the test-retest and combined reassess and memory conditions reported recalling previous answers for 20-25% of the items on the second test, it was concluded that conscious repetition of specific responses did not seriously inflate the estimate of test-retest reliability.     

Measuring implicit attitudes toward physical activity and sedentary behaviors: Test-retest reliability of three scoring algorithms of the Implicit Association Test and Single Category-Implicit Association Test

ObjectivesThe Implicit Association Test (IAT) and the Single-Category IAT (SC-IAT) are two frequently used measures of implicit attitudes. Nonetheless, the test-retest reliability of these measures has not been investigated. The aim of this study was to examine the test-retest reliability of a physical activity versus sedentary behavior IAT, a physical activity SC-IAT, and a sedentary behavior SC-IAT.MethodA total of 111 older adults living with chronic diseases were recruited. They either completed a physical activity versus sedentary behavior IAT (N = 54) or two independent SC-IATs of physical activity and sedentary behavior (N = 57). These tests were administered twice in a one-hour interval. Three scores were computed for each test (D-Score, DW-Score, IP-Score). Both absolute and relative test-retest reliability was computed.ResultsRegarding absolute reliability, the tests were comparable regardless of the scoring algorithm (Coefficients of Repeatability ranged from 1.27 for the two SC-IATs with the D-Score, to 1.36 for the IAT with the D-Score and DW-Score). Regarding relative test-retest reliability, the IAT systematically showed better reliability than the two SC-IATs. The DW-Score systematically exhibited better reliability compared to other scores (Intraclass Correlation Coefficient ranged from 0.20 for the sedentary behavior SC-IAT with the D-Score to 0.78 for the IAT with the DW-Score).ConclusionAdequate test-retest reliability for the IAT was supported independently from the scoring algorithms. Test-retest reliability for the two independent SC-IATs was not supported in this study. The IAT is more sensitive to change than the SC-IATs, which needs to be accounted for in future research on physical activity and sedentary behavior implicit attitudes.     

Coping strategies questionnaire (CSQ): Reliability of the swedish version of the CSQ

Abstract

We present a study with the aim of investigating the internal consistency and reliability of a Swedish version of the Coping Strategies Questionnaire (CSQ). The study group consisted of 282 subjects suffering from long term back pain. Internal consistency was investigated by calculating alpha coefficients and test-retest reliability was investigated by a correlation analysis with two different test-retest intervals. The results reveal that the internal consistency of the Swedish CSQ is high (alpha range between 0.7 and 0.8) and consistent with the American version. The test-retest reliability was not equally satisfactory (correlation ranged between 0.4 and 0.9) but the results support the usefulness of the CSQ as a tool in the clinical assessment of pain coping strategies. The test-retest result indicate the need for further research. In conclusion, the results from the present study are encouraging and support the usefulness of the instrument but to improve the utility and application of the Swedish version of the CSQ further research is warranted.     

Test-retest reliability of the Hurlbert Index of Sexual Assertiveness

This study investigated the test-retest stability of the Hurlbert Index of Sexual Assertiveness. 54 nonclinical and 46 clinical subjects were administered the Index on two occasions 4 wk. apart. Test-retest correlation coefficients were calculated separately and together. The results evidenced high test-retest reliability. Correlation coefficients were .88 for nonclinical subjects and .83 for clinical subjects with an over-all test-retest reliability of .85 for all 100 subjects.     

Effects of modified instructions on the Washington University Sentence Completion Test of Ego Development

This research project was designed to investigate the possibility that asking subjects to respond in a mature manner when they take the Washington University Sentence Completion Test of Ego Development (WUSCTED) would result in higher test scores and improve the test-retest reliability of the measure. The results showed that there was a significant increase in Total Protocol Ratings (TPRs) and item sums in the experimental group (n = 32) over the control group (n = 32). In addition, the experimental group spent more time and used significantly more words in its response than did the control group. The question of improved test-retest reliability remains only tentatively resolved. The item sum scores showed a significantly higher correlation for the experimental instruction than for the control, although the test-retest agreement between TPR levels was insignificantly different in the two instructional groups.     

Stability of scores for the Slosson Full-Range Intelligence Test

The test-retest stability of the Slosson Full-Range Intelligence Test by Algozzine, Eaves, Mann, and Vance was investigated with test scores from a sample of 103 students. With a mean interval of 13.7 mo. and different examiners for each of the two test administrations, the test-retest reliability coefficients for the Full-Range IQ, Verbal Reasoning, Abstract Reasoning, Quantitative Reasoning, and Memory were .93, .85, .80, .80, and .83, respectively. Mean differences from the test-retest scores were not statistically significantly different for any of the scales. Results suggest that Slosson scores are stable over time even when different examiners administer the test.     

Age-related differences in three tests of visual imagery.

Adult age differences were explored on 3 short tests of the ability to generate and manipulate mental images. Age-related decrements were found in all 3 tests and were especially marked on the Clock Test. The tests are all reliable, as shown by test-retest reliability coefficients. Correlations also revealed that the Brooks Letter Test and the East-West Test appear to tap one common underlying ability, whereas the Clock Test measured a somewhat different ability. The East-West and Clock tests, in particular, may provide rapid and easily administered assessments of age-related changes in aspects of mental imagery.     

Assessing handwriting speed of children biliterate in English and Chinese

The assessment of multiliterate handwriting performance is rarely reported despite increased globalization. The present study describes the psychometric properties of a handwriting speed test developed for children who are biliterate in English and Chinese. This included interrater reliability, test-retest reliability, interitem correlation, construct validity, and concurrent validity. The test's reliabilities between two raters and over a 1-wk. interval were high with ICCs ranging from .89 to .99. Interitem correlation between the English and Chinese items was .87. The presence of age trends but not sex differences was a positive indicator of the test's validity. Correlations of .91 and 1.00 between the Chinese and the English items of the Handwriting Assessment Tool with the Chinese Handwriting Speed Test and Handwriting Speed Test, respectively, provided evidence of concurrent validity. These preliminary results showed the Handwriting Assessment Tool is reliable and is a potentially useful handwriting test for children biliterate in English and Chinese. The feasibility of assessing biliterate handwriting speed performance with the same set of scoring criteria for different writing systems was supported.     

Short-interval test-retest interrater reliability of the Dutch version of the Structured Clinical Interview for DSM-IV personality disorders (SCID-II)

This study examined the short-interval test-retest reliability of the Structured Clinical Interview (SCID-II: First, Spitzer, Gibbon, & Williams, 1995) for DSM-IV personality disorders (PDs). The SCID-II was administered to 69 in- and outpatients on two occasions separated by 1 to 6 weeks. The interviews were conducted at three sites by ten raters. Each rater acted as first and as second rater and equal number of times. The test-retest interrater reliability for the presence or absence of any PD was fair to good (kappa = .63) and was higher than values found in previous short-interval test-retest studies with the SCID-II for DSM-III-R. Test-retest reliability coefficients for trait and sumscores were sufficient, except for dependent PD. Values for single criteria were variable, ranging from poor to good agreement. Further large-scale test-retest research is needed to test the interrater reliability of more categorical diagnoses and single traits.     

Evaluating a modified exercise self-efficacy scale for college-age women

This pilot study examined test-retest and internal consistency reliabilities of original and modified formats of the Exercise Self-efficacy Scale in college-age women. 30 completed original and modified versions of the scale. Data from both tests, administered 1 wk. apart, were analyzed using the intraclass correlation coefficient (ICC) to assess test-retest reliability and Cronbach coefficient alpha for internal consistency. Scores for both versions correlated .96. Cronbach coefficients alpha for the original scale were .96 for Time 1 and .98 for Time 2. Cronbach coefficients alpha for the revised scale were .95 for Time 1 and .98 for Time 2. Test-retest reliability and internal consistency remained consistently high for both versions of the scales within this sample. Implications for use of this scale and recommendations for research are given.     

A coefficient alpha for test-retest data

Transient errors are caused by variations in feelings, moods, and mental states over time. If these errors are present, coefficient alpha is an inflated estimate of reliability. A true-score model is presented that incorporates transient errors for test-retest data, and a reliability estimate is derived. This estimate, referred to as the test-retest alpha, is less than coefficient alpha if transient error is present and is less susceptible to effects due to item recall than a test-retest correlation. An assumption underlying the test-retest alpha is essential tau equivalency of items. A test-retest split-half coefficient is presented as an alternative to the test-retest alpha when this assumption is violated. The test-retest alpha is the mean of all possible test-retest split-half coefficients.     

Reliability of the Finger Tapping Test and a note on sex differences.

The reliability of the Finger Tapping Test was investigated in two studies. In the test-retest condition 30 male and 30 female college students were tested twice by the same examiner. In the inter-examiner condition 30 male and 30 female college students were tested once by each of two examiners. Reliability coefficients for the dominant and nondominant hands were high in both studies (about .8), as contrasted with that of the ratio score (about .5), casting doubt on the use of the ratio score to lateralize impairment. Significant sex differences (males about 3 taps faster) were found, calling into question the use of single test interpretation schemes. Slight inter-examiner differences in mean scores were also detected.     

The passion scale: Aspects of reliability and validity of a new 8-item scale assessing passion.

In this article, the psychometric properties of a new scale aimed at quantifying passion are explored, i.e. passion related to becoming good or achieving in some area/theme/skill.The Passion Scale was designed to be quantitative, simple to administer, applicable for large-group testing, and reliable in monitoring passion.A total of 126 participants between 18 and 47 years of age (mean age = 21.65, SD = 3.45) completed an assessment of Passion Scale, enabling us to investigate its feasibility, internal consistency, construct validity and test-retest reliability.FeasibilityThe overall pattern of results suggest that the scale for passion presented here is applicable for the age studied (18–47).Internal consistencyAll individual item scores correlated positively with the total score, with correlations ranging from 0.51 to 0.69. The Cronbach's alpha value for the standardized items was 0.86.Construct validityPearson correlations coefficient between total score passion scale and Grit-S scale were 0.39 for adults, mean age 21.23 (SD = 3.45) (N = 107).Test-retest reliability: Intraclass correlation coefficient (ICCs) between test and retest scores for the total score was 0.92.These promising results warrant further development of the passion scale, including normalization based on a large, representative sample.     

Construction and validation of a japanese adaptation of the test anxiety inventory

This study describes the construction and validation of a Japanese adaptation of Spielberger's (1980) Test Anxiety Inventory (TAI) and presents evidence of the reliability and validity of this new instrument. The items for the Japanese TAI (TAI-J) were selected on the basis of content validity and itemremainder correlations, which were .40 or higher for both sexes. Alpha reliability coefficients for the TAI-J Total scores were .90 or higher for both high school and college students; test-retest stability over a three-week interval was .89. Mean TAI-J Total scores for Japanese high school females were significantly higher than those of Japanese college students, whose scores were slightly lower than those reported for American undergraduates. TAI-J Total scores correlated .72 with a Japanese trait anxiety measure. Significant negative correlations were found between TAI-J Total scores and measures of academic achievement. Implications of these results for the measurement of test anxiety in Japanese students are discussed from a cross-cultural perspective.     

Development of a 15-item odour discrimination test (Düsseldorf Odour Discrimination Test)

A key function of the olfactory system is the detection of differences in odour quality. Therefore, a test was developed to assess odour discrimination ability in normosmic humans. Out of six monomolecular substances (capric acid, coumarin, eugenol, geraniol, phenylethyl alcohol, and vanillin) quaternary mixtures were prepared. Within one item, three odour mixtures were presented (triangle forced-choice procedure). The deviant odour contained the same substances as the two remaining odours; however, the proportions were changed. Study 1 (120 participants) aimed to select items that contribute to a high internal consistency. Study 2 (104 participants) assessed test-retest reliability, parallel test reliability and test validity. Out of 45 items, a 15-item test (Düsseldorf Odour Discrimination Test, DODT) with an internal consistency of 0.61 and medium item difficulties was prepared. The test-retest reliability of the DODT was 0.66 (test interval = 4 weeks) and the parallel test reliability 0.42. The DODT correlated significantly with the University of Pennsylvania Smell Identification Test and to a lesser extent with the phenylethyl alcohol odour threshold test. As the DODT did not correlate with the odour discrimination test of the Sniffin' Sticks, the two tests seem to measure different performances of the olfactory system.     

Recognition Memory for Faces: Reliability and Validity of the Warrington Recognition Memory Test (RMT) in a Neurological Sample

In response to critiques regarding the psychometric limitations of the Warrington Recognition Memory Test for faces (RMT-F), the current study was conducted to examine the test-retest reliability and validity of the measure in a neurological sample. Forty adult outpatients, ages 35–81, were administered the RMT-F as part of their diagnostic exam. A second evaluation was conducted after an average interval of 7 months (range = 2–20 months). Results yielded a Pearson reliability coefficient of 0.81 (p < .001), indicating a clinically satisfactory index of stability. Correlations with other measures were conducted to examine convergent and divergent validity. Results indicate that the facial component of the RMT has adequate reliability for patients with established neurological disease, shows moderate correlations with other measures of complex visuospatial function, and shows no significant correlation with measures of verbal reasoning, visual problem-solving, or verbal fluency. These findings provide additional support for the clinical efficacy of this instrument for use in a diverse neurological patient sample.