Measuring change for a multidimensional test using a generalized explanatory longitudinal item response model

Even though many educational and psychological tests are known to be multidimensional, little research has been done to address how to measure individual differences in change within an item response theory framework. In this paper, we suggest a generalized explanatory longitudinal item response model to measure individual differences in change. New longitudinal models for multidimensional tests and existing models for unidimensional tests are presented within this framework and implemented with software developed for generalized linear models. In addition to the measurement of change, the longitudinal models we present can also be used to explain individual differences in change scores for person groups (e.g., learning disabled students versus non‐learning disabled students) and to model differences in item difficulties across item groups (e.g., number operation, measurement, and representation item groups in a mathematics test). An empirical example illustrates the use of the various models for measuring individual differences in change when there are person groups and multiple skill domains which lead to multidimensionality at a time point.     

Using a three-stage model of change to understand people’s use of bicycle,public transport,and car

More active ways of travelling (e.g., walking, cycling, and public transport) would benefit both individuals and society. To encourage people’s transition to more active travelling, it is important to understand the decision-making process regarding modal choice. The first aim of this study is therefore to combine a three-stage version of the transtheoretical model of change (TTM; Prochaska & DiClemente, 1983) with the theory of planned behaviour (TPB; Ajzen, 1991) to advance our understanding of the nature of the TTM stages. The second aim is to examine certain characteristics (i.e., age, gender, importance of everyday exercise, importance of environmental issues, perceived accessibility, and satisfaction with travel) of these three stages of change. The study used a web-based questionnaire, an app-based questionnaire, and an app-based travel diary completed by 306 people in the Stockholm area. The observed behaviour measured using the app-based travel diary showed that the three-stage model used in this study was consistent with the participants’ self-reported travel behaviour in using bicycles, public transport, and cars. Interventions focusing on attitude, subjective norm, and perceived behavioural control appear to have potential to move people from one stage to another regardless of initial stage. To make interventions as effective as possible, the stage of change as well as the behavioural, normative, and control beliefs underpinning attitude, subjective norm, and perceived behavioural control must be considered. Finally, more research is needed to advance our knowledge of the relationship between the three stages of change and other variables.     

Planning for Multiple Shopping Goals in the Marketplace

Four online grocery‐shopping experiments and one field study using video‐tracking technology at a grocery store document how shoppers’ motivation evolves from the beginning to the end of their shopping trips. We uncover unique motivational patterns as shoppers achieve multiple subgoals (i.e., choose multiple grocery items) to complete their trips: a monotonic decrease in motivation for shoppers with a shopping list versus a curvilinear trend (i.e., decrease then increase) in motivation for shoppers without a list. In addition, we demonstrate how to reverse the observed patterns for shoppers with a list by changing their reference points for tracking progress. The discovery of the moderating role of shopping‐list usage adds to the bubbling dialogue in goal pursuit and shopper psychology research concerning how consumer motivation follows either a monotonic trend (e.g., a goal gradient effect) or a nonmonotonic trend (e.g., the stuck‐in‐the‐middle effect). Importantly, we demonstrate how the stuck‐in‐the‐middle theory, which applies to single‐goal pursuits, can apply more broadly to the domain of grocery shopping, which consists of the generation and completion of multiple subgoals.     

A stochastic detection and retrieval model for the study of metacognition

We present a signal detection-like model termed the stochastic detection and retrieval model (SDRM) for use in studying metacognition. Focusing on paradigms that relate retrieval (e.g., recall or recognition) and confidence judgments, the SDRM measures (1) variance in the retrieval process, (2) variance in the confidence process, (3) the extent to which different sources of information underlie each response, (4) simple bias (i.e., increasing or decreasing confidence criteria across conditions), and (5) metacognitive bias (i.e., contraction or expansion of the confidence criteria across conditions). In the metacognition literature, gamma correlations have been used to measure the accuracy of confidence judgments. However, gamma cannot distinguish between the first 3 attributes, and it cannot measure either form of bias. In contrast, the SDRM can distinguish among the attributes, and it can measure both forms of bias. In this way, the SDRM can be used to test competing process theories by determining the attribute that best accounts for a change across conditions. To demonstrate the SDRM's usefulness, we investigated judgments of learning (JOLs) followed by cued-recall. Through a series of nested and non-nested model comparisons applied to a new experiment, the SDRM determined that a reduction in variance during the confidence process is the most likely explanation of the delayed-JOL effect, and a stronger relation between information underlying JOLs and recall is the most likely explanation of the testing-JOL effect. Following a brief discussion of implications for JOL theories, we conclude with a broader discussion of how the SDRM can benefit metacognition research.     

Motivation Gains in Computer‐Supported Groups1

One challenge in computer‐supported groups is the maintenance of high performance motivation of group members because face‐to‐face interaction and social control are restricted. Based on research on the Kohler effect (Hertel, Kerr, & Messe, 2000), we expected high motivation of group members when their individual effort is highly instrumental for the group's success. First, a task paradigm was developed and validated to measure motivation in a computer task. Then, this paradigm was used to explore group members’ motivation in computer‐supported dyads without face‐to‐face contact. Consistent with our expectations, motivation (and performance) of the group members was high and even exceeded the baseline of individual work (thus revealing motivation gains) when the individual's contribution was highly instrumental for the dyad's success (i.e., weaker coworker under conjunctive task demand). When instrumentality was low (i.e., weaker coworker under additive task demand), inconclusive results were obtained. Overall, the results demonstrate that motivation gains can be produced in computer‐supported dyads, even without face‐to‐face interaction.     

Processes and Stages of Change: Counseling With the Transtheoretical Model of Change

Technical eclecticism and theoretical integration literature has typically examined how multiple approaches to counseling practice may lead to more comprehensive and functional outcomes. Few have proposed an integration of approaches from a scientist‐practitioner perspective; many others have neglected the richness found in the body of existing theory. The purpose of this synthesis is to highlight the contributions that the Transtheoretical Model of Change (J. O. Prochaska & C. C. DiClemente, 1984; J. O. Prochaska & J. C. Norcross, 1994) has for technical eclecticism and theoretical integration. The intervention implications of processes and stages of change are discussed.     

Beyond Protection Motivation: An Integrative Theory of Health Appeals

We develop an integrated theory of health communication by combining protection motivation theory (PMT; Rogers, 1983) with the stages of change described in the transtheoretical model (Prochaska & DClemente, 1982). Our study challenges the assumption implicit in PMT that perceptions of vulnerability, severity, response efficacy, and self-efficacy are equally weighted across individuals. Rather, we propose that people at different stages of readiness to change are differentially affected by levels of these predictor variables. Results from our experiment confirm that vulnerability, severity, and efficacy (response and self) are the main motivators to change behavior during the precontemplation, contemplation, and action stages, respectively. Furthermore, we explore how specific categories of beliefs identified by the transtheoretical model are associated with perceptions of vulnerability, severity, response efficacy, and self-efficacy.     

Leave Her out of It: Person‐Presentation of Strategies is Harmful for Transfer

A common practice in textbooks is to introduce concepts or strategies in association with specific people. This practice aligns with research suggesting that using “real‐world” contexts in textbooks increases students’ motivation and engagement. However, other research suggests this practice may interfere with transfer by distracting students or leading them to tie new knowledge too closely to the original learning context. The current study investigates the effects on learning and transfer of connecting mathematics strategies to specific people. A total of 180 college students were presented with an example of a problem‐solving strategy that was either linked with a specific person (e.g., “Juan's strategy”) or presented without a person. Students who saw the example without a person were more likely to correctly transfer the novel strategy to new problems than students who saw the example presented with a person. These findings are the first evidence that using people to present new strategies is harmful for learning and transfer.     

Predicting Individual Score Elevation in an Applicant Setting: The Influence of Individual Differences and Situational Perceptions

Previous research has indicated that applicants can increase their scores on non‐cognitive measures by half of 1 standard deviation (e.g., Rosse, Stecher, Miller, & Levin, 1998 ; Viswesvaran & Ones, 1999 ). Two influential factors have been proposed to influence this elevation: individual differences and situational influences (e.g., Douglas, McDaniel, & Snell, 1996 ). The current study examined how individual differences and motivation (expectancy theory) predicted individual response elevation from a general to a job applicant context using a conscientiousness measure. Results indicated that elevation was primarily predicted by emotional stability, instrumentality, and the interaction between expectancy and instrumentality. Practical implications and future research directions are discussed.     

Does Selection Measure Scoring Influence Motivation: One size fits all?

Current theories of applicant motivation do not take the scoring of the selection measure into account. We propose that selection measures scored objectively versus using ratings have different motivational antecedents and consequences than selection measures scored using performance ratings. Results from two studies indicated differences between a cognitive ability test (scored objectively) and both an interview and written role‐play (scored using ratings) regarding the amount of self‐reported motivation, factors related to motivation (i.e., procedural justice, perceived performance, and perceived influence), and the relationship between motivation and performance. Both perceived performance and procedural justice were related to motivation across selection measures but only procedural justice was equally important. Perceived influence was only related to motivation regarding the interview. Motivation predicted performance only on the cognitive ability test. Thus, it appears that how a selection measure will be scored should be taken into account when investigating applicant motivation.     

Primary and Secondary Control in Achievement Settings: A Longitudinal Field Study of Academic Motivation,Emotions, and Performance1

The present research represents an application of Rothbaum et al.'s (1982) dual‐process model of perceived control to adaptation in achievement settings. This eight‐month longitudinal field study examined how primary and secondary control influenced end‐of‐year academic motivation (e.g., voluntary course withdrawal), emotions (e.g., stress, regret, pride), and performance (e.g., cumulative grade point average) in 703 first‐year college students. For successful students, primary control related to better performance, higher motivation, and more positive affect. For unsuccessful students, the combination of primary and secondary control resulted in optimal academic adjustment. Unsuccessful students who rely on primary at the expense of secondary control risk serious long‐term deficits in motivation and performance. These findings are discussed with respect to academic overconfidence and control‐enhancing treatments.     

Digital piracy: an examination of low self-control and motivation using short-term longitudinal data.

The purpose of the present study was to examine the link between low self-control, motivation, and digital piracy. This study used short-term longitudinal data (i.e., once a week for 4 weeks) from undergraduate students (n = 292) and latent trajectory analysis. The results of this study revealed that the students had significant variability in initial levels and rates of change in digital piracy. The results indicated that whether motivation was treated as a time-invariant or time-varying measure, it along with sex (i.e., being male) had a significant link with the initial levels of digital piracy and that sex and low self-control had links with the rate of change. These results are discussed, and policy implications are made.     

Validation of a questionnaire for measuring psychosocial factors associated with pharmaceutical care in Spanish community pharmacists

Pharmacotherapy follow-up (PTF) is the professional practice in which the pharmacist takes charge of the needs of the patients related to their drugs. OBJECTIVE: To validate a questionnaire to measure the ASE psychosocial determinants (attitude, social influence, self-efficacy) of PTF and the Prochaska & DiClemente's stage of change in Spanish community pharmacists. METHOD: Postal survey to 482 Asturian community pharmacists (test and retest). Validity was estimated in 134 pharmacists answering the test. Stability was estimated in 85 pharmacists answering the test and retest. Exploratory factorial analysis was used to investigate construct validity and produced 4 factors and 104 items. Those factors had high reliability (Cronbach's a between 0,87 and 0,96). DISCRIMINANT VALIDITY: Pharmacists in extreme stages of change showed significant differences of attitude, motivation and self-efficacy. Repeatability was good and the questionnaire appears valid and reliable.     

Patterns of self-initiated smoking cessation among young adults

Prochaska and DiClemente's (1984) cyclic-stage model of self-initiated smoking cessation divides the cessation process into five stages. This model was applied to a young adult population to determine the cross-sectional distribution of stages and the frequency and pattern of changes among stages over time. Compared to older adults, the distribution of the stages differed substantially: There were twice as many relapsers and only half as many maintainers among young adults. One-year changes in stages were examined using a static model, which did not take into account the cyclic nature of the change process, and a more realistic dynamic model, which did. Both models, especially the dynamic model, suggested substantially more movement among stages in younger than in older adults.     

Children's theories of intelligence: beliefs, goals, and motivation in the elementary years

The authors tested a developmental model of children's theories about intelligence in kindergarten, second grade, and fourth grade children by using paper-and-pencil maze tasks. Older children were more likely than younger children to espouse learning goals (e.g., that they preferred difficult mazes to improve their skill), and less likely to espouse performance goals (e.g., that they preferred easy mazes to be successful). Children in all 3 age groups reported stronger beliefs in the malleability of intelligence than the stability of intelligence. In general, the results supported the authors' hypotheses about developmental change in children's theory-like conceptions of intelligence: Beliefs, goals, and motivation were related in expected ways for second and fourth graders more than for kindergartners. The authors discussed contextual influences on children's beliefs and the development of children's conceptualizations of intelligence.     

Are students in some college majors more self-determined in their studies than others?

Self-determination theory proposes that the extent to which students’ motivation is self-determined is critical to learning outcomes. Based on occasional research evidence and our perceptions, we hypothesize that college students in certain majors have profiles that are higher in self-determined motivation than students in other majors. Specifically, our primary hypothesis is that students in the social sciences and humanities tend to be more self-determined, whereas students in business-related majors tend to be less self-determined. The results from two studies using large samples and advanced analytical methods support the primary hypotheses. Comparison results were also obtained for other majors (e.g., engineering and natural sciences), and supplemental analyses supported the critical role of self-determined motivation in learning outcomes among students in all majors. Study 2 also found support for two mechanisms for such differences, i.e., the majors’ learning climates and students’ individual differences in autonomous functioning. The current evidence suggests the importance of promoting more humanistic learning environments in certain academic disciplines.     

Variations in Self-Determination Across the Stages of Change for Exercise in Adults

This study explored the relationship between self-determination in the regulation of exercise behavior and stage of change for exercise. Deci and Ryan (1985, 1990) outlined a continuum of behavioral regulation that ranges from non-self-determined regulation (external regulation) to completely self-determined regulation (intrinsic regulation). Prochaska and DiClemente (1984) outlined five stages of behavior change that range from no thoughts of changing (precontemplation) to maintenance of change (maintenance). In our study, 314 individuals completed measures of regulation in exercise behavior and stage of change for exercise. Discriminant function analysis revealed that those in the latter stages of change were more self-determined in their behavioral regulation than those in the early stages of change. An analysis of variance indicated that self-determination increased from the lower to the upper stages of change. Results endorse the importance of motivational considerations in understanding the change process.     

Second-order conditioning in Drosophila

Associative conditioning in Drosophila melanogaster has been well documented for several decades. However, most studies report only simple associations of conditioned stimuli (CS, e.g., odor) with unconditioned stimuli (US, e.g., electric shock) to measure learning or establish memory. Here we describe a straightforward second-order conditioning (SOC) protocol that further demonstrates the flexibility of fly behavior. In SOC, a previously conditioned stimulus (CS1) is used as reinforcement for a second conditioned stimulus (CS2) in associative learning. This higher-order context presents an opportunity for reassessing the roles of known learning and memory genes and neuronal networks in a new behavioral paradigm.     

Self‐reported inner speech use in university students

Remarkably little is known regarding what people talk to themselves about (inner speech use) in their everyday lives. Existing self‐directed speech measures (e.g., thought sampling and questionnaires) either uniquely capture inner speech frequency and neglect its content or classify self‐reported thoughts instances in overly simplistic categories determined by the researchers. In the current study, we describe an open‐format thought listing procedure as well as a refined coding scheme and present detailed inner speech content self‐generated by 76 university students. The most frequently self‐reported inner speech activities were self‐regulation (e.g., planning and problem solving), self‐reflection (e.g., emotions, self‐motivation, appearance, behavior/performance, and autobiography), critical thinking (e.g., evaluating, judging, and criticizing), people in general, education, and current events. Inner speech occurred most commonly while studying and driving. These results are consistent with the self‐regulatory and self‐referential functions of inner speech often emphasized in the literature. Future research avenues using the open‐format inner speech listing procedure and coding scheme are proposed.     

Effects of testing on subsequent re‐encoding and long‐term forgetting of action‐relevant materials: On the influence of recall type

Testing one's memory of previously studied information reduces the rate of forgetting, compared to restudy. However, little is known about how this direct testing effect applies to action phrases (e.g., “wash the car”) – a learning material relevant to everyday memory. As action phrases consist of two different components, a verb (e.g., “wash”) and a noun (e.g., “car”), testing can either be implemented as noun‐cued recall of verbs or verb‐cued recall of nouns, which may differently affect later memory performance. In the present study, we investigated the effect of testing for these two recall types, using verbally encoded action phrases as learning materials. Results showed that repeated study–test practice, compared to repeated study–restudy practice, decreased the forgetting rate across 1 week to a similar degree for both noun‐cued and verb‐cued recall types. However, noun‐cued recall of verbs initiated more new subsequent learning during the first restudy, compared to verb‐cued recall of nouns. The study provides evidence that testing has benefits on both subsequent restudy and long‐term retention of action‐relevant materials, but that these benefits are differently expressed with testing via noun‐cued versus verb‐cued recall.