Performance implications of leader briefings and team-interaction training for team adaptation to novel environments

The authors examined how leader briefings and team-interaction training influence team members' knowledge structures concerning processes related to effective performance in both routine and novel environments. Two-hundred thirty-seven undergraduates from a large mid-Atlantic university formed 79 three-member tank platoon teams and participated in a low-fidelity tank simulation. Team-interaction training, leader briefings, and novelty of performance environment were manipulated. Findings indicated that both leader briefings and team-interaction training affected the development of mental models, which in turn positively influenced team communication processes and team performance. Mental models and communication processes predicted performance more strongly in novel than in routine environments. Implications for the role of team-interaction training, leader briefings, and mental models as mechanisms for team adaptation are discussed.     

Enhancing the transfer of computer-assisted training proficiency in geographically distributed teams

The authors examined factors that determine whether knowledge gained from computer-assisted (i.e., technology-based) team training in a geographically distributed team (GDT) context transfers to organizational results. They examined the moderating effects of team trust, technology support, and leader experience on the relation between teams' average individual training proficiency on a computer-assisted (i.e., CD-ROM-based) training program and team performance as assessed by team customer satisfaction ratings. Using data collected from 40 GDTs in a high-technology company, the authors found that the relation between teams' average training proficiency and team performance was complex and moderated by several factors. In particular, teams' average training proficiency had a positive association with customer satisfaction when GDTs were higher, rather than lower, in both trust and technology support and when team leaders had longer, rather than shorter, levels of tenure with their specific team.     

Evaluating Cognitive Training Outcomes: Validity and Utility of Structural Knowledge Assessment

Conventional approaches to evaluating cognitive outcomes of training typically use paper-and-pencil tests that emphasize gains or differences in declarative knowledge. Yet a key factor in differentiating expert and novice performance is the way individuals organize their knowledge. Accordingly, the acquisition of meaningful knowledge structures and methods of assessing structural knowledge are potentially important issues for designing and evaluating training programs. Two studies were conducted to examine the validity and utility of one structural assessment technique called Pathfinder (Schvaneveldt, Durso, & Dearholt, 1989). Results from academic and organizational samples indicated that Pathfinder measures of structural knowledge quality predicted individual differences in performance self-efficacy. After controlling for differences in declarative knowledge, measures of structural knowledge quality added to the prediction of performance self-efficacy in the student sample, but not in the organizational sample. The unique features and potential advantages of structural assessment for training evaluation are discussed.     

Are Pre-Assembly Shared Work Experiences Useful for Temporary-Team Assembly Decisions? A Study of Olympic Ice Hockey Team Composition

The purpose of this study was to investigate if pre-assembly shared work experiences among temporary team members facilitate individual and team performance. Archival data from the 2014 Men’s Olympic Ice Hockey Tournament (12 teams, 25 players each) was used in the study. Measures of social network centrality were computed based on the pre-assembly shared work experiences among national team members derived from professional and amateur affiliations. These measures were used to predict objective individual and team performance criteria. Players’ closeness centrality scores, from pre-assembly shared work experience networks, positively predicted their goals, assists, and being involved in more positive than negative plays. Teams with less centralized pre-assembly shared work experience network structures tended to perform better than teams with more centralized pre-assembly shared work experience network structures. Temporary teams are commonly used by organizations to perform tasks that are specific, important, and of short duration. Because temporary teams have little time to develop the shared properties required for effective team functioning, assembly decisions are of paramount importance. The results from this study suggest that centrality measures derived from pre-assembly shared work experiences are useful to consider when assembling temporary teams. Few studies have investigated the impact of pre-assembly shared work experiences on individual and team performance. Using objective data, this study provides evidence that pre-assembly shared work experiences relate to individual and team performance in temporary teams, supporting the need for expanded research in this area.     

团队问题解决的知识结构转换研究

本研究利用多维标度分析法,通过计算机联网实验．对团队问题解决过程中的知识结构进行获取与分析。我们考察了团队共享知识结构在群体讨论过程中结构性的区别,结果得出团队知识结构在概念聚集度、概念群数量、结构明晰性三个指标上发生了变化。我们认为,这些指标可以作为团队综合能力的指标,为团队评估与培训提供依据。     

Performance Measurement in Distributed Environments: Initial Results and Implications for Training

Advances in telecommunications and simulation technologies have created opportunities for conducting distributed team training through networked simulations. In distributed team training, in which simulators may be geographically dispersed, military teams train together in the same battlespace despite the physical separation. In these types of training environments, multiple users are located at multiple sites; consequently, the efficient and effective conduct of training is a challenge. One area that is particularly challenging is the measurement of team performance. Two case studies are reported in which team performance measurement instruments were developed and tested in a distributed training environment. The measurement tools were designed within the context of an instructional approach known as event-based training, which relies on the creation of explicit linkages among learning objectives, exercise events, performance measures, and after-action review or feedback. Active duty, reserve, and National Guard personnel from the Marine Corps, Air Force, and Army participated in several days of training exercises conducted within a network of simulators that were geographically distributed across the United States. The development and use of the measurement instruments are described, data from both case studies are presented, and implications for training are discussed.     

TRAINING TEAM PERFORMANCE-RELATED ASSERTIVENESS

The present paper extends the existing literature on assertiveness in a way that supports industrial training as well as the selection of individuals for team positions. Data are reported from three studies that examined determinants of team performance-related assertiveness. First, data from 149 college students demonstrated that assertiveness consists of multiple dimensions which were not all related to performance in a team decision-making task. Second, data obtained from 225 business students indicated that correlations among self-report measures and peer ratings of the same assertive responses assigned by intact team members varied according to the interpersonal context (i.e., personal, stranger, work related) in which scale items were framed. Third, data from 60 college students suggested that team performance-related assertiveness has a significant skill component. Whereas both attitudinally focused and skill-based training improved attitudes toward team member assertiveness, practice and feedback were essential to producing behavioral effects. Implications for selection and team training are discussed.     

Knowledge Organization and the Acquisition of Procedural Expertise

The influence of the organization of a declarative knowledge base on the development and application of proceduralized knowledge was investigated in a complex troubleshooting domain. Domain explanations were generated in either a depth-first or breadth-first manner for different groups of subjects who were also given experience learning to troubleshoot in the domain. Although the two explanatory structures led to similar training performance, the two groups differed significantly in their overall level of performance in subsequent troubleshooting problems. Examination of objective measures of troubleshooting performance and think-aloud protocols indicated that breadth-first declarative knowledge representation fosters the use of mental models during problem-solving in training. It also facilitates proceduralization of that knowledge into fast and accurate methods for localizing faults.     

A multilevel examination of the relationships among training outcomes, mediating regulatory processes, and adaptive performance

This study examined whether cognitive, affective-motivational, and behavioral training outcomes relate to posttraining regulatory processes and adaptive performance similarly at the individual and team levels of analysis. Longitudinal data were collected from 156 individuals composing 78 teams who were trained on and then performed a simulated flight task. Results showed that posttraining regulation processes related similarly to adaptive performance across levels. Also, regulation processes fully mediated the influences of self- and collective efficacy beliefs on individual and team adaptive performance. Finally, knowledge and skill more strongly and directly related to adaptive performance at the individual than the team level of analysis. Implications to theory and practice, limitations, and future directions are discussed.     

KNOWLEDGE WORKER TEAM EFFECTIVENESS: THE ROLE OF AUTONOMY, INTERDEPENDENCE, TEAM DEVELOPMENT, AND CONTEXTUAL SUPPORT VARIABLES

This study investigated how autonomy, interdependence, and team development, along with process and contextual support variables, were related to the effectiveness of teams of "knowledge workers." The sample included 231 knowledge workers from 27 work teams. Team members completed surveys measuring the design, process, and contextual factors. Effectiveness measures included multiple key stakeholder evaluations of team performance and self-report measures of attitudinal outcomes. The results suggest that interactions among design, process, and contextual support factors have important implications for team effectiveness. In particular, the positive relationship between team autonomy and team job motivation was reduced as teams worked under more interdependent conditions. This interaction effect also varied across the types of autonomy (e.g., planning-related, product-related, and people-related) the team was given. Results also demonstrated that the relationship between job motivation and team process behaviors (helping, sharing, and innovating) was more positive in teams who were developmental mature. Process behaviors were positively related to effectiveness, but those relationships became more positive in the presence of certain contextual factors (high-quality goals and efficient information transmission), and less positive in the presence of others (feedback and time pressure). Future research needs and practical implications of these results are discussed.     

Characterizing sequence knowledge using online measures and hidden Markov models

What knowledge do subjects acquire in sequence-learning experiments? How can they express that knowledge? In two sequence-learning experiments, we studied the acquisition of knowledge of complex probabilistic sequences. Using a novel experimental paradigm, we were able to compare reaction time and generation measures of sequence knowledge online. Hidden Markov models were introduced as a novel way of analyzing generation data that allowed for a characterization of sequence knowledge in terms of the grammar that was used to generate the stimulus material. The results indicated a strong correlation between the decrease in reaction times and an increase in generation performance. This pattern of results is consistent with a common knowledge base for improvement on both measures. On a more detailed level, the results indicate that at the start of training, generation performance and reaction times are uncorrelated and that this correlation increases with training.     

Team-Track: A tool for investigating tracking performance in teams

Team performance and coordination have gained considerable interest in disparate fields (e.g., aviation, process control, medicine, and wartime operations). Team-Track, a C program that allows controlled experimental manipulation of team conditions, was developed to meet the research needs resulting from this interest. Using Team-Track, one can manipulate task interdependence, team staffing, relative contributions of team members, communications, and informational displays in a low-cost environment. The dependent measure of performance generated by the program is the absolute tracking error along each dimension. The program is ideal for investigating team interactions as it allows for orthogonal manipulation of team variables, therefore accommodating a multitude of research paradigms.     

Knowledge structures and the acquisition of a complex skill

The purpose of this study was to examine the viability of knowledge structures as an operationalization of learning in the context of a task that required a high degree of skill. Over the course of 3 days, 86 men participated in 9 training sessions and learned a complex video game. At the end of acquisition, participants' knowledge structures were assessed. After a 4-day nonpractice interval, trainees completed tests of skill retention and skill transfer. Findings indicated that the similarity of trainees' knowledge structures to an expert structure was correlated with skill acquisition and was predictive of skill retention and skill transfer. However, the magnitude of these effects was dependent on the method used to derive the expert referent structure. Moreover, knowledge structures mediated the relationship between general cognitive ability and skill-based performance.     

A Chaining-Mastery,Discrimination Training Program to Teach Little Leaguers to Hit a Baseball

One of two little league baseball teams, consisting of boys between the ages of 8 and 12, was taught to hit a baseball using a chaining-mastery program extrapolated from the "Total Golf" (Simek & O'Brien, 1981) program. Following two baseline games and a baseline measurement session, 10 of the 12 boys on the experimental team participated in a chaining-mastery batting program, beginning with slow pitches from close to the batter and progressing to normal speed pitches from the regulation distance. Both game performance and a repeat of the baseline measures following Game 6 showed large increases in the number of hits. The control team showed no such increases. Following Game 6, a program of discrimination training for hitable balls (strikes) was instituted with the experimental team using a mastery approach to produce earlier discriminations of strikes from balls. Number of bases on balls increased for Games 7 through 10 after remaining stable for the first 6 games. For the control team, bases on balls increased during Games 3 through 6, but remained stable for Games 7 through 10. Batting averages revealed similar improvement for the experimental team from a baseline of .250 to .342 for Games 3 through 6, and .369 for Games 7 through 10, and no improvement for the control team (baseline = .281, Games 3 through 6 = .230, Games 7 through 10 = .230). Two members of the experimental team rejected the chaining-discrimination training program in favor of practice in "guided positive fantasy" for batting skills, which was provided by the father of one of the boys. These two boys showed little improvement on the dependent measures. The results suggest that a program of chaining-mastery instruction for batting and discrimination training for pitch selection can be effective in teaching little leaguers to hit.     

AN EVALUATION OF GENERIC TEAMWORK SKILLS TRAINING WITH ACTION TEAMS: EFFECTS ON COGNITIVE AND SKILL-BASED OUTCOMES

This study evaluated the utility of generic teamwork skills training for enhancing the effectiveness of action teams. Results from 65 4-person action teams working on an interdependent command and control simulator revealed that generic teamwork skills training had a significant and positive impact on both cognitive and skill-based outcomes. Trained team members evidenced higher levels of declarative knowledge regarding teamwork competencies and demonstrated greater proficiency in the areas of planning and task coordination, collaborative problem-solving, and communication. Furthermore, results indicated that cognitive and skill based outcomes were interrelated. Team members' declarative knowledge regarding teamwork competencies positively affected planning and task coordination, collaborative problem solving, and communication skills. However, we found that the effects of declarative knowledge differed across team members depending on their roles and responsibilities. The team benefited the most from the knowledge held by the team member who occupied the most critical position in the workflow. Implications of these findings for future research and practice are discussed.     

Team cognition in experienced command-and-control teams

Team cognition in experienced command-and-control teams is examined in an UAV (Uninhabited Aerial Vehicle) simulation. Five 3-person teams with experience working together in a command-and-control setting were compared to 10 inexperienced teams. Each team participated in five 40-min missions of a simulation in which interdependent team members control a UAV to take reconnaissance photos. Experienced teams exceeded performance of inexperienced teams, suggesting transfer of previous command-and-control experience. Compared to inexperienced teams, experienced teams had fewer errors on process-related training knowledge, superior team process ratings, and communications containing fewer coordination-related utterances. These findings support the view that team cognition emerges through the interactions of team members, that interactions distinguish high-performing teams from average teams, and that these interactions transfer across different tasks.     

Team structure and regulatory focus: the impact of regulatory fit on team dynamic

We report a within-teams experiment testing the effects of fit between team structure and regulatory task demands on task performance and satisfaction through average team member positive affect and helping behaviors. We used a completely crossed repeated-observations design in which 21 teams enacted 2 tasks with different regulatory focus characteristics (prevention and promotion) in 2 organizational structures (functional and divisional), resulting in 84 observations. Results suggested that salient regulatory demands inherent in the task interacted with structure to determine objective and subjective team-level outcomes, such that functional structures were best suited to (i.e., had best fit with) tasks with a prevention regulatory focus and divisional structures were best suited to tasks with a promotion regulatory focus. This contingency finding integrates regulatory focus and structural contingency theories, and extends them to the team level with implications for models of performance, satisfaction, and team dynamics.     

DISPOSITIONAL INFLUENCES ON TRANSFER OF LEARNING IN MULTISTAGE TRAINING PROGRAMS

The training effectiveness literature has paid little attention to the potentially dynamic interaction of individual differences with various phases of training in determining ultimate training success. This study investigates the role of individual differences in explaining the transfer of learning from 1 phase of training to another among pilot trainees in a multistage, aviation training program. Using 3 of the Big Five factors (Conscientiousness, Emotional Stability, Openness to Experience), the results showed these measures to contribute to the prediction of the number of hours it took for trainees to attain their private pilot's license. Significant interactions between some of these measures and success on an earlier, simulator phase of the training program were also found. The results are discussed in terms of both the role of individual differences in training research as well as the broader issue of transfer of learning between phases of training.     

Team adaptation to an unforeseen system failure: Limits of the potential aids of shared knowledge and standardized communication

The present study investigates the potential benefits of a team’s shared knowledge and standardized communication in adapting to an unforeseen change by combining literature on adaptation and team performance. Each of 20 teams performed a dynamic team task and was suddenly confronted with a simulated partial system breakdown. Results show that a methodological framework designed to describe performance adaptation to an unforeseen change in individuals can also be used to model performance adaptation in teams. The system failure was followed by a performance drop and a subsequent period of gradual performance recovery. Accuracy of teams’ shared knowledge correlated positively with performance before and after the change, confirming and extending the literature on shared mental models. However, the amount of knowledge similarity did not aid teams in adapting to the unforeseen system breakdown. In addition, improving teams’ standardized communication had no damping effect on the sudden performance drop and neither helped them during the subsequent recovery period. These results show that even though shared knowledge and efficient communication are of high value to team performance and success, these characteristics are limited in aiding adaptive team performance after unforeseen unique changes that force team members to update their strategies.     

Establishing team knowledge coordination from a learning perspective

Research has identified the importance of knowledge coordination in high-performing teams. However, little is known on the processes through which these cognitive structures are developed, more specifically on the learning occurring as teams communicate and interact to build new team knowledge. In a multiple-measures experiment, 33 teams with no prior experience in flight simulations were assigned to newly formed dyads to complete 4 successive performance episodes of a flight simulation task, modeling a complex, fast-paced, and high workload task context. The study showed how team learning processes (i.e., team learning behaviors and team reflexivity), driven by task cohesion, and group potency supported coordination development, which in turn predicted team performance.