Learning representations in a gated prefrontal cortex model of dynamic task switching |
| |
Authors: | Nicolas P. Rougier Randall C. O'Reilly |
| |
Affiliation: | 1. Graduate Institute of Brain and Mind Sciences, National Taiwan University, Taipei, Taiwan;2. Center for Artificial Intelligence and Robotics, National Taiwan University, Taipei, Taiwan;3. Department of Psychology, National Taiwan University, Taipei, Taiwan;4. Neurobiology and Cognitive Science Center, National Taiwan University, Taipei, Taiwan;5. Taiwan International Graduate Program in Interdisciplinary Neuroscience, National Taiwan University and Academia Sinica, Taipei, Taiwan;1. School of Mathematics and Statistics, Wuhan University, Wuhan 430072, PR China;2. Department of Basic Sciences, Air Force Engineering University, Xi’an 710051, PR China;3. School of Mathematics and Statistics, Hunan University of Technology and Business, Changsha 410205, PR China;4. Key Laboratory of Hunan Province for Mobile Business Intelligence, Hunan University of Technology and Business, Changsha 410205, PR China;5. College of Mathematics and Statistics, Shenzhen University, Shenzhen 518060, PR China |
| |
Abstract: | The prefrontal cortex is widely believed to play an important role in facilitating people's ability to switch performance between different tasks. We present a biologically‐based computational model of prefrontal cortex (PFC) that explains its role in task switching in terms of the greater flexibility conferred by activation‐based working memory representations in PFC, as compared with more slowly adapting weight‐based memory mechanisms. Specifically we show that PFC representations can be rapidly updated when a task switches via a dynamic gating mechanism based on a temporal‐differences reward‐prediction learning mechanism. Unlike prior models of this type, the present model develops all of its internal representations via learning mechanisms as shaped by the demands of continuous periodic task switching. This advance opens up a new domain of research into the interactions between working memory task demands and the representations that develop to meet them. Results on a version of the Wisconsin card sorting task are presented for the full model and a number of comparison networks that test the importance of various model features. Furthermore, we show that a lesioned model produces perseverative errors like those seen in frontal patients. |
| |
Keywords: | Working memory Wisconsin card sorting task Reinforcement learning Computational modeling Neural networks |
本文献已被 ScienceDirect 等数据库收录! |
|