RT Journal Article
SR Electronic
T1 Explicit knowledge of task structure is the primary determinant of human model-based action
JF medRxiv
FD Cold Spring Harbor Laboratory Press
SP 2020.09.06.20189241
DO 10.1101/2020.09.06.20189241
A1 Castro-Rodrigues, Pedro
A1 Akam, Thomas
A1 Snorasson, Ivar
A1 Marta Camacho, M
A1 Paixão, Vitor
A1 Barahona-Corrêa, J. Bernardo
A1 Dayan, Peter
A1 Simpson, H. Blair
A1 Costa, Rui M.
A1 Oliveira-Maia, Albino J.
YR 2021
UL http://medrxiv.org/content/early/2021/09/18/2020.09.06.20189241.abstract
AB Explicit information obtained through instruction profoundly shapes human choice behaviour. However, this has been studied in computationally simple tasks, and it is unknown how model-based and model-free systems, respectively generating goal-directed and habitual actions, are affected by the absence or presence of instructions. We assessed behaviour in a novel variant of a computationally more complex decision-making task, before and after providing information about task structure, both in healthy volunteers and individuals suffering from obsessive-compulsive (OCD) or other disorders. Initial behaviour was model-free, with rewards directly reinforcing preceding actions. Model-based control, employing predictions of states resulting from each action, emerged with experience in a minority of subjects, and less in OCD. Providing task structure information strongly increased model-based control, similarly across all groups. Thus, explicit task structural knowledge determines human use of model-based reinforcement learning, and is most readily acquired from instruction rather than experience.Competing Interest StatementJBBC received honoraria from Janssen-Cilag, Ltd, as member of a local Advisory Board. HBS has received research support for an industry-sponsored clinical trial from Biohaven Pharmaceuticals, royalties from UpToDate Inc., and a stipend from the American Medical Association for her role as Associate Editor of JAMA Psychiatry. AJOM is recipient of a grant from Schuhfried GmBH for norming and validation of cognitive tests, and is national coordinator for Portugal of a non-interventional study (EDMS-ERI-143085581, 4.0) to characterize a Treatment-Resistant Depression Cohort in Europe, sponsored by Janssen-Cilag, Ltd and of a trial of psilocybin therapy for treatment-resistant depression, sponsored by Compass Pathways, Ltd (EudraCT number 2017-003288-36).Funding StatementPCR was supported by a Doctoral Fellowship (SFRH/SINTD/94350/2013) from Fundacao para a Ciencia e Tecnologia (FCT) and a Fulbright Research Scholarship from the Bureau of Educational and Cultural Affairs of the US Department of State. PCR, JBBC and AJOM were supported by grant LISBOA-01-0145-FEDER-30302, funded by Portuguese national funds from FCT and co-funded by Fundo Europeu de Desenvolvimento Regional (FEDER), under the Partnership Agreement Lisboa 2020 - Programa Operacional Regional de Lisboa. MC was supported by Centre for Parkinsons Plus and funded by the Evelyn Trust (proj ref 19/24). PD was supported by the Max Planck Society and the Alexander von Humboldt Foundation. AJOM was further supported by Portuguese national funds from FCT through grant PTDC/MED-NEU/31331/2017.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:The research protocol was conducted in accordance with the declaration of Helsinki for human studies of the World Medical Association and approved by the Ethics Committees of the Champalimaud Centre for the Unknown, NOVA Medical School and Centro Hospitalar Psiquiatrico de Lisboa (CHPL), and the Institutional Review Board of the New York State Psychiatric Institute (NYSPI).All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesN/A