多中心合作和可重复的心理与脑科学研究
|
摘要
心理与脑科学研究结果的可重复性问题近年来备受关注。这一问题的根源一般被认为有两个方面:客观存在的方法学问题和研究者有意或无意的可疑研究操纵。开展可重复的心理与脑科学研究已经为越来越多的研究者所接受和推崇,正在成为新的趋势。本文从多中心合作的视角,就多中心合作研究模式在开展可重复的心理与脑科学研究中的应用和发展,以及应用过程中需要注意的问题展开讨论。希望国内心理与脑科学同行,尤其是年轻研究者加强多中心合作研究相关的方法学训练,以更开放的心态联合起来,开展稳健、可重复的心理与脑科学研究。
The replicability issue has received increased attention over recent years in a variety of fields including psychology and neuroscience. Two plausible roots have been considered contributing to this issue: intrinsic problems in traditional statistical methods, and potential problematic research practices in the traditional studies. Multiple calls for reproducible and replicable researches have been proposed. Multi-site collaboration approaches could play a critical role in this progress. As the new generations of scientists, young researchers may want to pursue open science and multi-site collaboration approaches for conducting replicable research in the psychological and brain sciences.
The replicability issue has received increased attention over recent years in a variety of fields including psychology and neuroscience. Two plausible roots have been considered contributing to this issue: intrinsic problems in traditional statistical methods, and potential problematic research practices in the traditional studies. Multiple calls for reproducible and replicable researches have been proposed. Multi-site collaboration approaches could play a critical role in this progress. As the new generations of scientists, young researchers may want to pursue open science and multi-site collaboration approaches for conducting replicable research in the psychological and brain sciences.
引文
胡传鹏,王非,过继成思,宋梦迪,隋洁,彭凯平 (2016).心理学研究中的可重复性问题:从危机到契机.心理科学进展,24(9),1504-1518.
骆大森 (2017).心理学可重复性危机两种根源的评估.心理与行为研究,15(5),577-586.
朱滢 (2016).“开放科学数据共享软件共享”,你准备好了吗?心理科学进展,24(6),995-996.
Aarts,A.A.,Anderson,J.E.,Anderson,C.J.,Attridge,P.R.,Attwood,A.,Axt,J.,...Bartmess,E.(2015).Estimating the reproducibility of psychological science.Science,349(6251),253-267.
Bates,D.,M?chler,M.,Bolker,B.,& Walker,S.(2015).Fitting Linear Mixed-Effects Models Using lme4.Journal of Statistical Software,67(1),1-48.
Beaty,R.E.,Kenett,Y.N.,Christensen,A.P.,Rosenberg,M.D.,Benedek,M.,Chen,Q.,...Silvia,P.J.(2018).Robust prediction of individual creative ability from brain functional connectivity.Proceedings of the National Academy of Sciences of the United States of America,115(5),1087-1092.
Benjamin,D.J.,Berger,J.O.,Johannesson,M.,Nosek,B.A.,Wagenmakers,E.J.,Berk,R.,...Cesarini,D.(2018).Redefine statistical significance.Nature Human Behaviour,2(1),6-10.
Boedhoe,P.S.,Schmaal,L.,Abe,Y.,Ameis,S.H.,Arnold,P.D.,Batistuzzo,M.C.,...Brem,S.(2017).Distinct subcortical volume alterations in pediatric and adult ocd:a worldwide meta- and mega-Analysis.American Journal of Psychiatry,174(1),60-69.
Button,K.S.,Ioannidis,J.P.,Mokrysz,C.,Nosek,B.A.,Flint,J.,Robinson,E.S.,& Munafò,M.R.(2013).Power failure:why small sample size undermines the reliability of neuroscience.Nature Reviews Neuroscience,14(5),365-376.
Cheng,W.,Rolls,E.T.,Qiu,J.,Liu,W.,Tang,Y.,Huang,C.C.,...Pu,J.(2016).Medial reward and lateral non-reward orbitofrontal cortex circuits change in opposite directions in depression.Brain,139,3296-3309.
Freese,J.,& Peterson,D.(2017).Replication in Social Science.Annual Review of Sociology,43,147-165.
Guglielmi,G.The world's largest set of brain scans are helping reveal the workings of the mind and how diseases ravage the brain.Retrieved December 20,2018,from https://www.sciencemag.org/news/2018/01/world-s-largest-set-brain-scans-are-helping-reveal-workings-mind-and-how-diseases
Gorgolewski,K.J.,& Poldrack,R.A.(2016).A Practical Guide for Improving Transparency and Reproducibility in Neuroimaging Research.Plos Biology,14(7),e1002506.
Hu,C.P.,Yin,J.X.,Lindenberg,S.,Dalgar,I.,Weissgerber,S.C.,Vergara,R.C.,...Hadi,R.(2018).Data from the Human Penguin Project:a cross-national dataset testing principles from social thermoregulation theory.https://doi.org/10.31234/osf.io/cs6au.
IJzerman,H.,Lindenberg,S.,Dalar,.,Weissgerber,S.S.,Vergara,R.C.,Cairo,A.H.,...Hall,C.J.(2018).The Human Penguin Project:climate,social integration,and core body temperature.Collabra:Psychology,4(1),37.
Ioannidis,J.P.A.(2005).Why most published research findings are false.Plos Medicine,2(8),696-701.
Klein,R.A.,Vianello,M.,Hasselman,F.,Adams,B.G.,Adams Jr,R.B.,Alper,S.,...Batra,R.(2018).Many labs 2:investigating variation in replicability across sample and setting.Advances in Methods and Practices in Psychological Science,1(4),443-490.
Kong,X.Z.,Mathias,S.R.,Guadalupe,T.,Glahn,D.C.,Franke,B.,Crivello,F.,...ENIGMA Laterality Working Group.(2018).Mapping cortical brain asymmetry in 17,141 healthy individuals worldwide via the ENIGMA Consortium.Proceedings of the National Academy of Sciences of the United States of America,115(22),E5154-E5163.
LeWinn,K.Z.,Sheridan,M.A.,Keyes,K.M.,Hamilton,A.,& McLaughlin,K.A.(2017).Sample composition alters associations between age and brain structure.Nature Communications,8(1),1-14.
Munafò,M.R.,Nosek,B.A.,Bishop,D.V.,Button,K.S.,Chambers,C.D.,Du Sert,N.P.,...Ioannidis,J.P.(2017).A manifesto for reproducible science.Nature Human Behaviour,1(1),1-9.
Olds,J.L.(2016).The rise of team neuroscience.Nature Reviews Neuroscience,17(10),601-602.
Poldrack,R.A.,Baker,C.I.,Durnez,J.,Gorgolewski,K.J.,Matthews,P.M.,Munafò,M.R.,...& Yarkoni,T.(2017).Scanning the horizon:towards transparent and reproducible neuroimaging research.Nature Reviews Neuroscience,18(2),115-126.
Prinz,F.,Schlange,T.,& Asadullah,K.(2011).Believe it or not:how much can we rely on published data on potential drug targets?Nature Reviews Drug Discovery,10(9),712-U781.
Schooler,J.W.(2014).Metascience could rescue the replication crisis.Nature,515(7525),9.
Simmons,J.P.,Nelson,L.D.,& Simonsohn,U.(2011).False-positive psychology:undisclosed flexibility in data collection and analysis allows presenting anything as significant.Psychological Science,22(11),1359-1366.
Viechtbauer,W.(2010).Conducting meta-analyses in R with the metafor package.Journal of statistical software,36(3).
Weisberg,S.M.,Chatterjee,A.,& Newcombe,N.(2018).Hippocampal volume and navigation ability reanalysis.Retrieved May 1,2018,from:https://osf.io/xp7ru
Yan,C.G.,Li,L.,Chen,X.,Castellanos,F.X.,Bai,F.,Bai,T.J.,...Cheng,C.(2018).Twenty-five cohorts of major depressive disorder in china:evidence for reduced but not enhanced default mode network functional connectivity.bioRxiv,321745.
Zeng,L.L.,Wang,H.,Hu,P.,Yang,B.,Pu,W.,Shen,H.,...Wang,K.(2018).Multi-Site Diagnostic Classification of Schizophrenia Using Discriminant Deep Learning with Functional Connectivity MRI.Ebiomedicine,30,74-85.
Zickfeld,J.H.,Schubert,T.W.,Seibt,B.,Blomster,J.K.,Arriaga,P.,Basabe,N.,...Ding,Y.(2018).Kama muta:Conceptualizing and measuring the experience often labelled being moved across 19 nations and 15 languages.Emotion,in press.
骆大森 (2017).心理学可重复性危机两种根源的评估.心理与行为研究,15(5),577-586.
朱滢 (2016).“开放科学数据共享软件共享”,你准备好了吗?心理科学进展,24(6),995-996.
Aarts,A.A.,Anderson,J.E.,Anderson,C.J.,Attridge,P.R.,Attwood,A.,Axt,J.,...Bartmess,E.(2015).Estimating the reproducibility of psychological science.Science,349(6251),253-267.
Bates,D.,M?chler,M.,Bolker,B.,& Walker,S.(2015).Fitting Linear Mixed-Effects Models Using lme4.Journal of Statistical Software,67(1),1-48.
Beaty,R.E.,Kenett,Y.N.,Christensen,A.P.,Rosenberg,M.D.,Benedek,M.,Chen,Q.,...Silvia,P.J.(2018).Robust prediction of individual creative ability from brain functional connectivity.Proceedings of the National Academy of Sciences of the United States of America,115(5),1087-1092.
Benjamin,D.J.,Berger,J.O.,Johannesson,M.,Nosek,B.A.,Wagenmakers,E.J.,Berk,R.,...Cesarini,D.(2018).Redefine statistical significance.Nature Human Behaviour,2(1),6-10.
Boedhoe,P.S.,Schmaal,L.,Abe,Y.,Ameis,S.H.,Arnold,P.D.,Batistuzzo,M.C.,...Brem,S.(2017).Distinct subcortical volume alterations in pediatric and adult ocd:a worldwide meta- and mega-Analysis.American Journal of Psychiatry,174(1),60-69.
Button,K.S.,Ioannidis,J.P.,Mokrysz,C.,Nosek,B.A.,Flint,J.,Robinson,E.S.,& Munafò,M.R.(2013).Power failure:why small sample size undermines the reliability of neuroscience.Nature Reviews Neuroscience,14(5),365-376.
Cheng,W.,Rolls,E.T.,Qiu,J.,Liu,W.,Tang,Y.,Huang,C.C.,...Pu,J.(2016).Medial reward and lateral non-reward orbitofrontal cortex circuits change in opposite directions in depression.Brain,139,3296-3309.
Freese,J.,& Peterson,D.(2017).Replication in Social Science.Annual Review of Sociology,43,147-165.
Guglielmi,G.The world's largest set of brain scans are helping reveal the workings of the mind and how diseases ravage the brain.Retrieved December 20,2018,from https://www.sciencemag.org/news/2018/01/world-s-largest-set-brain-scans-are-helping-reveal-workings-mind-and-how-diseases
Gorgolewski,K.J.,& Poldrack,R.A.(2016).A Practical Guide for Improving Transparency and Reproducibility in Neuroimaging Research.Plos Biology,14(7),e1002506.
Hu,C.P.,Yin,J.X.,Lindenberg,S.,Dalgar,I.,Weissgerber,S.C.,Vergara,R.C.,...Hadi,R.(2018).Data from the Human Penguin Project:a cross-national dataset testing principles from social thermoregulation theory.https://doi.org/10.31234/osf.io/cs6au.
IJzerman,H.,Lindenberg,S.,Dalar,.,Weissgerber,S.S.,Vergara,R.C.,Cairo,A.H.,...Hall,C.J.(2018).The Human Penguin Project:climate,social integration,and core body temperature.Collabra:Psychology,4(1),37.
Ioannidis,J.P.A.(2005).Why most published research findings are false.Plos Medicine,2(8),696-701.
Klein,R.A.,Vianello,M.,Hasselman,F.,Adams,B.G.,Adams Jr,R.B.,Alper,S.,...Batra,R.(2018).Many labs 2:investigating variation in replicability across sample and setting.Advances in Methods and Practices in Psychological Science,1(4),443-490.
Kong,X.Z.,Mathias,S.R.,Guadalupe,T.,Glahn,D.C.,Franke,B.,Crivello,F.,...ENIGMA Laterality Working Group.(2018).Mapping cortical brain asymmetry in 17,141 healthy individuals worldwide via the ENIGMA Consortium.Proceedings of the National Academy of Sciences of the United States of America,115(22),E5154-E5163.
LeWinn,K.Z.,Sheridan,M.A.,Keyes,K.M.,Hamilton,A.,& McLaughlin,K.A.(2017).Sample composition alters associations between age and brain structure.Nature Communications,8(1),1-14.
Munafò,M.R.,Nosek,B.A.,Bishop,D.V.,Button,K.S.,Chambers,C.D.,Du Sert,N.P.,...Ioannidis,J.P.(2017).A manifesto for reproducible science.Nature Human Behaviour,1(1),1-9.
Olds,J.L.(2016).The rise of team neuroscience.Nature Reviews Neuroscience,17(10),601-602.
Poldrack,R.A.,Baker,C.I.,Durnez,J.,Gorgolewski,K.J.,Matthews,P.M.,Munafò,M.R.,...& Yarkoni,T.(2017).Scanning the horizon:towards transparent and reproducible neuroimaging research.Nature Reviews Neuroscience,18(2),115-126.
Prinz,F.,Schlange,T.,& Asadullah,K.(2011).Believe it or not:how much can we rely on published data on potential drug targets?Nature Reviews Drug Discovery,10(9),712-U781.
Schooler,J.W.(2014).Metascience could rescue the replication crisis.Nature,515(7525),9.
Simmons,J.P.,Nelson,L.D.,& Simonsohn,U.(2011).False-positive psychology:undisclosed flexibility in data collection and analysis allows presenting anything as significant.Psychological Science,22(11),1359-1366.
Viechtbauer,W.(2010).Conducting meta-analyses in R with the metafor package.Journal of statistical software,36(3).
Weisberg,S.M.,Chatterjee,A.,& Newcombe,N.(2018).Hippocampal volume and navigation ability reanalysis.Retrieved May 1,2018,from:https://osf.io/xp7ru
Yan,C.G.,Li,L.,Chen,X.,Castellanos,F.X.,Bai,F.,Bai,T.J.,...Cheng,C.(2018).Twenty-five cohorts of major depressive disorder in china:evidence for reduced but not enhanced default mode network functional connectivity.bioRxiv,321745.
Zeng,L.L.,Wang,H.,Hu,P.,Yang,B.,Pu,W.,Shen,H.,...Wang,K.(2018).Multi-Site Diagnostic Classification of Schizophrenia Using Discriminant Deep Learning with Functional Connectivity MRI.Ebiomedicine,30,74-85.
Zickfeld,J.H.,Schubert,T.W.,Seibt,B.,Blomster,J.K.,Arriaga,P.,Basabe,N.,...Ding,Y.(2018).Kama muta:Conceptualizing and measuring the experience often labelled being moved across 19 nations and 15 languages.Emotion,in press.