References

Albert, Derek A., and Daniel Smilek. 2023. “Comparing Attentional Disengagement Between Prolific and MTurk Samples.” Scientific Reports 13 (1): 20574. https://doi.org/10.1038/s41598-023-46048-5.
Albert, Scott T, Jihoon Jang, Shanaathanan Modchalingam, Bernard Marius ’t Hart, Denise Henriques, Gonzalo Lerner, Valeria Della-Maggiore, Adrian M Haith, John W Krakauer, and Reza Shadmehr. 2022. “Competition Between Parallel Sensorimotor Learning Systems.” eLife 11 (February): e65361. https://doi.org/10.7554/eLife.65361.
Allen, Kelsey, Franziska Brändle, Matthew Botvinick, Judith E. Fan, Samuel J. Gershman, Alison Gopnik, Thomas L. Griffiths, et al. 2024. “Using Games to Understand the Mind.” Nature Human Behaviour, June. https://doi.org/10.1038/s41562-024-01878-9.
Angele, Bernhard, Ana Baciero, Pablo Gómez, and Manuel Perea. 2022. “Does Online Masked Priming Pass the Test? The Effects of Prime Exposure Duration on Masked Identity Priming.” Behavior Research Methods 55 (1): 151–67. https://doi.org/10.3758/s13428-021-01742-y.
Ansolabehere, S., and B. F. Schaffner. 2015. “Distractions: The Incidence and Consequences of Interruptions for Survey Respondents.” Journal of Survey Statistics and Methodology 3 (2): 216–39. https://doi.org/10.1093/jssam/smv003.
Anwyl-Irvine, Alexander L., Edwin S. Dalmaijer, Nick Hodges, and Jo K. Evershed. 2021. “Realistic Precision and Accuracy of Online Experiment Platforms, Web Browsers, and Devices.” Behavior Research Methods 53 (4): 1407–25. https://doi.org/10.3758/s13428-020-01501-5.
Anwyl-Irvine, Alexander L., Jessica Massonnié, Adam Flitton, Natasha Kirkham, and Jo K. Evershed. 2020. “Gorilla in Our Midst: An Online Behavioral Experiment Builder.” Behavior Research Methods 52 (1): 388–407. https://doi.org/10.3758/s13428-019-01237-x.
Arnett, Jeffrey J. 2008. “The Neglected 95%: Why American Psychology Needs to Become Less American.” American Psychologist 63 (7): 602–14. https://doi.org/10.1037/0003-066X.63.7.602.
Atkinson, Amy L, Beatriz Pinheiro Sanchez, Matthew Warburton, Heather Allmark, and Richard J Allen. 2025. “The Ability to Direct Attention in Working Memory Is Not Impaired in Adults with Symptoms of ADHD.” Journal of Attention Disorders 29 (9): 684–705. https://doi.org/10.1177/10870547251330039.
Avraham, Guy, and Richard B Ivry. 2025. “Interference Underlies Attenuation Upon Relearning in Sensorimotor Adaptation.” eNeuro 12 (6): 1–17. https://doi.org/10.1523/ENEURO.0132-25.2025.
Baker, Daniel H., Greta Vilidaite, Freya A. Lygo, Anika K. Smith, Tessa R. Flack, André D. Gouws, and Timothy J. Andrews. 2021. “Power Contours: Optimising Sample Size and Precision in Experimental Psychology and Human Neuroscience.” Psychological Methods 26 (3): 295–314. https://doi.org/10.1037/met0000337.
Banerjee, Abhijit V., Swati Bhattacharjee, Raghabendra Chattopadhyay, Esther Duflo, Alejandro J. Ganimian, Kailash Rajah, and Elizabeth S. Spelke. 2025. “Children’s Arithmetic Skills Do Not Transfer Between Applied and Academic Mathematics.” Nature 639 (8055): 673–81. https://doi.org/10.1038/s41586-024-08502-w.
Barack, David L, Vera U Ludwig, Felipe Parodi, Nuwar Ahmed, Elizabeth M Brannon, Arjun Ramakrishnan, and Michael L Platt. 2024. “Attention Deficits Linked with Proclivity to Explore While Foraging.” Proceedings of the Royal Society B: Biological Sciences 291 (2017): 20222584. https://doi.org/10.1098/rspb.2022.2584.
Barnhoorn, Jonathan S., Erwin Haasnoot, Bruno R. Bocanegra, and Henk Van Steenbergen. 2015. QRTEngine: An Easy Solution for Running Online Reaction Time Experiments Using Qualtrics.” Behavior Research Methods 47 (4): 918–29. https://doi.org/10.3758/s13428-014-0530-7.
Barradas, Victor R., Yasuharu Koike, and Nicolas Schweighofer. 2024. “Theoretical Limits on the Speed of Learning Inverse Models Explain the Rate of Adaptation in Arm Reaching Tasks.” Neural Networks 170 (February): 376–89. https://doi.org/10.1016/j.neunet.2023.10.049.
Begbie, G. H. 1959. “Accuracy of Aiming in Linear Hand-Movements.” Quarterly Journal of Experimental Psychology 11 (2): 65–75. https://doi.org/10.1080/17470215908416293.
Bridges, David, Alain Pitiot, Michael R. MacAskill, and Jonathan W. Peirce. 2020. “The Timing Mega-Study: Comparing a Range of Experiment Generators, Both Lab-Based and Online.” PeerJ 8 (July): e9414. https://doi.org/10.7717/peerj.9414.
Brookes, Jack, Matthew Warburton, Mshari Alghadier, Mark Mon-Williams, and Faisal Mushtaq. 2019. “Studying Human Behavior with Virtual Reality: The Unity Experiment Framework.” Behavior Research Methods 52 (April): 455–63. https://doi.org/10.3758/s13428-019-01242-0.
Brown, Judson S, and Arthur T Slater-Hammel. 1949. “Discrete Movements in the Horizontal Plane as a Function of Their Length and Direction.” Journal of Experimental Psychology 39 (1): 84. https://doi.org/10.1037/h0062478.
Cao, Shuangyuan, and Fang Liu. 2022. “Learning to Play: Understanding in-Game Tutorials with a Pilot Study on Implicit Tutorials.” Heliyon 8 (11): e11482. https://doi.org/10.1016/j.heliyon.2022.e11482.
Casey, Logan S., Jesse Chandler, Adam Seth Levine, Andrew Proctor, and Dara Z. Strolovitch. 2017. “Intertemporal Differences Among MTurk Workers: Time-Based Sample Variations and Implications for Online Data Collection.” SAGE Open 7 (2): 215824401771277. https://doi.org/10.1177/2158244017712774.
Casler, Krista, Lydia Bickel, and Elizabeth Hackett. 2013. “Separate but Equal? A Comparison of Participants and Data Gathered via Amazon’s MTurk, Social Media, and Face-to-Face Behavioral Testing.” Computers in Human Behavior 29 (6): 2156–60. https://doi.org/10.1016/j.chb.2013.05.009.
Cesanek, Evan, Sabyasachi Shivkumar, James N. Ingram, and Daniel M. Wolpert. 2023. “Ouvrai: Opening Access to Remote VR Studies of Human Behavioral Neuroscience.” Preprint. Neuroscience. https://doi.org/10.1101/2023.05.23.542017.
———. 2024. “Ouvrai Opens Access to Remote Virtual Reality Studies of Human Behavioural Neuroscience.” Nature Human Behaviour, April. https://doi.org/10.1038/s41562-024-01834-7.
Cesanek, Evan, Zhaoran Zhang, James N Ingram, Daniel M Wolpert, and J Randall Flanagan. 2021. “Motor Memories of Object Dynamics Are Categorically Organized.” eLife 10 (November): e71627. https://doi.org/10.7554/eLife.71627.
Chen, Xiuli, Robb B. Rutledge, Harriet R. Brown, Raymond J. Dolan, Sven Bestmann, and Joseph M. Galea. 2018. “Age-Dependent Pavlovian Biases Influence Motor Decision-Making.” Edited by Gunnar Blohm. PLOS Computational Biology 14 (7): e1006304. https://doi.org/10.1371/journal.pcbi.1006304.
Chen, Yifei, Sabrina J. Abram, Richard B. Ivry, and Jonathan S. Tsay. 2025. “Indirect Feedback Hinders Explicit Sensorimotor Adaptation.” Proceedings of the Royal Society B: Biological Sciences 292 (2051): 20251407. https://doi.org/10.1101/2024.06.28.601293.
Chmielewski, Michael, and Sarah C. Kucker. 2020. “An MTurk Crisis? Shifts in Data Quality and the Impact on Study Results.” Social Psychological and Personality Science 11 (4): 464–73. https://doi.org/10.1177/1948550619875149.
Cisneros, Elizabeth, Sheer Karny, Richard B. Ivry, and Jonathan S. Tsay. 2024. “Differential Aging Effects on Implicit and Explicit Sensorimotor Learning.” July 4, 2024. https://doi.org/10.1101/2024.07.02.601091.
Clode, Dani, Lucy Dowdall, Edmund Da Silva, Klara Selén, Dorothy Cowie, Giulia Dominijanni, and Tamar R. Makin. 2024. “Evaluating Initial Usability of a Hand Augmentation Device Across a Large and Diverse Sample.” Science Robotics 9 (90): eadk5183. https://doi.org/10.1126/scirobotics.adk5183.
Cohen, Jacob. 1962. “The Statistical Power of Abnormal-Social Psychological Research: A Review.” The Journal of Abnormal and Social Psychology 65 (3): 145.
Coltman, Susan K., Robert J. van Beers, W. Pieter Medendorp, and Paul L. Gribble. 2021. “Sensitivity to Error During Visuomotor Adaptation Is Similarly Modulated by Abrupt, Gradual, and Random Perturbation Schedules.” Journal of Neurophysiology 126 (3): 934–45. https://doi.org/10.1152/jn.00269.2021.
Coutrot, Antoine, Ricardo Silva, Ed Manley, Will De Cothi, Saber Sami, Véronique D. Bohbot, Jan M. Wiener, et al. 2018. “Global Determinants of Navigation Ability.” Current Biology 28 (17): 2861–2866.e4. https://doi.org/10.1016/j.cub.2018.06.009.
Crump, Matthew J. C., John V. McDonnell, and Todd M. Gureckis. 2013. “Evaluating Amazon’s Mechanical Turk as a Tool for Experimental Behavioral Research.” Edited by Sam Gilbert. PLoS ONE 8 (3): e57410. https://doi.org/10.1371/journal.pone.0057410.
Cullen, Simon, and Daniel Oppenheimer. 2024. “Choosing to Learn: The Importance of Student Autonomy in Higher Education.” Science Advances 10 (29): eado6759. https://doi.org/10.1126/sciadv.ado6759.
Dandurand, Frédéric, Thomas R Shultz, and Kristine H Onishi. 2008. “Comparing Online and Lab Methods in a Problem-Solving Experiment.” Behavior Research Methods 40 (2): 428–34. https://doi.org/10.3758/BRM.40.2.428.
Das, Anwesha, Alexandros Karagiorgis, Jörn Diedrichsen, Max-Philipp Stenner, and Elena Azañón. 2025. “Micro-Offline Gains Do Not Reflect Offline Learning During Early Motor Skill Acquisition in Humans.” Proceedings of the National Academy of Sciences 122 (44): e2509233122. https://doi.org/10.1073/pnas.2509233122.
De Leeuw, Joshua R. 2015. jsPsych: A JavaScript Library for Creating Behavioral Experiments in a Web Browser.” Behavior Research Methods 47 (1): 1–12. https://doi.org/10.3758/s13428-014-0458-y.
———. 2023. DataPipe: Born-open Data Collection for Online Experiments.” Behavior Research Methods 56 (3): 2499–2506. https://doi.org/10.3758/s13428-023-02161-x.
Deary, Ian J., and Geoff Der. 2005. “Reaction Time, Age, and Cognitive Ability: Longitudinal Findings from Age 16 to 63 Years in Representative Population Samples.” Aging, Neuropsychology, and Cognition 12 (2): 187–215. https://doi.org/10.1080/13825580590969235.
Dhakal, Vivek, Anna Maria Feit, Per Ola Kristensson, and Antti Oulasvirta. 2018. “Observations on Typing from 136 Million Keystrokes.” In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 1–12. Montreal QC Canada: ACM. https://doi.org/10.1145/3173574.3174220.
Ding, Wei, Anjuli Niyogi, and Jonathan S. Tsay. 2025. “Hypothesis Testing Governs an Efficiency-Flexibility Trade-off in Strategic Motor Learning.” 2025. https://doi.org/10.64898/2025.11.29.691289.
Dotan, Dror, Florent Meyniel, and Stanislas Dehaene. 2018. “On-Line Confidence Monitoring During Decision Making.” Cognition 171 (February): 112–21. https://doi.org/10.1016/j.cognition.2017.11.001.
Dotan, Dror, Pedro Pinheiro-Chagas, Fosca Al Roumi, and Stanislas Dehaene. 2019. “Track It to Crack It: Dissecting Processing Stages with Finger Tracking.” Trends in Cognitive Sciences 23 (12): 1058–70. https://doi.org/10.1016/j.tics.2019.10.002.
Douglas, Benjamin D., Patrick J. Ewell, and Markus Brauer. 2023. “Data Quality in Online Human-Subjects Research: Comparisons Between MTurk, Prolific, CloudResearch, Qualtrics, and SONA.” Edited by Jeffrey S. Hallam. PLOS ONE 18 (3): e0279720. https://doi.org/10.1371/journal.pone.0279720.
Doya, K. 2000. “Complementary Roles of Basal Ganglia and Cerebellum in Learning and Motor Control.” Current Opinion in Neurobiology 10 (6): 732–39. https://doi.org/10.1016/S0959-4388(00)00153-7.
Drody, Allison C., Effie J. Pereira, and Daniel Smilek. 2023. “A Desire for Distraction: Uncovering the Rates of Media Multitasking During Online Research Studies.” Scientific Reports 13 (1): 781. https://doi.org/10.1038/s41598-023-27606-3.
Durisko, Corrine, Michael McCue, Patrick J. Doyle, Michael Walsh Dickey, and Julie A. Fiez. 2016. “A Flexible and Integrated System for the Remote Acquisition of Neuropsychological Data in Stroke Research.” Telemedicine and e-Health 22 (12): 1032–40. https://doi.org/10.1089/tmj.2015.0235.
Eerola, Tuomas, James Armitage, Nadine Lavan, and Sarah Knight. 2021. “Online Data Collection in Auditory Perception and Cognition Research: Recruitment, Testing, Data Quality and Ethical Considerations.” Auditory Perception & Cognition 4 (3–4): 251–80. https://doi.org/10.1080/25742442.2021.2007718.
Faul, Franz, Edgar Erdfelder, Albert-Georg Lang, and Axel Buchner. 2007. “G*Power 3: A Flexible Statistical Power Analysis Program for the Social, Behavioral, and Biomedical Sciences.” Behavior Research Methods 39 (2): 175–91. https://doi.org/10.3758/BF03193146.
Fitts, Paul M. 1954. “The Information Capacity of the Human Motor System in Controlling the Amplitude of Movement.” Journal of Experimental Psychology 47 (6): 381. https://doi.org/10.1037/h0055392.
Fowler, Craig, Jian Jiao, and Margaret Pitts. 2023. “Frustration and Ennui Among Amazon MTurk Workers.” Behavior Research Methods 55: 3009–25. https://doi.org/10.3758/s13428-022-01955-9.
Gagné, Nathan, and Léon Franzen. 2023. “How to Run Behavioural Experiments Online: Best Practice Suggestions for Cognitive Psychology and Neuroscience.” Swiss Psychology Open 3 (1): 1. https://doi.org/10.5334/spo.34.
Gajos, Krzysztof Z., Katharina Reinecke, Mary Donovan, Christopher D. Stephen, Albert Y. Hung, Jeremy D. Schmahmann, and Anoopum S. Gupta. 2020. “Computer Mouse Use Captures Ataxia and Parkinsonism, Enabling Accurate Measurement and Detection.” Movement Disorders 35 (2): 354–58. https://doi.org/10.1002/mds.27915.
Germine, Laura, Ken Nakayama, Bradley C. Duchaine, Christopher F. Chabris, Garga Chatterjee, and Jeremy B. Wilmer. 2012. “Is the Web as Good as the Lab? Comparable Performance from Web and Lab in Cognitive/Perceptual Experiments.” Psychonomic Bulletin & Review 19 (5): 847–57. https://doi.org/10.3758/s13423-012-0296-9.
Germine, Laura, Katharina Reinecke, and Naomi S. Chaytor. 2019. “Digital Neuropsychology: Challenges and Opportunities at the Intersection of Science and Software.” The Clinical Neuropsychologist 33 (2): 271–86. https://doi.org/10.1080/13854046.2018.1535662.
Goodrich, Brittney, Marieke Fenton, Jerrod Penn, John Bovay, and Travis Mountain. 2023. “Battling Bots: Experiences and Strategies to Mitigate Fraudulent Responses in Online Surveys.” Applied Economic Perspectives and Policy 45 (2): 762–84. https://doi.org/10.1002/aepp.13353.
Gordon, Michael E, L Allen Slade, and Neal Schmitt. 1986. “The "Science of the Sophomore" Revisited: From Conjecture to Empiricism.” The Academy of Management Review 11 (1): 191–207.
Gosling, Samuel D., Carson J. Sandy, Oliver P. John, and Jeff Potter. 2010. “Wired but Not WEIRD: The Promise of the Internet in Reaching More Diverse Samples.” Behavioral and Brain Sciences 33 (2–3): 94–95. https://doi.org/10.1017/S0140525X10000300.
Grant, Naomi K., Leah K. Hamilton, and Jenalyn M. Ormita. 2025. “Improving Comprehension of Consent Forms in Online Research: An Empirical Test of Four Interventions.” Journal of Empirical Research on Human Research Ethics, March, 15562646251321132. https://doi.org/10.1177/15562646251321132.
Griffin, Marybec, Richard J. Martino, Caleb LoSchiavo, Camilla Comer-Carruthers, Kristen D. Krause, Christopher B. Stults, and Perry N. Halkitis. 2022. “Ensuring Survey Research Data Integrity in the Era of Internet Bots.” Quality & Quantity 56 (4): 2841–52. https://doi.org/10.1007/s11135-021-01252-1.
Gross, Paul, Mary Gannotti, Amy Bailes, Susan D. Horn, Jacob Kean, Unni G. Narayanan, Jerry Oakes, and Garey Noritz. 2020. “Cerebral Palsy Research Network Clinical Registry: Methodology and Baseline Report.” Archives of Rehabilitation Research and Clinical Translation 2 (3): 100054. https://doi.org/10.1016/j.arrct.2020.100054.
Hadjiosif, Alkis M., Y. Dajaj, Tanvi Ranjan, and Maurice A. Smith. 2025. “Tiny Visual Latencies Can Profoundly Impair Implicit Sensorimotor Learning.” Scientific Reports 15 (1): 16084. https://doi.org/10.1038/s41598-025-98652-2.
Hamari, Juho, Jonna Koivisto, and Harri Sarsa. 2014. “Does Gamification Work? – A Literature Review of Empirical Studies on Gamification.” In 2014 47th Hawaii International Conference on System Sciences, 3025–34. Waikoloa, HI: IEEE. https://doi.org/10.1109/HICSS.2014.377.
Hartshorne, Joshua K., Joshua R. De Leeuw, Noah D. Goodman, Mariela Jennings, and Timothy J. O’Donnell. 2019. “A Thousand Studies for the Price of One: Accelerating Psychological Science with Pushkin.” Behavior Research Methods 51 (4): 1782–1803. https://doi.org/10.3758/s13428-018-1155-z.
Hartshorne, Joshua K., and Laura T. Germine. 2015. “When Does Cognitive Functioning Peak? The Asynchronous Rise and Fall of Different Cognitive Abilities Across the Life Span.” Psychological Science 26 (4): 433–43. https://doi.org/10.1177/0956797614567339.
Hauser, David J., Phoebe C. Ellsworth, and Richard Gonzalez. 2018. “Are Manipulation Checks Necessary?” Frontiers in Psychology 9 (June): 998. https://doi.org/10.3389/fpsyg.2018.00998.
Hauser, David J., and Norbert Schwarz. 2015. “It’s a Trap! Instructional Manipulation Checks Prompt Systematic Thinking on Tricky Tasks.” Sage Open 5 (2): 2158244015584617. https://doi.org/10.1177/2158244015584617.
Henninger, Felix, Yury Shevchenko, Ulf K. Mertens, Pascal J. Kieslich, and Benjamin E. Hilbig. 2022. “Lab.js: A Free, Open, Online Study Builder.” Behavior Research Methods 54 (2): 556–73. https://doi.org/10.3758/s13428-019-01283-5.
Henrich, Joseph, Steven J. Heine, and Ara Norenzayan. 2010. “The Weirdest People in the World?” Behavioral and Brain Sciences 33 (2–3): 61–83. https://doi.org/10.1017/S0140525X0999152X.
Hilton, Courtney B. 2024. “Why Music Psychology Needs Larger and More Diverse Datasets and How Citizen Science Can Help.” March 7, 2024. https://doi.org/10.31234/osf.io/zv6w8.
Hyde, Eleanor R A, Robert Schmidt, Daniel J Carroll, and Claudia C. Von Bastian. 2025. “First-Person Shooter Expertise: A Processing Speed, Not Multitasking Advantage.” 2025. https://doi.org/10.31234/osf.io/t3znr_v1.
Jang, Jihoon, Reza Shadmehr, and Scott T. Albert. 2023. “A Software Tool for at-Home Measurement of Sensorimotor Adaptation.” December 13, 2023. https://doi.org/10.1101/2023.12.12.571359.
Johnson, Brian P., Eran Dayan, Nitzan Censor, and Leonardo G. Cohen. 2022. “Crowdsourcing in Cognitive and Systems Neuroscience.” The Neuroscientist 28 (5): 425–37. https://doi.org/10.1177/10738584211017018.
Kapitány, Rohan, and Christopher Kavanagh. 2023. “Best Practices for Crowd-Sourcing Data in the Behavioral Sciences.” OSF Preprints. https://doi.org/10.31219/osf.io/sn5gh.
Kay, Cameron Stuart. 2025. “Why You Shouldn’t Trust Data Collected on MTurk.” Behavior Research Methods 57 (340): 1–11. https://doi.org/10.3758/s13428-025-02852-7.
Keith, Melissa G., and Alexander S. McKay. 2024. “Too Anecdotal to Be True? Mechanical Turk Is Not All Bots and Bad Data: Response to Webb and Tangney (2022).” Perspectives on Psychological Science, March, 17456916241234328. https://doi.org/10.1177/17456916241234328.
Keller, Arielle S., Alisha Shetty, Ran Barzilay, Monica E. Calkins, Yap-Seng Chong, Niyati Dave, Damien A. Fair, et al. 2025. “Cognition Varies Across the Calendar Year in Multiple Large-Scale Datasets.” Proceedings of the National Academy of Sciences 122 (51): e2506054122. https://doi.org/10.1073/pnas.2506054122.
Kennedy, Ryan, Scott Clifford, Tyler Burleigh, Philip D. Waggoner, Ryan Jewell, and Nicholas J. G. Winter. 2020. “The Shape of and Solutions to the MTurk Quality Crisis.” Political Science Research and Methods 8 (4): 614–29. https://doi.org/10.1017/psrm.2020.6.
Kim, Hojoong M., James B. Leverenz, Daniel J. Burdick, Sindhu Srivatsal, Jennifer Pate, Shu-Ching Hu, Steven P. Millard, Marie Y. Davis, Ali Samii, and Cyrus P. Zabetian. 2018. “Diagnostic Validation for Participants in the Washington State Parkinson Disease Registry.” Parkinson’s Disease 2018 (November): 1–6. https://doi.org/10.1155/2018/3719578.
Kim, Hyosub E., Guy Avraham, and Richard B. Ivry. 2021. “The Psychology of Reaching: Action Selection, Movement Implementation, and Sensorimotor Learning.” Annual Review of Psychology 72 (1): 61–95. https://doi.org/10.1146/annurev-psych-010419-051053.
Kim, Olivia A., Alexander D. Forrence, and Samuel D. McDougle. 2022. “Motor Learning Without Movement.” Proceedings of the National Academy of Sciences 119 (30): e2204379119. https://doi.org/10.1073/pnas.2204379119.
Kothe, Emily Jane, and Mathew Ling. 2019. “Retention of Participants Recruited to a Multi-Year Longitudinal Study via Prolific.” September 6, 2019. https://doi.org/10.31234/osf.io/5yv2u.
Krakauer, John W., Asif A. Ghazanfar, Alex Gomez-Marin, Malcolm A. MacIver, and David Poeppel. 2017. “Neuroscience Needs Behavior: Correcting a Reductionist Bias.” Neuron 93 (3): 480–90. https://doi.org/10.1016/j.neuron.2016.12.041.
Krakauer, John W., Alkis M. Hadjiosif, Jing Xu, Aaron L. Wong, and Adrian M. Haith. 2019. “Motor Learning.” In Comprehensive Physiology, edited by Ronald Terjung, 1st ed., 613–63. Wiley. https://doi.org/10.1002/cphy.c170043.
Lakens, Daniël. 2024. “When and How to Deviate From a Preregistration.” Collabra: Psychology 10 (1): 117094. https://doi.org/10.1525/collabra.117094.
Leys, Christophe, Christophe Ley, Olivier Klein, Philippe Bernard, and Laurent Licata. 2013. “Detecting Outliers: Do Not Use Standard Deviation Around the Mean, Use Absolute Deviation Around the Median.” Journal of Experimental Social Psychology 49 (4): 764–66. https://doi.org/10.1016/j.jesp.2013.03.013.
Li, Qisheng, Sung Jun Joo, Jason D. Yeatman, and Katharina Reinecke. 2020. “Controlling for ParticipantsViewing Distance in Large-Scale, Psychophysical Online Experiments Using a Virtual Chinrest.” Scientific Reports 10 (1): 904. https://doi.org/10.1038/s41598-019-57204-1.
Listman, Jennifer B., Jonathan S. Tsay, Hyosub E. Kim, Wayne E. Mackey, and David J. Heeger. 2021. “Long-Term Motor Learning in the Wild With High Volume Video Game Data.” Frontiers in Human Neuroscience 15 (December): 777779. https://doi.org/10.3389/fnhum.2021.777779.
Liu, Jingxuan, Courtney B. Hilton, Elika Bergelson, and Samuel A. Mehr. 2023. “Language Experience Predicts Music Processing in a Half-Million Speakers of Fifty-Four Languages.” Current Biology 33 (10): 1916–1925.e4. https://doi.org/10.1016/j.cub.2023.03.067.
Long, Bria, Jan Simson, Andrés Buxó-Lugo, Duane G. Watson, and Samuel A. Mehr. 2023. “How Games Can Make Behavioural Science Better.” Nature 613 (7944): 433–36. https://doi.org/10.1038/d41586-023-00065-6.
Malone, Laura A., Nayo M. Hill, Haley Tripp, Vadim Zipunnikov, Daniel M. Wolpert, and Amy J. Bastian. 2025. “The Control of Movement Gradually Transitions from Feedback Control to Feedforward Adaptation Throughout Childhood.” Npj Science of Learning 10 (1): 13. https://doi.org/10.1038/s41539-025-00304-7.
Mandlekar, Ajay, Yuke Zhu, Animesh Garg, Jonathan Booher, Max Spero, Albert Tung, Julian Gao, et al. 2018. RoboTurk: A Crowdsourcing Platform for Robotic Skill Learning Through Imitation.” November 7, 2018. https://doi.org/10.48550/arXiv.1811.02790.
Marek, Scott, Brenden Tervo-Clemmens, Finnegan J. Calabro, David F. Montez, Benjamin P. Kay, Alexander S. Hatoum, Meghan Rose Donohue, et al. 2022. “Reproducible Brain-Wide Association Studies Require Thousands of Individuals.” Nature 603 (7902): 654–60. https://doi.org/10.1038/s41586-022-04492-9.
Mathôt, Sebastiaan, Daniel Schreij, and Jan Theeuwes. 2012. OpenSesame: An Open-Source, Graphical Experiment Builder for the Social Sciences.” Behavior Research Methods 44 (2): 314–24. https://doi.org/10.3758/s13428-011-0168-7.
McConnell, Patrick A., Christian Finetto, and Kirstin-Friederike Heise. 2024. “Methodological Considerations for Behavioral Studies Relying on Response Time Outcomes Through Online Crowdsourcing Platforms.” Scientific Reports 14 (1): 7719. https://doi.org/10.1038/s41598-024-58300-7.
Miller, R., K. Schmidt, C. Kirschbaum, and S. Enge. 2018. “Comparability, Stability, and Reliability of Internet-Based Mental Chronometry in Domestic and Laboratory Settings.” Behavior Research Methods 50 (4): 1345–58. https://doi.org/10.3758/s13428-018-1036-5.
Milne, Alice E., Roberta Bianco, Katarina C. Poole, Sijia Zhao, Andrew J. Oxenham, Alexander J. Billig, and Maria Chait. 2021. “An Online Headphone Screening Test Based on Dichotic Pitch.” Behavior Research Methods 53 (4): 1551–62. https://doi.org/10.3758/s13428-020-01514-0.
Morehead, J. Ryan, Jordan A. Taylor, Darius E. Parvin, and Richard B. Ivry. 2017. “Characteristics of Implicit Sensorimotor Adaptation Revealed by Task-irrelevant Clamped Feedback.” Journal of Cognitive Neuroscience 29 (6): 1061–74. https://doi.org/10.1162/jocn_a_01108.
Moss, Aaron. 2019. “Study: Does Time of Day Affect Online Survey Results?” CloudResearch. 2019. https://www.cloudresearch.com/resources/research/does-time-of-day-affect-survey-results/.
Moss, Aaron J, Cheskie Rosenzweig, Shalom N Jaffe, Richa Gautam, Jonathan Robinson, and Leib Litman. 2021. “Bots or Inattentive Humans? Identifying Sources of Low-Quality Data in Online Platforms.” PsyArXiv.
Munnilari, Madhavi, Tulasiram Bommasamudram, Judy Easow, David Tod, Evdokia Varamenti, Ben J. Edwards, Aishwarya Ravindrakumar, Chloe Gallagher, and Samuel A. Pullinger. 2024. “Diurnal Variation in Variables Related to Cognitive Performance: A Systematic Review.” Sleep and Breathing 28 (1): 495–510. https://doi.org/10.1007/s11325-023-02895-0.
Newman, Alexander, Yuen Lam Bavik, Matthew Mount, and Bo Shao. 2021. “Data Collection via Online Platforms: Challenges and Recommendations for Future Research.” Applied Psychology 70 (3): 1380–1402. https://doi.org/10.1111/apps.12302.
Niv, Yael. 2021. “The Primacy of Behavioral Research for Understanding the Brain.” Behavioral Neuroscience 135 (5): 601–9. https://doi.org/10.1037/bne0000471.
Ogletree, Aaron M., and Benjamin Katz. 2021. “How Do Older Adults Recruited Using MTurk Differ From Those in a National Probability Sample?” The International Journal of Aging and Human Development 93 (2): 700–721. https://doi.org/10.1177/0091415020940197.
Open Science Collaboration. 2015. “Estimating the Reproducibility of Psychological Science.” Science 349 (6251): aac4716-1 - aac4716-8. https://doi.org/10.1126/science.aac4716.
Paolacci, Gabriele, and Jesse Chandler. 2014. “Inside the Turk: Understanding Mechanical Turk as a Participant Pool.” Current Directions in Psychological Science 23 (3): 184–88. https://doi.org/10.1177/0963721414531598.
Passell, Eliza, Roger W. Strong, Lauren A. Rutter, Heesu Kim, Luke Scheuer, Paolo Martini, Liz Grinspoon, and Laura Germine. 2021. “Cognitive Test Scores Vary with Choice of Personal Digital Device.” Behavior Research Methods 53 (6): 2544–57. https://doi.org/10.3758/s13428-021-01597-3.
Peer, Eyal, Laura Brandimarte, Sonam Samat, and Alessandro Acquisti. 2017. “Beyond the Turk: Alternative Platforms for Crowdsourcing Behavioral Research.” Journal of Experimental Social Psychology 70 (May): 153–63. https://doi.org/10.1016/j.jesp.2017.01.006.
Peer, Eyal, David Rothschild, Andrew Gordon, Zak Evernden, and Ekaterina Damer. 2021. “Data Quality of Platforms and Panels for Online Behavioral Research.” Behavior Research Methods 54 (4): 1643–62. https://doi.org/10.3758/s13428-021-01694-3.
Peirce, Jonathan W. 2007. PsychoPyPsychophysics Software in Python.” Journal of Neuroscience Methods 162 (1–2): 8–13. https://doi.org/10.1016/j.jneumeth.2006.11.017.
Peterson, Joshua C., David D. Bourgin, Mayank Agrawal, Daniel Reichman, and Thomas L. Griffiths. 2021. “Using Large-Scale Experiments and Machine Learning to Discover Theories of Human Decision-Making.” Science 372 (6547): 1209–14. https://doi.org/10.1126/science.abe2629.
Pickavance, John P., M. Mon-Williams, Faisal Mushtaq, and J. Ryan Morehead. 2022. “Proactive Inhibition of Goal-Directed Movements Involves Explicit Changes to Movement Planning.” June 2, 2022. https://doi.org/10.1101/2022.06.01.494317.
Pittman, Matthew, and Kim Sheehan. 2016. “Amazon’s Mechanical Turk a Digital Sweatshop? Transparency and Accountability in Crowdsourced Online Research.” Journal of Media Ethics 31 (4): 260–62. https://doi.org/10.1080/23736992.2016.1228811.
Pronk, Thomas, Reinout W. Wiers, Bert Molenkamp, and Jaap Murre. 2020. “Mental Chronometry in the Pocket? Timing Accuracy of Web Applications on Touchscreen and Keyboard Devices.” Behavior Research Methods 52 (3): 1371–82. https://doi.org/10.3758/s13428-019-01321-2.
Rahnev, Dobromir, Kobe Desender, Alan L. F. Lee, William T. Adler, David Aguilar-Lleyda, Başak Akdoğan, Polina Arbuzova, et al. 2020. “The Confidence Database.” Nature Human Behaviour 4 (3): 317–25. https://doi.org/10.1038/s41562-019-0813-1.
Raz, Gal, Sabrina Piccolo, Janine Medrano, Shari Liu, Kirsten Lydic, Catherine Mei, Victoria Nguyen, Tianmin Shu, and Rebecca Saxe. 2024. “An Asynchronous, Hands-Off Workflow for Looking Time Experiments with Infants.” Developmental Psychology 60 (8): 1447–56. https://doi.org/10.1037/dev0001791.
Reinecke, Katharina, and Krzysztof Z. Gajos. 2015. LabintheWild: Conducting Large-Scale Online Experiments With Uncompensated Samples.” In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing, 1364–78. Vancouver BC Canada: ACM. https://doi.org/10.1145/2675133.2675246.
Reips, Ulf-Dietrich. 2000. “The Web Experiment Method.” In Psychological Experiments on the Internet, 89–117. Elsevier. https://doi.org/10.1016/B978-012099980-4/50005-8.
———. 2001. “The Web Experimental Psychology Lab: Five Years of Data Collection on the Internet.” Behavior Research Methods, Instruments, & Computers 33 (2): 201–11. https://doi.org/10.3758/BF03195366.
———. 2021. “Web-Based Research in Psychology: A Review.” Zeitschrift Für Psychologie 229 (4): 198–213. https://doi.org/10.1027/2151-2604/a000475.
Rodd, Jennifer M. 2024. “Moving Experimental Psychology Online: How to Obtain High Quality Data When We Can’t See Our Participants.” Journal of Memory and Language 134 (February): 104472. https://doi.org/10.1016/j.jml.2023.104472.
Rossi, Cristina, Rini Varghese, and Amy J Bastian. 2025. MovementVR: An Open-Source Tool for the Study of Motor Control and Learning in Virtual Reality.” 2025. https://doi.org/10.48550/arXiv.2504.21696.
Ruitenberg, Marit F. L., Vincent Koppelmans, Rachael D. Seidler, and Judith Schomaker. 2023. “Developmental and Age Differences in Visuomotor Adaptation Across the Lifespan.” Psychological Research 87 (6): 1710–17. https://doi.org/10.1007/s00426-022-01784-7.
Sauter, Marian, Maximilian Stefani, and Wolfgang Mack. 2022. “Equal Quality for Online and Lab Data: A Direct Comparison from Two Dual-Task Paradigms.” Open Psychology 4 (1): 47–59. https://doi.org/10.1515/psych-2022-0003.
Schatz, Philip, Vincent Ybarra, and Donald Leitner. 2015. “Validating the Accuracy of Reaction Time Assessment on Computer-Based Tablet Devices.” Assessment 22 (4): 405–10. https://doi.org/10.1177/1073191114566622.
Schmahmann, Jeremy D. 2019. “The Cerebellum and Cognition.” Neuroscience Letters 688 (January): 62–75. https://doi.org/10.1016/j.neulet.2018.07.005.
Schmidt, Christina, Fabienne Collette, Christian Cajochen, and Philippe Peigneux. 2007. “A Time to Think: Circadian Rhythms in Human Cognition.” Cognitive Neuropsychology 24 (7): 755–89. https://doi.org/10.1080/02643290701754158.
Semmelmann, Kilian, and Sarah Weigelt. 2017. “Online Psychophysics: Reaction Time Effects in Cognitive Experiments.” Behavior Research Methods 49 (4): 1241–60. https://doi.org/10.3758/s13428-016-0783-4.
Shadmehr, Reza, and John W. Krakauer. 2008. “A Computational Neuroanatomy for Motor Control.” Experimental Brain Research 185 (3): 359–81. https://doi.org/10.1007/s00221-008-1280-5.
Shadmehr, Reza, Thomas R. Reppert, Erik M. Summerside, Tehrim Yoon, and Alaa A. Ahmed. 2019. “Movement Vigor as a Reflection of Subjective Economic Utility.” Trends in Neurosciences 42 (5): 323–36. https://doi.org/10.1016/j.tins.2019.02.003.
Shmuelof, Lior, John W. Krakauer, and Pietro Mazzoni. 2012. “How Is a Motor Skill Learned? Change and Invariance at the Levels of Task Success and Trajectory Control.” Journal of Neurophysiology 108 (2): 578–94. https://doi.org/10.1152/jn.00856.2011.
Shyr, Megan C., and Sanjay S. Joshi. 2024. “A Case Study of the Validity of Web-based Visuomotor Rotation Experiments.” Journal of Cognitive Neuroscience 36 (1): 71–94. https://doi.org/10.1162/jocn_a_02080.
Simmons, Joseph P., Leif D. Nelson, and Uri Simonsohn. 2021. “Pre-Registration: Why and How.” Journal of Consumer Psychology 31 (1): 151–62. https://doi.org/10.1002/jcpy.1208.
Smith, Nicholas A., Isaac E. Sabat, Larry R. Martinez, Kayla Weaver, and Shi Xu. 2015. “A Convenient Solution: Using MTurk To Sample From Hard-To-Reach Populations.” Industrial and Organizational Psychology 8 (2): 220–28. https://doi.org/10.1017/iop.2015.29.
Smith, W. M. 1972. “Feedback: Real-Time Delayed Vision of One’s Own Tracking Behavior.” Science 176 (4037): 939–40. https://doi.org/10.1126/science.176.4037.939.
Spiers, Hugo J., Antoine Coutrot, and Michael Hornberger. 2023. “Explaining WorldWide Variation in Navigation Ability from Millions of People: Citizen Science Project Sea Hero Quest.” Topics in Cognitive Science 15 (1): 120–38. https://doi.org/10.1111/tops.12590.
Storozuk, Andie, Marilyn Ashley, Véronic Delage, and Erin A. Maloney. 2020. “Got Bots? Practical Recommendations to Protect Online Survey Data from Bot Attacks.” The Quantitative Methods for Psychology 16 (5): 472–81. https://doi.org/10.20982/tqmp.16.5.p472.
Szucs, Denes, and John P. A. Ioannidis. 2017. “Empirical Assessment of Published Effect Sizes and Power in the Recent Cognitive Neuroscience and Psychology Literature.” Edited by Eric-Jan Wagenmakers. PLOS Biology 15 (3): e2000797. https://doi.org/10.1371/journal.pbio.2000797.
Thomas, Kyle A., and Scott Clifford. 2017. “Validity and Mechanical Turk: An Assessment of Exclusion Methods and Interactive Experiments.” Computers in Human Behavior 77 (December): 184–97. https://doi.org/10.1016/j.chb.2017.08.038.
Townsend, Max, Matthew Warburton, Carlo Campagnoli, Mark Mon-Williams, Faisal Mushtaq, and J Ryan Morehead. 2025. “An Aha!’ Moment Precedes the Strategic Response to a Visuomotor Rotation.” 2025. https://doi.org/10.1101/2025.05.11.653302.
Tsay, Jonathan S., Hrach Asmerian, Laura T. Germine, Jeremy Wilmer, Richard B. Ivry, and Ken Nakayama. 2024. “Large-Scale Citizen Science Reveals Predictors of Sensorimotor Adaptation.” Nature Human Behaviour, January. https://doi.org/10.1038/s41562-023-01798-0.
Tsay, Jonathan S., Anisha M. Chandy, Romeo Chua, R. Chris Miall, Jonathan Cole, Alessandro Farnè, Richard B. Ivry, and Fabrice R. Sarlegna. 2024. “Minimal Impact of Chronic Proprioceptive Loss on Implicit Sensorimotor Adaptation and Perceived Movement Outcome.” Journal of Neurophysiology 132 (3): 770–80. https://doi.org/10.1152/jn.00096.2024.
Tsay, Jonathan S., and Richard B. Ivry. 2025. “Cerebellar Contributions to Action and Cognition: Prediction, Timescale, and Continuity.” 2025.
Tsay, Jonathan S., Richard B Ivry, Alan Lee, and Guy Avraham. 2021. “Moving Outside the Lab: The Viability of Conducting Sensorimotor Learning Studies Online.” Neurons, Behavior, Data Analysis, and Theory, 1–22. https://doi.org/10.51628/001c.26985.
Tsay, Jonathan S., Hyosub E Kim, Samuel D McDougle, Jordan A Taylor, Adrian Haith, Guy Avraham, John W Krakauer, Anne Ge Collins, and Richard B Ivry. 2024. “Fundamental Processes in Sensorimotor Learning: Reasoning, Refinement, and Retrieval.” eLife 13 (August): e91839. https://doi.org/10.7554/eLife.91839.
Tsay, Jonathan S., Lauren Schuck, and Richard B. Ivry. 2023. “Cerebellar Degeneration Impairs Strategy Discovery but Not Strategy Recall.” The Cerebellum. https://doi.org/10.1007/s12311-022-01500-6.
Tseng, Ya-weng, Jörn Diedrichsen, John W. Krakauer, Reza Shadmehr, and Amy J. Bastian. 2007. “Sensory Prediction Errors Drive Cerebellum-Dependent Adaptation of Reaching.” Journal of Neurophysiology 98 (1): 54–62. https://doi.org/10.1152/jn.00266.2007.
Turner, Christopher, Satu Baylan, Martina Bracco, Gabriela Cruz, Simon Hanzal, Marine Keime, Isaac Kuye, et al. 2023. “Developmental Changes in Individual Alpha Frequency: Recording EEG Data During Public Engagement Events.” Imaging Neuroscience 1 (August): 1–14. https://doi.org/10.1162/imag_a_00001.
Uittenhove, Kim, Stephanie Jeanneret, and Evie Vergauwe. 2023. “From Lab-Testing to Web-Testing in Cognitive Research: Who You Test Is More Important Than How You Test.” Journal of Cognition 6 (1): 13. https://doi.org/10.5334/joc.259.
Vallet, William, and Virginie Van Wassenhove. 2023. “Can Cognitive Neuroscience Solve the Lab-Dilemma by Going Wild?” Neuroscience & Biobehavioral Reviews 155 (December): 105463. https://doi.org/10.1016/j.neubiorev.2023.105463.
Wang, Tianhe, Guy Avraham, Jonathan S. Tsay, Tanvi Thummala, and Richard B. Ivry. 2024. “Advanced Feedback Enhances Sensorimotor Adaptation.” Current Biology 34 (5): 1076–1085.e5. https://doi.org/10.1016/j.cub.2024.01.073.
Wang, Tianhe, Ryan J Morehead, Jonathan S. Tsay, and Richard B Ivry. 2024. “The Origin of Movement Biases During Reaching.” eLife, October. https://doi.org/10.7554/eLife.100715.1.
Warburton, Matthew, Carlo Campagnoli, Mark Mon-Williams, Faisal Mushtaq, and J. Ryan Morehead. 2023. “Kinematic Markers of Skill in First-Person Shooter Video Games.” PNAS Nexus 2 (8): pgad249. https://doi.org/10.1093/pnasnexus/pgad249.
———. 2025a. “Input Device Matters for Measures of Behaviour in Online Experiments.” Psychological Research 89 (29): 1–15. https://doi.org/10.1007/s00426-024-02065-1.
———. 2025b. “Visuomotor Memory Is Not Bound to Visual Motion.” Journal of Neuroscience 45 (17): e1884242025. https://doi.org/10.1523/JNEUROSCI.1884-24.2025.
Watral, Alexandra T., Abby Morley, Robert Pastel, and Kevin M. Trewartha. 2023. “Comparing Mouse Versus Trackpad Input in a Web-Based App for Assessing Motor Learning.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 67 (1): 2113–19. https://doi.org/10.1177/21695067231192911.
Webb, Margaret A., and June P. Tangney. 2022. “Too Good to Be True: Bots and Bad Data From Mechanical Turk.” Perspectives on Psychological Science, November, 174569162211200. https://doi.org/10.1177/17456916221120027.
Weightman, Matthew, John-Stuart Brittain, R. Chris Miall, and Ned Jenkinson. 2022. “Residual Errors in Visuomotor Adaptation Persist Despite Extended Motor Preparation Periods.” Journal of Neurophysiology 127 (2): 519–28. https://doi.org/10.1152/jn.00301.2021.
Westwood, Sean J. 2025. “The Potential Existential Threat of Large Language Models to Online Survey Research.” Proceedings of the National Academy of Sciences 122 (47): e2518075122. https://doi.org/10.1073/pnas.2518075122.
Wolpert, Daniel M., Jörn Diedrichsen, and J. Randall Flanagan. 2011. “Principles of Sensorimotor Learning.” Nature Reviews Neuroscience 12 (12): 739–51. https://doi.org/10.1038/nrn3112.
Yaron, Itay, Lucia Melloni, Michael Pitts, and Liad Mudrik. 2022. “The ConTraSt Database for Analysing and Comparing Empirical Studies of Consciousness Theories.” Nature Human Behaviour 6 (4): 593–604. https://doi.org/10.1038/s41562-021-01284-5.
Yung, Amanda, Pedro Cardoso-Leite, Gillian Dale, Daphne Bavelier, and C. Shawn Green. 2015. “Methods to Test Visual Attention Online.” Journal of Visualized Experiments, no. 96 (February): 52470. https://doi.org/10.3791/52470.
Zhang, Aoran, Marit F L Ruitenberg, Matthew Warburton, Stephen Scott, and Jonathan S. Tsay. 2026. “Large Reaching Datasets Quantify the Impact of Age, Sex/Gender, and Experience on Motor Control.” Communications Psychology 4 (16): 1–11. https://doi.org/10.1038/s44271-025-00383-7.
Zhao, Sijia, Christopher A. Brown, Lori L. Holt, and Frederic Dick. 2022. “Robust and Efficient Online Auditory Psychophysics.” Trends in Hearing 26 (January): 23312165221118792. https://doi.org/10.1177/23312165221118792.