References
Albert, Derek A., and Daniel Smilek. 2023. “Comparing Attentional
Disengagement Between Prolific and MTurk
Samples.” Scientific Reports 13 (1): 20574. https://doi.org/10.1038/s41598-023-46048-5.
Albert, Scott T, Jihoon Jang, Shanaathanan Modchalingam, Bernard Marius
’t Hart, Denise Henriques, Gonzalo Lerner, Valeria Della-Maggiore,
Adrian M Haith, John W Krakauer, and Reza Shadmehr. 2022.
“Competition Between Parallel Sensorimotor Learning
Systems.” eLife 11 (February): e65361. https://doi.org/10.7554/eLife.65361.
Allen, Kelsey, Franziska Brändle, Matthew Botvinick, Judith E. Fan,
Samuel J. Gershman, Alison Gopnik, Thomas L. Griffiths, et al. 2024.
“Using Games to Understand the Mind.” Nature Human
Behaviour, June. https://doi.org/10.1038/s41562-024-01878-9.
Angele, Bernhard, Ana Baciero, Pablo Gómez, and Manuel Perea. 2022.
“Does Online Masked Priming Pass the Test? The
Effects of Prime Exposure Duration on Masked Identity Priming.”
Behavior Research Methods 55 (1): 151–67. https://doi.org/10.3758/s13428-021-01742-y.
Ansolabehere, S., and B. F. Schaffner. 2015. “Distractions:
The Incidence and Consequences of
Interruptions for Survey Respondents.”
Journal of Survey Statistics and Methodology 3 (2): 216–39. https://doi.org/10.1093/jssam/smv003.
Anwyl-Irvine, Alexander L., Edwin S. Dalmaijer, Nick Hodges, and Jo K.
Evershed. 2021. “Realistic Precision and Accuracy of Online
Experiment Platforms, Web Browsers, and Devices.” Behavior
Research Methods 53 (4): 1407–25. https://doi.org/10.3758/s13428-020-01501-5.
Anwyl-Irvine, Alexander L., Jessica Massonnié, Adam Flitton, Natasha
Kirkham, and Jo K. Evershed. 2020. “Gorilla in Our Midst:
An Online Behavioral Experiment Builder.”
Behavior Research Methods 52 (1): 388–407. https://doi.org/10.3758/s13428-019-01237-x.
Arnett, Jeffrey J. 2008. “The Neglected 95%: Why
American Psychology Needs to Become Less
American.” American Psychologist 63 (7):
602–14. https://doi.org/10.1037/0003-066X.63.7.602.
Atkinson, Amy L, Beatriz Pinheiro Sanchez, Matthew Warburton, Heather
Allmark, and Richard J Allen. 2025. “The Ability to Direct
Attention in Working Memory Is Not Impaired in Adults with Symptoms of
ADHD.” Journal of Attention Disorders 29
(9): 684–705. https://doi.org/10.1177/10870547251330039.
Avraham, Guy, and Richard B Ivry. 2025. “Interference Underlies
Attenuation Upon Relearning in Sensorimotor Adaptation.”
eNeuro 12 (6): 1–17. https://doi.org/10.1523/ENEURO.0132-25.2025.
Baker, Daniel H., Greta Vilidaite, Freya A. Lygo, Anika K. Smith, Tessa
R. Flack, André D. Gouws, and Timothy J. Andrews. 2021. “Power
Contours: Optimising Sample Size and Precision in
Experimental Psychology and Human Neuroscience.”
Psychological Methods 26 (3): 295–314. https://doi.org/10.1037/met0000337.
Banerjee, Abhijit V., Swati Bhattacharjee, Raghabendra Chattopadhyay,
Esther Duflo, Alejandro J. Ganimian, Kailash Rajah, and Elizabeth S.
Spelke. 2025. “Children’s Arithmetic Skills Do Not Transfer
Between Applied and Academic Mathematics.” Nature 639
(8055): 673–81. https://doi.org/10.1038/s41586-024-08502-w.
Barack, David L, Vera U Ludwig, Felipe Parodi, Nuwar Ahmed, Elizabeth M
Brannon, Arjun Ramakrishnan, and Michael L Platt. 2024. “Attention
Deficits Linked with Proclivity to Explore While Foraging.”
Proceedings of the Royal Society B: Biological Sciences 291
(2017): 20222584. https://doi.org/10.1098/rspb.2022.2584.
Barnhoorn, Jonathan S., Erwin Haasnoot, Bruno R. Bocanegra, and Henk Van
Steenbergen. 2015. “QRTEngine: An Easy
Solution for Running Online Reaction Time Experiments Using
Qualtrics.” Behavior Research Methods 47
(4): 918–29. https://doi.org/10.3758/s13428-014-0530-7.
Barradas, Victor R., Yasuharu Koike, and Nicolas Schweighofer. 2024.
“Theoretical Limits on the Speed of Learning Inverse Models
Explain the Rate of Adaptation in Arm Reaching Tasks.” Neural
Networks 170 (February): 376–89. https://doi.org/10.1016/j.neunet.2023.10.049.
Begbie, G. H. 1959. “Accuracy of Aiming in
Linear Hand-Movements.” Quarterly Journal of
Experimental Psychology 11 (2): 65–75. https://doi.org/10.1080/17470215908416293.
Bridges, David, Alain Pitiot, Michael R. MacAskill, and Jonathan W.
Peirce. 2020. “The Timing Mega-Study: Comparing a Range of
Experiment Generators, Both Lab-Based and Online.” PeerJ
8 (July): e9414. https://doi.org/10.7717/peerj.9414.
Brookes, Jack, Matthew Warburton, Mshari Alghadier, Mark Mon-Williams,
and Faisal Mushtaq. 2019. “Studying Human Behavior with Virtual
Reality: The Unity Experiment Framework.”
Behavior Research Methods 52 (April): 455–63. https://doi.org/10.3758/s13428-019-01242-0.
Brown, Judson S, and Arthur T Slater-Hammel. 1949. “Discrete
Movements in the Horizontal Plane as a Function of Their Length and
Direction.” Journal of Experimental Psychology 39 (1):
84. https://doi.org/10.1037/h0062478.
Cao, Shuangyuan, and Fang Liu. 2022. “Learning to Play:
Understanding in-Game Tutorials with a Pilot Study on Implicit
Tutorials.” Heliyon 8 (11): e11482. https://doi.org/10.1016/j.heliyon.2022.e11482.
Casey, Logan S., Jesse Chandler, Adam Seth Levine, Andrew Proctor, and
Dara Z. Strolovitch. 2017. “Intertemporal Differences Among
MTurk Workers: Time-Based Sample Variations and
Implications for Online Data
Collection.” SAGE Open 7 (2): 215824401771277. https://doi.org/10.1177/2158244017712774.
Casler, Krista, Lydia Bickel, and Elizabeth Hackett. 2013.
“Separate but Equal? A Comparison of Participants and
Data Gathered via Amazon’s MTurk, Social
Media, and Face-to-Face Behavioral Testing.” Computers in
Human Behavior 29 (6): 2156–60. https://doi.org/10.1016/j.chb.2013.05.009.
Cesanek, Evan, Sabyasachi Shivkumar, James N. Ingram, and Daniel M.
Wolpert. 2023. “Ouvrai: Opening Access to Remote
VR Studies of Human Behavioral Neuroscience.”
Preprint. Neuroscience. https://doi.org/10.1101/2023.05.23.542017.
———. 2024. “Ouvrai Opens Access to Remote Virtual Reality Studies
of Human Behavioural Neuroscience.” Nature Human
Behaviour, April. https://doi.org/10.1038/s41562-024-01834-7.
Cesanek, Evan, Zhaoran Zhang, James N Ingram, Daniel M Wolpert, and J
Randall Flanagan. 2021. “Motor Memories of Object Dynamics Are
Categorically Organized.” eLife 10 (November): e71627.
https://doi.org/10.7554/eLife.71627.
Chen, Xiuli, Robb B. Rutledge, Harriet R. Brown, Raymond J. Dolan, Sven
Bestmann, and Joseph M. Galea. 2018. “Age-Dependent
Pavlovian Biases Influence Motor Decision-Making.”
Edited by Gunnar Blohm. PLOS Computational Biology 14 (7):
e1006304. https://doi.org/10.1371/journal.pcbi.1006304.
Chen, Yifei, Sabrina J. Abram, Richard B. Ivry, and Jonathan S. Tsay.
2025. “Indirect Feedback Hinders Explicit Sensorimotor
Adaptation.” Proceedings of the Royal Society B: Biological
Sciences 292 (2051): 20251407. https://doi.org/10.1101/2024.06.28.601293.
Chmielewski, Michael, and Sarah C. Kucker. 2020. “An MTurk
Crisis? Shifts in Data Quality and the
Impact on Study Results.” Social
Psychological and Personality Science 11 (4): 464–73. https://doi.org/10.1177/1948550619875149.
Cisneros, Elizabeth, Sheer Karny, Richard B. Ivry, and Jonathan S. Tsay.
2024. “Differential Aging Effects on
Implicit and Explicit Sensorimotor
Learning.” July 4, 2024. https://doi.org/10.1101/2024.07.02.601091.
Clode, Dani, Lucy Dowdall, Edmund Da Silva, Klara Selén, Dorothy Cowie,
Giulia Dominijanni, and Tamar R. Makin. 2024. “Evaluating Initial
Usability of a Hand Augmentation Device Across a Large and Diverse
Sample.” Science Robotics 9 (90): eadk5183. https://doi.org/10.1126/scirobotics.adk5183.
Coltman, Susan K., Robert J. van Beers, W. Pieter Medendorp, and Paul L.
Gribble. 2021. “Sensitivity to Error During Visuomotor Adaptation
Is Similarly Modulated by Abrupt, Gradual, and Random Perturbation
Schedules.” Journal of Neurophysiology 126 (3): 934–45.
https://doi.org/10.1152/jn.00269.2021.
Crump, Matthew J. C., John V. McDonnell, and Todd M. Gureckis. 2013.
“Evaluating Amazon’s Mechanical Turk as
a Tool for Experimental Behavioral
Research.” Edited by Sam Gilbert. PLoS ONE 8 (3):
e57410. https://doi.org/10.1371/journal.pone.0057410.
Cullen, Simon, and Daniel Oppenheimer. 2024. “Choosing to Learn:
The Importance of Student Autonomy in Higher
Education.” Science Advances 10 (29): eado6759. https://doi.org/10.1126/sciadv.ado6759.
Dandurand, Frédéric, Thomas R Shultz, and Kristine H Onishi. 2008.
“Comparing Online and Lab Methods in a Problem-Solving
Experiment.” Behavior Research Methods 40 (2): 428–34.
https://doi.org/10.3758/BRM.40.2.428.
Das, Anwesha, Alexandros Karagiorgis, Jörn Diedrichsen, Max-Philipp
Stenner, and Elena Azañón. 2025. “Micro-Offline Gains Do Not
Reflect Offline Learning During Early Motor Skill Acquisition in
Humans.” Proceedings of the National Academy of Sciences
122 (44): e2509233122. https://doi.org/10.1073/pnas.2509233122.
De Leeuw, Joshua R. 2015. “jsPsych:
A JavaScript Library for Creating Behavioral Experiments in
a Web Browser.” Behavior Research Methods
47 (1): 1–12. https://doi.org/10.3758/s13428-014-0458-y.
———. 2023. “DataPipe: Born-open Data Collection for Online
Experiments.” Behavior Research Methods 56 (3):
2499–2506. https://doi.org/10.3758/s13428-023-02161-x.
Deary, Ian J., and Geoff Der. 2005. “Reaction Time,
Age, and Cognitive Ability: Longitudinal
Findings from Age 16 to 63 Years in
Representative Population Samples.” Aging,
Neuropsychology, and Cognition 12 (2): 187–215. https://doi.org/10.1080/13825580590969235.
Dhakal, Vivek, Anna Maria Feit, Per Ola Kristensson, and Antti
Oulasvirta. 2018. “Observations on Typing from 136
Million Keystrokes.” In Proceedings of the 2018
CHI Conference on Human Factors in
Computing Systems, 1–12. Montreal QC Canada: ACM. https://doi.org/10.1145/3173574.3174220.
Ding, Wei, Anjuli Niyogi, and Jonathan S. Tsay. 2025. “Hypothesis
Testing Governs an Efficiency-Flexibility Trade-off in
Strategic Motor Learning.” 2025. https://doi.org/10.64898/2025.11.29.691289.
Dotan, Dror, Florent Meyniel, and Stanislas Dehaene. 2018.
“On-Line Confidence Monitoring During Decision Making.”
Cognition 171 (February): 112–21. https://doi.org/10.1016/j.cognition.2017.11.001.
Dotan, Dror, Pedro Pinheiro-Chagas, Fosca Al Roumi, and Stanislas
Dehaene. 2019. “Track It to Crack It:
Dissecting Processing Stages with Finger
Tracking.” Trends in Cognitive Sciences 23 (12):
1058–70. https://doi.org/10.1016/j.tics.2019.10.002.
Douglas, Benjamin D., Patrick J. Ewell, and Markus Brauer. 2023.
“Data Quality in Online Human-Subjects Research:
Comparisons Between MTurk,
Prolific, CloudResearch,
Qualtrics, and SONA.” Edited by Jeffrey
S. Hallam. PLOS ONE 18 (3): e0279720. https://doi.org/10.1371/journal.pone.0279720.
Doya, K. 2000. “Complementary Roles of Basal Ganglia and
Cerebellum in Learning and Motor Control.” Current Opinion in
Neurobiology 10 (6): 732–39. https://doi.org/10.1016/S0959-4388(00)00153-7.
Drody, Allison C., Effie J. Pereira, and Daniel Smilek. 2023. “A
Desire for Distraction: Uncovering the Rates of Media Multitasking
During Online Research Studies.” Scientific Reports 13
(1): 781. https://doi.org/10.1038/s41598-023-27606-3.
Durisko, Corrine, Michael McCue, Patrick J. Doyle, Michael Walsh Dickey,
and Julie A. Fiez. 2016. “A Flexible and
Integrated System for the Remote Acquisition
of Neuropsychological Data in Stroke
Research.” Telemedicine and e-Health 22 (12):
1032–40. https://doi.org/10.1089/tmj.2015.0235.
Eerola, Tuomas, James Armitage, Nadine Lavan, and Sarah Knight. 2021.
“Online Data Collection in Auditory
Perception and Cognition Research:
Recruitment, Testing, Data
Quality and Ethical Considerations.”
Auditory Perception & Cognition 4 (3–4): 251–80. https://doi.org/10.1080/25742442.2021.2007718.
Faul, Franz, Edgar Erdfelder, Albert-Georg Lang, and Axel Buchner. 2007.
“G*Power 3: A Flexible Statistical Power
Analysis Program for the Social, Behavioral, and Biomedical
Sciences.” Behavior Research Methods 39 (2): 175–91. https://doi.org/10.3758/BF03193146.
Fitts, Paul M. 1954. “The Information Capacity of the Human Motor
System in Controlling the Amplitude of Movement.” Journal of
Experimental Psychology 47 (6): 381. https://doi.org/10.1037/h0055392.
Fowler, Craig, Jian Jiao, and Margaret Pitts. 2023. “Frustration
and Ennui Among Amazon MTurk Workers.” Behavior
Research Methods 55: 3009–25. https://doi.org/10.3758/s13428-022-01955-9.
Gagné, Nathan, and Léon Franzen. 2023. “How to Run
Behavioural Experiments Online: Best Practice
Suggestions for Cognitive Psychology and
Neuroscience.” Swiss Psychology Open 3 (1):
1. https://doi.org/10.5334/spo.34.
Gajos, Krzysztof Z., Katharina Reinecke, Mary Donovan, Christopher D.
Stephen, Albert Y. Hung, Jeremy D. Schmahmann, and Anoopum S. Gupta.
2020. “Computer Mouse Use Captures Ataxia and
Parkinsonism, Enabling Accurate Measurement
and Detection.” Movement Disorders 35 (2):
354–58. https://doi.org/10.1002/mds.27915.
Germine, Laura, Ken Nakayama, Bradley C. Duchaine, Christopher F.
Chabris, Garga Chatterjee, and Jeremy B. Wilmer. 2012. “Is the
Web as Good as the Lab? Comparable Performance
from Web and Lab in Cognitive/Perceptual
Experiments.” Psychonomic Bulletin & Review 19 (5):
847–57. https://doi.org/10.3758/s13423-012-0296-9.
Germine, Laura, Katharina Reinecke, and Naomi S. Chaytor. 2019.
“Digital Neuropsychology: Challenges and
Opportunities at the Intersection of Science and Software.”
The Clinical Neuropsychologist 33 (2): 271–86. https://doi.org/10.1080/13854046.2018.1535662.
Goodrich, Brittney, Marieke Fenton, Jerrod Penn, John Bovay, and Travis
Mountain. 2023. “Battling Bots: Experiences and
Strategies to Mitigate Fraudulent Responses in Online Surveys.”
Applied Economic Perspectives and Policy 45 (2): 762–84. https://doi.org/10.1002/aepp.13353.
Gordon, Michael E, L Allen Slade, and Neal Schmitt. 1986. “The
"Science of the Sophomore"
Revisited: From Conjecture to
Empiricism.” The Academy of Management
Review 11 (1): 191–207.
Gosling, Samuel D., Carson J. Sandy, Oliver P. John, and Jeff Potter.
2010. “Wired but Not WEIRD: The Promise
of the Internet in Reaching More Diverse Samples.”
Behavioral and Brain Sciences 33 (2–3): 94–95. https://doi.org/10.1017/S0140525X10000300.
Grant, Naomi K., Leah K. Hamilton, and Jenalyn M. Ormita. 2025.
“Improving Comprehension of Consent
Forms in Online Research: An Empirical
Test of Four Interventions.” Journal of
Empirical Research on Human Research Ethics, March,
15562646251321132. https://doi.org/10.1177/15562646251321132.
Griffin, Marybec, Richard J. Martino, Caleb LoSchiavo, Camilla
Comer-Carruthers, Kristen D. Krause, Christopher B. Stults, and Perry N.
Halkitis. 2022. “Ensuring Survey Research Data Integrity in the
Era of Internet Bots.” Quality & Quantity 56 (4):
2841–52. https://doi.org/10.1007/s11135-021-01252-1.
Gross, Paul, Mary Gannotti, Amy Bailes, Susan D. Horn, Jacob Kean, Unni
G. Narayanan, Jerry Oakes, and Garey Noritz. 2020. “Cerebral
Palsy Research Network Clinical Registry:
Methodology and Baseline Report.”
Archives of Rehabilitation Research and Clinical Translation 2
(3): 100054. https://doi.org/10.1016/j.arrct.2020.100054.
Hadjiosif, Alkis M., Y. Dajaj, Tanvi Ranjan, and Maurice A. Smith. 2025.
“Tiny Visual Latencies Can Profoundly Impair Implicit Sensorimotor
Learning.” Scientific Reports 15 (1): 16084. https://doi.org/10.1038/s41598-025-98652-2.
Hamari, Juho, Jonna Koivisto, and Harri Sarsa. 2014. “Does
Gamification Work? – A Literature Review of
Empirical Studies on Gamification.” In
2014 47th Hawaii International Conference on
System Sciences, 3025–34. Waikoloa, HI: IEEE. https://doi.org/10.1109/HICSS.2014.377.
Hartshorne, Joshua K., Joshua R. De Leeuw, Noah D. Goodman, Mariela
Jennings, and Timothy J. O’Donnell. 2019. “A Thousand Studies for
the Price of One: Accelerating Psychological Science with
Pushkin.” Behavior Research Methods 51 (4):
1782–1803. https://doi.org/10.3758/s13428-018-1155-z.
Hartshorne, Joshua K., and Laura T. Germine. 2015. “When
Does Cognitive Functioning Peak? The Asynchronous
Rise and Fall of Different Cognitive Abilities
Across the Life Span.” Psychological
Science 26 (4): 433–43. https://doi.org/10.1177/0956797614567339.
Hauser, David J., Phoebe C. Ellsworth, and Richard Gonzalez. 2018.
“Are Manipulation Checks Necessary?”
Frontiers in Psychology 9 (June): 998. https://doi.org/10.3389/fpsyg.2018.00998.
Hauser, David J., and Norbert Schwarz. 2015. “It’s a
Trap! Instructional Manipulation Checks Prompt
Systematic Thinking on ‘Tricky’
Tasks.” Sage Open 5 (2): 2158244015584617.
https://doi.org/10.1177/2158244015584617.
Henninger, Felix, Yury Shevchenko, Ulf K. Mertens, Pascal J. Kieslich,
and Benjamin E. Hilbig. 2022. “Lab.js: A Free, Open,
Online Study Builder.” Behavior Research Methods 54 (2):
556–73. https://doi.org/10.3758/s13428-019-01283-5.
Henrich, Joseph, Steven J. Heine, and Ara Norenzayan. 2010. “The
Weirdest People in the World?” Behavioral and Brain
Sciences 33 (2–3): 61–83. https://doi.org/10.1017/S0140525X0999152X.
Hilton, Courtney B. 2024. “Why Music Psychology Needs Larger and
More Diverse Datasets and How Citizen Science Can Help.” March 7,
2024. https://doi.org/10.31234/osf.io/zv6w8.
Hyde, Eleanor R A, Robert Schmidt, Daniel J Carroll, and Claudia C. Von
Bastian. 2025. “First-Person Shooter Expertise:
A Processing Speed, Not Multitasking
Advantage.” 2025. https://doi.org/10.31234/osf.io/t3znr_v1.
Jang, Jihoon, Reza Shadmehr, and Scott T. Albert. 2023. “A
Software Tool for at-Home Measurement of Sensorimotor
Adaptation.” December 13, 2023. https://doi.org/10.1101/2023.12.12.571359.
Johnson, Brian P., Eran Dayan, Nitzan Censor, and Leonardo G. Cohen.
2022. “Crowdsourcing in Cognitive and Systems
Neuroscience.” The Neuroscientist 28 (5): 425–37.
https://doi.org/10.1177/10738584211017018.
Kapitány, Rohan, and Christopher Kavanagh. 2023. “Best Practices
for Crowd-Sourcing Data in the Behavioral Sciences.” OSF
Preprints. https://doi.org/10.31219/osf.io/sn5gh.
Kay, Cameron Stuart. 2025. “Why You Shouldn’t Trust Data Collected
on MTurk.” Behavior Research Methods 57
(340): 1–11. https://doi.org/10.3758/s13428-025-02852-7.
Keith, Melissa G., and Alexander S. McKay. 2024. “Too
Anecdotal to Be True? Mechanical Turk Is
Not All Bots and Bad Data: Response to
Webb and Tangney (2022).”
Perspectives on Psychological Science, March,
17456916241234328. https://doi.org/10.1177/17456916241234328.
Keller, Arielle S., Alisha Shetty, Ran Barzilay, Monica E. Calkins,
Yap-Seng Chong, Niyati Dave, Damien A. Fair, et al. 2025.
“Cognition Varies Across the Calendar Year in Multiple Large-Scale
Datasets.” Proceedings of the National Academy of
Sciences 122 (51): e2506054122. https://doi.org/10.1073/pnas.2506054122.
Kennedy, Ryan, Scott Clifford, Tyler Burleigh, Philip D. Waggoner, Ryan
Jewell, and Nicholas J. G. Winter. 2020. “The Shape of and
Solutions to the MTurk Quality Crisis.”
Political Science Research and Methods 8 (4): 614–29. https://doi.org/10.1017/psrm.2020.6.
Kim, Hojoong M., James B. Leverenz, Daniel J. Burdick, Sindhu Srivatsal,
Jennifer Pate, Shu-Ching Hu, Steven P. Millard, Marie Y. Davis, Ali
Samii, and Cyrus P. Zabetian. 2018. “Diagnostic
Validation for Participants in the
Washington State Parkinson Disease Registry.”
Parkinson’s Disease 2018 (November): 1–6. https://doi.org/10.1155/2018/3719578.
Kim, Hyosub E., Guy Avraham, and Richard B. Ivry. 2021. “The
Psychology of Reaching: Action
Selection, Movement Implementation, and
Sensorimotor Learning.” Annual Review of
Psychology 72 (1): 61–95. https://doi.org/10.1146/annurev-psych-010419-051053.
Kim, Olivia A., Alexander D. Forrence, and Samuel D. McDougle. 2022.
“Motor Learning Without Movement.” Proceedings of the
National Academy of Sciences 119 (30): e2204379119. https://doi.org/10.1073/pnas.2204379119.
Kothe, Emily Jane, and Mathew Ling. 2019. “Retention of
Participants Recruited to a Multi-Year Longitudinal Study via
Prolific.” September 6, 2019. https://doi.org/10.31234/osf.io/5yv2u.
Krakauer, John W., Asif A. Ghazanfar, Alex Gomez-Marin, Malcolm A.
MacIver, and David Poeppel. 2017. “Neuroscience Needs
Behavior: Correcting a Reductionist
Bias.” Neuron 93 (3): 480–90. https://doi.org/10.1016/j.neuron.2016.12.041.
Krakauer, John W., Alkis M. Hadjiosif, Jing Xu, Aaron L. Wong, and
Adrian M. Haith. 2019. “Motor Learning.” In
Comprehensive Physiology, edited by Ronald
Terjung, 1st ed., 613–63. Wiley. https://doi.org/10.1002/cphy.c170043.
Lakens, Daniël. 2024. “When and How to Deviate
From a Preregistration.” Collabra:
Psychology 10 (1): 117094. https://doi.org/10.1525/collabra.117094.
Leys, Christophe, Christophe Ley, Olivier Klein, Philippe Bernard, and
Laurent Licata. 2013. “Detecting Outliers: Do Not Use
Standard Deviation Around the Mean, Use Absolute Deviation Around the
Median.” Journal of Experimental Social Psychology 49
(4): 764–66. https://doi.org/10.1016/j.jesp.2013.03.013.
Li, Qisheng, Sung Jun Joo, Jason D. Yeatman, and Katharina Reinecke.
2020. “Controlling for Participants’ Viewing
Distance in Large-Scale, Psychophysical Online
Experiments Using a Virtual Chinrest.”
Scientific Reports 10 (1): 904. https://doi.org/10.1038/s41598-019-57204-1.
Listman, Jennifer B., Jonathan S. Tsay, Hyosub E. Kim, Wayne E. Mackey,
and David J. Heeger. 2021. “Long-Term Motor Learning
in the ‘Wild’ With High Volume Video
Game Data.” Frontiers in Human Neuroscience 15
(December): 777779. https://doi.org/10.3389/fnhum.2021.777779.
Liu, Jingxuan, Courtney B. Hilton, Elika Bergelson, and Samuel A. Mehr.
2023. “Language Experience Predicts Music Processing in a
Half-Million Speakers of Fifty-Four Languages.” Current
Biology 33 (10): 1916–1925.e4. https://doi.org/10.1016/j.cub.2023.03.067.
Long, Bria, Jan Simson, Andrés Buxó-Lugo, Duane G. Watson, and Samuel A.
Mehr. 2023. “How Games Can Make Behavioural Science
Better.” Nature 613 (7944): 433–36. https://doi.org/10.1038/d41586-023-00065-6.
Malone, Laura A., Nayo M. Hill, Haley Tripp, Vadim Zipunnikov, Daniel M.
Wolpert, and Amy J. Bastian. 2025. “The Control of Movement
Gradually Transitions from Feedback Control to Feedforward Adaptation
Throughout Childhood.” Npj Science of Learning 10 (1):
13. https://doi.org/10.1038/s41539-025-00304-7.
Mandlekar, Ajay, Yuke Zhu, Animesh Garg, Jonathan Booher, Max Spero,
Albert Tung, Julian Gao, et al. 2018. “RoboTurk:
A Crowdsourcing Platform for Robotic Skill
Learning Through Imitation.” November 7,
2018. https://doi.org/10.48550/arXiv.1811.02790.
Marek, Scott, Brenden Tervo-Clemmens, Finnegan J. Calabro, David F.
Montez, Benjamin P. Kay, Alexander S. Hatoum, Meghan Rose Donohue, et
al. 2022. “Reproducible Brain-Wide Association Studies Require
Thousands of Individuals.” Nature 603 (7902): 654–60. https://doi.org/10.1038/s41586-022-04492-9.
Mathôt, Sebastiaan, Daniel Schreij, and Jan Theeuwes. 2012.
“OpenSesame: An Open-Source, Graphical
Experiment Builder for the Social Sciences.” Behavior
Research Methods 44 (2): 314–24. https://doi.org/10.3758/s13428-011-0168-7.
McConnell, Patrick A., Christian Finetto, and Kirstin-Friederike Heise.
2024. “Methodological Considerations for Behavioral Studies
Relying on Response Time Outcomes Through Online Crowdsourcing
Platforms.” Scientific Reports 14 (1): 7719. https://doi.org/10.1038/s41598-024-58300-7.
Miller, R., K. Schmidt, C. Kirschbaum, and S. Enge. 2018.
“Comparability, Stability, and Reliability of Internet-Based
Mental Chronometry in Domestic and Laboratory Settings.”
Behavior Research Methods 50 (4): 1345–58. https://doi.org/10.3758/s13428-018-1036-5.
Milne, Alice E., Roberta Bianco, Katarina C. Poole, Sijia Zhao, Andrew
J. Oxenham, Alexander J. Billig, and Maria Chait. 2021. “An Online
Headphone Screening Test Based on Dichotic Pitch.” Behavior
Research Methods 53 (4): 1551–62. https://doi.org/10.3758/s13428-020-01514-0.
Morehead, J. Ryan, Jordan A. Taylor, Darius E. Parvin, and Richard B.
Ivry. 2017. “Characteristics of Implicit Sensorimotor
Adaptation Revealed by Task-irrelevant
Clamped Feedback.” Journal of Cognitive
Neuroscience 29 (6): 1061–74. https://doi.org/10.1162/jocn_a_01108.
Moss, Aaron. 2019. “Study: Does Time of Day
Affect Online Survey Results?” CloudResearch. 2019. https://www.cloudresearch.com/resources/research/does-time-of-day-affect-survey-results/.
Moss, Aaron J, Cheskie Rosenzweig, Shalom N Jaffe, Richa Gautam,
Jonathan Robinson, and Leib Litman. 2021. “Bots or Inattentive
Humans? Identifying Sources of Low-Quality Data in Online
Platforms.” PsyArXiv.
Munnilari, Madhavi, Tulasiram Bommasamudram, Judy Easow, David Tod,
Evdokia Varamenti, Ben J. Edwards, Aishwarya Ravindrakumar, Chloe
Gallagher, and Samuel A. Pullinger. 2024. “Diurnal Variation in
Variables Related to Cognitive Performance: A Systematic Review.”
Sleep and Breathing 28 (1): 495–510. https://doi.org/10.1007/s11325-023-02895-0.
Newman, Alexander, Yuen Lam Bavik, Matthew Mount, and Bo Shao. 2021.
“Data Collection via Online Platforms:
Challenges and Recommendations for
Future Research.” Applied Psychology 70
(3): 1380–1402. https://doi.org/10.1111/apps.12302.
Niv, Yael. 2021. “The Primacy of Behavioral Research for
Understanding the Brain.” Behavioral Neuroscience 135
(5): 601–9. https://doi.org/10.1037/bne0000471.
Ogletree, Aaron M., and Benjamin Katz. 2021. “How Do Older
Adults Recruited Using MTurk Differ From Those in a
National Probability Sample?” The International
Journal of Aging and Human Development 93 (2): 700–721. https://doi.org/10.1177/0091415020940197.
Open Science Collaboration. 2015. “Estimating the Reproducibility
of Psychological Science.” Science 349 (6251): aac4716-1
- aac4716-8. https://doi.org/10.1126/science.aac4716.
Paolacci, Gabriele, and Jesse Chandler. 2014. “Inside the
Turk: Understanding Mechanical Turk as a
Participant Pool.” Current Directions in
Psychological Science 23 (3): 184–88. https://doi.org/10.1177/0963721414531598.
Passell, Eliza, Roger W. Strong, Lauren A. Rutter, Heesu Kim, Luke
Scheuer, Paolo Martini, Liz Grinspoon, and Laura Germine. 2021.
“Cognitive Test Scores Vary with Choice of Personal Digital
Device.” Behavior Research Methods 53 (6): 2544–57. https://doi.org/10.3758/s13428-021-01597-3.
Peer, Eyal, Laura Brandimarte, Sonam Samat, and Alessandro Acquisti.
2017. “Beyond the Turk: Alternative
Platforms for Crowdsourcing Behavioral Research.” Journal of
Experimental Social Psychology 70 (May): 153–63. https://doi.org/10.1016/j.jesp.2017.01.006.
Peer, Eyal, David Rothschild, Andrew Gordon, Zak Evernden, and Ekaterina
Damer. 2021. “Data Quality of Platforms and Panels for Online
Behavioral Research.” Behavior Research Methods 54 (4):
1643–62. https://doi.org/10.3758/s13428-021-01694-3.
Peirce, Jonathan W. 2007.
“PsychoPy—Psychophysics Software in
Python.” Journal of Neuroscience Methods
162 (1–2): 8–13. https://doi.org/10.1016/j.jneumeth.2006.11.017.
Peterson, Joshua C., David D. Bourgin, Mayank Agrawal, Daniel Reichman,
and Thomas L. Griffiths. 2021. “Using Large-Scale Experiments and
Machine Learning to Discover Theories of Human Decision-Making.”
Science 372 (6547): 1209–14. https://doi.org/10.1126/science.abe2629.
Pickavance, John P., M. Mon-Williams, Faisal Mushtaq, and J. Ryan
Morehead. 2022. “Proactive Inhibition of Goal-Directed Movements
Involves Explicit Changes to Movement Planning.” June 2, 2022. https://doi.org/10.1101/2022.06.01.494317.
Pittman, Matthew, and Kim Sheehan. 2016. “Amazon’s
Mechanical Turk a Digital Sweatshop?
Transparency and Accountability in
Crowdsourced Online Research.” Journal of Media
Ethics 31 (4): 260–62. https://doi.org/10.1080/23736992.2016.1228811.
Pronk, Thomas, Reinout W. Wiers, Bert Molenkamp, and Jaap Murre. 2020.
“Mental Chronometry in the Pocket? Timing Accuracy of
Web Applications on Touchscreen and Keyboard Devices.”
Behavior Research Methods 52 (3): 1371–82. https://doi.org/10.3758/s13428-019-01321-2.
Rahnev, Dobromir, Kobe Desender, Alan L. F. Lee, William T. Adler, David
Aguilar-Lleyda, Başak Akdoğan, Polina Arbuzova, et al. 2020. “The
Confidence Database.” Nature Human
Behaviour 4 (3): 317–25. https://doi.org/10.1038/s41562-019-0813-1.
Raz, Gal, Sabrina Piccolo, Janine Medrano, Shari Liu, Kirsten Lydic,
Catherine Mei, Victoria Nguyen, Tianmin Shu, and Rebecca Saxe. 2024.
“An Asynchronous, Hands-Off Workflow for Looking Time Experiments
with Infants.” Developmental Psychology 60 (8): 1447–56.
https://doi.org/10.1037/dev0001791.
Reinecke, Katharina, and Krzysztof Z. Gajos. 2015.
“LabintheWild: Conducting Large-Scale Online
Experiments With Uncompensated Samples.” In
Proceedings of the 18th ACM Conference on
Computer Supported Cooperative Work & Social
Computing, 1364–78. Vancouver BC Canada: ACM. https://doi.org/10.1145/2675133.2675246.
Reips, Ulf-Dietrich. 2000. “The Web Experiment
Method.” In Psychological Experiments on
the Internet, 89–117. Elsevier. https://doi.org/10.1016/B978-012099980-4/50005-8.
———. 2001. “The Web Experimental Psychology Lab:
Five Years of Data Collection on the
Internet.” Behavior Research Methods,
Instruments, & Computers 33 (2): 201–11. https://doi.org/10.3758/BF03195366.
———. 2021. “Web-Based Research in
Psychology: A Review.” Zeitschrift
Für Psychologie 229 (4): 198–213. https://doi.org/10.1027/2151-2604/a000475.
Rodd, Jennifer M. 2024. “Moving Experimental Psychology Online:
How to Obtain High Quality Data When We Can’t See Our
Participants.” Journal of Memory and Language 134
(February): 104472. https://doi.org/10.1016/j.jml.2023.104472.
Rossi, Cristina, Rini Varghese, and Amy J Bastian. 2025.
“MovementVR: An Open-Source Tool for the
Study of Motor Control and Learning in Virtual Reality.” 2025. https://doi.org/10.48550/arXiv.2504.21696.
Ruitenberg, Marit F. L., Vincent Koppelmans, Rachael D. Seidler, and
Judith Schomaker. 2023. “Developmental and Age Differences in
Visuomotor Adaptation Across the Lifespan.” Psychological
Research 87 (6): 1710–17. https://doi.org/10.1007/s00426-022-01784-7.
Sauter, Marian, Maximilian Stefani, and Wolfgang Mack. 2022.
“Equal Quality for Online and Lab
Data: A Direct Comparison from Two Dual-Task
Paradigms.” Open Psychology 4 (1): 47–59. https://doi.org/10.1515/psych-2022-0003.
Schatz, Philip, Vincent Ybarra, and Donald Leitner. 2015.
“Validating the Accuracy of Reaction Time
Assessment on Computer-Based Tablet Devices.”
Assessment 22 (4): 405–10. https://doi.org/10.1177/1073191114566622.
Schmahmann, Jeremy D. 2019. “The Cerebellum and Cognition.”
Neuroscience Letters 688 (January): 62–75. https://doi.org/10.1016/j.neulet.2018.07.005.
Schmidt, Christina, Fabienne Collette, Christian Cajochen, and Philippe
Peigneux. 2007. “A Time to Think: Circadian Rhythms
in Human Cognition.” Cognitive Neuropsychology 24 (7):
755–89. https://doi.org/10.1080/02643290701754158.
Semmelmann, Kilian, and Sarah Weigelt. 2017. “Online
Psychophysics: Reaction Time Effects in Cognitive Experiments.”
Behavior Research Methods 49 (4): 1241–60. https://doi.org/10.3758/s13428-016-0783-4.
Shadmehr, Reza, and John W. Krakauer. 2008. “A Computational
Neuroanatomy for Motor Control.” Experimental Brain
Research 185 (3): 359–81. https://doi.org/10.1007/s00221-008-1280-5.
Shadmehr, Reza, Thomas R. Reppert, Erik M. Summerside, Tehrim Yoon, and
Alaa A. Ahmed. 2019. “Movement Vigor as a
Reflection of Subjective Economic
Utility.” Trends in Neurosciences 42 (5): 323–36.
https://doi.org/10.1016/j.tins.2019.02.003.
Shmuelof, Lior, John W. Krakauer, and Pietro Mazzoni. 2012. “How
Is a Motor Skill Learned? Change and Invariance at the
Levels of Task Success and Trajectory Control.” Journal of
Neurophysiology 108 (2): 578–94. https://doi.org/10.1152/jn.00856.2011.
Shyr, Megan C., and Sanjay S. Joshi. 2024. “A Case
Study of the Validity of Web-based Visuomotor Rotation Experiments.”
Journal of Cognitive Neuroscience 36 (1): 71–94. https://doi.org/10.1162/jocn_a_02080.
Simmons, Joseph P., Leif D. Nelson, and Uri Simonsohn. 2021.
“Pre-Registration: Why and How.” Journal
of Consumer Psychology 31 (1): 151–62. https://doi.org/10.1002/jcpy.1208.
Smith, Nicholas A., Isaac E. Sabat, Larry R. Martinez, Kayla Weaver, and
Shi Xu. 2015. “A Convenient Solution: Using
MTurk To Sample From Hard-To-Reach Populations.”
Industrial and Organizational Psychology 8 (2): 220–28. https://doi.org/10.1017/iop.2015.29.
Smith, W. M. 1972. “Feedback: Real-Time Delayed
Vision of One’s Own Tracking
Behavior.” Science 176 (4037): 939–40. https://doi.org/10.1126/science.176.4037.939.
Spiers, Hugo J., Antoine Coutrot, and Michael Hornberger. 2023.
“Explaining World‐Wide Variation in
Navigation Ability from Millions of
People: Citizen Science Project Sea Hero
Quest.” Topics in Cognitive Science 15 (1):
120–38. https://doi.org/10.1111/tops.12590.
Storozuk, Andie, Marilyn Ashley, Véronic Delage, and Erin A. Maloney.
2020. “Got Bots? Practical
Recommendations to Protect Online Survey Data from
Bot Attacks.” The Quantitative Methods for
Psychology 16 (5): 472–81. https://doi.org/10.20982/tqmp.16.5.p472.
Szucs, Denes, and John P. A. Ioannidis. 2017. “Empirical
Assessment of Published Effect Sizes and Power in the Recent Cognitive
Neuroscience and Psychology Literature.” Edited by Eric-Jan
Wagenmakers. PLOS Biology 15 (3): e2000797. https://doi.org/10.1371/journal.pbio.2000797.
Thomas, Kyle A., and Scott Clifford. 2017. “Validity and
Mechanical Turk: An Assessment of Exclusion
Methods and Interactive Experiments.” Computers in Human
Behavior 77 (December): 184–97. https://doi.org/10.1016/j.chb.2017.08.038.
Townsend, Max, Matthew Warburton, Carlo Campagnoli, Mark Mon-Williams,
Faisal Mushtaq, and J Ryan Morehead. 2025. “An
‘Aha!’ Moment Precedes the Strategic Response
to a Visuomotor Rotation.” 2025. https://doi.org/10.1101/2025.05.11.653302.
Tsay, Jonathan S., Hrach Asmerian, Laura T. Germine, Jeremy Wilmer,
Richard B. Ivry, and Ken Nakayama. 2024. “Large-Scale Citizen
Science Reveals Predictors of Sensorimotor Adaptation.”
Nature Human Behaviour, January. https://doi.org/10.1038/s41562-023-01798-0.
Tsay, Jonathan S., Anisha M. Chandy, Romeo Chua, R. Chris Miall,
Jonathan Cole, Alessandro Farnè, Richard B. Ivry, and Fabrice R.
Sarlegna. 2024. “Minimal Impact of Chronic Proprioceptive Loss on
Implicit Sensorimotor Adaptation and Perceived Movement Outcome.”
Journal of Neurophysiology 132 (3): 770–80. https://doi.org/10.1152/jn.00096.2024.
Tsay, Jonathan S., and Richard B. Ivry. 2025. “Cerebellar
Contributions to Action and
Cognition: Prediction, Timescale,
and Continuity.” 2025.
Tsay, Jonathan S., Richard B Ivry, Alan Lee, and Guy Avraham. 2021.
“Moving Outside the Lab: The Viability of Conducting
Sensorimotor Learning Studies Online.” Neurons, Behavior,
Data Analysis, and Theory, 1–22. https://doi.org/10.51628/001c.26985.
Tsay, Jonathan S., Hyosub E Kim, Samuel D McDougle, Jordan A Taylor,
Adrian Haith, Guy Avraham, John W Krakauer, Anne Ge Collins, and Richard
B Ivry. 2024. “Fundamental Processes in Sensorimotor Learning:
Reasoning, Refinement, and Retrieval.”
eLife 13 (August): e91839. https://doi.org/10.7554/eLife.91839.
Tsay, Jonathan S., Lauren Schuck, and Richard B. Ivry. 2023.
“Cerebellar Degeneration Impairs Strategy Discovery
but Not Strategy Recall.” The Cerebellum.
https://doi.org/10.1007/s12311-022-01500-6.
Tseng, Ya-weng, Jörn Diedrichsen, John W. Krakauer, Reza Shadmehr, and
Amy J. Bastian. 2007. “Sensory Prediction Errors Drive
Cerebellum-Dependent Adaptation of Reaching.”
Journal of Neurophysiology 98 (1): 54–62. https://doi.org/10.1152/jn.00266.2007.
Turner, Christopher, Satu Baylan, Martina Bracco, Gabriela Cruz, Simon
Hanzal, Marine Keime, Isaac Kuye, et al. 2023. “Developmental
Changes in Individual Alpha Frequency: Recording EEG Data
During Public Engagement Events.” Imaging Neuroscience 1
(August): 1–14. https://doi.org/10.1162/imag_a_00001.
Uittenhove, Kim, Stephanie Jeanneret, and Evie Vergauwe. 2023.
“From Lab-Testing to Web-Testing in
Cognitive Research: Who You Test Is More
Important Than How You Test.” Journal of
Cognition 6 (1): 13. https://doi.org/10.5334/joc.259.
Vallet, William, and Virginie Van Wassenhove. 2023. “Can Cognitive
Neuroscience Solve the Lab-Dilemma by Going Wild?”
Neuroscience & Biobehavioral Reviews 155 (December):
105463. https://doi.org/10.1016/j.neubiorev.2023.105463.
Wang, Tianhe, Guy Avraham, Jonathan S. Tsay, Tanvi Thummala, and Richard
B. Ivry. 2024. “Advanced Feedback Enhances Sensorimotor
Adaptation.” Current Biology 34 (5): 1076–1085.e5. https://doi.org/10.1016/j.cub.2024.01.073.
Wang, Tianhe, Ryan J Morehead, Jonathan S. Tsay, and Richard B Ivry.
2024. “The Origin of Movement Biases During
Reaching.” eLife, October. https://doi.org/10.7554/eLife.100715.1.
Warburton, Matthew, Carlo Campagnoli, Mark Mon-Williams, Faisal Mushtaq,
and J. Ryan Morehead. 2023. “Kinematic Markers of Skill in
First-Person Shooter Video Games.” PNAS Nexus 2 (8):
pgad249. https://doi.org/10.1093/pnasnexus/pgad249.
———. 2025a. “Input Device Matters for Measures of Behaviour in
Online Experiments.” Psychological Research 89 (29):
1–15. https://doi.org/10.1007/s00426-024-02065-1.
———. 2025b. “Visuomotor Memory Is Not Bound to Visual
Motion.” Journal of Neuroscience 45 (17): e1884242025.
https://doi.org/10.1523/JNEUROSCI.1884-24.2025.
Watral, Alexandra T., Abby Morley, Robert Pastel, and Kevin M.
Trewartha. 2023. “Comparing Mouse Versus Trackpad Input in a
Web-Based App for Assessing Motor Learning.” Proceedings of
the Human Factors and Ergonomics Society Annual Meeting 67 (1):
2113–19. https://doi.org/10.1177/21695067231192911.
Webb, Margaret A., and June P. Tangney. 2022. “Too
Good to Be True: Bots and
Bad Data From Mechanical Turk.” Perspectives on
Psychological Science, November, 174569162211200. https://doi.org/10.1177/17456916221120027.
Weightman, Matthew, John-Stuart Brittain, R. Chris Miall, and Ned
Jenkinson. 2022. “Residual Errors in Visuomotor Adaptation Persist
Despite Extended Motor Preparation Periods.” Journal of
Neurophysiology 127 (2): 519–28. https://doi.org/10.1152/jn.00301.2021.
Westwood, Sean J. 2025. “The Potential Existential Threat of Large
Language Models to Online Survey Research.” Proceedings of
the National Academy of Sciences 122 (47): e2518075122. https://doi.org/10.1073/pnas.2518075122.
Wolpert, Daniel M., Jörn Diedrichsen, and J. Randall Flanagan. 2011.
“Principles of Sensorimotor Learning.” Nature Reviews
Neuroscience 12 (12): 739–51. https://doi.org/10.1038/nrn3112.
Yaron, Itay, Lucia Melloni, Michael Pitts, and Liad Mudrik. 2022.
“The ConTraSt Database for Analysing and Comparing
Empirical Studies of Consciousness Theories.” Nature Human
Behaviour 6 (4): 593–604. https://doi.org/10.1038/s41562-021-01284-5.
Yung, Amanda, Pedro Cardoso-Leite, Gillian Dale, Daphne Bavelier, and C.
Shawn Green. 2015. “Methods to Test Visual Attention
Online.” Journal of Visualized Experiments, no.
96 (February): 52470. https://doi.org/10.3791/52470.
Zhang, Aoran, Marit F L Ruitenberg, Matthew Warburton, Stephen Scott,
and Jonathan S. Tsay. 2026. “Large Reaching Datasets
Quantify the Impact of Age,
Sex/Gender, and Experience on
Motor Control.” Communications Psychology 4
(16): 1–11. https://doi.org/10.1038/s44271-025-00383-7.
Zhao, Sijia, Christopher A. Brown, Lori L. Holt, and Frederic Dick.
2022. “Robust and Efficient Online Auditory
Psychophysics.” Trends in Hearing 26 (January):
23312165221118792. https://doi.org/10.1177/23312165221118792.