Reinforcement-trained recurrent networks reproduce human beat-synchronization dynamics
Most adult humans can move their bodies in time with rhythmic music, but how this capacity develops is poorly understood. Moving to music is often pleasurable, suggesting that a system of intrinsic reward guides this developmental process. Here, we ask what reward systems can scaffold the robust development of human-like synchronization.
We explore this question in a recurrent neural network model whose input is a series of metronomic cues delivered at a range of tempi, and whose output is a series of “finger taps” executed with a short delay. The network is trained through reinforcement learning under four different schemes that incentivize tap/cue synchrony in distinct ways. We find that the most successful of these schemes rewards early taps more than late ones and additionally incentivizes tempo matching.
The trained agent exhibits tapping error correction that captures key qualitative and quantitative features of human error correction data, including an asymmetry in which lateness is corrected more than earliness. When timing jitter is introduced into training or testing, the agent shows a human-like tendency to tap ahead of the cues (a “negative mean asynchrony”) that closely resembles human data in its scaling with jitter and amount of training. The agent also maintains accurate inter-tap timing during a tapping continuation phase, demonstrating human-like internalization of tempo, despite the fact that this condition was not included in its training.
Neural activity exhibits patterns observed in monkeys trained to synchronize, as well as signs of subjective rhythmitization—the human tendency to perceive metronome clicks in groups of two. These results suggest that intrinsic reinforcement for early action and imitation may be important for the development of audiomotor synchronization, and provide a model system in which to explore synchronization learning. This research was funded in part by the Natural Sciences and Engineering Research Council of Canada (Award Number RGPIN-202205027) and by the Human Frontier Science Program (Award Number RGEC27/2025).
The funders had no role in study design, data collection and analysis, decision to publish or preparation of the manuscript. School of Computational Science & Engineering, McMaster University, Hamilton, ON, Canada Yassaman Ommi, Matin Yousefabadi & Jonathan Cannon Department of Psychology, Neuroscience & Behaviour, McMaster University, Hamilton, ON, Canada The authors declare no competing interests. Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material.
Extract — continue reading at the source.