TY - JOUR
T1 - Curriculum effects in multitask learning through the lens of contextual inference
AU - Shivkumar, Sabyasachi
AU - Lengyel, Máté
AU - Wolpert, Daniel M.
N1 - Publisher Copyright:
© 2025 Elsevier Ltd. All rights are reserved, including those for text and data mining, AI training, and similar technologies.
PY - 2025/12
Y1 - 2025/12
N2 - When learning multiple tasks, the structure of practice, or curriculum, profoundly influences learning outcomes across domains, including motor learning, rule learning, perceptual learning, and machine learning. In multitask learning settings, there is often a trade-off between the speed of acquisition and long-term retention. For example, in motor learning, acquisition appears faster, but retention is substantially reduced with blocked training compared to randomly interleaved training. In machine learning, this effect is known as catastrophic forgetting. In contrast, perceptual and cognitive learning benefit from structured, predictable curricula such as blocked training. We propose contextual inference as a unifying framework to explain these effects, emphasizing the integration of task transition dynamics, contextual cues and observation noise during learning. Insights from this framework may allow mitigating catastrophic interference in machine learning by leveraging principles inspired by biological learning.
AB - When learning multiple tasks, the structure of practice, or curriculum, profoundly influences learning outcomes across domains, including motor learning, rule learning, perceptual learning, and machine learning. In multitask learning settings, there is often a trade-off between the speed of acquisition and long-term retention. For example, in motor learning, acquisition appears faster, but retention is substantially reduced with blocked training compared to randomly interleaved training. In machine learning, this effect is known as catastrophic forgetting. In contrast, perceptual and cognitive learning benefit from structured, predictable curricula such as blocked training. We propose contextual inference as a unifying framework to explain these effects, emphasizing the integration of task transition dynamics, contextual cues and observation noise during learning. Insights from this framework may allow mitigating catastrophic interference in machine learning by leveraging principles inspired by biological learning.
UR - https://www.scopus.com/pages/publications/105019217631
U2 - 10.1016/j.conb.2025.103123
DO - 10.1016/j.conb.2025.103123
M3 - Review Article
C2 - 41072183
AN - SCOPUS:105019217631
SN - 0959-4388
VL - 95
JO - Current Opinion in Neurobiology
JF - Current Opinion in Neurobiology
M1 - 103123
ER -