Hebbian learning for online prediction, neural recall and classical conditioning of anthropomimetic robot arm motions
Source abstract
Abstract
Classical conditioning plays a vital role in learning in every mammal. It is based on unsupervised neural learning embodied in a physical body that is in continuous interaction with the environment. Embedding the hierarchical temporal memory (HTM) in the closed loop of the sensorimotor space of a Myorobotics tendon-driven robotic arm we demonstrate learning, prediction and control of biomimetic body motions. Experiments finally lead to conditioned reactions in natural interaction with a human partner. The HTM is able to learn arm movements generated by interaction with a human partner in a short time. It predicts future positions in different time scales up to seconds in advance. Closing the loop we utilize HTM predictions for motor control. Hereby learned motions are recalled from synaptic connections proactively continuing motion execution. Association, prediction and control are required by the HTM for conditioning according to Pavlov: neutral stimuli get associated with motions, and after learning sensor impulses can trigger single arm lifting motions. Hereby, both the motions and the stimuli are learned from the environment and get associated efficiently. We can demonstrate high biological plausibility as for example even input variations result in similar variations in the action output. The robotic system consisting of biologically-derived hardware and software components utilizes only unsupervised Hebbian learning to act autonomously. Learning is executed in real time, can handle natural variations of human motions and takes morphologically plausible sensor input into account. The setup is fully scalable due to its modularity. Hereby, novel applications for the HTM are opened: it can be used in musculoskeletal robot control scenarios and robots being able to interactively learn from human partners and the environment.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Robot Manipulation and Learning · Neural dynamics and brain function · EEG and Brain-Computer Interfaces
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (32)
Show source-provided references
1. Pfeifer R · How the Body Shapes the Way We Think: a New View of Intelligence/Rolf Pfeifer and Josh Bongard; with a Contribution by Simon Grand; Foreword by Rodney Brooks; Illustrations by Shun Iwasawa · 2007
2. Feldotto B · Bernstein Conf. · 2017
3. Marques H G · Int. Symp. on Adaptive Motion of Animals and Machines · 2013
4. 10.3389/fncir.2016.0002310.3389/fncir.2016.00023 ↗
5. Numenta Inc. · Hierarchical Temporal Memory: Including Cortical Learning Algorithms · 2011
6. 10.1109/ICRA.2011.598041610.1109/ICRA.2011.5980416 ↗
7. 10.1186/s40648-016-0061-310.1186/s40648-016-0061-3 ↗
8. 10.1109/BIOROB.2014.691389110.1109/BIOROB.2014.6913891 ↗
9. 10.2316/P.2011.752-01810.2316/P.2011.752-018 ↗
10. Jäntsch M · 13th IEEE-RAS Int. Conf. on Humanoid Robots · 2013 · 342
11. Jäntsch M · 2014
12. Hebb D O · The Organization of Behavior: a Neuropsychological Theory · 1949
13. 10.1126/science.137275410.1126/science.1372754 ↗
14. 10.3389/fnsyn.2012.0000210.3389/fnsyn.2012.00002 ↗
15. 10.1146/annurev.neuro.31.060407.12563910.1146/annurev.neuro.31.060407.125639 ↗
16. 10.1002/9781118032466.ch310.1002/9781118032466.ch3 ↗
17. 10.3923/ajms.2010.225.23610.3923/ajms.2010.225.236 ↗
18. Bakker B · Proc. of the 2003 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems · 2003 · 43010.1109/IROS.2003.1250667 ↗
19. 10.1162/neco.1989.1.2.27010.1162/neco.1989.1.2.270 ↗
20. Purdy S · 2016
21. Ahmad S · CoRR · 2015
22. 10.3389/fncir.2017.0008110.3389/fncir.2017.00081 ↗
23. Ahmad S · 2016
24. 10.1162/NECO_a_0089310.1162/NECO_a_00893 ↗
25. Kandel E R · Principles of Neural Science · 2012
26. 10.1007/BF0099269810.1007/BF00992698 ↗
27. Novianto R · Int. Conf. on Social Robotics · 2014 · 8755 · 27910.1007/978-3-319-11973-1_29 ↗
28. 10.1177/105971231244223110.1177/1059712312442231 ↗
29. 10.3389/fnbot.2013.0000610.3389/fnbot.2013.00006 ↗
30. Hawkins J · On Intelligence · 2005
31. Jaeger H · 2014
32. Numenta