Tangible User Interface and Mu Rhythm Suppression: The Effect of User Interface on the Brain Activity in Its Operator and Observer
Source abstract
Abstract
The intuitiveness of tangible user interface (TUI) is not only for its operator. It is quite possible that this type of user interface (UI) can also have an effect on the experience and learning of observers who are just watching the operator using it. To understand the possible effect of TUI, the present study focused on the mu rhythm suppression in the sensorimotor area reflecting execution and observation of action, and investigated the brain activity both in its operator and observer. In the observer experiment, the effect of TUI on its observers was demonstrated through the brain activity. Although the effect of the grasping action itself was uncertain, the unpredictability of the result of the action seemed to have some effect on the mirror neuron system (MNS)-related brain activity. In the operator experiment, in spite of the same grasping action, the brain activity was activated in the sensorimotor area when UI functions were included (TUI). Such activation of the brain activity was not found with a graphical user interface (GUI) that has UI functions without grasping action. These results suggest that the MNS-related brain activity is involved in the effect of TUI, indicating the possibility of UI evaluation based on brain activity.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Action Observation and Synchronization · Motor Control and Adaptation · Neural and Behavioral Psychology Studies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Advanced Business Center, Dai Nippon Printing Co., Ltd., Tokyo 1628001, Japan
Graduate School of Integrated Frontier Science, Kyushu University, Fukuoka 8128581, Japan
Research Fellow of Japan Society for the Promotion of Science, Tokyo 1020083, Japan
Department of Multimedia, Cultural Bureau, Musée de Louvre, Paris 75058, France
Department of Human Science, Faculty of Design, Kyushu University, Fukuoka 8158540, Japan
References (37)
Show source-provided references
1. Ishii, H., and Ullmer, B. (1997, January 22–27). Tangible bits: Towards seamless interfaces between people, bits and atoms. Proceedings of the Conference on Human Factors in Computing Systems-Proceedings, Atlanta, GA, USA.10.1145/258549.258715 ↗
2. Fitzmaurice, G.W. (1996). Graspable User Interfaces. [Ph.D. Thesis, University of Toronto].
3. Tangible interaction = form + computing10.1145/1649475.1649477 ↗
4. Van Den Hoven, E., Frens, J., Aliakseyeu, D., Martens, J.B., Overbeeke, K., and Peters, P. (2007, January 15–17). Design research & Tangible Interaction. Proceedings of the First International Conference on Tangible and Embedded Interaction, Baton Rouge, LA, USA.10.1145/1226969.1226993 ↗
5. Situating approaches to interactive museum guides10.1080/09647770802517423 ↗
6. Stanton, D., Bayon, V., Neale, H., Ghali, A., Benford, S., Cobb, S., Ingram, R., O’Malley, C., Wilson, J., and Pridmore, T. (April, January 31). Classroom collaboration in the design of tangible interfaces for storytelling. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Seattle, WA, USA.
7. Antle, A.N. (2007, January 15–17). The cti framework: Informing the design of tangible systems for children. Proceedings of the First International Conference on Tangible and Embedded Interaction, TEI’07, Baton Rouge, LA, USA.10.1145/1226969.1227010 ↗
8. O’Malley, C., and Fraser, D.S. (2004). Literature Review in Learning with Tangible Technologies, A NESTA Futurelab.
9. Tangible user interfaces: Past, present, and future directions10.1561/1100000026 ↗
10. Hornecker, E., and Buur, J. (2006, January 22–27). Getting a grip on tangible interaction: A framework on physical space and social interaction. Proceedings of the SIGCHI conference on Human Factors in Computing Systems, QC, Canada.10.1145/1124772.1124838 ↗
11. Arias, E., Eden, H., and Fischer, G. (1997, January 18–20). Enhancing communication, facilitating shared understanding, and creating better artifacts by integrating physical and computational media for design. Proceedings of the Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques, DIS, New York, NY, USA.10.1145/263552.263553 ↗
12. Suzuki, H., and Kato, H. (1995, January 17–20). In Interaction-level support for collaborative learning: Algoblock—An open programming language. Proceedings of the First International Conference on Computer Support for Collaborative Learning, Bloomington, IN, USA.10.3115/222020.222828 ↗
13. Fitzmaurice, G.W., and Buxton, W. (1997, January 22–27). An empirical evaluation of graspable user interfaces: Towards specialized, space-multiplexed input. Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems, Atlanta, GA, USA.10.1145/258549.258578 ↗
14. Patten, J., and Ishii, H. (2000, January 12–14). A comparison of spatial organization strategies in graphical and tangible user interfaces. Proceedings of the DARE 2000 on Designing Augmented Reality Environments, Elsinore, Denmark.10.1145/354666.354671 ↗
15. To tui or not to tui: Evaluating performance and preference in tangible vs. Graphical user interfaces10.1016/j.ijhcs.2013.04.003 ↗
16. Reeves, S., Benford, S., O’Malley, C., and Fraser, M. (2005, January 2–7). Designing the spectator experience. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Portland, OR, USA.10.1145/1054972.1055074 ↗
17. Peltonen, P., Kurvinen, E., Salovaara, A., Jacucci, G., Ilmonen, T., Evans, J., Oulasvirta, A., and Saarikko, P. (2008, January 5–10). It’s mine, don’t touch!: Interactions at a large multi-touch display in a city centre. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Florence, Italy.10.1145/1357054.1357255 ↗
18. Ichino, J., Isoda, K., Ueda, T., and Satoh, R. (27–2, January 27). Effects of the display angle on social behaviors of the people around the display: A field study at a museum. Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing, San Francisco, CA, USA.
19. Action recognition in the premotor cortex10.1093/brain/119.2.593 ↗
20. Neurophysiological mechanisms underlying the understanding and imitation of action10.1038/35090060 ↗
21. Imitation, empathy, and mirror neurons10.1146/annurev.psych.60.110707.163604 ↗
22. Neural mechanisms of imitation10.1016/j.conb.2005.10.010 ↗
23. The functional significance of mu rhythms: Translating “seeing” and “hearing” into “doing”10.1016/j.brainresrev.2005.04.005 ↗
24. EEG changes during cinematographic presentation; moving picture activation of the EEG10.1016/0013-4694(54)90058-9 ↗
25. Mu rhythm modulation during observation of an object-directed grasp10.1016/j.cogbrainres.2003.12.001 ↗
26. EEG evidence for mirror neuron activity during the observation of human and robot actions: Toward an analysis of the human qualities of interactive robots10.1016/j.neucom.2006.02.024 ↗
27. Functional dissociation of lower and upper frequency mu rhythms in relation to voluntary limb movement10.1016/S1388-2457(00)00428-4 ↗
28. The tangible user interface and its evolution10.1145/1349026.1349034 ↗
29. Isoda, K., Sueyoshi, K., Ikeda, Y., Nishimura, Y., Hisanaga, I., Orlic, S., Kim, Y.K., and Higuchi, S. (2016). Effect of the hand-omitted tool motion on mu rhythm suppression. Front. Hum. Neurosci., 10.10.3389/fnhum.2016.00266 ↗
30. Two different streams form the dorsal visual system: Anatomy and functions10.1007/s00221-003-1588-0 ↗
31. The human mirror neuron system: A link between action observation and social skills10.1093/scan/nsl022 ↗
32. Dissociation between ventral and dorsal fmri activation during object and action recognition10.1016/j.neuron.2005.06.034 ↗
33. Sports experience changes the neural processing of action language10.1073/pnas.0803424105 ↗
34. The functional role of motor activation in language processing: Motor cortical oscillations support lexical-semantic retrieval10.1016/j.neuroimage.2009.12.123 ↗
35. Prefrontal involvement in imitation learning of hand actions: Effects of practice and expertise10.1016/j.neuroimage.2007.07.005 ↗
36. Mirror activity in the human brain while observing hand movements: A comparison between EEG desynchronization in the mu-range and previous fmri results10.1016/j.brainres.2009.05.059 ↗
37. Cortical topography of human anterior intraparietal cortex active during visually guided grasping10.1016/j.cogbrainres.2004.11.010 ↗