A real‐time interactive rendering method for 360° tabletop integral imaging 3D display
Source abstract
Abstract
Abstract In this paper, a rendering method for interactive tabletop integral imaging 3D display is proposed to present interactive 3D graphics to users 360° around the display in real‐time. By transforming the viewpoint plane and the elemental image array (EIA) plane with a parallel backward ray‐tracing technique according to the recognized gestures, a high‐efficient rendering for interactive 3D contents can be achieved, thus, the 3D graphics can be manipulated to be displayed on the tabletop in real‐time. Compared with the previous methods that all viewpoint images should be generated first, the proposed method can generate the interactive EIAs that contain all viewpoint information directly, which makes the interactive rendering more efficient. A gesture‐based interactive tabletop integral imaging 3D display prototype is built using an 8‐K (7680 × 4320) pixel resolution LCD. Experimental results show that the proposed interactive rendering method can achieve a short response time of less than 40 ms and high recognition accuracy of over 95% for different spatial hand gestures.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Optical Imaging Technologies · Virtual Reality Applications and Impacts · Interactive and Immersive Displays
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Electronics and Information Engineering Sichuan University Chengdu China
School of Instrumentation and Optoelectronic Engineering Beihang University Beijing China
Funding
National Natural Science Foundation of China · National Key Research and Development Program of China
References (24)
Show source-provided references
1. Haptable: An interactive tabletop providing online haptic feedback for touch gestures
2. WestendorfL ShaerO VarsanyiP van derMeulenH KunAL.Understanding collaborative decision making around a large‐scale interactive tabletop. In Proceedings of the ACM on Human‐Computer Interaction.2017;1(CSCW):1–21.10.1145/3134745 ↗
3. ScottSD AllavenaA CerarK FranckG HazenM ShuterT et al.Investigating tabletop interfaces to support collaborative decision‐making in maritime operations. In Proceedings of ICCRTS2010;22–24.
4. FujinawaE GotoK IrieA WuS XuK.Occlusion‐aware hand posture based interaction on tabletop projector. In the Adjunct Publication of the 32nd Annual ACM Symposium on User Interface Software and Technology.2019;113–115.10.1145/3332167.3356890 ↗
5. HilligesO IzadiS WilsonAD HodgesS Garcia‐MendozaA ButzA.Interactions in the air: Adding further depth to interactive tabletops. In Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology.2009;139–148.10.1145/1622176.1622203 ↗
6. 10.1364/AOP.5.00045610.1364/AOP.5.000456 ↗
7. 10.1002/jsid.82910.1002/jsid.829 ↗
8. 10.1364/OE.21.01123710.1364/OE.21.011237 ↗
9. 10.1364/OE.24.01319410.1364/OE.24.013194 ↗
10. 10.1364/OE.23.00653310.1364/OE.23.006533 ↗
11. 10.1364/OE.24.02499910.1364/OE.24.024999 ↗
12. MakiguchiM SakamotoD TakadaH HondaK OnoT.Interactive 360‐degree glasses‐free tabletop 3D display. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology.2019;625–637.10.1145/3332165.3347948 ↗
13. YoshidaS.Implementations toward interactive glasses‐free tabletop 3D display. In ACM SIGGRAPH 2014 Posters.2014;1–1.10.1145/2614217.2614231 ↗
14. GrossmanT WigdorD BalakrishnanR.Multi‐finger gestural interaction with 3D volumetric displays. In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology.2004;61–70.10.1145/1029632.1029644 ↗
15. 10.1109/JPROC.2006.87069610.1109/JPROC.2006.870696 ↗
16. La photographie integrale
17. 10.1364/OE.40927510.1364/OE.409275 ↗
18. 10.1364/OE.23.01841510.1364/OE.23.018415 ↗
19. 10.1364/AO.45.00737510.1364/AO.45.007375 ↗
20. 10.1016/j.optcom.2020.12627810.1016/j.optcom.2020.126278 ↗
21. 10.1364/OE.25.00033010.1364/OE.25.000330 ↗
22. Leap Motion Inc.Homepage of leap motion [Internet].2021[2021‐01‐24]. Available from:https://www.leapmotion.com
23. ArvoJ.Backward ray tracing. developments in ray tracing. ACM SIGGRAPH Course Notes1986;12:259–263.
24. NVIDIA CUDA toolkit.2021[2021‐01‐24]. Available from:https://developer.nvidia.com/CUDA-toolkit.