journal article·2016-12-21

Single Photon in Hierarchical Architecture for Physical Decision Making: Photon Intelligence

Makoto Naruse, Martin Berthel, Aurélien Drezet, Serge Huant, Hirokazu Hori, Song-Ju Kim

ACS Photonics· Volume 3· Issue 12
Publisher page

Abstract

Understanding and using photonic processes for intelligent functionalities, referred to as photonic intelligence, has recently attracted interest from a variety of fields, including postsilicon computing for artificial intelligence and decision making in the behavioral sciences. In a past study, we successfully used the wave–particle duality of single photons to solve the two-armed bandit problem, which constitutes one of the important foundations of decision making and reinforcement learning. In this paper, we propose and confirm a hierarchical architecture for single-photon-based decision making that verifies the scalability of the principle. Specifically, the four-armed bandit problem is solved given zero prior knowledge in a two-layer hierarchical architecture, where the polarization of single photons is autonomously adapted in order to effect adequate decision making. In the hierarchical structure, the notion of layer-dependent decisions emerges. The optimal solutions in the coarse layer and the fine layer, however, conflict with each other in some contradictory problems. We show that while what we call a tournament strategy resolves such contradictions, the probabilistic nature of single photons allows for the direct location of the optimal solution, even for contradictory problems, hence manifesting the exploration capability of single photons. This study provides insights into photon intelligence in hierarchical architectures for artificial intelligence as well as a novel aspect of photonic processes for intelligent functionalities.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Neural Networks and Reservoir Computing · Quantum Information and Cryptography · Random lasers and scattering media

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Network System Research Institute, National Institute of Information and Communications Technology, 4-2-1 Nukui-kita, Koganei, Tokyo 184-8795, Japan

University Grenoble Alpes, CNRS, Institute NEEL, F-38000 Grenoble, France

Interdisciplinary Graduate School of Medicine and Engineering, University of Yamanashi, Takeda, Kofu, Yamanashi 400-8511, Japan

WPI Center for Materials Nanoarchitectonics, National Institute for Materials Science, 1-1 Namiki, Tsukuba, Ibaraki 305-0044, Japan

Funding

Agence Nationale de la Recherche · Japan Society for the Promotion of Science

References (47)

Show source-provided references
1. 10.1038/nature1696110.1038/nature16961 ↗
2. 10.1145/359576.35957910.1145/359576.359579 ↗
3. 10.1126/science.125464210.1126/science.1254642 ↗
4. 10.1109/MC.2013.43110.1109/MC.2013.431 ↗
5. 10.1038/ncomms306710.1038/ncomms3067 ↗
6. 10.1088/1367-2630/14/1/01305210.1088/1367-2630/14/1/013052 ↗
7. 10.1109/ISSCC.2015.706311110.1109/ISSCC.2015.7063111 ↗
8. 10.1038/srep0329710.1038/srep03297 ↗
9. 10.1063/1.489857010.1063/1.4898570 ↗
10. 10.1038/srep1325310.1038/srep13253 ↗
11. 10.1098/rspb.2009.012110.1098/rspb.2009.0121 ↗
12. 10.1016/j.physleta.2010.10.06310.1016/j.physleta.2010.10.063 ↗
13. 10.1038/nrn245610.1038/nrn2456 ↗
14. 10.1038/nature0476610.1038/nature04766 ↗
15. 10.1038/nn.423810.1038/nn.4238 ↗
16. 10.1016/j.neubiorev.2015.05.00510.1016/j.neubiorev.2015.05.005 ↗
17. Sutton R. S. · 1998
18. 10.1037/a001849510.1037/a0018495 ↗
19. 10.1023/A:101368970435210.1023/A:1013689704352 ↗
20. 10.1109/TMC.2010.6510.1109/TMC.2010.65 ↗
21. 10.1587/nolta.5.19810.1587/nolta.5.198 ↗
22. 10.1109/ICDM.2009.5210.1109/ICDM.2009.52 ↗
23. 10.1007/11871842_2910.1007/11871842_29 ↗
24. 10.1090/S0002-9904-1952-09620-810.1090/S0002-9904-1952-09620-8 ↗
25. 10.1088/1367-2630/17/8/08302310.1088/1367-2630/17/8/083023 ↗
26. Naruse, M.; Kim, S.J.; Aono, M.; Berthel, M.; Drezet, A.; Huant, S.; Hori, H.Category theoretic foundation of single-photon-based decision making. Preprint athttp://arxiv.org/abs/1602.08199.
27. 10.1109/IROS.2012.638629510.1109/IROS.2012.6386295 ↗
28. 10.1109/JLT.2014.237828110.1109/JLT.2014.2378281 ↗
29. 10.1038/ncomms122810.1038/ncomms1228 ↗
30. 10.1103/PhysRevA.72.05231110.1103/PhysRevA.72.052311 ↗
31. 10.1038/nature0881210.1038/nature08812 ↗
32. 10.1088/0034-4885/68/5/R0410.1088/0034-4885/68/5/R04 ↗
33. 10.1126/sciadv.150157410.1126/sciadv.1501574 ↗
34. 10.1103/PhysRevLett.114.11050410.1103/PhysRevLett.114.110504 ↗
35. Lau, H.K.; Pooser, R.; Siopsis, G.; Weedbrook, C.Quantum machine learning over infinite dimensions. Preprint athttp://arxiv.org/abs/1603.06222.
36. 10.1140/epjqt/s40507-015-0023-310.1140/epjqt/s40507-015-0023-3 ↗
37. 10.1016/j.biosystems.2010.04.00210.1016/j.biosystems.2010.04.002 ↗
38. 10.1103/PhysRevA.64.06180210.1103/PhysRevA.64.061802 ↗
39. 10.1364/OL.33.00061110.1364/OL.33.000611 ↗
40. 10.1103/PhysRevB.91.03530810.1103/PhysRevB.91.035308 ↗
41. 10.1016/j.jlumin.2004.01.02010.1016/j.jlumin.2004.01.020 ↗
42. 10.1038/nphoton.2007.22710.1038/nphoton.2007.227 ↗
43. 10.1038/nphys225310.1038/nphys2253 ↗
44. 10.1088/0034-4885/76/5/05640110.1088/0034-4885/76/5/056401 ↗
45. 10.1088/2040-8978/14/9/09400210.1088/2040-8978/14/9/094002 ↗
46. 10.1111/1467-937X.0007610.1111/1467-937X.00076 ↗
47. Kim S.-J. · Philosophies, Special Issue of Natural Computation: Attempts in Reconciliation of Dialectic Oppositions