journal article·2024-03Open access

Coupled Ferroelectric‐Photonic Memory in a Retinomorphic Hardware for In‐Sensor Computing

Ngoc Thanh Duong, Yufei Shi, Sifan Li, Yu‐Chieh Chien, Heng Xiang, Haofei Zheng, Peiyang Li, Lingqi Li, Yangwu Wu, Kah‐Wee Ang

Advanced Science· Volume 11· Issue 12

Abstract

Abstract The development of all‐in‐one devices for artificial visual systems offers an attractive solution in terms of energy efficiency and real‐time processing speed. In recent years, the proliferation of smart sensors in the growth of Internet‐of‐Things (IoT) has led to the increasing importance of in‐sensor computing technology, which places computational power at the edge of the data‐flow architecture. In this study, a prototype visual sensor inspired by the human retina is proposed, which integrates ferroelectricity and photosensitivity in two‐dimensional (2D) α‐In2Se3 material. This device mimics the functions of photoreceptors and amacrine cells in the retina, performing optical reception and memory computation functions through the use of electrical switching polarization in the channel. The gate‐tunable linearity of excitatory and inhibitory functions in photon‐induced short‐term plasticity enables to encode and classify 12 000 images in the Mixed National Institute of Standards and Technology (MNIST) dataset with remarkable accuracy, achieving ≈94%. Additionally, in‐sensor convolution image processing through a network of phototransistors, with five convolutional kernels electrically pre‐programmed into the transistors is demonstrated. The convoluted photocurrent matrices undergo straightforward arithmetic calculations to produce edge and feature‐enhanced scenarios. The findings demonstrate the potential of ferroelectric α‐In2Se3 for highly compact and efficient retinomorphic hardware implementation, regardless of ambipolar transport in the channel.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Memory and Neural Computing · Neural Networks and Reservoir Computing · Neuroscience and Neural Engineering

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Electrical and Computer Engineering National University of Singapore 4 Engineering Drive 3 Singapore 117583 Singapore

Funding

National Research Foundation Singapore · Science and Engineering Research Council

References (32)

Show source-provided references
1. 10.1038/s41928-020-00501-910.1038/s41928-020-00501-9 ↗
2. 10.1038/s41586-020-2038-x10.1038/s41586-020-2038-x ↗
3. 10.1038/s41928-022-00819-610.1038/s41928-022-00819-6 ↗
4. 10.1002/inf2.1227510.1002/inf2.12275 ↗
5. 10.1109/JPROC.2014.234615310.1109/JPROC.2014.2346153 ↗
6. 10.1038/s41565-021-01003-110.1038/s41565-021-01003-1 ↗
7. 10.1126/sciadv.abg145510.1126/sciadv.abg1455 ↗
8. 10.1038/s41565-019-0501-310.1038/s41565-019-0501-3 ↗
9. 10.1038/s41467-020-19806-610.1038/s41467-020-19806-6 ↗
10. 10.1038/s41467-022-29171-110.1038/s41467-022-29171-1 ↗
11. 10.1016/j.isci.2021.10372910.1016/j.isci.2021.103729 ↗
12. 10.1002/adma.20220383010.1002/adma.202203830 ↗
13. 10.1038/s41928-022-00747-510.1038/s41928-022-00747-5 ↗
14. 10.1021/acs.nanolett.0c0365210.1021/acs.nanolett.0c03652 ↗
15. 10.1038/s41467-022-30519-w10.1038/s41467-022-30519-w ↗
16. 10.1093/nsr/nwaa17210.1093/nsr/nwaa172 ↗
17. 10.1002/adma.20220681610.1002/adma.202206816 ↗
18. 10.1126/sciadv.aba617310.1126/sciadv.aba6173 ↗
19. 10.1038/s41928-022-00713-110.1038/s41928-022-00713-1 ↗
20. 10.1002/aisy.20200012210.1002/aisy.202000122 ↗
21. 10.1002/adma.20210882610.1002/adma.202108826 ↗
22. 10.1002/aisy.20230000910.1002/aisy.202300009 ↗
23. 10.1038/ncomms1495610.1038/ncomms14956 ↗
24. 10.1038/s41928-019-0338-710.1038/s41928-019-0338-7 ↗
25. 10.1021/acs.nanolett.5b0252310.1021/acs.nanolett.5b02523 ↗
26. 10.1002/adfm.20200460910.1002/adfm.202004609 ↗
27. 10.1038/s41467-020-20257-210.1038/s41467-020-20257-2 ↗
28. 10.1002/adma.20180707510.1002/adma.201807075 ↗
29. 10.1016/j.neuron.2013.05.02410.1016/j.neuron.2013.05.024 ↗
30. 10.1038/23610.1038/236 ↗
31. 10.1016/j.neuron.2009.12.00910.1016/j.neuron.2009.12.009 ↗
32. A. G.Weber http://sipi.usc.edu/database/(accessed: September 2022).