journal article·2023-01

Broadband Visual Adaption and Image Recognition in a Monolithic Neuromorphic Machine Vision System

Yuchen Cai, Feng Wang, Xinming Wang, Shuhui Li, Yanrong Wang, Jia Yang, Tao Yan, Xueying Zhan, Fengmei Wang, Ruiqing Cheng, Jun He, Zhenxing Wang

Advanced Functional Materials· Volume 33· Issue 5
Publisher page

Abstract

Abstract Bio‐inspired machine visions have caused wide attentions due to the higher time/power efficiencies over the conventional architectures. Although bio‐mimic photo‐sensors and neuromorphic computing have been individually demonstrated, a complete monolithic vision system has rarely been studied. Here, a neuromorphic machine vision system (NMVS) integrating front‐end retinomorphic sensors and a back‐end convolutional neural network (CNN) based on a single ferroelectric‐semiconductor‐transistor (FST) device structure is reported. As a photo‐sensor, the FST shows a broadband (275–808 nm) retina‐like light adaption function with a large dynamic range of 20.3 stops, and as a unit of the CNN, the FST's weight can be linearly programmed. In total, the NMVS has a high recognition accuracy of 93.0% on a broadband‐dim‐image classification task, which is 20% higher than that of an incomplete system without the retinomorphic sensors. Because of the monolithic unit, the NVMS shows high feasibility for integrated bio‐inspired machine vision systems.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Memory and Neural Computing · Ferroelectric and Negative Capacitance Devices · Neuroscience and Neural Engineering

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

CAS Key Laboratory of Nanosystem and Hierarchical Fabrication National Center for Nanoscience and Technology Beijing 100190 P. R. China

Center of Materials Science and Optoelectronics Engineering University of Chinese Academy of Sciences Beijing 100049 P. R. China

State Key Laboratory of Low‐Dimensional Quantum Physics Department of Physics Tsinghua University Beijing 100084 P. R. China

Key Laboratory of Artificial Micro‐ and Nano‐structures of Ministry of Education School of Physics and Technology Wuhan University Wuhan 430072 P. R. China

Funding

National Natural Science Foundation of China · Fundamental Research Funds for the Central Universities

References (52)

Show source-provided references
1. 10.1038/s41928-020-00501-910.1038/s41928-020-00501-9 ↗
2. 10.1038/d41586-020-00592-610.1038/d41586-020-00592-6 ↗
3. 10.1002/inf2.1227510.1002/inf2.12275 ↗
4. 10.1016/j.conb.2010.03.00710.1016/j.conb.2010.03.007 ↗
5. 10.1109/JPROC.2015.244409410.1109/JPROC.2015.2444094 ↗
6. 10.1511/2003.11.2810.1511/2003.11.28 ↗
7. 10.1002/admt.20210014410.1002/admt.202100144 ↗
8. 10.1002/aelm.20220066810.1002/aelm.202200668 ↗
9. 10.1016/j.isci.2021.10372910.1016/j.isci.2021.103729 ↗
10. 10.1038/s41928-022-00847-210.1038/s41928-022-00847-2 ↗
11. 10.1002/adma.20210882610.1002/adma.202108826 ↗
12. 10.1002/adma.20210548510.1002/adma.202105485 ↗
13. 10.1038/ncomms1519910.1038/ncomms15199 ↗
14. 10.1038/s41586-020-1942-410.1038/s41586-020-1942-4 ↗
15. 10.1038/s41928-017-0002-z10.1038/s41928-017-0002-z ↗
16. 10.1038/nnano.2016.7010.1038/nnano.2016.70 ↗
17. 10.1038/s41928-018-0092-210.1038/s41928-018-0092-2 ↗
18. 10.1038/s41928-017-0006-810.1038/s41928-017-0006-8 ↗
19. 10.1038/s41563-019-0291-x10.1038/s41563-019-0291-x ↗
20. 10.1038/s41586-022-04992-810.1038/s41586-022-04992-8 ↗
21. 10.1038/s41586-020-2038-x10.1038/s41586-020-2038-x ↗
22. 10.1038/s41565-019-0501-310.1038/s41565-019-0501-3 ↗
23. 10.1093/nsr/nwaa17210.1093/nsr/nwaa172 ↗
24. 10.1038/s41928-022-00747-510.1038/s41928-022-00747-5 ↗
25. 10.1126/sciadv.aba617310.1126/sciadv.aba6173 ↗
26. 10.1038/s41928-022-00819-610.1038/s41928-022-00819-6 ↗
27. 10.1038/s41467-022-29364-810.1038/s41467-022-29364-8 ↗
28. 10.1038/s41928-022-00713-110.1038/s41928-022-00713-1 ↗
29. 10.1038/s41467-021-22047-w10.1038/s41467-021-22047-w ↗
30. 10.1038/s41467-020-19806-610.1038/s41467-020-19806-6 ↗
31. 10.1021/acs.nanolett.2c0059910.1021/acs.nanolett.2c00599 ↗
32. 10.1201/b1137310.1201/b11373 ↗
33. 10.1152/physiol.00007.200710.1152/physiol.00007.2007 ↗
34. 10.1038/140545a010.1038/140545a0 ↗
35. 10.1021/acs.nanolett.7b0219810.1021/acs.nanolett.7b02198 ↗
36. 10.1021/acs.nanolett.7b0485210.1021/acs.nanolett.7b04852 ↗
37. 10.1016/j.scib.2021.06.02010.1016/j.scib.2021.06.020 ↗
38. 10.1038/ncomms1495610.1038/ncomms14956 ↗
39. 10.1103/PhysRevLett.120.22760110.1103/PhysRevLett.120.227601 ↗
40. 10.1002/adfm.20180373810.1002/adfm.201803738 ↗
41. 10.1039/C8NR04422H10.1039/C8NR04422H ↗
42. 10.1038/s41928-019-0338-710.1038/s41928-019-0338-7 ↗
43. 10.1038/nmat328210.1038/nmat3282 ↗
44. 10.1063/1.474833010.1063/1.4748330 ↗
45. 10.1038/ncomms1080810.1038/ncomms10808 ↗
46. 10.1038/s41467-018-05640-410.1038/s41467-018-05640-4 ↗
47. 10.1038/s41467-020-20660-910.1038/s41467-020-20660-9 ↗
48. 10.1002/adfm.20220546810.1002/adfm.202205468 ↗
49. Kalloniatis M. · 1995
50. 10.1143/JPSJ.63.160110.1143/JPSJ.63.1601 ↗
51. 10.1063/1.162173010.1063/1.1621730 ↗
52. 10.1103/PhysRevMaterials.2.01240110.1103/PhysRevMaterials.2.012401 ↗