Neuromorphic In‐Memory Computing for Marine Visual‐Auditory Perception
Source abstract
Abstract
ABSTRACT The exploration of marine environments is crucial, yet the extreme conditions of the deep‐sea, combined with the segregated signal processing in current sensor technologies, lead to bulky systems, high energy consumption, and significant latency, which severely constrains the development of real‐time intelligent perception systems underwater. Herein, we developed a neuromorphic floating‐gate transistor (NFT) that integrates both electrical and optical memory functionalities, emulating simultaneously visual and auditory synaptic behaviors within a single unit, thus enabling in‐memory dual‐mode processing of visual‐auditory signals. Electrically, it achieves rapid switching (∼14 µs), high on/off ratio (10 6 ), and robust endurance (>10 4 cycles). This enables high‐accuracy (88%) classification of seafloor minerals and rocks via sonar echo processing using a convolutional neural network (CNN). Optically, the NFT exhibits tunable synaptic weight modulation from short‐term to long‐term plasticity under 405–808 nm laser pulses. Leveraging the low‐attenuation green‐light window in seawater, the system, combined with RGB denoising and green‐channel enhancement preprocessing, realizes 80% accuracy in marine biological image recognition. This synergistic electro‐optical in‐memory computing architecture provides an efficient, low‐power, and compact hardware solution for intelligent perception in complex underwater environments.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Neural Networks and Reservoir Computing · Advanced Memory and Neural Computing · Ferroelectric and Negative Capacitance Devices
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Guangdong Provincial Key Laboratory of Chip and Integration Technology School of Electronic Science and Engineering (School of Microelectronics) South China Normal University Foshan P. R. China
Funding
National Natural Science Foundation of China · Basic and Applied Basic Research Foundation of Guangdong Province
References (36)
Show source-provided references
1. 10.1002/inf2.7003610.1002/inf2.70036 ↗
2. 10.1002/adfm.20241670310.1002/adfm.202416703 ↗
3. 10.1111/raq.1272610.1111/raq.12726 ↗
4. 10.1007/s12601‐021‐00015‐110.1007/s12601‐021‐00015‐1 ↗
5. 10.1002/rse2.20510.1002/rse2.205 ↗
6. 10.1002/adfm.20242181910.1002/adfm.202421819 ↗
7. 10.1002/advs.20240782210.1002/advs.202407822 ↗
8. 10.1021/acsnano.1c1093610.1021/acsnano.1c10936 ↗
9. 10.3390/rs1314267110.3390/rs13142671 ↗
10. 10.1016/j.neucom.2019.01.08410.1016/j.neucom.2019.01.084 ↗
11. 10.1007/s11432‐020‐3227‐110.1007/s11432‐020‐3227‐1 ↗
12. 10.1038/ncomms918110.1038/ncomms9181 ↗
13. 10.1021/acs.chemrev.5c0034010.1021/acs.chemrev.5c00340 ↗
14. 10.1038/s41467‐025‐62868‐710.1038/s41467‐025‐62868‐7 ↗
15. 10.1021/acsnano.4c0702410.1021/acsnano.4c07024 ↗
16. 10.1088/2631‐7990/ad88bb10.1088/2631‐7990/ad88bb ↗
17. 10.1038/s41586‐025‐08742‐410.1038/s41586‐025‐08742‐4 ↗
18. 10.1021/acsnano.5c0068310.1021/acsnano.5c00683 ↗
19. 10.1038/s41467‐025‐59104‐710.1038/s41467‐025‐59104‐7 ↗
20. 10.1038/s41467‐023‐42172‐y10.1038/s41467‐023‐42172‐y ↗
21. 10.1002/adfm.20252081610.1002/adfm.202520816 ↗
22. 10.1016/j.mattod.2023.08.00210.1016/j.mattod.2023.08.002 ↗
23. 10.1002/adfm.20220832010.1002/adfm.202208320 ↗
24. 10.1002/adma.20220686410.1002/adma.202206864 ↗
25. 10.1002/adma.20230681810.1002/adma.202306818 ↗
26. 10.1002/adma.20230198610.1002/adma.202301986 ↗
27. 10.1002/adfm.20230558910.1002/adfm.202305589 ↗
28. 10.1002/adma.20230231810.1002/adma.202302318 ↗
29. 10.1002/adma.20240503010.1002/adma.202405030 ↗
30. 10.1002/adma.20240416010.1002/adma.202404160 ↗
31. 10.1002/adma.20230850210.1002/adma.202308502 ↗
32. 10.1007/s12274‐016‐1118‐610.1007/s12274‐016‐1118‐6 ↗
33. 10.1103/PhysRevB.80.23540210.1103/PhysRevB.80.235402 ↗
34. 10.1021/acsnano.5c1426210.1021/acsnano.5c14262 ↗
35. 10.1021/acsami.4c1891310.1021/acsami.4c18913 ↗
36. 10.1002/adma.20240102110.1002/adma.202401021 ↗