journal article·2024-11Open access

Visual‐Audio Thermoelectric Detectors for Images and Sound Recognition

Zekun Liu, Shuai Zhang, Zhenhua Wu, Xing‐Er Wang, Kangning Zou, Zhiyuan Zhu, Xuyu Wang, Erzhen Mu, Xiaotian Zhang, Yan Liu, Huilie Shi, Zhiyu Hu

Advanced Functional Materials· Volume 34· Issue 46

Abstract

Abstract Inherent in humans is the capacity to perceive music and art, engaging both the visual and auditory senses, with profound effects on physiological and psychological states. Sound and light possess the remarkable ability to transform into thermal energy and, ultimately, electrical signals, playing a crucial role in human sensory perception. This research introduces a previously unmentioned synesthesia‐inspired image and sound recognition system, diverging from conventional image/sound acquisition techniques based on photo/mechanical‐electrical conversion. Leveraging the photo/acoustic‐thermal‐electric effects, the system utilizes micro‐/commercial thermoelectric devices as a conduit for energy conversion. It successfully discriminates monochromatic red, green, blue (RGB) and color coverage, showcasing its proficiency in distinguishing ten digital paintings. Additionally, by probing fiber responses to varied sound frequencies and loudness levels, the system achieves time‐domain identification of four classical music compositions. The device exhibits high sensitivity to detecting input energy and its inputting rate power, offering a novel approach to image and sound recognition through thermal signals. Potential applications span from bionic image sensors and time‐domain thermal monitoring of audio. With further exploration, this thermoelectric‐based system holds promise in quantifying emotional responses to images and sound.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Chemical Sensor Technologies · Building Energy and Comfort Optimization · Thermography and Photoacoustic Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Institute of NanoMicroEnergy Zhangjiang Institute for Advanced Study Shanghai Jiao Tong University Shanghai 200240 China

Department of Micro/Nano Electronics School of Electronic Information and Electrical Engineering Shanghai Jiao Tong University Shanghai 200240 China

School of Mechanical and Power Engineering East China University of Science and Technology Shanghai 200237 China

School of Mechanical Engineering Shanghai Jiao Tong University Shanghai 200240 China

Shanghai Key Laboratory for Digital Maintenance of Buildings and Infrastructure School of Naval Architecture Ocean and Civil Engineering Shanghai Jiao Tong University Shanghai 200240 China

Department of Automation School of Electronic Information and Electrical Engineering Shanghai Jiao Tong University Shanghai 200240 China

School of Materials Science and Engineering Henan Polytechnic University Henan 454001 China

China Nuclear Power Operation Technology Corporation, LTD. Wuhan 430223 China

Funding

National Natural Science Foundation of China

References (48)

Show source-provided references
1. 10.1126/science.aao009810.1126/science.aao0098 ↗
2. 10.1016/j.matt.2022.02.02010.1016/j.matt.2022.02.020 ↗
3. 10.1038/434312a10.1038/434312a ↗
4. 10.1038/s41583-023-00743-410.1038/s41583-023-00743-4 ↗
5. 10.1038/nature1260810.1038/nature12608 ↗
6. Whiteford K. L. · Iperception · 2018 · 9 · 1
7. 10.1038/s41377-023-01223-110.1038/s41377-023-01223-1 ↗
8. 10.1002/col.508016020610.1002/col.5080160206 ↗
9. 10.1038/s42256-023-00616-610.1038/s42256-023-00616-6 ↗
10. 10.1002/adma.20230341010.1002/adma.202303410 ↗
11. 10.1002/smtd.20220149910.1002/smtd.202201499 ↗
12. 10.1109/TPAMI.2021.312664810.1109/TPAMI.2021.3126648 ↗
13. Yuan L. · IEEE Trans. Pattern Anal. Mach. Intell. · 2023 · 45 · 6575
14. 10.1021/acs.chemrev.2c0057210.1021/acs.chemrev.2c00572 ↗
15. 10.1021/acs.chemrev.3c0015910.1021/acs.chemrev.3c00159 ↗
16. 10.1016/j.buildenv.2021.10865810.1016/j.buildenv.2021.108658 ↗
17. 10.1038/s41467-024-45092-710.1038/s41467-024-45092-7 ↗
18. 10.1038/s41467-024-47417-y10.1038/s41467-024-47417-y ↗
19. 10.1002/adma.20231314610.1002/adma.202313146 ↗
20. 10.1002/adfm.20240349810.1002/adfm.202403498 ↗
21. 10.1002/adfm.20240231710.1002/adfm.202402317 ↗
22. 10.1016/j.nanoen.2021.10669210.1016/j.nanoen.2021.106692 ↗
23. 10.1038/s41928-022-00776-010.1038/s41928-022-00776-0 ↗
24. 10.1002/adfm.20230335210.1002/adfm.202303352 ↗
25. 10.1038/nnano.2014.18210.1038/nnano.2014.182 ↗
26. 10.1021/acs.analchem.9b0521810.1021/acs.analchem.9b05218 ↗
27. Osborn L. E. · Nat. Biomed. Eng. · 2023
28. 10.1002/admt.20210141610.1002/admt.202101416 ↗
29. 10.1016/j.nanoen.2023.10861110.1016/j.nanoen.2023.108611 ↗
30. 10.1149/2754-2726/ac753410.1149/2754-2726/ac7534 ↗
31. 10.1016/j.nanoen.2018.10.05710.1016/j.nanoen.2018.10.057 ↗
32. 10.1126/sciadv.abo750010.1126/sciadv.abo7500 ↗
33. 10.1109/TPEL.2009.202647610.1109/TPEL.2009.2026476 ↗
34. 10.1016/j.xcrp.2022.10078910.1016/j.xcrp.2022.100789 ↗
35. 10.1016/j.jpowsour.2018.05.03110.1016/j.jpowsour.2018.05.031 ↗
36. 10.1186/s40580-020-0218-x10.1186/s40580-020-0218-x ↗
37. 10.1002/(SICI)1520-6378(199702)22:1<11::AID-COL4>3.0.CO;2-710.1002/(SICI)1520-6378(199702)22:1<11::AID-COL4>3.0.CO;2-7 ↗
38. 10.1007/978-3-030-27103-910.1007/978-3-030-27103-9 ↗
39. 10.1016/B978-0-12-397021-3.00004-110.1016/B978-0-12-397021-3.00004-1 ↗
40. 10.1002/adma.20180363710.1002/adma.201803637 ↗
41. 10.1038/nrn378610.1038/nrn3786 ↗
42. 10.1007/s40820-023-01116-310.1007/s40820-023-01116-3 ↗
43. 10.1016/j.tics.2020.02.00110.1016/j.tics.2020.02.001 ↗
44. 10.1038/s41583-022-00578-510.1038/s41583-022-00578-5 ↗
45. Rohsenow W. M. · 1997
46. 10.1016/j.jallcom.2020.15423910.1016/j.jallcom.2020.154239 ↗
47. 10.1002/aelm.20190073510.1002/aelm.201900735 ↗
48. 10.1021/acs.cgd.8b0163210.1021/acs.cgd.8b01632 ↗