journal article·2025-12Open access

Gaussian‐Sigmoid Reinforcement Transistors: Resolving Exploration‐Exploitation Trade‐Off Through Gate Voltage‐Controlled Activation Functions

Jisoo Park, Juhyung Seo, Ryun‐Han Koo, Dinithi Jayasuriya, Nethmi Jayasinghe, Wonjun Shin, Amit R. Trivedi, Hocheon Yoo

Advanced Functional Materials· Volume 35· Issue 49

Abstract

Abstract Reinforcement learning (RL) relies on Gaussian and sigmoid functions to balance exploration and exploitation, but implementing these functions in hardware typically requires iterative computations, increasing power and circuit complexity. Here, Gaussian‐sigmoid reinforcement transistors (GS‐RTs) are reported that integrate both activation functions into a single device. The transistors feature a vertical n‐p‐i‐p heterojunction stack composed of a‐IGZO and DNTT, with asymmetric source–drain contacts and a parylene interlayer that enables voltage‐tunable transitions between sigmoid, Gaussian, and mixed responses. This architecture emulates the behavior of three transistors in one, reducing the required circuit complexity from dozens of transistors to fewer than a few. The GS‐RT exhibits a peak current of 5.95 µA at V G = −17 V and supports nonlinear transfer characteristics suited for neuromorphic computing. In a multi‐armed bandit task, GS‐RT‐based RL policies demonstrate 20% faster convergence and 30% higher final reward compared to conventional sigmoid‐ or Gaussian‐based approaches. Extending this advantage further, GS‐RT‐based activation function in deep RL for cartpole balancing significantly outperforms the traditional ReLU‐based activation function in terms of faster learning and tolerance to input perturbations.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Memory and Neural Computing · Advancements in Semiconductor Devices and Circuit Design · Neuroscience and Neural Engineering

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Semiconductor Engineering Gachon University 1342 Seongnam‐daero Seongnam 13120 Republic of Korea

Department of Electronic Engineering Hanyang University Seoul 04763 Republic of Korea

Department of Electrical and Computer Engineering and Inter‐University Semiconductor Research Center (ISRC) Seoul National University Seoul 08826 South Korea

Department of Electrical and Computer Engineering University of Illinois Chicago IL 60607 USA

Department of Semiconductor Convergence Engineering Sungkyunkwan University Suwon 16419 Republic of Korea

Funding

National Research Foundation of Korea · National Science Foundation

References (34)

Show source-provided references
1. 10.1038/s41586-021-03625-w10.1038/s41586-021-03625-w ↗
2. 10.1002/aelm.20240045510.1002/aelm.202400455 ↗
3. 10.1002/aelm.20220086810.1002/aelm.202200868 ↗
4. 10.1021/acsami.3c0103410.1021/acsami.3c01034 ↗
5. 10.1002/admt.20210014110.1002/admt.202100141 ↗
6. 10.1038/s41528-022-00133-310.1038/s41528-022-00133-3 ↗
7. 10.1021/acs.nanolett.1c0383210.1021/acs.nanolett.1c03832 ↗
8. 10.1038/s41467-024-49668-110.1038/s41467-024-49668-1 ↗
9. 10.1039/D1TC01451J10.1039/D1TC01451J ↗
10. 10.1002/adma.20210611010.1002/adma.202106110 ↗
11. 10.1021/acsaelm.4c0026010.1021/acsaelm.4c00260 ↗
12. 10.1021/acsaelm.4c0033510.1021/acsaelm.4c00335 ↗
13. 10.1021/acsami.3c1785510.1021/acsami.3c17855 ↗
14. 10.1109/85.60172710.1109/85.601727 ↗
15. 10.1109/MEI.2024.1044476410.1109/MEI.2024.10444764 ↗
16. 10.1613/jair.30110.1613/jair.301 ↗
17. 10.1002/aisy.20230076310.1002/aisy.202300763 ↗
18. 10.1021/acs.nanolett.3c0272610.1021/acs.nanolett.3c02726 ↗
19. 10.1038/s41467-024-46681-210.1038/s41467-024-46681-2 ↗
20. 10.1002/adfm.20231621710.1002/adfm.202316217 ↗
21. 10.1002/adfm.20241134810.1002/adfm.202411348 ↗
22. 10.1038/s41467-020-15378-710.1038/s41467-020-15378-7 ↗
23. 10.1021/acsami.4c0611610.1021/acsami.4c06116 ↗
24. 10.1021/acsnano.9b0020110.1021/acsnano.9b00201 ↗
25. 10.1016/j.inffus.2022.03.00310.1016/j.inffus.2022.03.003 ↗
26. 10.1016/j.artint.2021.10353510.1016/j.artint.2021.103535 ↗
27. 10.1109/TED.2024.337915710.1109/TED.2024.3379157 ↗
28. 10.1002/adma.20090319310.1002/adma.200903193 ↗
29. Madrenas J. · IEEE Transact. Circ. Syst. II: Anal. Digit. Signal Proc. · 1996 · 43 · 70
30. M. T.Abuelma'atti S. R.Al‐Abbas presented at2016 IEEE Industrial Electronics and Applications Conf. (IEACon) Kota Kinabalu Malaysia November2016.
31. C.‐W.Lin J.‐S.Wang presented at2008 IEEE International Symposium on Circuits and Systems (ISCAS) Seattle WA USA May2008.
32. 10.1109/TVLSI.2011.210940410.1109/TVLSI.2011.2109404 ↗
33. N.Wiedemann V.Wüest A.Loquercio M.Müller D.Floreano D.Scaramuzza presented at2023 IEEE International Conf. on Robotics and Automation (ICRA) London UK May2023.
34. 10.3389/fnins.2021.78669410.3389/fnins.2021.786694 ↗