journal article·2026-06-30

Differential Image Sensor With Decoupled Static and Dynamic Outputs

Yegang Liang, Yi Liu, Lin Yuan, Wenhao Ran, Shukun Li, Zeke Liu, Yang Song, Bin Wei, Qingsong Deng, Min Xia, You Meng, Zhuoran Wang, Johnny C. Ho, Guozhen Shen

Publisher page

Abstract

ABSTRACT Acquiring and processing full‐motion details in machine vision typically consumes a substantial amount of energy. In contrast, a hierarchical processing architecture, combining a low‐power standby front end with an on‐demand activated back end, provides an optimized energy‐performance tradeoff. To achieve this, the complete acquisition and decoupling of static (brightness) and dynamic (amplitude and polarity) output at the sensory level are essential for activating on‐demand vision function. Here, we report a differential image sensor (DIS) that leverages differential photodiodes with decoupled differential and tunneling modes. These modes can be read out via conventional ROICs, paving the way for the up‐scaled integration (e.g., 640 × 512). With on‐demand activated dynamic and static modes, the DIS implements a hierarchical motion‐processing pipeline—from sparse motion detection to optical flow and depth analysis. This work provides a power‐efficient and scalable strategy for advancing vision‐based AIoT applications.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: CCD and CMOS Imaging Sensors · Advanced Optical Sensing Technologies · Advanced Memory and Neural Computing

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Integrated Circuits and Electronics Beijing Institute of Technology Beijing China

School of Automation Nanjing University of Information Science and Technology Nanjing China

Institute of Functional Nano & Soft Materials (FUNSOM) Joint International Research Laboratory of Carbon‐Based Functional Materials and Devices Soochow University Suzhou China

Advanced Research Institute of Multidisciplinary Sciences Beijing Institute of Technology Beijing China

School of Materials Sun Yat‐sen University Shenzhen China

College of Materials Science and Engineering Beijing University of Technology Beijing China

Changsha Semiconductor Technology and Application Innovation Research Institute College of Semiconductors (College of Integrated Circuits) Hunan University Changsha China

Greater Bay Area Innovation Institute Beijing Institute of Technology Zhuhai China

Tangshan Research Institute Beijing Institute of Technology Tangshan China

Department of Materials Science and Engineering City University of Hong Kong Hong Kong China

Funding

National Natural Science Foundation of China · Natural Science Foundation of Beijing Municipality · Natural Science Foundation of Hebei Province · Fundamental Research Funds for the Central Universities

References (42)

Show source-provided references
1. 10.1126/scirobotics.aaz971210.1126/scirobotics.aaz9712 ↗
2. 10.1038/s41928‐023‐01055‐210.1038/s41928‐023‐01055‐2 ↗
3. Visualization of Convolutional Neural Networks for Monocular Depth Estimation
4. 10.3389/fncom.2013.0006510.3389/fncom.2013.00065 ↗
5. A.Gupta J.Vohra andM.Alioto “CogniVision: End‐to‐End SoC for Always‐on Smart Vision With mW Power in 40Nm ” in2024 IEEE Symposium on VLSI Technology and Circuits (VLSI Technology and Circuits)(IEEE 2024) 1–2 https://doi.org/10.1109/VLSITechnologyandCir46783.2024.10631426.10.1109/VLSITechnologyandCir46783.2024.10631426 ↗
6. Senputing: An Ultra‐Low‐Power Always‐On Vision Perception Chip Featuring the Deep Fusion of Sensing and Computing
7. 10.1007/s11263‐019‐01209‐w10.1007/s11263‐019‐01209‐w ↗
8. 10.1109/LRA.2021.306070710.1109/LRA.2021.3060707 ↗
9. 10.1126/sciadv.adg782710.1126/sciadv.adg7827 ↗
10. 10.1038/s41467‐025‐59446‐210.1038/s41467‐025‐59446‐2 ↗
11. 10.1109/JSSC.2007.91433710.1109/JSSC.2007.914337 ↗
12. 10.1126/scirobotics.adj812410.1126/scirobotics.adj8124 ↗
13. 10.1109/LRA.2025.358538910.1109/LRA.2025.3585389 ↗
14. Sensor‐Level Computer Vision With Pixel Processor Arrays for Agile Robots10.1126/scirobotics.abl7755 ↗
15. A Compact Neuromorphic System for Ultra–Energy‐Efficient, on‐Device Robot Localization10.1126/scirobotics.ads3968 ↗
16. M.InnocentandG.Meynants “Differential Image Sensor With High Common‐mode Rejection ” inProceedings of the 31st European Solid‐State Circuits Conference 2005 ESSCIRC 2005(IEEE 2005) 483–486 https://doi.org/10.1109/ESSCIR.2005.1541665.10.1109/ESSCIR.2005.1541665 ↗
17. D.Tedaldi G.Gallego E.Mueggler andD.Scaramuzza “Feature Detection and Tracking With the Dynamic Active‐Pixel Vision Sensor (DAVIS) ” inInternational Conference on Event‐based Control Communication and Signal Processing (EBCCSP)(IEEE 2016) 1–7 https://doi.org/10.1109/EBCCSP.2016.7605086.10.1109/EBCCSP.2016.7605086 ↗
18. V.Sundar M.Dutson andA.Ardelean “Generalized Event Cameras ” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition(IEEE 2024) 25007–25017 https://doi.org/10.1109/CVPR52733.2024.02362.10.1109/CVPR52733.2024.02362 ↗
19. 10.1002/inf2.7000710.1002/inf2.70007 ↗
20. 10.1002/adma.20241802310.1002/adma.202418023 ↗
21. 10.1002/adfm.20250552110.1002/adfm.202505521 ↗
22. 10.1002/adma.20241767510.1002/adma.202417675 ↗
23. 10.1038/s41467‐025‐60006‐x10.1038/s41467‐025‐60006‐x ↗
24. 10.1038/s41565‐025‐01973‐610.1038/s41565‐025‐01973‐6 ↗
25. 10.1088/1674‐4926/2408003910.1088/1674‐4926/24080039 ↗
26. 10.1038/s41566‐021‐00950‐410.1038/s41566‐021‐00950‐4 ↗
27. 10.1038/s41566‐023‐01345‐310.1038/s41566‐023‐01345‐3 ↗
28. 10.1021/acs.nanolett.4c0095910.1021/acs.nanolett.4c00959 ↗
29. 10.1021/acsenergylett.4c0301510.1021/acsenergylett.4c03015 ↗
30. 10.1016/j.cej.2023.14524610.1016/j.cej.2023.145246 ↗
31. 10.1002/advs.20241746110.1002/advs.202417461 ↗
32. 10.1002/adma.20240660710.1002/adma.202406607 ↗
33. 10.1002/smll.20240954410.1002/smll.202409544 ↗
34. H.FanandH.Ling “Siamese Cascaded Region Proposal Networks for Real‐Time Visual Tracking ” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition(IEEE 2018) 7944–7953 https://openaccess.thecvf.com/content_CVPR_2019/html/Fan_Siamese_Cascaded_Region_Proposal_Networks_for_Real-Time_Visual_Tracking_CVPR_2019_paper.html.10.1109/CVPR.2019.00814 ↗
35. SiamMask: A Framework for Fast Online Object Tracking and Segmentation
36. 10.1109/TNNLS.2018.285233510.1109/TNNLS.2018.2852335 ↗
37. 10.1126/scirobotics.adl360610.1126/scirobotics.adl3606 ↗
38. 10.1007/s00359‐022‐01610‐w10.1007/s00359‐022‐01610‐w ↗
39. 10.1016/j.neucom.2025.12989910.1016/j.neucom.2025.129899 ↗
40. 10.1007/s11263‐010‐0390‐210.1007/s11263‐010‐0390‐2 ↗
41. A Survey of Variational and CNN‐based Optical Flow Techniques
42. 10.1063/1.173597310.1063/1.1735973 ↗