Author:
Kodukula Venkatesh,Katrawala Saad,Jones Britton,Wu Carole-Jean,LiKamWa Robert
Abstract
Vision processing on traditional architectures is inefficient due to energy-expensive off-chip data movement. Many researchers advocate pushing processing close to the sensor to substantially reduce data movement. However, continuous near-sensor processing raises sensor temperature, impairing imaging/vision fidelity. We characterize the thermal implications of using 3D stacked image sensors with near-sensor vision processing units. Our characterization reveals that near-sensor processing reduces system power but degrades image quality. For reasonable image fidelity, the sensor temperature needs to stay below a threshold, situationally determined by application needs. Fortunately, our characterization also identifies opportunities—unique to the needs of near-sensor processing—to regulate temperature based on dynamic visual task requirements and rapidly increase capture quality on demand. Based on our characterization, we propose and investigate two thermal management strategies—stop-capture-go and seasonal migration—for imaging-aware thermal management. For our evaluated tasks, our policies save up to 53% of system power with negligible performance impact and sustained image fidelity.
Funder
National Science Foundation
Subject
Electrical and Electronic Engineering,Biochemistry,Instrumentation,Atomic and Molecular Physics, and Optics,Analytical Chemistry
Reference54 articles.
1. Enhancing Facebook’s AR Platform with Target Tracking Capabilitieshttps://research.fb.com/enhancing-facebooks-ar-platform-with-target-tracking-capabilities/
2. Microsoft Hololenshttps://www.microsoft.com/en-us/research/blog/ideas-blossom-for-using-microsoft-hololens/
3. End-to-End Deep Learning for Self-Driving Carshttps://devblogs.nvidia.com/deep-learning-self-driving-cars/
4. Neurostream: Scalable and Energy Efficient Deep Learning with Smart Memory Cubes
Cited by
10 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Exploiting Human Color Discrimination for Memory- and Energy-Efficient Image Encoding in Virtual Reality;Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 1;2024-04-17
2. 3-D In-Sensor Computing for Real-Time DVS Data Compression: 65-nm Hardware-Algorithm Co-Design;IEEE Solid-State Circuits Letters;2024
3. Invited Paper: Learned In-Sensor Visual Computing: From Compression to Eventification;2023 IEEE/ACM International Conference on Computer Aided Design (ICCAD);2023-10-28
4. CAMJ: Enabling System-Level Energy Modeling and Architectural Exploration for In-Sensor Visual Computing;Proceedings of the 50th Annual International Symposium on Computer Architecture;2023-06-17
5. In-Sensor & Neuromorphic Computing Are all You Need for Energy Efficient Computer Vision;ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP);2023-06-04