| Collaborative image compression and classification with multi-task learning for visual Internet of Things |
| |
| 作者姓名： | Bing DU Yiping DUAN Hang ZHANG Xiaoming TAO Yue WU Congchong RU |
| |
| 作者单位： | 1. School of Computer and Communication Engineering, University of Science and Technology Beijing;2. Department of Electronic Engineering, Tsinghua University;3. School of Computer Science and Technology, Xidian University;4. Smart Network Computing Lab, Cross-strait Tsinghua Research Institution |
| |
| 基金项目： | supported by the National Key R&D Program of China (No.: 2019YFB1803400)；;the National Natural Science Foundation of China (Nos. NSFC 61925105, 61801260 and U1633121)；;the Fundamental Research Funds for the Central Universities, China (No. FRF-NP-2003)； |
| |
| 摘 要： | Widespread deployment of the Internet of Things(Io T) has changed the way that network services are developed, deployed, and operated. Most onboard advanced Io T devices are equipped with visual sensors that form the so-called visual Io T. Typically, the sender would compress images, and then through the communication network, the receiver would decode images, and then analyze the images for applications. However, image compression and semantic inference are generally conducted separately, and t...
|
| 收稿时间： | 15 March 2021 |
Collaborative image compression and classification with multi-task learning for visual Internet of Things |
| |
| Bing DU,Yiping DUAN,Hang ZHANG,Xiaoming TAO,Yue WU,Congchong RU.Collaborative image compression and classification with multi-task learning for visual Internet of Things[J].Chinese Journal of Aeronautics,2022,35(5):390-399. |
| |
| Institution: | 1. School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, China;2. Department of Electronic Engineering, Tsinghua University, Beijing 100084, China;3. School of Computer Science and Technology, Xidian University, Xian 710071, China;4. Smart Network Computing Lab, Cross-strait Tsinghua Research Institution, Beijing 100084, China |
| |
| Abstract: | Widespread deployment of the Internet of Things (IoT) has changed the way that network services are developed, deployed, and operated. Most onboard advanced IoT devices are equipped with visual sensors that form the so-called visual IoT. Typically, the sender would compress images, and then through the communication network, the receiver would decode images, and then analyze the images for applications. However, image compression and semantic inference are generally conducted separately, and thus, current compression algorithms cannot be transplanted for the use of semantic inference directly. A collaborative image compression and classification framework for visual IoT applications is proposed, which combines image compression with semantic inference by using multi-task learning. In particular, the multi-task Generative Adversarial Networks (GANs) are described, which include encoder, quantizer, generator, discriminator, and classifier to conduct simultaneously image compression and classification. The key to the proposed framework is the quantized latent representation used for compression and classification. GANs with perceptual quality can achieve low bitrate compression and reduce the amount of data transmitted. In addition, the design in which two tasks share the same feature can greatly reduce computing resources, which is especially applicable for environments with extremely limited resources. Using extensive experiments, the collaborative compression and classification framework is effective and useful for visual IoT applications. |
| |
| Keywords: | Deep learning Generative Adversarial Network (GAN) Image classification Image compression Internet of Things |
| 本文献已被 ScienceDirect 等数据库收录！ |
|
