Adversarial networks for scale feature-attention spectral image reconstruction from a single RGB
Liu PF(刘鹏飞)1,2,3,4,5; Zhao HC(赵怀慈)2,3,4,5
刊名SENSORS
2020
卷号20期号:8页码:1-17
关键词hyperspectral imaging generative adversarial network attention mechanism feature pyramid boundary supervision
ISSN号1424-8220
产权排序1
英文摘要

Hyperspectral images reconstruction focuses on recovering the spectral information from a single RGBimage. In this paper, we propose two advanced Generative Adversarial Networks (GAN) for the heavily underconstrained inverse problem. We first propose scale attention pyramid UNet (SAPUNet), which uses U-Net with dilated convolution to extract features. We establish the feature pyramid inside the network and use the attention mechanism for feature selection. The superior performance of this model is due to the modern architecture and capturing of spatial semantics. To provide a more accurate solution, we propose another distinct architecture, named W-Net, that builds one more branch compared to U-Net to conduct boundary supervision. SAPUNet and scale attention pyramid WNet (SAPWNet) provide improvements on the Interdisciplinary Computational Vision Lab at Ben Gurion University (ICVL) datasetby 42% and 46.6%, and 45% and 50% in terms of root mean square error (RMSE) and relative RMSE,respectively. The experimental results demonstrate that our proposed models are more accurate than the state-of-the-art hyperspectral recovery methods.

WOS研究方向Chemistry ; Engineering ; Instruments & Instrumentation
语种英语
WOS记录号WOS:000533346400268
内容类型期刊论文
源URL[http://ir.sia.cn/handle/173321/26747]  
专题沈阳自动化研究所_光电信息技术研究室
通讯作者Liu PF(刘鹏飞)
作者单位1.University of Chinese Academy of Sciences, Beijing 100049, China
2.Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang 110016, China
3.The Key Lab of Image Understanding and Computer Vision, Shenyang 110016, China
4.Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China
5.Key Laboratory of Opto-Electronic Information Processing, Chinese Academy of Sciences, Shenyang 110016, China
推荐引用方式
GB/T 7714
Liu PF,Zhao HC. Adversarial networks for scale feature-attention spectral image reconstruction from a single RGB[J]. SENSORS,2020,20(8):1-17.
APA Liu PF,&Zhao HC.(2020).Adversarial networks for scale feature-attention spectral image reconstruction from a single RGB.SENSORS,20(8),1-17.
MLA Liu PF,et al."Adversarial networks for scale feature-attention spectral image reconstruction from a single RGB".SENSORS 20.8(2020):1-17.
个性服务
查看访问统计
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。


©版权所有 ©2017 CSpace - Powered by CSpace