Dual-stream Representation Fusion Learning for accurate medical image segmentation | |
Xu RT(许镕涛)1,3; Wang CW(王常维)1,3; Xu SB(徐士彪)2; Meng WL(孟维亮)3; Zhang XP(张晓鹏)3 | |
刊名 | Engineering Applications of Artificial Intelligence |
2023 | |
卷号 | 123页码:106402 |
英文摘要 | Accurate segmenting regions of interest in various medical images are essential to clinical research and applications. Although deep learning-based methods have achieved good results, the fully automated segmentation results still need to be refined on the tininess, complexities, and irregularities of lesion shapes. To address this issue, we propose a Dual-stream Representation Fusion Learning (DRFL) paradigm for accurate clinical segmentation, including Dual-stream Fusion Module, Representation Fusion Transformer Module and Peakiness Fusion Attention Module. Specifically, Dual-stream Fusion Module can simultaneously generate binary masks and high-resolution images with segmentation stream and super-resolution stream that share a feature extractor, then both prediction outputs are merged as the input of Fusion Module to further improve the performance of the network for generating the final segmentation result; Representation Fusion Transformer Module is lightweight to fuse high-resolution representation and fine-grained structure representation; Peakiness Fusion Attention Module can capture more salient features while fusing more spatial information to improve the performance of the network. The effectiveness of our dual-stream representation fusion learning is validated on different medical image segmentation tasks, and extensive experiments show that our DRFL outperforms the state-of-the-art methods in segmentation quality of lung nodule segmentation, lung segmentation, cell contour segmentation, and prostate segmentation. Our code is available at https://github.com/Rongtao-Xu/RepresentationLearning/tree/main/DRFL-EAAI2023. |
内容类型 | 期刊论文 |
源URL | [http://ir.ia.ac.cn/handle/173211/51657] |
专题 | 模式识别国家重点实验室_三维可视计算 |
通讯作者 | Xu RT(许镕涛); Zhang XP(张晓鹏) |
作者单位 | 1.School of Artificial Intelligence, University of Chinese Academy of Sciences, China 2.School of Artificial Intelligence, Beijing University of Posts and Telecommunications, China 3.State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, China |
推荐引用方式 GB/T 7714 | Xu RT,Wang CW,Xu SB,et al. Dual-stream Representation Fusion Learning for accurate medical image segmentation[J]. Engineering Applications of Artificial Intelligence,2023,123:106402. |
APA | Xu RT,Wang CW,Xu SB,Meng WL,&Zhang XP.(2023).Dual-stream Representation Fusion Learning for accurate medical image segmentation.Engineering Applications of Artificial Intelligence,123,106402. |
MLA | Xu RT,et al."Dual-stream Representation Fusion Learning for accurate medical image segmentation".Engineering Applications of Artificial Intelligence 123(2023):106402. |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论