Mass Image Synthesis in Mammogram with Contextual Information Based on GANs | |
Shen, Tianyu3,4; Hao, Kunkun1; Gou, Chao2; Wang, Fei-Yue4,5,6 | |
刊名 | COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE |
2021-04-01 | |
卷号 | 202期号:2021页码:9 |
关键词 | medical image synthesis generative adversarial network mammogram mass detection |
ISSN号 | 0169-2607 |
DOI | 10.1016/j.cmpb.2021.106019 |
英文摘要 | Background and Objective: In medical imaging, the scarcity of labeled lesion data has hindered the application of many deep learning algorithms. To overcome this problem, the simulation of diverse lesions in medical images is proposed. However, synthesizing labeled mass images in mammograms is still challenging due to the lack of consistent patterns in shape, margin, and contextual information. Therefore, we aim to generate various labeled medical images based on contextual information in mammograms. Methods: In this paper, we propose a novel approach based on GANs to generate various mass images and then perform contextual infilling by inserting the synthetic lesions into healthy screening mammograms. Through incorporating features of both realistic mass images and corresponding masks into the adversarial learning scheme, the generator can not only learn the distribution of the real mass images but also capture the matching shape, margin and context information. Results: To demonstrate the effectiveness of our proposed method, we conduct experiments on publicly available mammogram database of DDSM and a private database provided by Nanfang Hospital in China. Qualitative and quantitative evaluations validate the effectiveness of our approach. Additionally, through the data augmentation by image generation of the proposed method, an improvement of 5.03% in detection rate can be achieved over the same model trained on original real lesion images. Conclusions: The results show that the data augmentation based on our method increases the diversity of dataset. Our method can be viewed as one of the first steps toward generating labeled breast mass images for precise detection and can be extended in other medical imaging domains to solve similar problems. ? 2021 Elsevier B.V. All rights reserved. Background and Objective: In medical imaging, the scarcity of labeled lesion data has hindered the application of many deep learning algorithms. To overcome this problem, the simulation of diverse lesions in medical images is proposed. However, synthesizing labeled mass images in mammograms is still challenging due to the lack of consistent patterns in shape, margin, and contextual information. Therefore, we aim to generate various labeled medical images based on contextual information in mammograms. Methods: In this paper, we propose a novel approach based on GANs to generate various mass images and then perform contextual infilling by inserting the synthetic lesions into healthy screening mammograms. Through incorporating features of both realistic mass images and corresponding masks into the adversarial learning scheme, the generator can not only learn the distribution of the real mass images but also capture the matching shape, margin and context information. Results: To demonstrate the effectiveness of our proposed method, we conduct experiments on publicly available mammogram database of DDSM and a private database provided by Nanfang Hospital in China. Qualitative and quantitative evaluations validate the effectiveness of our approach. Additionally, through the data augmentation by image generation of the proposed method, an improvement of 5.03% in detection rate can be achieved over the same model trained on original real lesion images. Conclusions: The results show that the data augmentation based on our method increases the diversity of dataset. Our method can be viewed as one of the first steps toward generating labeled breast mass images for precise detection and can be extended in other medical imaging domains to solve similar problems. |
资助项目 | National Key R&D Program of China[2020YFB1600400] ; National Natural Science Foundation of China[61806198] ; National Natural Science Foundation of China[61533019] |
WOS研究方向 | Computer Science ; Engineering ; Medical Informatics |
语种 | 英语 |
出版者 | ELSEVIER IRELAND LTD |
WOS记录号 | WOS:000639096300010 |
资助机构 | National Key R&D Program of China ; National Natural Science Foundation of China |
内容类型 | 期刊论文 |
源URL | [http://ir.ia.ac.cn/handle/173211/44263] |
专题 | 自动化研究所_复杂系统管理与控制国家重点实验室_先进控制与自动化团队 |
通讯作者 | Gou, Chao |
作者单位 | 1.Xian Fiaotong Univ, Sch Software Engn, Xian, Peoples R China 2.Sun Yat Sen Univ, Sch Intelligent Syst Engn, Guangzhou, Peoples R China 3.Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R China 4.Chinese Acad Sci, Inst Automat, Beijing, Peoples R China 5.Macau Univ Sci & Technol, Inst Syst Engn, Macau, Peoples R China 6.Qingdao Acad Intelligent Ind, Qingdao, Peoples R China |
推荐引用方式 GB/T 7714 | Shen, Tianyu,Hao, Kunkun,Gou, Chao,et al. Mass Image Synthesis in Mammogram with Contextual Information Based on GANs[J]. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE,2021,202(2021):9. |
APA | Shen, Tianyu,Hao, Kunkun,Gou, Chao,&Wang, Fei-Yue.(2021).Mass Image Synthesis in Mammogram with Contextual Information Based on GANs.COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE,202(2021),9. |
MLA | Shen, Tianyu,et al."Mass Image Synthesis in Mammogram with Contextual Information Based on GANs".COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 202.2021(2021):9. |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论