Low-cost high performance distributed data storage for multi-channel observations

CORC > 云南天文台 > 中国科学院云南天文台 > 其他

	Low-cost high performance distributed data storage for multi-channel observations
	Liu YB(刘应波)1,2,3 ; Wang F(王锋)1,2,3 ; Deng, H 1; Ji, KF1 ; Dai W(戴伟)1,2,3 ; Wei SL(卫守林)1,2,3 ; Liang, B 1; Zhang, XL1
刊名	NEW ASTRONOMY
	2015-10
卷号	40 页码:78-86
关键词	Astronomical databases: miscellaneous Methods: massive solar data storage Techniques: high performance I/O
ISSN号	1384-1076
通讯作者	Wang, F (reprint author), Kunming Univ Sci & Technol, Comp Technol Applicat Key Lab Yunnan Prov, Chenggong 650500, Kunming, Peoples R China.
产权排序	第二完成单位
英文摘要	The New Vacuum Solar Telescope (NVST) is a 1-m solar telescope that aims to observe the fine structures in both the photosphere and the chromosphere of the Sun. The observational data acquired simultaneously from one channel for the chromosphere and two channels for the photosphere bring great challenges to the data storage of NVST. The multi-channel instruments of NVST, including scientific cameras and multi-band spectrometers, generate at least 3 terabytes data per day and require high access performance while storing massive short-exposure images. It is worth studying and implementing a storage system for NVST which would balance the data availability, access performance and the cost of development. In this paper, we build a distributed data storage system (DDSS) for NVST and then deeply evaluate the availability of real-time data storage on a distributed computing environment. The experimental results show that two factors, i.e., the number of concurrent read/write and the file size, are critically important for improving the performance of data access on a distributed environment. Referring to these two factors, three strategies for storing FITS files are presented and implemented to ensure the access performance of the DDSS under conditions of multi-host write and read simultaneously. The real applications of the DDSS proves that the system is capable of meeting the requirements of NVST real-time high performance observational data storage. Our study on the DDSS is the first attempt for modern astronomical telescope systems to store real-time observational data on a low-cost distributed system. The research results and corresponding techniques of the DDSS provide a new option for designing real-time massive astronomical data storage system and will be a reference for future astronomical data storage. (C) 2015 Elsevier B.V. All rights reserved.
学科主题	Astronomy & Astrophysics
WOS标题词	Science & Technology ; Physical Sciences
类目[WOS]	Astronomy & Astrophysics
研究领域[WOS]	Astronomy & Astrophysics
收录类别	SCI
原文出处	http://www.sciencedirect.com/science/article/pii/S1384107615000470
语种	英语
WOS记录号	WOS:000356552700009
内容类型	期刊论文
源URL	[http://ir.ynao.ac.cn/handle/114a53/4257]
专题	云南天文台_其他
作者单位	1.Computer Technology Application Key Lab of Yunnan Province, Kunming University of Science and Technology, Chenggong, Kunming 650500, China 2.Yunnan Observatories, Chinese Academy of Sciences, Kunming 650011, China 3.University of Chinese Academy of Sciences, Beijing 100049, China
推荐引用方式 GB/T 7714	Liu YB,Wang F,Deng, H,et al. Low-cost high performance distributed data storage for multi-channel observations[J]. NEW ASTRONOMY,2015,40:78-86.
APA	Liu YB.,Wang F.,Deng, H.,Ji, KF.,Dai W.,...&Zhang, XL.(2015).Low-cost high performance distributed data storage for multi-channel observations.NEW ASTRONOMY,40,78-86.
MLA	Liu YB,et al."Low-cost high performance distributed data storage for multi-channel observations".NEW ASTRONOMY 40(2015):78-86.