Research on elastic resource management for multi-queue under cloud computing environment

doi:10.1088/1742-6596/898/9/092003

	Research on elastic resource management for multi-queue under cloud computing environment
	Cheng, Yaodong; Cheng ZJ(程振京); Li HB(李海波); Huang QL(黄秋兰); Cheng YD(程耀东); Chen G(陈刚); Cheng, Zhenjing ; Li, Haibo ; Huang, Qiulan ; Chen, Gang
刊名	Journal of Physics: Conference Series
	2017
卷号	898 期号:9 页码:092003
ISSN号	1742-6588
DOI	10.1088/1742-6596/898/9/092003
文献子类	Proceedings Paper
英文摘要	As a new approach to manage computing resource, virtualization technology is more and more widely applied in the high-energy physics field. A virtual computing cluster based on Openstack was built at IHEP, using HTCondor as the job queue management system. In a traditional static cluster, a fixed number of virtual machines are pre-allocated to the job queue of different experiments. However this method cannot be well adapted to the volatility of computing resource requirements. To solve this problem, an elastic computing resource management system under cloud computing environment has been designed. This system performs unified management of virtual computing nodes on the basis of job queue in HTCondor based on dual resource thresholds as well as the quota service. A two-stage pool is designed to improve the efficiency of resource pool expansion. This paper will present several use cases of the elastic resource management system in IHEPCloud. The practical run shows virtual computing resource dynamically expanded or shrunk while computing requirements change. Additionally, the CPU utilization ratio of computing resource was significantly increased when compared with traditional resource management. The system also has good performance when there are multiple condor schedulers and multiple job queues. © Published under licence by IOP Publishing Ltd.
电子版国际标准刊号	1742-6596
会议地点	San Francisco, CA, United states
会议日期	October 10, 2016 - October 14, 2016
语种	英语
内容类型	期刊论文
源URL	[http://ir.ihep.ac.cn/handle/311005/285444]
专题	中国科学院高能物理研究所
作者单位	1.University of Chinese Academy of Sciences, Beijing, China 2.IHEP Computing Center, 19B Yuquan Road, Beijing; 100049, China;
推荐引用方式 GB/T 7714	Cheng, Yaodong,Cheng ZJ,Li HB,et al. Research on elastic resource management for multi-queue under cloud computing environment[J]. Journal of Physics: Conference Series,2017,898(9):092003.
APA	Cheng, Yaodong.,程振京.,李海波.,黄秋兰.,程耀东.,...&Chen, Gang.(2017).Research on elastic resource management for multi-queue under cloud computing environment.Journal of Physics: Conference Series,898(9),092003.
MLA	Cheng, Yaodong,et al."Research on elastic resource management for multi-queue under cloud computing environment".Journal of Physics: Conference Series 898.9(2017):092003.