HCMonitor: An accurate measurement system for high concurrent network services

doi:10.1002/cpe.6081

	HCMonitor: An accurate measurement system for high concurrent network services
	Song, Hui 3; Zhang, Wenli 3; Liu, Ke 3; Shen, Yifan 2,3; Chen, Mingyu 1,2,3
刊名	CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE
	2021-04-27
页码	16
关键词	accurate measurement full traffic high concurrency monitor server‐ side latency
ISSN号	1532-0626
DOI	10.1002/cpe.6081
英文摘要	This article aims to enhance the monitoring accuracy of high concurrent network services. As modern network services grow rapidly in data centers, tail latency has become one of the most crucial deciding factors on user experience. Latency measurement and anomaly detection are essential in evaluating service performance. Existing monitoring tools can be divided into two categories according to estimation methods. First, approaches based on sample traffic sample network packets to unburden the measurement. Second, approaches based on full traffic like wrk, analyze all of the packets from the kernel network stack and load the client-side overhead into response delay. Therefore, we propose a high-performance monitor system named HCMonitor, which computes the server-side response latency and the round-trip time of per-request. It can afford full traffic monitoring on the basis of userspace, "zero copy" and pipeline. By switch mirroring, the measured latency eliminates the kernel network stack overhead and the queuing delay of the client-side. Such measurement results in improved accuracy, online analysis, anomaly detection, real-time display and transparent to network services. Our evaluations show HCMonitor obtains a higher throughput compared with tcpdump by over 200 times. Compared with wrk, the tail latency accuracy shows an increase by up to 72%-76% in high concurrent networks.
资助项目	National Key Research and Development Plan of China[2017YFB1001602] ; National-Natural Science Foundation of China[62072439]
WOS研究方向	Computer Science
语种	英语
出版者	WILEY
WOS记录号	WOS:000644709200001
内容类型	期刊论文
源URL	[http://119.78.100.204/handle/2XEOYT63/17832]
专题	中国科学院计算技术研究所
通讯作者	Zhang, Wenli
作者单位	1.Peng Cheng Lab, Frontier Res Ctr, Shenzhen, Peoples R China 2.Univ Chinese Acad Sci, Sch Comp Sci & Technol, Beijing, Peoples R China 3.Chinese Acad Sci, Inst Comp Technol, State Key Lab Comp Architecture, Kexueyuan Rd South 6, Beijing, Peoples R China
推荐引用方式 GB/T 7714	Song, Hui,Zhang, Wenli,Liu, Ke,et al. HCMonitor: An accurate measurement system for high concurrent network services[J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE,2021:16.
APA	Song, Hui,Zhang, Wenli,Liu, Ke,Shen, Yifan,&Chen, Mingyu.(2021).HCMonitor: An accurate measurement system for high concurrent network services.CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE,16.
MLA	Song, Hui,et al."HCMonitor: An accurate measurement system for high concurrent network services".CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE (2021):16.