dCompaction: Speeding up Compaction of the LSM-Tree via Delayed Compaction

doi:10.1007/s11390-017-1704-4

CORC > 计算技术研究所 > 中国科学院计算技术研究所 > 中国科学院计算技术研究所期刊论文 > 英文

	dCompaction: Speeding up Compaction of the LSM-Tree via Delayed Compaction
	Pan, Feng-Feng 2,3; Yue, Yin-Liang 1; Xiong, Jin 2,3
刊名	JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY
	2017
卷号	32 期号:1 页码:41-54
关键词	key-value store Log-Structured Merge-tree (LSM-tree) write amplification delayed compaction
ISSN号	1000-9000
DOI	10.1007/s11390-017-1704-4
英文摘要	Key-value (KV) stores have become a backbone of large-scale applications in today's data centers. Writeoptimized data structures like the Log-Structured Merge-tree (LSM-tree) and their variants are widely used in KV storage systems like BigTable and RocksDB. Conventional LSM-tree organizes KV items into multiple, successively larger components, and uses compaction to push KV items from one smaller component to another adjacent larger component until the KV items reach the largest component. Unfortunately, current compaction scheme incurs significant write amplification due to repeated KV item reads and writes, and then results in poor throughput. We propose a new compaction scheme, delayed compaction (dCompaction) that decreases write amplification. dCompaction postpones some compactions and gathers them into the following compaction. In this way, it avoids KV item reads and writes during compaction, and consequently improves the throughput of LSM-tree based KV stores. We implement dCompaction on RocksDB, and conduct extensive experiments. Validation using YCSB framework shows that compared with RocksDB, dCompaction has about 40% write performance improvements and also comparable read performance.
资助项目	National Key Research and Development Program of China[2016YFB1000202] ; National Natural Science Foundation of China[61303056] ; National Natural Science Foundation of China[61379042]
WOS研究方向	Computer Science
语种	英语
出版者	SCIENCE PRESS
WOS记录号	WOS:000392106200005
内容类型	期刊论文
源URL	[http://119.78.100.204/handle/2XEOYT63/7666]
专题	中国科学院计算技术研究所期刊论文_英文
通讯作者	Pan, Feng-Feng
作者单位	1.Chinese Acad Sci, Inst Informat Engn, Beijing 100093, Peoples R China 2.Univ Chinese Acad Sci, Beijing 100049, Peoples R China 3.Chinese Acad Sci, Inst Comp Technol, State Key Lab Comp Architecture, Beijing 100190, Peoples R China
推荐引用方式 GB/T 7714	Pan, Feng-Feng,Yue, Yin-Liang,Xiong, Jin. dCompaction: Speeding up Compaction of the LSM-Tree via Delayed Compaction[J]. JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY,2017,32(1):41-54.
APA	Pan, Feng-Feng,Yue, Yin-Liang,&Xiong, Jin.(2017).dCompaction: Speeding up Compaction of the LSM-Tree via Delayed Compaction.JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY,32(1),41-54.
MLA	Pan, Feng-Feng,et al."dCompaction: Speeding up Compaction of the LSM-Tree via Delayed Compaction".JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY 32.1(2017):41-54.