Parallel compression and decompression of DNA sequence reads in FASTQ format

CORC > 软件研究所 > 软件所图书馆 > 期刊论文

	Parallel compression and decompression of DNA sequence reads in FASTQ format
	Zheng, Jingjing (1) ; Wang, Ting (1)
刊名	International Journal of Hybrid Information Technology
	2014
卷号	7 期号:4 页码:91-100
ISSN号	17389968
中文摘要	Large volumes of short reads of genomic data are generated by high-throughput sequencing instruments. The FASTQ format is widely accepted as the input format of genomic reads and has presented challenges in data storage, management, and transfer. The performance of this type of serial algorithms such as G-SQZ and DSRC is limited by the single processor and the memory in a single computer. Utilizing data parallelism, the circular dual queues of buffers, memory mapping integrated with superblocks, pipeline parallelism with multi threads, and so on, we present the parallel compression and decompression methods for DNA sequence reads in FASTQ format based on the parallel computer architectures of the cluster and the SMP. Experimental results for the parallel DSRC algorithm clearly show the efficiency of using the powerful computing resources from multi computing nodes and multi cores of each node. The speedups vary from 46 to 62 for parallel compression and vary from 40 to 58 for parallel decompression by using 10 nodes of the cluster in Tianhe-1A super computer. Test results on the SMP machine are also pleasant. The methods could be applied to any serial compressing algorithms of DNA sequence reads in FASTQ format only if they have the traits of index and superblocks. © 2014 SERSC.
英文摘要	Large volumes of short reads of genomic data are generated by high-throughput sequencing instruments. The FASTQ format is widely accepted as the input format of genomic reads and has presented challenges in data storage, management, and transfer. The performance of this type of serial algorithms such as G-SQZ and DSRC is limited by the single processor and the memory in a single computer. Utilizing data parallelism, the circular dual queues of buffers, memory mapping integrated with superblocks, pipeline parallelism with multi threads, and so on, we present the parallel compression and decompression methods for DNA sequence reads in FASTQ format based on the parallel computer architectures of the cluster and the SMP. Experimental results for the parallel DSRC algorithm clearly show the efficiency of using the powerful computing resources from multi computing nodes and multi cores of each node. The speedups vary from 46 to 62 for parallel compression and vary from 40 to 58 for parallel decompression by using 10 nodes of the cluster in Tianhe-1A super computer. Test results on the SMP machine are also pleasant. The methods could be applied to any serial compressing algorithms of DNA sequence reads in FASTQ format only if they have the traits of index and superblocks. © 2014 SERSC.
收录类别	EI
语种	英语
公开日期	2014-12-16
内容类型	期刊论文
源URL	[http://ir.iscas.ac.cn/handle/311060/17026]
专题	软件研究所_软件所图书馆_期刊论文
推荐引用方式 GB/T 7714	Zheng, Jingjing ,Wang, Ting . Parallel compression and decompression of DNA sequence reads in FASTQ format[J]. International Journal of Hybrid Information Technology,2014,7(4):91-100.
APA	Zheng, Jingjing ,&Wang, Ting .(2014).Parallel compression and decompression of DNA sequence reads in FASTQ format.International Journal of Hybrid Information Technology,7(4),91-100.
MLA	Zheng, Jingjing ,et al."Parallel compression and decompression of DNA sequence reads in FASTQ format".International Journal of Hybrid Information Technology 7.4(2014):91-100.