K-mer Counting for Genomic Big Data
Shengzhong Feng; Jianqiu Ge; Ning Guo; Jintao Meng; Bingqiang Wang; Pavan Balaji; Jiaxiu Zhou; Yanjie Wei
2018
会议日期2018
英文摘要Counting the abundance of all the k-mers (substrings of length k) in sequencing reads is an important step of many bioinformatics applications, including de novo assembly, error correction and multiple sequence alignment. However, processing large amount of genomic dataset (TB range) has become a bottle neck in these bioinformatics pipelines. At present, most of the k-mer counting tools are based on single node, and cannot handle the data at TB level efficiently. In this paper, we propose a new distributed method for k-mer counting with high scalability. We test our k-mer counting tool on Mira supercomputer at Argonne National Lab, the experimental results show that it can scale to 8192 cores with an efficiency of 43% when processing 2 TB simulated genome dataset with 200 billion distinct k-mers (graph size), and only 578 s is used for the whole genome statistical analysis.
语种英语
URL标识查看原文
内容类型会议论文
源URL[http://ir.siat.ac.cn:8080/handle/172644/14063]  
专题深圳先进技术研究院_数字所
推荐引用方式
GB/T 7714
Shengzhong Feng,Jianqiu Ge,Ning Guo,et al. K-mer Counting for Genomic Big Data[C]. 见:. 2018.
个性服务
查看访问统计
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。


©版权所有 ©2017 CSpace - Powered by CSpace