CORC  > 北京大学  > 软件与微电子学院
BDTune: Hierarchical Correlation-based Performance Analysis and Rule-based Diagnosis for Big Data Systems
Ren, Rui ; Jia, Zhen ; Wang, Lei ; Zhan, Jianfeng ; Yi, Tianxu
2016
关键词Big Data Systems Correlation-based Analysis Bottleneck Detection Root Causes Diagnosis
英文摘要Although big data systems are in widespread use and there have much research efforts for improving big data systems performance, efficiently analysing and diagnosing performance bottlenecks over these massively distributed systems remain a major challenge. In this paper, we propose a hierarchical correlation-based analysis and rule-based diagnostic approach for big data systems. The key approaches lie in identifying performance bottlenecks, classifying root causes, analyzing performance according to multi-level performance metrics, and setting diagnostic rules for performance tuning. Based on this approach, we have implemented BDTune-a lightweight, extensible and transparent tool that can provide valuable insights into performance of big data applications with a very low overhead. We also report our experience on how to use BDTune to conduct performance analysis and performance bottlenecks diagnosis, and demonstrate BDTune can help users find the performance bottlenecks and provide optimization recommendations.; Major Program of National Natural Science Foundation of China [61432006]; National High Technology Research and Development Program of China [2015AA015308]; National Natural Science Foundation of China [61502279]; CPCI-S(ISTP); 555-562
语种英语
出处4th IEEE International Conference on Big Data (Big Data)
内容类型其他
源URL[http://ir.pku.edu.cn/handle/20.500.11897/470185]  
专题软件与微电子学院
推荐引用方式
GB/T 7714
Ren, Rui,Jia, Zhen,Wang, Lei,et al. BDTune: Hierarchical Correlation-based Performance Analysis and Rule-based Diagnosis for Big Data Systems. 2016-01-01.
个性服务
查看访问统计
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。


©版权所有 ©2017 CSpace - Powered by CSpace