ridm@nrct.go.th   ระบบคลังข้อมูลงานวิจัยไทย   รายการโปรดที่คุณเลือกไว้

Improving large graph processing on partitioned graphs in the cloud

หน่วยงาน Nanyang Technological University, Singapore

รายละเอียด

ชื่อเรื่อง : Improving large graph processing on partitioned graphs in the cloud
นักวิจัย : Chen, Rishan , Yang, Mao , Weng, Xuetian , Choi, Byron , He, Bingsheng , Li, Xiaoming
คำค้น : DRNTU::Engineering::Computer science and engineering
หน่วยงาน : Nanyang Technological University, Singapore
ผู้ร่วมงาน : -
ปีพิมพ์ : 2555
อ้างอิง : Chen, R., Yang, M., Weng, X., Choi, B., He, B., & Li, X. (2012). Improving large graph processing on partitioned graphs in the cloud. Proceedings of the Third ACM Symposium on Cloud Computing - SoCC '12. , http://hdl.handle.net/10220/12588 , http://dx.doi.org/10.1145/2391229.2391232
ที่มา : -
ความเชี่ยวชาญ : -
ความสัมพันธ์ : -
ขอบเขตของเนื้อหา : -
บทคัดย่อ/คำอธิบาย :

As the study of large graphs over hundreds of gigabytes becomes increasingly popular for various data-intensive applications in cloud computing, developing large graph processing systems has become a hot and fruitful research area. Many of those existing systems support a vertex-oriented execution model and allow users to develop custom logics on vertices. However, the inherently random access pattern on the vertex-oriented computation generates a significant amount of network traffic. While graph partitioning is known to be effective to reduce network traffic in graph processing, there is little attention given to how graph partitioning can be effectively integrated into large graph processing in the cloud environment. In this paper, we develop a novel graph partitioning framework to improve the network performance of graph partitioning itself, partitioned graph storage and vertex-oriented graph processing. All optimizations are specifically designed for the cloud network environment. In experiments, we develop a system prototype following Pregel (the latest vertex-oriented graph engine by Google), and extend it with our graph partitioning framework. We conduct the experiments with a real-world social network and synthetic graphs over 100GB each in a local cluster and on Amazon EC2. Our experimental results demonstrate the efficiency of our graph partitioning framework, and the effectiveness of network performance aware optimizations on the large graph processing engine.

บรรณานุกรม :
Chen, Rishan , Yang, Mao , Weng, Xuetian , Choi, Byron , He, Bingsheng , Li, Xiaoming . (2555). Improving large graph processing on partitioned graphs in the cloud.
    กรุงเทพมหานคร : Nanyang Technological University, Singapore.
Chen, Rishan , Yang, Mao , Weng, Xuetian , Choi, Byron , He, Bingsheng , Li, Xiaoming . 2555. "Improving large graph processing on partitioned graphs in the cloud".
    กรุงเทพมหานคร : Nanyang Technological University, Singapore.
Chen, Rishan , Yang, Mao , Weng, Xuetian , Choi, Byron , He, Bingsheng , Li, Xiaoming . "Improving large graph processing on partitioned graphs in the cloud."
    กรุงเทพมหานคร : Nanyang Technological University, Singapore, 2555. Print.
Chen, Rishan , Yang, Mao , Weng, Xuetian , Choi, Byron , He, Bingsheng , Li, Xiaoming . Improving large graph processing on partitioned graphs in the cloud. กรุงเทพมหานคร : Nanyang Technological University, Singapore; 2555.