2008 DataMiningUsingHighPerformanceD

From GM-RKB
Jump to navigation Jump to search

Subject Headings:

Notes

Cited By

Quotes

Author Keywords

Abstract

We describe the design and implementation of a high performance cloud that we have used to archive, analyze and mine large distributed data sets. By a cloud, we mean an infrastructure that provides resources and/or services over the Internet. A storage cloud provides storage services, while a compute cloud provides compute services. We describe the design of the Sector storage cloud and how it provides the storage services required by the Sphere compute cloud. We also describe the programming paradigm supported by the Sphere compute cloud. Sector and Sphere are designed for analyzing large data sets using computer clusters connected with wide area high performance networks (for example, 10+ Gb/s). We describe a distributed data mining application that we have developed using Sector and Sphere. Finally, we describe some experimental studies comparing Sector/Sphere to Hadoop.

References

,

 AuthorvolumeDate ValuetitletypejournaltitleUrldoinoteyear
2008 DataMiningUsingHighPerformanceDRobert L. Grossman
Yunhong Gu
Data Mining Using High Performance Data Clouds: Experimental Studies Using Sector and Sphere10.1145/1401890.1402000