2015 FastandRobustParallelSGDMatrixF
- (Oh et al., 2015) ⇒ Jinoh Oh, Wook-Shin Han, Hwanjo Yu, and Xiaoqian Jiang. (2015). “Fast and Robust Parallel SGD Matrix Factorization.” In: Proceedings of the 21st ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-2015). ISBN:978-1-4503-3664-2 doi:10.1145/2783258.2783322
Subject Headings: SGD Matrix Factorization.
Notes
Cited By
- http://scholar.google.com/scholar?q=%222015%22+Fast+and+Robust+Parallel+SGD+Matrix+Factorization
- http://dl.acm.org/citation.cfm?id=2783258.2783322&preflayout=flat#citedby
Quotes
Author Keywords
Abstract
Matrix factorization is one of the fundamental techniques for analyzing latent relationship between two entities. Especially, it is used for recommendation for its high accuracy. Efficient parallel SGD matrix factorization algorithms have been developed for large matrices to speed up the convergence of factorization. However, most of them are designed for a shared-memory environment thus fail to factorize a large matrix that is too big to fit in memory, and their performances are also unreliable when the matrix is skewed.
This paper proposes a fast and robust parallel SGD matrix factorization algorithm, called MLGF-MF, which is robust to skewed matrices and runs efficiently on block-storage devices (e.g., SSD disks) as well as shared-memory. MLGF-MF uses Multi-Level Grid File (MLGF) for partitioning the matrix and minimizes the cost for scheduling parallel SGD updates on the partitioned regions by exploiting partial match queries processing. Thereby, MLGF-MF produces reliable results efficiently even on skewed matrices. MLGF-MF is designed with asynchronous I/O permeated in the algorithm such that CPU keeps executing without waiting for I/O to complete. Thereby, MLGF-MF overlaps the CPU and I/O processing, which eventually offsets the I/O cost and maximizes the CPU utility. Recent flash SSD disks support high performance parallel I/O, thus are appropriate for executing the asynchronous I/O.
From our extensive evaluations, MLGF-MF significantly outperforms (or converges faster than) the state-of-the-art algorithms in both shared-memory and block-storage environments. In addition, the outputs of MLGF-MF is significantly more robust to skewed matrices. Our implementation of MLGF-MF is available at http://dm.postech.ac.kr/MLGF-MF as executable files.
References
;
| Author | volume | Date Value | title | type | journal | titleUrl | doi | note | year | |
|---|---|---|---|---|---|---|---|---|---|---|
| 2015 FastandRobustParallelSGDMatrixF | Xiaoqian Jiang Jinoh Oh Hwanjo Yu Wook-Shin Han | Fast and Robust Parallel SGD Matrix Factorization | 10.1145/2783258.2783322 | 2015 |