2015 MiningQualityPhrasesfromMassive

(Redirected from Liu et al., 2015)
Jump to navigation Jump to search

Subject Headings: SegPhrase Segmenter, AutoPhrase, Text Segmentation, Phrasal Chunking.


Cited By




Text data are ubiquitous and play an essential role in big data applications. However, text data are mostly unstructured. Transforming unstructured text into structured units (e.g., semantically meaningful phrases) will substantially reduce semantic ambiguity and enhance the power and efficiency at manipulating such data using database technology. Thus mining quality phrases is a critical research problem in the field of databases. In this paper, we propose a new framework that extracts quality phrases from text corpora integrated with phrasal segmentation. The framework requires only limited training but the quality of phrases so generated is close to human judgment. Moreover, the method is scalable: both computation time and required space grow linearly as corpus size increases. Our experiments on large text corpora demonstrate the quality and efficiency of the new method.



 AuthorvolumeDate ValuetitletypejournaltitleUrldoinoteyear
2015 MiningQualityPhrasesfromMassiveChi Wang
Jialu Liu
Xiang Ren
Jingbo Shang
Jiawei Han
Mining Quality Phrases from Massive Text Corpora10.1145/2723372.27515232015