2009 ConvolutionalDeepBeliefNetworks

• (Lee et al., 2009) ⇒ Honglak Lee, Roger Grosse, Rajesh Ranganath, and Andrew Y. Ng. (2009). “Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical Representations.” In: Proceedings of the 26th Annual International Conference on Machine Learning (ICML 2009). ISBN:978-1-60558-516-1 doi:10.1145/1553374.1553453

Subject Headings: Convolutional Neural Network.

Cited By

• http://scholar.google.com/scholar?q=%222009%22+Convolutional+Deep+Belief+Networks+for+Scalable+Unsupervised+Learning+of+Hierarchical+Representations
• http://dl.acm.org/citation.cfm?id=1553374.1553453&preflayout=flat#citedby

Quotes

Abstract

There has been much interest in unsupervised learning of hierarchical generative models such as deep belief networks. Scaling such models to full-sized, high-dimensional images remains a difficult problem. To address this problem, we present the convolutional deep belief network, a hierarchical generative model which scales to realistic image sizes. This model is translation-invariant and supports efficient bottom-up and top-down probabilistic inference. Key to our approach is probabilistic max-pooling, a novel technique which shrinks the representations of higher layers in a probabilistically sound way. Our experiments show that the algorithm learns useful high-level visual features, such as object parts, from unlabeled object images data and natural scenes. We demonstrate excellent performance on several visual recognition tasks and show that our model can perform hierarchical (bottom-up and top-down) inference over full-sized images.

References

;

	Author	volume	Date Value	title	type	journal	titleUrl	doi	note	year
2009 ConvolutionalDeepBeliefNetworks	Andrew Y. Ng Honglak Lee Roger Grosse Rajesh Ranganath			Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical Representations				10.1145/1553374.1553453		2009