Mixture Model Fitting Algorithm

From GM-RKB
Jump to navigation Jump to search

A Mixture Model Fitting Algorithm is a parametic model fitting algorithm that can be implemented into a Mixture Model Fitting System (to solve a Mixture Model Fitting Task.



References

2014

  • (Wikipedia, 2014) ⇒ http://en.wikipedia.org/wiki/Mixture_model#Parameter_estimation_and_system_identification Retrieved:2014-3-21.
    • Parametric mixture models are often used when we know the distribution Y and we can sample from X, but we would like to determine the ai and θi values. Such situations can arise in studies in which we sample from a population that is composed of several distinct subpopulations.

      It is common to think of probability mixture modeling as a missing data problem. One way to understand this is to assume that the data points under consideration have "membership" in one of the distributions we are using to model the data. When we start, this membership is unknown, or missing. The job of estimation is to devise appropriate parameters for the model functions we choose, with the connection to the data points being represented as their membership in the individual model distributions.

      A variety of approaches to the problem of mixture decomposition have been proposed, many of which focus on maximum likelihood methods such as expectation maximization (EM) or maximum a posteriori estimation (MAP). Generally these methods consider separately the question of parameter estimation and system identification, that is to say a distinction is made between the determination of the number and functional form of components within a mixture and the estimation of the corresponding parameter values. Some notable departures are the graphical methods as outlined in Tarter and Lock and more recently minimum message length (MML) techniques such as Figueiredo and Jain [1] and to some extent the moment matching pattern analysis routines suggested by McWilliam and Loh (2009).[2]

  1. Figueiredo, M.A.T.; Jain, A.K. (March 2002).

    "Unsupervised Learning of Finite Mixture Models". IEEE Transactions on Pattern Analysis and Machine Intelligence 24 (3): 381–396. doi:10.1109/34.990138. http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=990138

    . 

  2. [1]