An EM algorithm for the block mixture model

@article{citeulike:2939464, abstract = {Although many clustering procedures aim to construct an optimal partition of objects or, sometimes, of variables, there are other methods, called block clustering methods, which consider simultaneously the two sets and organize the data into homogeneous blocks. Recently, we have proposed a new mixture model called block mixture model which takes into account this situation. This model allows one to embed simultaneous clustering of objects and variables in a mixture approach. We have studied this probabilistic model under the classification likelihood approach and developed a new algorithm for simultaneous partitioning based on the classification EM algorithm. In this paper, we consider the block clustering problem under the maximum likelihood approach and the goal of our contribution is to estimate the parameters of this model. Unfortunately, the application of the EM algorithm for the block mixture model cannot be made directly; difficulties arise due to the dependence structure in the model and approximations are required. Using a variational approximation, we propose a generalized EM algorithm to estimate the parameters of the block mixture model and, to illustrate our approach, we study the case of binary data by using a Bernoulli block mixture.}, author = {Govaert, G. and Nadif, M. }, booktitle = {Pattern Analysis and Machine Intelligence, IEEE Transactions on}, citeulike-article-id = {2939464}, doi = {http://dx.doi.org/10.1109/TPAMI.2005.69}, journal = {Pattern Analysis and Machine Intelligence, IEEE Transactions on}, keywords = {textmining}, number = {4}, pages = {643--647}, posted-at = {2008-06-28 18:12:11}, priority = {2}, title = {An EM algorithm for the block mixture model}, url = {http://dx.doi.org/10.1109/TPAMI.2005.69}, volume = {27}, year = {2005} }

TY - JOUR ID - citeulike:2939464 L3 - citeulike-article-id:2939464 N2 - Although many clustering procedures aim to construct an optimal partition of objects or, sometimes, of variables, there are other methods, called block clustering methods, which consider simultaneously the two sets and organize the data into homogeneous blocks. Recently, we have proposed a new mixture model called block mixture model which takes into account this situation. This model allows one to embed simultaneous clustering of objects and variables in a mixture approach. We have studied this probabilistic model under the classification likelihood approach and developed a new algorithm for simultaneous partitioning based on the classification EM algorithm. In this paper, we consider the block clustering problem under the maximum likelihood approach and the goal of our contribution is to estimate the parameters of this model. Unfortunately, the application of the EM algorithm for the block mixture model cannot be made directly; difficulties arise due to the dependence structure in the model and approximations are required. Using a variational approximation, we propose a generalized EM algorithm to estimate the parameters of the block mixture model and, to illustrate our approach, we study the case of binary data by using a Bernoulli block mixture. IS - 4 JF - Pattern Analysis and Machine Intelligence, IEEE Transactions on EP - 647 TI - An EM algorithm for the block mixture model VL - 27 T2 - Pattern Analysis and Machine Intelligence, IEEE Transactions on SP - 643 KW - textmining AU - Govaert, G AU - Nadif, M PY - 2005/// UR - http://dx.doi.org/10.1109/TPAMI.2005.69 ER -