Search results for ""Author Gérard Govaert""

Book SynopsisThe first part of this book is devoted to methods seeking relevant dimensions of data. The variables thus obtained provide a synthetic description which often results in a graphical representation of the data. After a general presentation of the discriminating analysis, the second part is devoted to clustering methods which constitute another method, often complementary to the methods described in the first part, to synthesize and to analyze the data. The book concludes by examining the links existing between data mining and data analysis.Trade Review"The first part of this book is devoted to methods seeking relevantdimensions of data. The variables thus obtained provide a synthetic description which often results in a graphical representation of the data. After a general presentation of the discriminating analysis, the second part is devoted to clustering methods which constitute another method, often complementary to the methods described in the first part, to synthesize and to analyze the data." (Zentralblatt MATH 2016)Table of ContentsPreface xiii Chapter 1. Principal Component Analysis: Application to Statistical Process Control 1 Gilbert SAPORTA, Ndèye NIANG 1.1. Introduction 1 1.2. Data table and related subspaces 2 1.3. Principal component analysis 8 1.4. Interpretation of PCA results 11 1.5. Application to statistical process control 18 1.6. Conclusion 22 1.7. Bibliography 23 Chapter 2. Correspondence Analysis: Extensions and Applications to the Statistical Analysis of Sensory Data 25 Jérôme PAGÈS 2.1. Correspondence analysis 25 2.2. Multiple correspondence analysis 39 2.3. An example of application at the crossroads of CA and MCA 50 2.4. Conclusion: two other extensions 63 2.5. Bibliography 64 Chapter 3. Exploratory Projection Pursuit 67 Henri CAUSSINUS, Anne RUIZ-GAZEN 3.1. Introduction 67 3.2. General principles 68 3.3. Some indexes of interest: presentation and use 71 3.4. Generalized principal component analysis 76 3.5. Example 81 3.6. Further topics 86 3.7. Bibliography 89 Chapter 4. The Analysis of Proximity Data 93 Gerard D’AUBIGNY 4.1. Introduction 93 4.2. Representation of proximity data in a metric space 97 4.3. Isometric embedding and projection 103 4.4. Multidimensional scaling and approximation 108 4.5. Afielded application 122 4.6. Bibliography 139 Chapter 5. Statistical Modeling of Functional Data 149 Philippe BESSE, Hervé CARDOT 5.1. Introduction 149 5.2. Functional framework152 5.3. Principal components analysis 156 5.4. Linear regression models and extensions 161 5.5. Forecasting 169 5.6. Concluding remarks 176 5.7. Bibliography 177 Chapter 6. Discriminant Analysis 181 Gilles CELEUX 6.1. Introduction 181 6.2. Main steps in supervised classification 182 6.3. Standard methods in supervised classification 190 6.4. Recent advances 204 6.5. Conclusion 211 6.6. Bibliography 212 Chapter 7. Cluster Analysis 215 Mohamed NADIF, Gérard GOVAERT 7.1. Introduction 215 7.2. General principles 217 7.3. Hierarchical clustering 224 7.4. Partitional clustering: the k-means algorithm 233 7.5. Miscellaneous clustering methods 239 7.6. Block clustering 245 7.7. Conclusion 251 7.8. Bibliography 251 Chapter 8. Clustering and the Mixture Model 257 Gérard GOVAERT 8.1. Probabilistic approaches in cluster analysis 257 8.2. The mixture model 261 8.3. EM algorithm 263 8.4. Clustering and the mixture model 267 8.5.Gaussian mixture model 271 8.6. Binary variables 275 8.7. Qualitative variables 279 8.8. Implementation 282 8.9. Conclusion 284 8.10. Bibliography 284 Chapter 9. Spatial Data Clustering 289 Christophe AMBROISE, Mo DANG 9.1. Introduction 289 9.2. Non-probabilistic approaches 293 9.3. Markov random fields as models 295 9.4. Estimating the parameters for a Markov field 305 9.5. Application to numerical ecology 313 9.6. Bibliography 316 List of Authors 319 Index 323

Read more less

Book SynopsisCluster or co-cluster analyses are important tools in a variety of scientific areas. The introduction of this book presents a state of the art of already well-established, as well as more recent methods of co-clustering. The authors mainly deal with the two-mode partitioning under different approaches, but pay particular attention to a probabilistic approach. Chapter 1 concerns clustering in general and the model-based clustering in particular. The authors briefly review the classical clustering methods and focus on the mixture model. They present and discuss the use of different mixtures adapted to different types of data. The algorithms used are described and related works with different classical methods are presented and commented upon. This chapter is useful in tackling the problem of co-clustering under the mixture approach. Chapter 2 is devoted to the latent block model proposed in the mixture approach context. The authors discuss this model in detail and present its interest regarding co-clustering. Various algorithms are presented in a general context. Chapter 3 focuses on binary and categorical data. It presents, in detail, the appropriated latent block mixture models. Variants of these models and algorithms are presented and illustrated using examples. Chapter 4 focuses on contingency data. Mutual information, phi-squared and model-based co-clustering are studied. Models, algorithms and connections among different approaches are described and illustrated. Chapter 5 presents the case of continuous data. In the same way, the different approaches used in the previous chapters are extended to this situation. Contents 1. Cluster Analysis. 2. Model-Based Co-Clustering. 3. Co-Clustering of Binary and Categorical Data. 4. Co-Clustering of Contingency Tables. 5. Co-Clustering of Continuous Data. About the Authors Gérard Govaert is Professor at the University of Technology of Compiègne, France. He is also a member of the CNRS Laboratory Heudiasyc (Heuristic and diagnostic of complex systems). His research interests include latent structure modeling, model selection, model-based cluster analysis, block clustering and statistical pattern recognition. He is one of the authors of the MIXMOD (MIXtureMODelling) software. Mohamed Nadif is Professor at the University of Paris-Descartes, France, where he is a member of LIPADE (Paris Descartes computer science laboratory) in the Mathematics and Computer Science department. His research interests include machine learning, data mining, model-based cluster analysis, co-clustering, factorization and data analysis. Cluster Analysis is an important tool in a variety of scientific areas. Chapter 1 briefly presents a state of the art of already well-established as well more recent methods. The hierarchical, partitioning and fuzzy approaches will be discussed amongst others. The authors review the difficulty of these classical methods in tackling the high dimensionality, sparsity and scalability. Chapter 2 discusses the interests of coclustering, presenting different approaches and defining a co-cluster. The authors focus on co-clustering as a simultaneous clustering and discuss the cases of binary, continuous and co-occurrence data. The criteria and algorithms are described and illustrated on simulated and real data. Chapter 3 considers co-clustering as a model-based co-clustering. A latent block model is defined for different kinds of data. The estimation of parameters and co-clustering is tackled under two approaches: maximum likelihood and classification maximum likelihood. Hard and soft algorithms are described and applied on simulated and real data. Chapter 4 considers co-clustering as a matrix approximation. The trifactorization approach is considered and algorithms based on update rules are described. Links with numerical and probabilistic approaches are established. A combination of algorithms are proposed and evaluated on simulated and real data. Chapter 5 considers a co-clustering or bi-clustering as the search for coherent co-clusters in biological terms or the extraction of co-clusters under conditions. Classical algorithms will be described and evaluated on simulated and real data. Different indices to evaluate the quality of coclusters are noted and used in numerical experiments.Table of ContentsAcknowledgment xi Introduction xiii I.1. Types and representation of data xiii I.1.1. Binary data xiv I.1.2. Categorical data xiv I.1.3. Continuous data xv I.1.4. Contingency table xvii I.1.5. Data representations xix I.2. Simultaneous analysis xx I.2.1. Data analysis xx I.2.2. Co-clustering xxii I.2.3. Applications xxiii I.3. Notation xxvii I.4. Different approaches xxviii I.4.1. Two-mode partitioning xxviii I.4.2. Two-mode hierarchical clustering xxxvii I.4.3. Direct or block clustering xxxix I.4.4. Biclustering xxxix I.4.5. Other structures and other aims xliv I.5. Model-based co-clustering xlvi I.6. Outline xlix Chapter 1. Cluster Analysis 1 1.1. Introduction 1 1.2. Miscellaneous clustering methods 4 1.2.1. Hierarchical approach 4 1.2.2. The k-means algorithm 5 1.2.3. Other approaches 7 1.3. Model-based clustering and the mixture model 11 1.4. EM algorithm 15 1.4.1. Complete data and complete-data likelihood 16 1.4.2. Principle 17 1.4.3. Application to mixture models 18 1.4.4. Properties 19 1.4.5. EM: an alternating optimization algorithm 19 1.5. Clustering and the mixture model 20 1.5.1. The two approaches 20 1.5.2. Classification likelihood 21 1.5.3. The CEM algorithm 22 1.5.4. Comparison of the two approaches 22 1.5.5. Fuzzy clustering 24 1.6. Gaussian mixture model 26 1.6.1. The model 26 1.6.2. CEM algorithm 28 1.6.3. Spherical form, identical proportions and volumes 29 1.6.4. Spherical form, identical proportions but differing volumes 30 1.6.5. Identical covariance matrices and proportions 31 1.7. Binary data 32 1.7.1. Binary mixture model 32 1.7.2. Parsimonious model 33 1.7.3. Examples of application 35 1.8. Categorical variables 36 1.8.1. Multinomial mixture model 36 1.8.2. Parsimonious model 38 1.9. Contingency tables 41 1.9.1. MNDKI2 algorithm 41 1.9.2. Model-based approach 43 1.9.3. Illustration 47 1.10. Implementation 49 1.10.1. Choice of model and of the number of classes 51 1.10.2. Strategies for use 51 1.10.3. Extension to particular situations 52 1.11. Conclusion 53 Chapter 2. Model-Based Co-Clustering 55 2.1. Metric approach 55 2.2. Probabilistic models 57 2.3. Latent block model 59 2.3.1. Definition 59 2.3.2. Link with the mixture model 61 2.3.3. Log-likelihoods 62 2.3.4. A complex model 63 2.4. Maximum likelihood estimation and algorithms 67 2.4.1. Variational EM approach 69 2.4.2. Classification EM approach 72 2.4.3. Stochastic EM-Gibbs approach 73 2.5. Bayesian approach 75 2.6. Conclusion and miscellaneous developments 76 Chapter 3. Co-Clustering of Binary and Categorical Data 79 3.1. Example and notation 80 3.2. Metric approach 82 3.3. Bernoulli latent block model and algorithms 84 3.3.1. The model 84 3.3.2. Model identifiability 85 3.3.3. Binary LBVEM and LBCEM algorithms 86 3.4. Parsimonious Bernoulli LBMs 90 3.5. Categorical data 91 3.6. Bayesian inference 93 3.7. Model selection 96 3.7.1. The integrated completed log-likelihood (ICL) 96 3.7.2. Penalized information criteria 97 3.8. Illustrative experiments 98 3.8.1. Townships 98 3.8.2. Mero 101 3.9. Conclusion 105 Chapter 4. Co-Clustering of Contingency Tables 107 4.1. Measures of association 108 4.1.1. Phi-squared coefficient 109 4.1.2. Mutual information 111 4.2. Contingency table associated with a couple of partitions 113 4.2.1. Associated distributions 113 4.2.2. Associated measures of association 116 4.3. Co-clustering of contingency table 119 4.3.1. Two equivalent approaches 119 4.3.2. Parameter modification of criteria 121 4.3.3. Co-clustering with the phi-squared coefficient 124 4.3.4. Co-clustering with the mutual information 129 4.4. Model-based co-clustering 131 4.4.1. Block model for contingency tables 133 4.4.2. Poisson latent block model 137 4.4.3. Poisson LBVEM and LBCEM algorithms 138 4.5. Comparison of all algorithms 140 4.5.1. CROKI2 versus CROINFO 142 4.5.2. CROINFO versus Poisson LBCEM 142 4.5.3. Poisson LBVEM versus Poisson LBCEM 144 4.5.4. Behavior of CROKI2, CROINFO, LBCEM and LBVEM 147 4.6. Conclusion 149 Chapter 5. Co-Clustering of Continuous Data 151 5.1. Metric approach 152 5.1.1. Measure of information 153 5.1.2. Summarized data associated with partitions 153 5.1.3. Objective function 156 5.1.4. CROEUC algorithm 157 5.2. Gaussian latent block model 159 5.2.1. The model 159 5.2.2. Gaussian LBVEM and LBCEM algorithms 160 5.2.3. Parsimonious Gaussian latent block models 161 5.3. Illustrative example 163 5.4. Gaussian block mixture model 168 5.4.1. The model 169 5.4.2. GBEM algorithm 170 5.5. Numerical experiments 173 5.5.1. GBEM versus CROEUC and EM 174 5.5.2. Effect of the size of data 175 5.6. Conclusion 175 Bibliography 177 Index 199

Read more less