Composite likelihood inference for hidden Markov models for dynamic networks

Bartolucci, Francesco and Marino, Maria Francesca and Pandolfi, Silvia (2015): Composite likelihood inference for hidden Markov models for dynamic networks.

Abstract

We introduce a hidden Markov model for dynamic network data where directed relations among a set of units are observed at different time occasions. The model can also be used with minor adjustments to deal with undirected networks. In the directional case, dyads referred to each pair of units are explicitly modelled conditional on the latent states of both units. Given the complexity of the model, we propose a composite likelihood method for making inference on its parameters. This method is studied in detail for the directional case by a simulation study in which different scenarios are considered. The proposed approach is illustrated by an example based on the well-known Enron dataset about email exchange.

• Item Type: MPRA Paper
• Language: English
• Keywords: Dyads; EM algorithm; Enron dataset; Latent Markov models
• Subjects: C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C13 - Estimation: General; C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C14 - Semiparametric and Nonparametric Methods: General; C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C18 - Methodological Issues: General; C - Mathematical and Quantitative Methods > C3 - Multiple or Simultaneous Equation Models ; Multiple Variables

References

Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In Second International Symposium on Information Theory, pages 267-281. Akademinai Kiado.

Bartolucci, F. and Farcomeni, A. (2015). Information matrix for hidden markov models with covariates. Statistics and Computing, 25:515-526.

Bartolucci, F., Farcomeni, A., and Pennoni, F. (2013). Latent Markov Models for Longitudinal Data. Chapman & Hall/CRC Statistics in the Social and Behavioral Sciences. Taylor & Francis.

Bartolucci, F. and Lupparelli, M. (2015). Pairwise likelihood inference for nested hidden Markov chain models for multilevel longitudinal data. Journal of the American Statistical Association, pages 00-00.

Baum, L. E., Petrie, T., Soules, G., andWeiss, N. (1970). A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains. The Annals of Mathematical Statistics, 41:164-171.

Cox, D. R. and Reid, N. (2004). A note on pseudolikelihood constructed from marginal densities. Biometrika, 91:729-737.

Dempster, A. P., Laird, N. M., and Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society. Series B. Methodological, 39:1-38.

Diggle, P., Heagerty, P., Liang, K.-Y., and Zeger, S. (2002). Analysis of longitudinal data. Oxford University Press.

Durante, D. and Dunson, D. B. (2014). Nonparametric bayes dynamic modelling of relational data. Biometrika.

Gao, X. and Song, P. X.-K. (2010). Composite likelihood Bayesian information criteria for model selection in high-dimensional data. Journal of the American Statistical Association, 105:1531-1540.

Godambe, V. P. (1960). An optimum property of regular maximum likelihood estimation. The Annals of Mathematical Statistics, 31:1208-1211.

Goldenberg, A., Zheng, A. X., Fienberg, S. E., and Airoldi, E. M. (2010). A survey of statistical network models. Foundations and Trends R in Machine Learning, 2:129-233.

Ho, Q., Song, L., and Xing, E. P. (2011). Evolving cluster mixed-membership blockmodel for time-evolving networks. In International Conference on Artificial Intelligence and Statistics, pages 342-350.

Ho, P. D. (2011). Hierarchical multilinear models for multiway data. Computational Statistics and Data Analysis, 55:530-543.

Holland, P. and Leinhardt, S. (1976). Local structure in social networks. Sociological Methodology, 7:1-45.

Klimt, B. and Yang, Y. (2004). The Enron corpus: a new dataset for email classification research. In Machine Learning: ECML 2004, volume 3201, pages 217-226. Springer Berlin Heidelberg.

Lee, N. and Priebe, C. (2011). A latent process model for time series of attributed random graphs. Statistical inference for stochastic processes, 14:231-253.

Lindsay, B. G. (1988). Composite likelihood methods. Contemporary Mathematics, 80:221-39.

Nowicki, K. and Snijders, T. A. B. (2001). Estimation and prediction for stochastic blockstructures. Journal of the American Statistical Association, 96:1077-1087.

Robins, G. and Pattison, P. (2001). Random graph models for temporal processes in social networks. Journal of Mathematical Sociology, 25:541.

Sarkar, P. and Moore, A. W. (2005). Dynamic social network analysis using latent space models. ACM SIGKDD Explorations Newsletter, 7:31-40.

Sarkar, P., Siddiqi, S. M., and Gordon, G. J. (2007). A latent space approach to dynamic embedding of co-occurrence data. In International Conference on Artificial Intelligence and Statistics, pages 420-427.

Tang, L., Liu, H., Zhang, J., and Nazeri, Z. (2008). Community evolution in dynamic multimode networks. In 14th ACM SIGKDD International Conference on Knowledge Discovery and Data ining, pages 677-685.

Varin, C., Reid, N., and Firth, D. (2011). An overview of composite likelihood methods. Statistica Sinica, 21:5-42.

Varin, C. and Vidoni, P. (2005). A note on composite likelihood inference and model selection. Biometrika, 92:519-528.

Welch, L. R. (2003). Hidden Markov models and the Baum-Welch algorithm. IEEE Information Theory Society Newsletter, 53:10-13.

Xing, E. P., Fu, W., Song, L., et al. (2010). A state-space mixed membership blockmodel for dynamic network tomography. The Annals of Applied Statistics, 4:535-566.

Xu, K. (2015). Stochastic block transition models for dynamic networks. In 18th International Conference on Artificial Intelligence and Statistics, pages 1079-1087.

Xu, K. S. and Hero, A. O. (2014). Dynamic stochastic blockmodels for time-evolving social networks. IEEE Journal of Selected Topics in Signal Processing, 8:552-562.

Yang, T., Chi, Y., Zhu, S., Gong, Y., and Jin, R. (2011). Detecting communities and their evolutions in dynamic social networks - a bayesian approach. Machine Learning, 82:157-189.

Zucchini, W. and MacDonald, I. (2009). Hidden Markov models for time series. CRC Press.