Semi-parametric Bayesian Partially Identified Models based on Support Function

Liao, Yuan and Simoni, Anna (2012): Semi-parametric Bayesian Partially Identified Models based on Support Function.

Abstract

Bayesian partially identified models have received a growing attention in recent years in the econometric literature, due to their broad applications in empirical studies. Classical Bayesian approach in this literature has been assuming a parametric model, by specifying an ad-hoc parametric likelihood function. However, econometric models usually only identify a set of moment inequalities, and therefore assuming a known likelihood function suffers from the risk of misspecification, and may result in inconsistent estimations of the identified set. On the other hand, moment-condition based likelihoods such as the limited information and exponential tilted empirical likelihood, though guarantee the consistency, lack of probabilistic interpretations. We propose a semi-parametric Bayesian partially identified model, by placing a nonparametric prior on the unknown likelihood function. Our approach thus only requires a set of moment conditions but still possesses a pure Bayesian interpretation. We study the posterior of the support function, which is essential when the object of interest is the identified set. The support function also enables us to construct two-sided Bayesian credible sets (BCS) for the identified set. It is found that, while the BCS of the partially identified parameter is too narrow from the frequentist point of view, that of the identified set has asymptotically correct coverage probability in the frequentist sense. Moreover, we establish the posterior consistency for both the structural parameter and its identified set. We also develop the posterior concentration theory for the support function, and prove the semi-parametric Bernstein von Mises theorem. Finally, the proposed method is applied to analyze a financial asset pricing problem.

• Item Type: MPRA Paper
• Language: English
• Keywords: partial identification; posterior consistency; concentration rate; support function; two-sided Bayesian credible sets; identified set; coverage probability; moment inequality models
• Subjects: C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C14 - Semiparametric and Nonparametric Methods: General; C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C11 - Bayesian Analysis: General

References

Aliprantis, C.D. and Border, K.C. (2006). Infinite dimensional analysis - A Hitch- hiker’s Guide. Springer-Verlag, Berlin.

Amewou-Atisso, M., Ghosal, S. and Ghosh, J. (2003) Posterior consistency for semi- parametric regression problems. Bernoulli 9, 291-312.

Andrews, D. and Jia, P. (2008). Inference for parameters dened by moment inequalities: a recommended moment selection procedure. Manuscript. Yale Univ.

Andrews, D. and Guggenberger, P. (2009). Validity of subsampling and plug-in asymptotic inference for parameters defined by moment inequalities. Econometric Theory. 25, 669-709.

Andrews, D. and Soares, G. (2010). Inference for parameters dened by moment inequal- ities using generalized moment selection. Econometrica. 78, 119-157. Beresteanu, A., Molchanov, I. and Molinari, F. (2011). Sharp identification regions in models with convex moment predictions. Econometrica, 79, No. 6, 1785-1821.

Beresteanu, A., Molchanov, I. and Molinari, F. (2012). Partial identification using random set theory. Journal of Econometrics, 166, 17-32.

Beresteanu, A. and Molinari, F. (2008) Asymptotic properties for a class of partially identified models. Econometrica, 76, 763-814.

Bickel, P. and Kleijn, B. (2011). The semiparametric Bernstein-Von Mises theorem. Annals of Statistics, 40, 206-237.

Birge ́, L. (1983) Approximation dans les espaces mtriques et thorie de l’estimation. Z. Wahrsch, Verw. Gebiete 65, 181-237.

Bollinger, C. and Hasselt, M. (2009) A Bayesian analysis of binary misclassification: inference in partially identified models. Manuscript. University of Kentucky.

Bontemps, C., Magnac, T. and Maurin, E. (2011). Set identified linear models. Econometrica, forthcoming.

Bugni, F. (2010) Bootstrap inference in partially identified models defined by moment inequalities: coverage of the identified set. Econometrica. 78, 735-753.

Canay, I. (2010) EL Inference for partially identified models: large deviations optimality and bootstrap validity. Journal of Econometrics. 156, 408-425.

Castillo, I. (2008) Lower bounds for posterior rates with Gaussian process priors. Electronic Journal of Statistics. 2, 1281-1299.

Chandrasekhar, A., Chernozhukov, V., Molinari, F. and Schrimpf, P. (2012) Inference for best linear approximations to set identified functions. Manuscript. MIT.

Chernozhukov, V., Kocatulum, E. and Menzel, K. (2008) Inference on sets in finance. Manuscript. MIT.

Chernozhukov, V. and Hong, H. (2003). An MCMC approach to classical estimation. J. Econometrics, 115, 293-346.

Chernozhukov, V., Hong, H. and Tamer, E. (2007). Estimation and confidence regions for parameter sets in econometric models. Econometrica, 75, 1243-1284.

Chiburis, R. (2009). Approximately most powerful tests for moment inequalities. Manuscript. UT Austin.

Epstein, L. and Seo, K. (2011) Bayesian inference and non-Bayesian prediction and choice: foundations and an application to entry games with multiple equilibria. Manuscript. Boston Univ.

Ferguson, T.S. (1973). A Bayesian analysis of some nonparametric problems. Ann. Statist. 1, No.2, 209-230.

Florens, J.P. (2002). Inf ́erence Bay ́esienne non param ́etrique et bootstrap. In Methoses Bay ́esiennes en statistique (eds. J.J. Droesbeke, J. Fine & G. Saporta), 295-313. Editions TECHNIP.

Florens, J.P. and Simoni, A. (2011). Bayesian identification and partial identification, preprint.

Florens, J.P. and Simoni, A. (2012). Nonparametric estimation of an instrumental regres- sion: A quasi-Bayesian approach based on regularized posterior. Journal of Econometrics. 170, 458-475

Gelfand, A. and Sahu, S. (1999) Identifiability, improper priors, and Gibbs sampling for generalized linear models. Journal of the American Statistical Association. 94, 247-253.

Ghosal, S. (2001). Convergence rates for density estimation with Bernstein polynomials. Annals of Statistics. 29, 1264-1280.

Ghosal, S., Ghosh, J. and Ramamoorthi, R. (1999) Posterior consistency of dirichlet mixtures in density estimation. Annals of Statistics. 27, 143-158.

Ghosal, S., Ghosh, J. and van der Vaart, A. (1999) Consistent semiparametric Bayesian inference about a location parameter. Journal of Statistical Planning and Inference 77, 181-193.

Ghosal, S., Ghosh, J. and van der Vaart, A. (2000) Convergence rates of posterior distributions. Annals of Statistics. 28, 500-531.

Ghosal, S. and van der Vaart, A. (2001) Entropies and rates of convergence for maximum likelihood and Bayes estimation for mixtures of normal densities. Annals of Statistics. 29, 1233-1263.

Ghosal, S. and van der Vaart, A. (2007) Convergence rates of posterior distributions for noniid obsevations. Annals of Statistics. 35, 192-223.

Ghosh, J.K. and Ramamoorthi, R.V.(2003). Bayesian Nonparametrics. Springer-Verlag.

Gustafson, P. (2005) On model expansion, model contraction, identifiability, and prior information: two illustrative scenarios involving mismeasured variables. Statistical Science. 20, 111-140.

Gustafson, P. (2012) On the behaviour of Bayesian credible intervals in partially identified models. Electronic Journal of Statistics. 6, 2107-2124.

Haile, P. and Tamer, E. (2003) Inference with an incomplete model of English auctions. Journal of Political Economy. 111, 1-51.

Hansen, L. and Jagannathan, R. (1991) Implications of security market data for models of dynamic economies. Journal of Political Economy. 99, 225-262.

Imbens, G. and Manski, C. (2004) Confidence Intervals for partially identified parameters. Econometrica. 72, 18451857.

Jiang, W. (2007) Bayesian variable selection for high dimensional generalized linear models: Convergence rates of the fitted densities. Annals of Statistics. 35, 1487-1511.

Kaido, H. and Santos, A. (2011). Asymptotically efficient estimation of models defined by convex moment inequalities, preprint.

Kaido, H. (2012). A dual approach to inference for partially Identified econometric models, preprint.

Kato, T. (1995). Perturbation theory for linear operators. Springer-Verlag Berlin Heidel- berg.

Kim, J. (2002) Limited information likelihood and Bayesian analysis. Journal of Econometrics. 107, 175-193.

Kitagawa, T. (2012) Estimation and inference for set-identified parameters using posterior lower probability. Manuscript. UCL.

Kline, B. (2011) The Bayesian and frequentist approaches to testing a one-sided hypothesis about a multivariate mean. Journal of Statistical Planning and Inference. 141, 3131-3141.

Lavine, M. (1992). Some aspects of polya tree distributions for statistical modelling. Ann. Statist. 20, No.3, 1222-1235.

Le Cam, L. (1986) Asymptotic Methods in Statistical Decision Theory. Springer-Verlag, New York.

Liao, Y. and Jiang, W. (2010) Bayesian analysis in moment inequality models. Annals of Statistics. 38, 275-316.

Liao, Y. and Jiang, W. (2011) Posterior consistency of nonparametric conditional moment restricted models. Annals of Statistics. 39, 3003-3031.

Lindsay, B. and Basak, P. (1993). Multivariate normal mixtures: a fast consistent method of moments. Journal of American Statistical Association 88, 468-476.

Manski, C. and Tamer, E. (2002) Inference on regressions with interval data on a regressor or outcome. Econometrica. 70, 519-547.

Manski, C. (2003) Partial identification of probability distributions. Spinger, New York. Menzel, K. (2011) Consistent estimation with many moment inequalities. Manuscript. NYU.

Milgrom, P. and Segal, I. (2002). Envelope theorems for arbitrary choice sets. Econometrica, 70, 583-601.

Molchanov, I. (2005). Theory of random sets. Springer.

Moon, H. R. and Schorfheide, F. (2012). Bayesian and frequentist inference in partially- identified models. Econometrica, 80, 755-782.

Neath, A. and Samaniego, F. (1997). On the efficacy of Bayesian inference for nonidentifiable models. The American Statistician 51, 325-332.

Norets, A. and Tang, X. (2012) Semiparametric Inference in dynamic binary choice models. Manuscript. Princeton Univ.

Otsu, T. (2006) Large deviation optimal inference for set identified moment inequality models. Manuscript. Yale Univ.

Poirier, D. (1998) Revising beliefs in nonidentified models. Econometric Theory. 14, 483- 509.

Ray, S. and Lindsay, B. (2005) The topography of multivariate normal mixtures. Annals of Statistics. 33, 2042-2065.

Rivoirard, V. and Rousseau, J. (2012). Bernstein-von Mises theorem for linear functionals of the density. Ann. Statist., forthcoming.

Rockafellar, R.T. (1970). Convex analysis. Princeton University Press.

Romano, J. and Shaikh, A. (2010) Inference for the identified set in partially identified econometric models. Econometrica. 78, 169-211.

Rosen, A. (2008) Confidence sets for partially identified parameters that satisfy a finite number of moment inequalities. Journal of Econometrics. 146, 107-117.

Rudin, W. (1986). Real and complex analysis. McGraw-Hill Science/Engineering/Maths

Schennach, S. (2005) Bayesian exponentially tilted empirical likelihood. Biometrika. 92, 31-46.

Schwartz, L. (1965) On Bayes procedures. Z. Wahrsch, Verw. Gebiete 4, 10-26.. Sethuraman, J. (1994). A constructive definition of the Dirichlet prior. Statistica Sinica, 2, 639-650.

Shen, X. and Wasserman, L. (2001) Rates of convergence of posterior distributions. Annals of Statistics. 29, 687-714.

Stoye, J. (2009) More on confidence intervals for partially identified parameters. Econometrica 77, 1299-1315,

Stoye, J. (2012) New perspectives on statistical decisions under ambiguity. Annual Review of Economics 4, 257-282.

Tamer, E. (2010) Partial identification in econometrics. Annual Review of Economics 2,167-195.

van der Vaart, A.W. (2002). Semiparametric Statistics. In Ecole d’Et ́e de St Flour 1999 (eds. P. Bernard), 331-457. Springer Verlag, New York.

van der Vaart, A.W. (2000). Asymptotic Statistics. Cambridge University Press. van der Vaart, A. and Wellner, J. (1996) Weak convergence and empirical processes. Springer.

van der Vaart, A.W. and J.H., van Zanten (2008). Rates of contraction of posterior distributions based on Gaussian process priors. Ann. Statist., 36, No.3, 1435-1463.

Walker, S., Lijoi, A. and Prunster, I. (2007) On rates of convergence for posterior distributions in infinite-dimensional models. Annals of Statistics. 35, 738-746.

Wan, Y. (2011) An integration-based approach to moment inequality models. Manuscript. Univ. of Toronto.

Wu, Y. and Ghosal, S. (2008) Posterior consistency for some semi-parametric problems. Sankhya: the Indian Journal of Statistics. 70, 0-46.