Posterior consistency of nonparametric conditional moment restricted models

Liao, Yuan and Jiang, Wenxin (2011): Posterior consistency of nonparametric conditional moment restricted models. Published in: Annals of Statistics , Vol. 39, No. 6 (2011): pp. 3003-3031.

Abstract

This paper addresses the estimation of the nonparametric conditional moment restricted model that involves an infinite-dimensional parameter g0. We estimate it in a quasi-Bayesian way, based on the limited information likelihood, and investigate the impact of three types of priors on the posterior consistency: (i) truncated prior (priors supported on a bounded set), (ii) thin-tail prior (a prior that has very thin tail outside a growing bounded set) and (iii) normal prior with nonshrinking variance. In addition, g0 is allowed to be only partially identified in the frequentist sense, and the parameter space does not need to be compact. The posterior is regularized using a slowly growing sieve dimension, and it is shown that the posterior converges to any small neighborhood of the identified region. We then apply our results to the nonparametric instrumental regression model. Finally, the posterior consistency using a random sieve dimension parameter is studied.

• Item Type: MPRA Paper
• Language: English
• Keywords: Identified region; limited information likelihood; sieve approximation; nonparametric instrumental variable; ill-posed problem; partial identification; Bayesian inference; shrinkage prior; regularization
• Subjects: C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C14 - Semiparametric and Nonparametric Methods: General; C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C11 - Bayesian Analysis: General; C - Mathematical and Quantitative Methods > C0 - General > C01 - Econometrics

References

Ai, C. and Chen, X. (2003). Efficient estimation of models with conditional moment restrictions containing unknown functions. Econometrica 71 1795–1843.

Mathematical Reviews (MathSciNet): MR2015420 Digital Object Identifier.

Antoniadis, A., Grégoire, G. and McKeague, I. W. (2004). Bayesian estimation in single-index models. Statist. Sinica 14, 1147–1164.

Azzalini, A. (1986). Further results on a class of distributions which includes the normal ones. Statistica (Bologna) 46 199–208.

Blundell, R., Chen, X. and Kristensen, D. (2007). Semi-nonparametric IV estimation of shape-invariant Engel curves. Econometrica 75 1613–1669.

Carrasco, M., Florens, J. and Renault, E. (2007). Linear inverse problems in structural econometrics estimation based on spectral decomposition and regularization. In Handbook of Econometrics (J. J. Heckman and E. E. Leamer, eds.) VI Chapter 77. North-Holland, Amsterdam.

Chen, X. (2007). Large sample sieve estimation of semi-nonparametric models. In Handbook of Econometrics (J. J. Heckman and E. E. Leamer, eds.) VI Chapter 76. North-Holland, Amsterdam.

Chen, X. and Ludvigson, S. C. (2009). Land of addicts? An empirical investigation of habit-based asset pricing models. J. Appl. Econometrics 24 1057–1093.

Chen, X. and Pouzo, D. (2009a). Estimation of nonparametric conditional moment models with possibly nonsmooth generalized residuals. Econometrica. To appear. Cowles Foundation Discussion Paper 1650R, Yale Univ.

Chen, X. and Pouzo, D. (2009b). Efficient estimation of semiparametric conditional moment models with possibly nonsmooth residuals. J. Econometrics 152 46–60.

Chen, X. and Reiss, M. (2011). On rate optimality for ill-posed inverse problems in econometrics. Econometric Theory 27 497–521.

Chernozhukov, V., Gagliardini, P. and Scaillet, O. (2008). Nonparametric instrumental variable estimation of quantile structural effects. Unpublished manuscript. MIT, Cambridge, MA.

Chernozhukov, V. and Hansen, C. (2005). An IV model of quantile treatment effects. Econometrica 73 245–261.

Chernozhukov, V. and Hong, H. (2003). An MCMC approach to classical estimation. J. Econometrics 115 293–346.

Chernozhukov, V., Hong, H. and Tamer, E. (2007). Estimation and confidence regions for parameter sets in econometric models. Econometrica 75 1243–1284.

Chernozhukov, V., Imbens, G. W. and Newey, W. K. (2007). Instrumental variable estimation of nonseparable models. J. Econometrics 139 4–14.

Choi, T. and Schervish, M. J. (2007). On posterior consistency in nonparametric regression problems. J. Multivariate Anal. 98 1969–1987.

Darolles, S., Fan, Y., Florens, J. P. and Renault, E. (2011). Nonparametric instrumental regression. Econometrica 79 1541–1565.

D’Haultfoeuille, X. (2011). On the completeness condition in nonparametric instrumental problems. Econometric Theory 27 460–471.

Florens, J. (2003). Inverse problems and structural econometrics: The example of instrumental variables. In Advances in Economics End Econometrics: Theory and Applications (M. Dewatripont, L. P. Hansen and S. J. Turnovsky, eds.). Invited Lectures to the World Congress of the Econometric Society, Seattle 2000 II 284–311. Cambridge Univ. Press, Cambridge.

Florens, J. and Simoni, A. (2009a). Nonparametric estimation of an instrumental regression: A quasi-Bayesian approach based on regularized posterior. Unpublished manuscript. Toulouse School of Economics, Toulouse, France.

Florens, J. and Simoni, A. (2009b). Regularizing priors for linear inverse problems. Unpublished manuscript. Toulouse School of Economics, Toulouse, France.

Florens, J. and Simoni, A. (2011). Bayesian identification and partial identification. Unpublished manuscript. Toulouse School of Economics, Toulouse, France.

Gallant, A. R. and Tauchen, G. (1989). Seminonparametric estimation of conditionally constrained heterogeneous processes: Asset pricing applications. Econometrica 57 1091–1120.

Ghosal, S. and Roy, A. (2006). Posterior consistency of Gaussian process prior for nonparametric binary regression. Ann. Statist. 34 2413–2429.

Ghosal, S. and van der Vaart, A. (2007). Convergence rates of posterior distributions for non-i.i.d. observations. Ann. Statist. 35 192–223.

Ghosh, J. K. and Ramamoorthi, R. V. (2003). Bayesian Nonparametrics. Springer, New York.

Hall, P. and Horowitz, J. L. (2005). Nonparametric methods for inference in the presence of instrumental variables. Ann. Statist. 33 2904–2929.

Han, C. and Phillips, P. C. B. (2006). GMM with many moment conditions. Econometrica 74 147–192.

Hansen, L. P. (1982). Large sample properties of generalized method of moments estimators. Econometrica 50 1029–1054.

Hansen, B. (2002). Econometrics. Unpublished manuscript. Univ. Wisconsin, Madison.

Horowitz, J. L. (2007). Asymptotic normality of a nonparametric instrumental variables estimator. Internat. Econom. Rev. 48 1329–1349.

Horowitz, J. (2010). Adaptive nonparametric instrumental variables estimation: Empirical choice of the regularization parameter. Unpublished manuscript. Northwestern Univ.

Horowitz, J. L. (2011). Applied nonparametric instrumental variables estimation. Econometrica 79 347–394.

Horowitz, J. L. and Lee, S. (2007). Nonparametric instrumental variables estimation of a quantile regression model. Econometrica 75 1191–1208.

Huang, T.-M. (2004). Convergence rates for posterior distributions and adaptive estimation. Ann. Statist. 32 1556–1593.

Ichimura, H. (1993). Semiparametric least squares (SLS) and weighted SLS estimation of single-index models. J. Econometrics 58 71–120.

Imbens, G. W., Spady, R. H. and Johnson, P. (1998). Information-theoretic approaches to inference in moment condition models. Econometrica 66 333–357.

Jiang, W. and Tanner, M. A. (2008). Gibbs posterior for variable selection in high-dimensional classification and data mining. Ann. Statist. 36 2207–2231.

Johannes, J., Van Bellegem, S. and Vanhems, A. (2010). Iterative regularization in nonparametric instrumental regression. Unpublished manuscript. Toulouse School of Economics, Toulouse, France.

Kim, J.-Y. (2002). Limited information likelihood and Bayesian analysis. J. Econometrics 107 175–193.

Kitamura, Y. (2006). Empirical likelihood methods in econometrics: Theory and practice. Unpublished manuscript. Yale Univ.

Kress, R. (1999). Linear Integral Equations, 2nd ed. Applied Mathematical Sciences 82. Springer, New York.

Liao, Y. and Jiang, W. (2010). Bayesian analysis in moment inequality models. Ann. Statist. 38 275–316.

Liao, Y. and Jiang, W. (2011a). Supplement to “Posterior consistency of nonparametric conditional moment restricted models.”

Liao, Y. and Jiang, W. (2011b). Posterior consistency of nonparametric conditional moment restricted models using a shrinking prior. Technical report, Northwestern Univ. Available at http://newton.stats.northwestern.edu/~jiang/cmrm/suppG.pdf.

Meyer, Y. (1990). Ondelettes et Opérateurs. I. Hermann, Paris.

Nair, M. T., Pereverzev, S. V. and Tautenhahn, U. (2005). Regularization in Hilbert scales under general smoothing conditions. Inverse Problems 21 1851–1869.

Newey, W. K. and Powell, J. L. (2003). Instrumental variable estimation of nonparametric models. Econometrica 71 1565–1578.

Newey, W. K. and Smith, R. J. (2004). Higher order properties of GMM and generalized empirical likelihood estimators. Econometrica 72 219–255.

Owen, A. (1990). Empirical likelihood ratio confidence regions. Ann. Statist. 18 90–120.

Santos, A. (2011). Instrumental variable methods for recovering continuous linear functionals. J. Econometrics 161 129–146.

Santos, A. (2012). Inference in nonparametric instrumental variables with partial identification. Econometrica 80 213–275.

Schumaker, L. L. (1981). Spline Functions: Basic Theory. Wiley, New York.

Severini, T. A. and Tripathi, G. (2006). Some identification issues in nonparametric linear models with endogenous regressors. Econometric Theory 22 258–278.

Shen, X. and Wasserman, L. (2001). Rates of convergence of posterior distributions. Ann. Statist. 29 687–714.

Smith, M. and Kohn, R. (1996). Nonparametric regression using Bayesian variable selection. J. Econometrics 75 317–343.

Tautenhahn, U. (1998). Optimality for ill-posed problems under general source conditions. Numer. Funct. Anal. Optim. 19 377–398.

Walker, S. (2003). Bayesian consistency for a class of regression problems. South African Statist. J. 37 149–167.