Zhu, Ying (2013): Sparse Linear Models and l1−Regularized 2SLS with HighDimensional Endogenous Regressors and Instruments. Forthcoming in: Journal of Econometrics
This is the latest version of this item.
Preview 
PDF
MPRA_paper_82184.pdf Download (728kB)  Preview 
Abstract
We explore the validity of the 2stage least squares estimator with l_{1}regularization in both stages, for linear triangular models where the numbers of endogenous regressors in the main equation and instruments in the firststage equations can exceed the sample size, and the regression coefficients are sufficiently sparse. For this l_{1}regularized 2stage least squares estimator, we first establish finitesample performance bounds and then provide a simple practical method (with asymptotic guarantees) for choosing the regularization parameter. We also sketch an inference strategy built upon this practical method.
Item Type:  MPRA Paper 

Original Title:  Sparse Linear Models and l1−Regularized 2SLS with HighDimensional Endogenous Regressors and Instruments 
Language:  English 
Keywords:  Highdimensional statistics; Lasso; sparse linear models; endogeneity; twostage estimation 
Subjects:  C  Mathematical and Quantitative Methods > C1  Econometric and Statistical Methods and Methodology: General C  Mathematical and Quantitative Methods > C1  Econometric and Statistical Methods and Methodology: General > C13  Estimation: General C  Mathematical and Quantitative Methods > C3  Multiple or Simultaneous Equation Models ; Multiple Variables > C31  CrossSectional Models ; Spatial Models ; Treatment Effect Models ; Quantile Regressions ; Social Interaction Models C  Mathematical and Quantitative Methods > C3  Multiple or Simultaneous Equation Models ; Multiple Variables > C36  Instrumental Variables (IV) Estimation 
Item ID:  82184 
Depositing User:  Ms Ying Zhu 
Date Deposited:  25 Oct 2017 05:51 
Last Modified:  30 Sep 2019 11:12 
References:  Amemiya, T. (1974). “The nonlinear twostage least squares estimator.” Journal of Econometrics, 2, 105110. Belloni, A. and V. Chernozhukov (2011b). “High dimensional sparse econometric models: an in troduction”, in: Inverse problems and high dimensional estimation, Stats in the Château 2009, Alquier, P., E. Gautier, and G. Stoltz, Eds., Lecture Notes in Statistics, 203, 127162, Springer, Berlin. Belloni, A., D. Chen, V. Chernozhukov, and C. Hansen (2012). “Sparse models and methods for instrumental regression, with an application to eminent domain.” Econometrica, 80, 23692429. Belloni, A. and V. Chernozhukov (2013). “Least squares after model selection in highdimensional sparse models.” Bernoulli, 19, 521547. Bickel, P., J. Y. Ritov, and A. B. Tsybakov (2009). “Simultaneous analysis of Lasso and Dantzig selector.” The Annals of Statistics, 37, 17051732. Bühlmann, P. and S. A. van de Geer (2011). Statistics for highdimensional data. Springer, New York. Caner, M. (2009). “Lasso type GMM estimator.” Econometric Theory, 25, 123. Candès, E. and T. Tao (2007). “The Dantzig selector: statistical estimation when p is much larger than n.” The Annals of Statistics, 35, 23132351. Carrasco, M. (2012). “A regularization approach to the many instruments problem.” Journal of Econometrics, 170, 383398. Fan, J. and R. Li (2001). “Variable selection via nonconcave penalized likelihood and its oracle properties.” Journal of American Statistical Association, 96, 13481360. Fan, J. and Y. Liao (2014). “Endogeneity in ultrahigh dimension.” The Annals of Statistics, 42, 872917. Fan, J. and J. Lv (2010). “A Selective overview of variable selection in high dimensional feature space.” Statistica Sinica, 20, 101148. Fan, J. and J. Lv (2011). “Nonconcave penalized likelihood with NPdimensionality.” IEEE Trans actions on Information Theory, 57, 54675484. Fan, J., J. Lv, and L. Qi (2011). “Sparse high dimensional models in economics.” Annual Review of Economics, 3, 291317. Garen, J. (1984). “The returns to schooling: a selectivity bias approach with a continuous choice variable.” Econometrica, 52, 11991218. Gautier, E. and A. B. Tsybakov (2014). “Highdimensional instrumental variables regression and confidence sets.” Manuscript. CREST (ENSAE). Javanmard, A. and A. Montanari (2014). “Confidence intervals and hypothesis testing for high dimensional regression.” Journal of Machine Learning Research, 15, 28692909. Jing, B.Y., Q. M. Shao, and Q. Wang (2003). “Selfnormalized Cramértype large deviations for independent random variables.” The Annals of Probability, 31, 21672215. Leeb, H. and Pötscher, B. M. (2006). “Can one estimate the conditional distribution of postmodelselection estimators?” The Annals of Statistics, 34, 25542591. Lim, C. and B. Yu. (2013). “Estimation stability with cross validation (ESCV).” arXiv:1303.3128. Loh, P., and M. Wainwright (2012). “Highdimensional regression with noisy and missing data: provable guarantees with nonconvexity.” The Annals of Statistics, 40, 16371664. Manresa, E. (2015). “Estimating the structure of social interactions using panel data.” Working paper. Sloan School of Management, MIT. Meinshausen, N., and P. Bühlmann (2006). “Highdimensional graphs and variable selection with the Lasso.” The Annals of Statistics, 34:14361462. Meinshausen, N., and B. Yu (2009). “Lassotype recovery of sparse representations for high dimensional Data.” The Annals of Statistics, 37, 246270. Minsker, S. (2014). “Geometric median and robust estimation in Banach spaces.” arXiv:1308.1334v5. Negahban, S., P. Ravikumar, M. J. Wainwright, and B. Yu (2012). “A unified framework for high dimensional analysis of Mestimators with decomposable regularizers.” Statistical Science, 27, 538557. Nemirovski, A., and D. Yudin (1983). Problem complexity and method efficiency in optimization. John Wiley and Sons Inc. Ravikumar, P., M. J. Wainwright, and J. Lafferty (2010). “Highdimensional Ising model selection using l1 −regularized logistic regression.” The Annals of Statistics, 38, 12871319. Rosenbaum, M. and A. B. Tsybakov (2010). “Sparse recovery under matrix uncertainty.” The Annals of Statistics, 38, 26202651. Rosenbaum, M. and A. B. Tsybakov (2013). “Improved matrix uncertainty selector”, in: From Prob ability to Statistics and Back: HighDimensional Models and Processes  A Festschrift in Honor of Jon A. Wellner, Banerjee, M. et al. Eds, IMS Collections, 9, 276290, Institute of Mathematical Statistics. Tibshirani, R. (1996). “Regression shrinkage and selection via the Lasso.” Journal of the Royal Statistical Society: Series B (Statistical Methodology), 58, 267288. Vershynin, R. (2012). “Introduction to the nonasymptotic analysis of random matrices”, in Eldar, Y. and G. Kutyniok, Eds, Compressed Sensing: Theory and Applications, 210268, Cam bridge. Wainwright, J. M. (2009). “Sharp thresholds for highdimensional and noisy sparsity recovery us ing l1 −constrained quadratic programming (Lasso).” IEEE Trans. Information Theory, 55, 21832202. Wainwright, J. M. (2015). Highdimensional statistics: A nonasymptotic viewpoint. In prepara tion. University of California, Berkeley. Wooldridge, J. M. (2010). Econometric analysis of cross section and panel data. MIT Press, Cam bridge. Yu, B. (2013). “Stability.” Bernoulli, 19, 14841500. Zhang C.H. and S. S. Zhang (2013). “Confidence intervals for low dimensional parameters in high dimensional linear models.” Journal of the Royal Statistical Society: Series B (Statistical Methodology), 76, 217242. Zhao, P., and B. Yu. (2007). “On model selection consistency of Lasso.” Journal of Machine Learn ing Research, 7, 25412567. Zhu, Y. (2013). “Consistent variable selection of the l1 regularized 2SLS with highdimensional endogenous regressors and instruments” Manuscript. University of California, Berkeley. (https://sites.google.com/site/yingzhu1215/home/HD2SLS_2013.pdf) 
URI:  https://mpra.ub.unimuenchen.de/id/eprint/82184 
Available Versions of this Item

Sparse Linear Models and l1−Regularized 2SLS with HighDimensional Endogenous Regressors and Instruments. (deposited 10 Sep 2017 07:29)
 Sparse Linear Models and l1−Regularized 2SLS with HighDimensional Endogenous Regressors and Instruments. (deposited 25 Oct 2017 05:51) [Currently Displayed]