Understanding and teaching unequal probability of selection

Raghav, Manu and Barreto, Humberto (2011): Understanding and teaching unequal probability of selection.

Abstract

This paper focuses on econometrics pedagogy. It demonstrates the importance of including probability weights in regression analysis using data from surveys that do not use simple random samples (SRS). We use concrete, numerical examples and simulation to show how to effectively teach this difficult material to a student audience. We relax the assumption of simple random sampling and show how unequal probability of selection can lead to biased, inconsistent OLS slope estimates. We then explain and apply probability weighted least squares, showing how weighting the observations by the reciprocal of the probability of inclusion in the sample improves performance. The exposition is non-mathematical and relies heavily on intuitive, visual displays to make the content accessible to students. This paper will enable professors to incorporate unequal probability of selection into their courses and allow students to use best practice techniques in analyzing data from complex surveys. The primary delivery vehicle is Microsoft Excel®. Two user-defined array functions, SAMPLE and LINESTW, are included in a prepared Excel workbook. We replicate all results in Stata® and offer a do file for easy analysis in Stata. Documented code in Excel and Stata allows users to see each step in the sampling and probability weighted least squares algorithms. All files and code are available at www.depauw.edu/learn/stata.

• Item Type: MPRA Paper
• Language: English
• Keywords: unequal probability; complex survey; simulation; weighted regression
• Subjects: A - General Economics and Teaching > A2 - Economic Education and Teaching of Economics > A22 - Undergraduate; A - General Economics and Teaching > A2 - Economic Education and Teaching of Economics > A23 - Graduate; C - Mathematical and Quantitative Methods > C8 - Data Collection and Data Estimation Methodology ; Computer Programs; C - Mathematical and Quantitative Methods > C0 - General > C01 - Econometrics

References

Barreto, H. and Howland, F. M. (2010). Introductory Econometrics: Using Monte Carlo Simulation with Microsoft Excel (Cambridge University Press). www.wabash.edu/econometrics

Carrington, W. J., J. L. Eltinge, K. McCue (2000), “An Economist's Primer on Survey Samples,” Working Papers from U.S. Census Bureau, Center for Economic Studies. EconPapers.repec.org/RePEc:cen:wpaper:00-15

Deaton, A. (1997). The Analysis of Household Surveys: A Microeconometric Approach to Development Policy (World Bank). books.google.com/books?&id=Mfe8ukMh_v4C

Lohr, S. L. (2010), Sampling: Design and Analysis, 2nd ed. (Cengage).

Lumley, T. S. (2010). Complex Surveys: A Guide to Analysis Using R (Wiley). faculty.washington.edu/tlumley/survey

Stata Corporation (2009). Survey Data Reference Manual, (Stata Press). www.stata.com

Wolter, K. M. (2003). Introduction to Variance Estimation (Springer).