Munich Personal RePEc Archive

Low sample size and regression: A Monte Carlo approach

Riveros Gavilanes, John Michael (2019): Low sample size and regression: A Monte Carlo approach. Published in: Journal of Applied Economic Sciences , Vol. XV, No. 1(67) (30 March 2020): pp. 22-44.

This is the latest version of this item.

[img]
Preview
PDF
MPRA_paper_99465.pdf

Download (6MB) | Preview

Abstract

This article performs simulations with different small samples considering the regression techniques of OLS, Jackknife, Bootstrap, Lasso and Robust Regression in order to stablish the best approach in terms of lower bias and statistical significance with a pre-specified data generating process -DGP-. The methodology consists of a DGP with 5 variables and 1 constant parameter which was regressed among the simulations with a set of random normally distributed variables considering samples sizes of 6, 10, 20 and 500. Using the expected values discriminated by each sample size, the accuracy of the estimators was calculated in terms of the relative bias for each technique. The results indicate that Jackknife approach is more suitable for lower sample sizes as it was stated by Speed (1994), Bootstrap approach reported to be sensitive to a lower sample size indicating that it might not be suitable for stablish significant relationships in the regressions. The Monte Carlo simulations also reflected that when a significant relationship is found in small samples, this relationship will also tend to remain significant when the sample size is increased.

Available Versions of this Item

UB_LMU-Logo
MPRA is a RePEc service hosted by
the Munich University Library in Germany.