Impact of Small Group Size on Neighborhood Influences in Multilevel Models

Theall, Katherine P. and Scribner, Richard and Lynch, Sara and Simonsen, Neal and Schonlau, Matthias and Carlin, Bradley and Cohen, Deborah (2008): Impact of Small Group Size on Neighborhood Influences in Multilevel Models.

Abstract

Objective: Although there is a growing body of literature on sample size in multilevel or hierarchical modeling, few studies have examined the impact of group size < 5.

Design: We examined the impact of a group size less than five on both a continuous and dichotomous outcome in a simple two-level multilevel model utilizing data from two studies.

Setting: Models with balanced and unbalanced data of group sizes 2 to 5 were compared to models with complete data. Impact on both fixed and random components were examined.

Results: Random components, particularly group-level variance estimates, were more affected by small group size than were fixed components. Both fixed and random standard error estimates were inflated with small group size. Datasets where there are a large number of groups yet all the groups are of very small size may fail to find or even consider a group-level effect when one may exist and also may be under-powered to detect fixed effects.

Conclusions: Researchers working with multilevel study designs should be aware of the potential impact of small group size when a large proportion of groups has very small (< 5) sample sizes.

• Item Type: MPRA Paper
• Language: English
• Keywords: Multilevel, Neighborhood, Body Weight, Obesity, Sample Size
• Subjects: C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C10 - General; I - Health, Education, and Welfare > I1 - Health > I12 - Health Behavior; I - Health, Education, and Welfare > I1 - Health > I18 - Government Policy ; Regulation ; Public Health

References

1. Clarke P. When can group level clustering be ignored? Multilevel models versus single-level models with sparse data. In; 2008. p. 752-758.

2. Bickel R. Multilevel Analysis for Applied Research: It. In. New York, NY: Guilford Press 2007. p. 428.

3. Snijders T, Boskers R. Multilevel analysis An introduction to basic and advanced multilevel modeling. London: Sage; 1999.

4. Maas CJM, Hox JJ. Sample sizes for multilevel modeling. Am J Public Health 1999;89:1181-6.

5. Maas CJM, Hox JJ. Robustness issues in multilevel regression analysis. Statistica Neerlandica 2004;58(2):127-137.

6. Raudenbush S, Xiao-Feng L. Effects of study duration, frequency of observation, and sample size on power in studies of group differences in polynomial change. Psychol Methods. 2001;6(4):387-401.

7. Moineddin R, Matheson FI, Glazier RH. A simulation study of sample size for multilevel logistic regression models. In: BioMed Central; 2007. p. 34.

8. Snijders TAB, Bosker RJ. Standard Errors and Sample Sizes for Two-Level Research. 1993;18(3):237-259.

9. Kreft IGG, de Leeuw J. Introducing multilevel modeling. Newbury Park, CA: Sage Publications; 1998.

10. Heck RH, Thomas SL. An Introduction to Multilevel Modeling Techniques: Lawrence Erlbaum Associates; 2000.

11. Hox JJ. Multilevel Analysis: Techniques and Applications: Lawrence Erlbaum Associates; 2002.

12. Bryk AS, Raudenbush SW. Hierarchical Linear Models: Applications and Data Analysis Methods. 1992.

13. Merlo J, Chaix B, Ohlsson H, Beckman A, Johnell K, Hjerpe P, et al. A brief conceptual tutorial of multilevel analysis in social epidemiology: using measures of clustering in multilevel logistic regression to investigate contextual phenomena. J Epidemiol Community Health 2006;60(4):290-297.