Reliability, Validity and Uni-Dimensionality: A Primer

Pillai N., Vijayamohanan and A., Rjumohan (2020): Reliability, Validity and Uni-Dimensionality: A Primer.

Abstract

Though measurement theory has traditionally got full attention and appreciation in scientific researches, its service in social sciences is young in years. Most of the popular definitions of measurement refer only to measuring objects or events in science; however, the phenomena to be measured in social sciences are mostly abstract ones, unobservable, latent, variables. Measurement in social sciences is hence to seek to construct these latent variables from aggregation of relevant observable items of questions or rating scale items in an interview questionnaire. These constructs are interpreted as manifestations of abstract traits. A number of criteria have come up to test the feasibility of this interpretation such as reliability, validity, uni-dimensionality, etc. The present paper seeks to present a primer on these three criteria.

• Item Type: MPRA Paper
• Language: English
• Keywords: Construct, Item, Reliability, validity, Uni-dimensionality, Factor Analysis
• Subjects: C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C10 - General; C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C18 - Methodological Issues: General; C - Mathematical and Quantitative Methods > C8 - Data Collection and Data Estimation Methodology ; Computer Programs > C80 - General

References

Carmines, Edward G. and Zeller, Richard A. (1979) Reliability and Validity Assessment. Sage Publications, Inc.

Connelly, L. M. (2008). Pilot studies. Medsurg Nursing, 17(6), 411-2.

Falissard, Bruno (2006) “The unidimensionality of a psychiatric scale: a statistical point of view”, International Journal of Methods in Psychiatric Research, Volume 8, Number 3: 162-167.

Garson, G. David (2013). Validity and Reliability Statistical Associates Publishing, Asheboro, NC 27205 USA.

Guttman, L. (1954). “Some necessary conditions for common factor analysis”. Psychometrika, Vol. 19: 149-161.

Hair, J. F., Anderson, R. E., Tatham, R. L., & Black, W. C. (1995). Multivariate data analysis with readings (4th ed.). Englewood Cliffs, NJ: Prentice Hall.

Hair, J. F., Black, W. C., Babin, B. J., Anderson, R. E. and Tatham, R. L. (2006). Multivariate Data Analysis. 6th edition. Upper Saddle River, New Jersey: Prentice Hall.

Hair, J. F., Money, A. H., Samouel, P. & Page, M. (2007). Research methods for business. Chichester: John Willey & Sons Ltd.

Hertzog, M.A. (2008). Considerations in determining sample size for pilot studies. Research in Nursing & Health, 31,180-191.

Hill, R. (1998). What sample size is “enough” in internet survey research? Interpersonal Computing and Technology: An Electronic Journal for the 21st Century, 6(3-4).

Huh, J, Delorme, D. E., and Reid, L. N. (2006). “Perceived third-person effects and consumer attitudes on preventing and banning DTC advertising”. Journal of Consumer Affairs 40(1): 90.

Isaac, S., & Michael, W. B. (1995). Handbook in research and evaluation. San Diego, CA: Educational and Industrial Testing Services.

Julious, S. A. (2005). Sample size of 12 per group rule of thumb for a pilot study. Pharmaceutical Statistics, 4, 287-291.

Kaiser, H. F. (1960). “The application of electronic computers to factor analysis”. Educational and Psychological Measurement, Vol. 20: 141-51.

Kaiser, H. F. (1974). “An index of factorial simplicity”. Psychometrika,Vol. 39: 32-36.

Kuder, G. F. and M. W. Richardson (1937) "The theory of the estimation of test reliability." Psychometrika 2: 151-160.

Novick, M., and Lewis, M. (1967). “Coefficient alpha and the reliability of composite measurements”. Psychometrika, Vol 32, 1-13.

Nunnally, J. C. (1978) Psychometric Theory. New York: McGraw-Hill.

Nunnally, J. C., and Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.

Pett, M. A., Lackey, N. R., and Sullivan, J. J. (2003). Making sense of factor analysis. Thousand Oaks, CA: Sage

Sekaran, Uma and Bougie, Roger (2010). Research methods for business: A skill building approach (5th ed.). Chichester: John Willey & Sons Ltd

Slocum-Gori, Suzanne L. and Zumbo, Bruno D. (2011). “Assessing the Unidimensionality of Psychological Scales: Using Multiple Criteria from Factor Analysis” Social Indicators Research, July, Vol. 102, No. 3, pp. 443-461.

Stanley, J. C. (1971) “Reliability”, pp. 356-442 in R. L. Thorndike (ed.) Educational Measurement. Washington, DC: American Council on Education.

Tabachnick, B. G., & Fidell, L. S. (2001). Using multivariate statistics (4th ed.). Boston: Allyn & Bacon.

Treece, E. W., & Treece, J. W. (1982). Elements of research in nursing (3rd ed.). St. Louis, MO:Mosby.

van Belle, G. (2002). Statistical rules of thumb. New York: John Wiley.

Ziegler, Matthias and Hagemann, Dirk (2015) “Testing the Unidimensionality of Items: Pitfalls and Loopholes”. European Journal of Psychological Assessment, Vol. 31(4): 231–237.