Development and Validation of Survey Questionnaire and Experimental Data – A Systematical Review-based Statistical Approach

Aithal, Architha and Aithal, Sreeramana (2020): Development and Validation of Survey Questionnaire and Experimental Data – A Systematical Review-based Statistical Approach. Published in: International Journal of Management, Technology, and Social Sciences (IJMTS) , Vol. 5, No. 2 (31 October 2020): pp. 233-251.

Abstract

In quantitative research methodology, the empirical research method is finding importance due to its effectiveness in carrying out research in social sciences, business management, and health sciences. The empirical research method contains the procedure of developing a model to find the relationship between different variables identified in a problem. Based on developing hypotheses and testing hypotheses, one can examine and improve the model to explain real-world phenomena. The empirical research method consists of using a survey-based questionnaire to collect the data to identify and interrelate variables present in the problem. It is a comparatively difficult task to design and develop an effective, efficient, and psychometrically perfect questionnaire to be used for research data collection in empirical and clinical research settings. This paper provides a reference on guidelines and framework for developing suitable questionnaires for use in social sciences, business management, medical, and paramedical research with a special emphasis on various stages of questionnaire preparation, preliminary questionnaire testing, and validation (reliability & validity) of the questionnaire using a number of statistical methods. The paper throws light on data collection and analysis stages before the finalization of the developed model for testing hypotheses in empirical research by providing guidelines for the design, development, and translation of questionnaires for application in the above-mentioned research fields. The different types of validation processes required for cleaning the data by various measuring instruments in experimental research are also discussed for comparison. A framework is suggested to guide researchers through the various stages of questionnaire design, development, and improvement using suitable statistical methods to assess the reliability and validity of the questionnaire used in empirical research and validation of the data obtained in experimental research.

• Item Type: MPRA Paper
• Language: English
• Keywords: Empirical research method, Questionnaire survey, Questionnaire design, Questionnaire preparation, Questionnaire testing, Validation (Reliability & Validity) of questionnaire, Validation of experimental data
• Subjects: B - History of Economic Thought, Methodology, and Heterodox Approaches > B4 - Economic Methodology > B41 - Economic Methodology; C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General; C - Mathematical and Quantitative Methods > C1 - Econometric and Statistical Methods and Methodology: General > C18 - Methodological Issues: General; C - Mathematical and Quantitative Methods > C8 - Data Collection and Data Estimation Methodology ; Computer Programs > C80 - General; C - Mathematical and Quantitative Methods > C8 - Data Collection and Data Estimation Methodology ; Computer Programs > C82 - Methodology for Collecting, Estimating, and Organizing Macroeconomic Data ; Data Access; I - Health, Education, and Welfare > I2 - Education and Research Institutions > I29 - Other; M - Business Administration and Business Economics ; Marketing ; Accounting ; Personnel Economics > M1 - Business Administration; M - Business Administration and Business Economics ; Marketing ; Accounting ; Personnel Economics > M1 - Business Administration > M19 - Other; Z - Other Special Topics > Z0 - General > Z00 - General

References

[1] Kothari, C. R. (2004). Research methodology: Methods and techniques. New Age International.

[2] Choy, L. T. (2014). The strengths and weaknesses of research methodology: Comparison and complimentary between qualitative and quantitative approaches. IOSR Journal of Humanities and Social Science, 19(4), 99-104.

[3] Warwick, D. P., & Lininger, C. A. (1975). The sample survey: Theory and practice. McGraw-Hill.

[4] Rossi, P. H., Wright, J. D., & Anderson, A. B. (Eds.). (2013). Handbook of survey research. Academic Press.

[5] Raghunathan, T. E., & Grizzle, J. E. (1995). A split questionnaire survey design. Journal of the American Statistical Association, 90(429), 54-63.

[6] Ballinger, C., & Davey, C. (1998). Designing a questionnaire: An overview. British Journal of Occupational Therapy, 61(12), 547-550.

[7] Bee, D. T., & Murdoch-Eaton, D. (2016). Questionnaire design: the good, the bad and the pitfalls. Archives of Disease in Childhood-Education and Practice, 101(4), 210-212.

[8] Oosterveld, P., Vorst, H. C., & Smits, N. (2019). Methods for questionnaire design: a taxonomy linking procedures to test goals. Quality of Life Research, 28(9), 2501-2512.

[9] Kachroo, P., & Kachen, S. (2018). Item placement for questionnaire design for optimal reliability. Journal of Marketing Analytics, 6(4), 120-126.

[10] Sirakaya-Turk, E., & Uysal, M. S. (2017). Survey research: sampling and questionnaire design. Research methods for leisure, recreation and tourism, (Ed. 2), 122-146.

[11] Moroney, W. F., & Joyce, A. (2019). Questionnaire Design: How to Ask the Right Questions of the Right People at the Right Time to Get the Information You Need. ergonomics in design. ISBN: 978-0-945289-56-2.

[12] Yaddanapudi, S., & Yaddanapudi, L. N. (2019). How to design a questionnaire. Indian journal of anaesthesia, 63(5), 335.

[13] Riaño, C. E., & Palomino, M. (2015). Design and preparation of a questionnaire according to Delphi method to select virtual laboratories (VL). Sophia, 11(2), 129-141.

[14] Bovell-Benjamin, A. C., Dawkin, N., Pace, R. D., & Shikany, J. M. (2009). Use of focus groups to understand African-Americans' dietary practices: Implications for modifying a food frequency questionnaire. Preventive medicine, 48(6), 549-554.

[15] Peytchev, A., & Peytcheva, E. (2017, December). Reduction of measurement error due to survey length: Evaluation of the split questionnaire design approach. In Survey Research Methods, 11(4), 361-368).

[16] de Jong, J. A., Dorer, B., Lee, S., Yan, T., & Villar, A. (2018). Overview of Questionnaire Design and Testing. Advances in Comparative Survey Methods: Multinational, Multiregional, and Multicultural Contexts (3MC), 115.

[17] Hamed Taherdoost (2016). Sampling Methods in Research Methodology; How to Choose a Sampling Technique for Research. International Journal of Academic Research in Management (IJARM), 5(2), 28-36.

[18] Onwuegbuzie, A. J., Dickinson, W. B., Leech, N. L., & Zoran, A. G. (2009). A qualitative framework for collecting and analyzing data in focus group research. International journal of qualitative methods, 8(3), 1-21.

[19] Aithal, P. S., Shailashree, V., & Kumar, P. M. (2016). Factors & Elemental Analysis of Six Thinking Hats Technique Using ABCD Framework. International Journal of Advanced Trends in Engineering and Technology (IJATET), 1(1), 85-95.

[20] Aithal, P. S. (2016). Review on Various Ideal System Models Used to Improve the Characteristics of Practical Systems. International Journal of Applied and Advanced Scientific Research, 1(1), 47-56. DOI: http://doi.org/10.5281/zenodo.159749.

[21] Aithal, P. S., & Aithal, Shubhrajyotsna (2019). New Directions in Scholarly Research- Some Fearless Innovations & Predictions for 21st Century Research. International Journal of Management, Technology, and Social Sciences (IJMTS), 4(1), 1-19. DOI: https://doi.org/10.5281/zenodo.2557222.

[22] Aithal, P. S., Shailashree, V. T., Suresh Kumar, P. M. (2015). A New ABCD Technique to Analyze Business Models & Concepts. International Journal of Management, IT and Engineering (IJMIE), 5(4), 409 – 423. DOI : http://doi.org/10.5281/zenodo.61652.

[23] Aithal, P. S. (2016). Study on ABCD Analysis Technique for Business Models, business strategies, Operating Concepts & Business Systems. International Journal in Management and Social Science, 4(1), 98-115. DOI : http://doi.org/10.5281/zenodo.161137.

[24] Aithal P. S. & Shubhrajyotsna Aithal (2018). Factor & Elemental Analysis of Nanotechnology as Green Technology using ABCD Framework. International Journal of Management, Technology, and Social Sciences (IJMTS), 3(2), 57-72. DOI : https://doi.org/10.5281/zenodo.1451490.

[25] Lewis, S. (2015). Qualitative inquiry and research design: Choosing among five approaches. Health promotion practice, 16(4), 473-475.

[26] Carmines E. G. & Zeller, R. A. (1979). Reliability and Validity Assessment, Newbury Park, CA, SAGE.

[27] Moser C. A. & Kalton, G. (1989). Survey methods in social investigation, Aldershot, Gower.

[28] Huck, S. W. (2007). Reading Statistics and Research, United States of America, Allyn & Bacon.

[29] Robinson, W. S. (2009). Ecological correlations and the behavior of individuals. International journal of epidemiology, 38(2), 337-341.

[30] Straub, D., Boudreau, M. C., & Gefen, D. (2004). Validation guidelines for IS positivist research. Communications of the Association for Information systems, 13(1), 380-427.

[31] Hamed Taherdoost. (2016). Validity and Reliability of the Research Instrument; How to Test the Validation of a Questionnaire/Survey in a Research. International Journal of Academic Research in Management (IJARM), 5(3), 28-36.

[32] Ghauri, P. & Gronhaug, K. (2005). Research Methods in Business Studies, Harlow, FT/Prentice Hall.

[33] Oluwatayo, J. A. (2012). Validity and reliability issues in educational research. Journal of educational and social research, 2(2), 391-400.

[34] Gelfand, D. M., Hartmann, D. P., Cromer, C. C., Smith, C. L., & Page, B. C. (1975). The effects of instructional prompts and praise on children's donation rates. Child Development, 46, 980-983.

[35] Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel psychology, 28(4), 563-575.

[36] Ayre, C., & Scally, A. J. (2014). Critical values for Lawshe’s content validity ratio: revisiting the original methods of calculation. Measurement and Evaluation in Counseling and Development, 47(1), 79-86.

[37] Brown, S. M., McBride, G., Collingridge, D. S., Butler, J. M., Kuttler, K. G., Hirshberg, E. L., ... & Orme, J. (2015). Validation of the Intermountain patient perception of quality (PPQ) survey among survivors of an intensive care unit admission: a retrospective validation study. BMC health services research, 15(1), 1-7.

[38] Hamed Taherdoost (2016). Validity and Reliability of the Research Instrument; How to Test the Validation of a Questionnaire/Survey in a Research. International Journal of Academic Research in Management (IJARM), 5(3), 28-36.

[39] Collingridge, D. S., & Gantt, E. E. (2008). The quality of qualitative research. American journal of medical quality, 23(5), 389-395.

[40] MacCallum, R. C., Widaman, K. F., Zhang, S., & Hong, S. (1999). Sample size in factor analysis. Psychological methods, 4(1), 84.

[41] Malterud, K., Siersma, V. D., & Guassora, A. D. (2016). Sample size in qualitative interview studies: guided by information power. Qualitative health research, 26(13), 1753-1760.