Estimating Nonresponse Bias in Mail Surveys

Armstrong, J. Scott and Overton, Terry S. (1977): Estimating Nonresponse Bias in Mail Surveys. Published in: Journal of Marketing Research No. 14 (1977): pp. 396-402.

Abstract

Valid predictions for the direction of nonresponse bias were obtained from subjective estimates and extrapolations in an analysis of mail survey data from published studies. For estimates of the magnitude of bias, the use of extrapolations led to substantial improvements over a strategy of not using extrapolation

• Item Type: MPRA Paper
• Language: English
• Keywords: market research, marketing, surveys
• Subjects: C - Mathematical and Quantitative Methods > C8 - Data Collection and Data Estimation Methodology ; Computer Programs > C83 - Survey Methods ; Sampling Methods; M - Business Administration and Business Economics ; Marketing ; Accounting ; Personnel Economics > M3 - Marketing and Advertising > M31 - Marketing

References

1. Baur, E. Jackson, “Response bias in a mail survey,” Public Opinion Quarterly, 11 (Winter 1947-48), 594-600.

2. Benson, Lawrence E., “Mail surveys can be valuable,” Public Opinion Quarterly, 10 (1946), 234-241.

3. Bisco, Ralph L.. “Social science data archives: progress and prospects,” Social Sciences Information, 6 (February 1967), 39-74.

4. Blair, William S., "How subject matter can bias a mail survey,” Media/Scope, (February 1964), 70-72.

5. Brown, Rex V., “Just how credible are your market estimates?” Journal of Marketing, 33 (July 1969), 46-50.

6. Clausen, John and Robert N. Ford, “Controlling bias in mail questionnaires,” Journal of the American Statistical Association, 42 (1947), 497-511.

7. Daniel, Wayne W., “Nonresponse in sociological surveys: A review of some methods for handling the problem,” Sociological Methods and Research, 3 (February 1975), 291-307.

8. Donald, Marjorie N., “Implications of nonresponse for the interpretation of mail questionnaire data,” Public Opinion Quarterly, 24 (1960), 99-114.

9. Edgerton, Harold A., Steuart H. Britt and Ralph D. Norman, “Objective differences among various types of respondents to a mailed questionnaire,” American Sociological Review, 12 (Summer 1947), 435 444.

10. Ellis, Robert A., Calvin M. Endo, and J. Michael Armer, “The use of potential nonrespondents for studying nonresponse bias,” Pacific Sociological Review, 13 (Spring 1970), 103-109.

11. Erdos, Paul L. and Arthur J. Morgan, Professional Mail Surveys. New York: McGraw-Hill Book Co.. 1970.

12. Ferber, Robert, “The problem of bias in mail returns – A solution,” Public Opinion Quarterly, 12 (Winter 1948-1949), 669-676.

13. Filion, F. L., “Estimating bias due to nonresponse in mail surveys,” Public Opinion Quarterly, 40 (Winter 1975-76), 482-492.

14. Filion, F. L., “Exploring and correcting for nonresponse bias using follow-ups of nonrespondents,” Pacific Sociological Review, 19 (July 1976), 401-408. 10

15. Finkner, A. L., “Methods of sampling for estimating peach production in North Carolina,” North Carolina Agricultural Experiment Station Technical Bulletin, 91, 1950. As cited in William G. Cochran, Sampling Techniques. New York: John Wiley and Sons. Inc., 1963. p. 374.

16. Ford, Robert N. and Hans Zeisel, “Bias in mail surveys cannot be controlled by one mailing,” Public Opinion Quarterly, Fall 1949, 495-501.

17. Franzen, Raymond and Paul Lazarsfeld, “Mail questionnaire as a research problem,” Journal of Psychology, 20 (1945), 293-320.

18. Fuller, Carol H., “Weighting to adjust for survey nonresponse,” Public Opinion Quarterly, 38 (1974), 239-246.

19. Gallup, George H., The Sophisticated Poll Watcher's Guide. Princeton, NJ: Princeton Opinion Press, 1972.

20. Hansen, Morris H. and W. N. Hurwitz, “The problem of non-response in sample surveys,” Journal of the American Statistical Association, 41 (December 1946), 517-529.

21. Hendricks, W. A., “Adjustment for bias by non-response in mail surveys,” Agricultural Economics Research, 1 (1949), 52 ff.

22. Hochstim, Joseph R., “A critical comparison of three strategies of collecting data from households," Journal of the American Statistical Association, 62 (1967), 976-989.

23. Hochstim, Joseph R. and Demetrios A. Athanasopoulous, “Personal follow-up in a mail survey: Its contribution and its cost,” Public Opinion Quarterly, 34 (Spring 1970), 69-81.

24. Hyman, Herbert, Secondary Analysis of Sample Surveys. New York: John Wiley and Sons, Inc., 1972.

25. Kanuk, Leslie and Conrad Berenson, “Mail surveys and response rates: A literature review,” Journal of Marketing Research, 12 (November 1975), 440-453.

26. Kirchner, Wayne K. and Nancy B. Mousley, “A note on job performance: differences between respondent and nonrespondent salesmen to an attitude survey,” Journal of Applied Psychology, 47 (Summer 1963), 223-244.

27. Kish, Leslie, Survey Sampling. New York: John Wiley and Sons, Inc., 1965.

28. Kivlin, Joseph E., “Contributions to the study of mail-back bias," Rural Sociology, 30 (Fall 1965), 332-336.

29. Lansing, John B. and James N. Morgan, Economic Survey Methods. Ann Arbor: Survey Research Center, University of Michigan. 1971.

30. Larson, R. F. and W. R. Carton, Jr., “Can the mail-back bias contribute to a study's validity?” American Sociological Review, 24 (April 1959), 243-245.

31. Lehman, Edward C., Jr.. “Tests of significance and partial returns to mail questionnaires,” Rural Sociology, 28 (September 1963). 284-289.

32. Linsky, Arnold S.. “Stimulating responses to mailed questionnaires: A review,” Public Opinion Quarterly, 30 (Spring 1975), 82-101.

33. Lubin, B., E. E. Levitt, and M. S. Zukerman, “Some personality differences between responders and nonresponders to a survey questionnaire,” Journal of Consulting Psychology, 26 (1962), 192.

34. Mayer, Charles S. and Robert W. Pratt, Jr., “A note on nonresponse in a mail survey," Public Opinion Quarterly, 30 (Winter 1966), 637-646.

35. Newman, Sheldon W., “Differences between early and late respondents to a mailed survey,” Journal of Advertising Research, 2 (June 1962), 37-39.

36. Ognibene, P., “Correcting non-response bias in mail questionnaires,” Journal of Marketing Research, 8 (May 1971), 233-235.

37. Pace, C. Robert, “Factors Influencing questionnaire returns from former university students,” Journal of Applied Psychology, 23 (June 1939), 388-397.

38. Pavalko, Ronald M. and Kenneth G. Lutterman, “Characteristics of willing and reluctant respondents,” Pacific Sociological Review, 16 (1973), 463-476.

39. Reid, Seerley, “Respondents and non-respondents to mail questionnaires,” Educational Research Bulletin, 21 (April 1942), 87-96.

40. Reuss, C. F.. “Differences between persons responding and not responding to a mailed questionnaire,” American Sociological Review, 8 (August 1943). 433-438.

41. Rollins, Malcom, “The practical use of repeated questionnaire waves,” Journal of Applied Psychology, 24 (December 1940), 770-772.

42. Rosenthal, Robert, “The volunteer subject,” Human Relations, 18 (1965), 389-406.

43. Schwirian, Kent P. and Harry R. Blaine, “Questionnaire-return bias in the study of blue-collar workers,” Public Opinion Quarterly, 30 (Winter 1966), 656-663.

44. Scott, Christopher, “Research on mail surveys,” Journal of the Royal Statistical Society, Series A, 124 (1961), 143-191.

45. Stanton, Frank, “Notes on the validity of mad questionnaire returns,” Journal of Applied Psychology, 23, (February 1939), 95-104.

46. Stephan, Frederick F. and Philip J. McCarthy, Sampling Opinions. New York: John Wiley and Sons, Inc., 1958.

47. Suchman, Edward A. and Boyd McCandless, “Who answers questionnaires?” Journal of Applied Psychology, 24 (December 1940), 758-769.

48. Vincent, Clark E., “Socioeconomic status and familial variables in mail questionnaire responses,” American Journal of Sociology, 69 (May 1964), 647-653.

49. Wallace, David, “A case for-and-against mail questionnaires,” Public Opinion Quarterly, 18 ( 1954), 40-52.

50. Wiseman, Frederick, “Methodological bias in public opinion surveys,” Public Opinion Quarterly, 36 (Spring 1972), 105-108.

51. Zajone, Robert B., Social Psychology: An Experimental Approach. Belmont, CA: Brooks/Cole Publishing, 1967.

52. Zimmer. H., “Validity of extrapolating non-response bias from mail questionnaire follow-ups,” Journal of Applied Psychology, 40 (1956), 117-121.