Using Internet in Stated Preference Surveys: A Review and Comparison of Survey Modes

Lindhjem, Henrik and Navrud, Stale (2011): Using Internet in Stated Preference Surveys: A Review and Comparison of Survey Modes. Published in: International Review of Environmental and Resource Economics No. 5 : pp. 309-351.

Abstract

Internet is quickly becoming the survey mode of choice for stated preference (SP) surveys in environmental economics. However, this choice is being made with relatively little consideration of its potential influence on survey results. This paper reviews the theory and emerging evidence of mode effects in the survey methodology and SP literatures, summarizes the findings, and points out implications for Internet SP practice and research. The SP studies that compare Internet with other modes do generally not find substantial difference. The majority of welfare estimates are equal; or somewhat lower for the Internet surveys. Further, there is no clear evidence of substantially lower quality or validity of Internet responses. However, the degree of experimental control is often low in comparative studies across survey modes, and they often confound measurement and sample composition effects. Internet offers a huge potential for experimentation and innovation in SP research, but when used to derive reliable welfare estimates for policy assessment, issues like representation and nonresponse bias for different Internet panels should receive more attention.

• Item Type: MPRA Paper
• Language: English
• Keywords: Internet; survey mode; contingent valuation; stated preferences
• Subjects: H - Public Economics > H4 - Publicly Provided Goods > H41 - Public Goods; Q - Agricultural and Natural Resource Economics ; Environmental and Ecological Economics > Q5 - Environmental Economics > Q51 - Valuation of Environmental Effects

References

Andreoni, J. 1990. “Impure Altruism and Donations to Public-Goods — A Theory of Warm-Glow Giving.” Economics Journal 100(401): 464–477.

Arrow, K. J., R. Solow, E. Leamer, P. Portney, R. Radner, and H. Schuman. 1993. “Report of the NOAA Panel on Contingent Valuation.” Federal Register 58: 4601–4614.

Atkeson, R. L., A. L. Adams, L. A. Bryant, L. Zilberman, and K. L. Saunders. 2011. “Considering Mixed Mode Surveys for Questions in Political Behavior: Using the Internet and Mail to Get Quality Data at Reasonable Costs.” Political Behavior 33(1): 161–178.

Baker, R., S. J. Blumberg, J. M. Brick, M. P. Couper, M. Courtright, J. M. Dennis, D. Dillman, M. R. Frankel, P. Garland, R. M. Groves, C. Kennedy, J. Krosnick, P. J. Lavrakas, S. Lee, M. Link, L. Piekarski, K. Rao, R. K. Thomas, and D. Zahs. 2010. "Research Synthesis: AAPOR Report on Online Panels.” Public Opinion Quarterly 74(4): 711–781.

Banzhaf, H. S., D. Burtraw, D. Evans, and A. Krupnick. 2006. “Valuation of Natural Resource Improvements in the Adirondacks.” Land Economics 82(3): 445–464.

Barrio, M. and M. Loureiro. 2010. “A Meta-analysis of Contingent Valuation Forest Studies.” Ecological Economics 69(5): 1023–1030.

Bateman, I. J., D. Burgess, G. H. Hutchinson, and D. I. Matthews. 2008. “Learning Design Contingent Valuation (LDCV): NOAA Guidelines, Preference Learning and Coherent Arbitrariness.” Journal of Environmental Economics and Management 55: 127–141.

Bateman, I. J., B. H. Day, A. P. Jones, and S. Jude. 2009. “Reducing Gain–loss Asymmetry:A virtual Reality Choice Experiment Valuing Land Use Change.” Journal of Environmental Economics and Management 58: 106–118.

Bateman, I. J. and J. Mawby. 2004. “First Impressions Count: Interviewer Appearance and Information Effects in Stated Preference Studies.” Ecological Economics 49(1): 47–55.

Bell, J., J. Huber, and W. K. Viscusi. 2011. “Survey Mode Effects on Valuation of Environmental Goods.” International Journal of Environmental Research and Public Health 8(4): 1222–1243.

Berrens, R. P., A. K. Bohara, H. Jenkins-Smith, C. Silva, and D. L. Weimer. 2003. “The Advent of Internet Surveys for Political Research: A Comparison of Telephone and Internet Samples.” Political Analysis 11(1): 1–22.

Berrens, R. P., A. K. Bohara, H. C. Jenkins-Smith, C. L. Silva, and D. L. Weimer. 2004. "Information and Effort in Contingent Valuation Surveys: Application to Global Climate Change Using National Internet Samples.” Journal of Environmental Economics and Management 47(2): 331–363.

Blamey, R. K., J. W. Bennett, and M. D. Morrison. 1999. “Yea-Saying in Contingent Valuation Surveys.” Land Economics 75(1): 126–141.

Blomquist, G. C. and J. C. Whitehead. 1998. “Resource Quality Information and Validity of Willingness to Pay in Contingent Valuation.” Resource Energy Economics 20(2): 179–196.

Borkan, B. 2010. “The Mode Effect in Mixed-Mode Surveys Mail and Web Surveys.” Social Science Computer Review 28(3): 371–380.

Boxall, P., W. L. Adamowicz, and A. Moon. 2009. “Complexity in Choice Experiments: Choice of the Status Quo Alternative and Implications for Welfare Measurement.” Australian Journal of Agricultural and Resource Economics 53(4): 503–519.

Boyle, K. J. and J. C. Bergstrom. 1999. “Doubt, Doubt, and Doubters: The Genesis of a New Research Agenda?” In: Valuing Environmental Preferences, I. Bateman and K. G. Willis, eds., Oxford University Press.

Brown, G. and D. A. Hagen. 2010. “Special Issue: Behavioral Economics and the Environment.” Environmental and Resource Economics 46(2): 135–247.

Cai, B. L., T. A. Cameron, and G. R. Gerdes. 2010. “Distributional Preferences and the Incidence of Costs and Benefits in Climate Change Policy.” Environmental and Resource Economics 46(4): 429–458.

Cameron, T. A., G. L. Poe, R. G. Ethier, and W. D. Schulze. 2002. “Alternative Nonmarket Value-elicitation Methods: Are the Underlying Preferences the Same?” Journal of Environmental Economics and Management 44(3): 391–425.

Canavari, M., G. Nocella, and R. Scarpa. 2005. “Stated Willingness-to-Pay for Organic Fruit and Pesticide Ban: An Evaluation Using Both Web-Based and Face-to-Face Interviewing.” Journal of Food Products Marketing 11(3): 107–134.

Carlsson, F. 2010. “Design of Stated Preference Surveys: Is There More to Learn from Behavioral Economics?” Environmental and Resource Economics 46(2): 167–177.

Carlsson, F., M. Kataria, and E. Lampi. 2010. “Dealing with Ignored Attributes in Choice Experiments on Valuation of Sweden’s Environmental Quality Objectives.” Environmental and Resource Economics 47: 65–89.

Chang, L. and J. A. Krosnick. 2009. “National Surveys Via Rdd Telephone Interviewing Versus the Internet.” Public Opinion Quarterly 73(4): 641–678.

Chang, L. and J. A. Krosnick. 2010. “Comparing Oral Interviewing with Self-Administered Computerized Questionnaires An Experiment.” Public Opinion Quarterly 74(1): 154–167.

Cooper, M. 2008. Designing Effective Web Surveys, Cambridge University Press.

Couper, M. and P. V. Miller. 2008. “Special Issue: Web Survey Methods.” Public Opinion Quarterly 72(5): 831–1032.

Couper, M. P. 2005. “Technology Trends in Survey Data Collection.” Social Science Computer Review 23(4): 486–501.

Couper, M. P., A. Kapteyn, M. Schonlau, and J. Winter. 2007. “Noncoverage and Nonresponse in an Internet Survey.” Social Science Research 36(1): 131–148.

Covey, J., A. Robinson, M. Jones-Lee, and G. Loomes. 2010. “Responsibility, Scale and the Valuation of Rail Safety.” Journal of Risk and Uncertainty 40: 85–108.

Dalecki, M. G., J. C. Whitehead, and G. C. Blomquist. 1993. “Sample Nonresponse Bias and Aggregate Benefits in Contingent Valuation — An Examination of Early, Late and Non-respondents.” Journal of Environmental Management 38(2): 133–143.

Davis, J. 2004. “Assessing Community Preferences for Development Projects: Are Willingness-to-Pay Studies Robust to Mode Effects?” World Development 32(4): 655–672.

de Leeuw, E. D. 2005. “To Mix or Not to Mix Data Collection Modes in Surveys.” Journal of Official Statistics 21(2): 233–255.

DeMaio, T. J. 1984. “Social Desirability and Survey Measurement: A Review.” In: Surveying Subjective Phenomena, C. F. Turner and E. Martin, eds., Vol. 2, New York: Russel Sage.

Denscombe, M. 2006. “Web-based Questionnaires and the Mode Effect — An Evaluation Based on Completion Rates and Data Contents of Near-identical Questionnaires Delivered in Different Modes.” Social Science Computer Review 24(2): 246–254.

Denscombe, M. 2009. “Item Non-response Rates: A Comparison of Online and Paper Questionnaires.” International Journal of Social Research Methodology 12(4): 281–291.

DeShazo, J. R. and G. Fermo. 2002. “Designing Choice Sets for Stated Preference Methods: The Effects of Complexity on Choice Consistency.” Journal of Environmental Economics Management 44(1): 123–143.

Dickie, M., S. Gerking, and W. L. Goffe. 2007. Valuation of Non-Market Goods Using Computer-Assisted Surveys: A Comparison of Data Quality from Internet and RDD Samples.

Dillman, D. 2000. Mail and Internet Surveys: The Tailored Design Method, John Wiley & Sons, Inc.

Dillman, D. and J. M. Bowker. 2001. “The WEB Questionnaire Challenge to Survey Methodologists.” In: Dimensions of Internet Science, U.-D. Reips and M. Bosnjak, eds., Lengerich, Germany: Pabst Science Publishers, pp. 159–178.

Dillman, D., J. D. Smyth, and L. M. Christian. 2009. Internet, Mail and Mixed-Mode Surveys, Wiley.

Ethier, R. G., G. L. Poe, W. D. Schulze, and J. Clark. 2000. “A Comparison of Hypothetical Phone and Mail Contingent Valuation Responses for Green-pricing Electricity Programs.” Land Economics 76(1): 54–67.

Fleming, C. M. and M. Bowden. 2009. “Web-based Surveys as an Alternative to Traditional Mail Methods.” Journal of Environmental Management 90: 284–292.

Fredman, P. 1999. “A Test of Nonresponse Bias in a Mail Contingent Valuation Survey.” In: Topics in Environmental Economics, M. Boman et al. eds., Kluwer Academic Publishers, pp. 175–186.

Fricker, S., M. Galesic, R. Tourangeau, and T. Yan. 2005. “An Experimental Comparison of Web and Telephone Surveys.” Public Opinion Quarterly 69(3): 370–392.

Gabaix, X., D. Laibson, and G. Moloche. 2003. “The Allocation of Attention: Theory and Evidence.” Working Paper, Harvard University.

Galesic, M., R. Tourangeau, M. P. Couper, and F. G. Conrad. 2008. “Eye-Tracking Data New Insights on Response Order Effects and Other Cognitive Shortcuts in Survey Responding.” Public Opinion Quarterly 72(5): 892–913.

Gong, M. and D. Aadland. 2011. “Interview Effects in an Environmental Phone Survey.” Environmental and Resource Economics 49(1): 47–64.

Grandjean, B. D., N. M. Nelson, and P. A. Taylor. 2009. “Comparing an Internet Panel Survey to Mail and Phone Surveys on Willingness to Pay for Environmental Quality: A National Mode Test.” Paper Presented at the 64th Annual conference of the American Association for Public Opinion Research, 14–17 May 2009.

Green, C. and S. Tunstall. 1999. “A Psychological Perspective.” In: Valuing Environmental Preferences: Theory and Practice of the Contingent Valuation Method in the US, EU, and Developing Countries, I. Bateman and K. G. Willis, eds., Oxford University Press.

Groves, R. M. 2006. “Nonresponse Rates and Nonresponse Bias in Household Surveys.” Public Opinion Quarterly 70(5): 646–675.

Groves, R. M., F. J. Fowler jr, M. P. Couper, J. M. Lepkowski, E. Singer, and R. Tourangeau. 2004. Survey Methodology. Wiley.

Hanley, N. 1989. “Valuing Rural Recreation Benefits: An Empirical Comparison of Two Approaches.” Journal of Agricultural Economics 40(3): 361–374.

Heckman, J. J. 1979. “Sample Selection Bias as a Specification Model.” Econometrica 47(1): 153–161.

Heerwegh, D. 2009. “Mode Differences Between Face-To-Face andWeb Surveys: An Experimental Investigation of Data Quality and Social Desirability Effects.” International Journal of Public Opinion Research 21(1): 111–121.

Heerwegh, D. and G. Loosveldt. 2008. “Face-To-Face Versus Web Surveying in a High- Internet-Coverage Population Differences in Response Quality.” Public Opinion Quarterly 72(5): 836–846.

Holbrook, A. L., M. C. Green, and J. Krosnick. 2003. “Telephone Versus Face-To-Face Interviewing of National Probability Samples with Long Questionnaires: Comparison of Respondent Satisficing and Social Desirability Response Bias.” Public Opinion Quarterly 67: 79–125.

Holbrook, A. L. and J. A. Krosnick. 2010. “Social Desirability Bias in Voter Turnout Reports.” Public Opinion Quarterly 74(1): 37–67.

Holtgraves, T. 2004. “Social Desirability and Self-Reports: Testing Models of Socially Desirable Responding.” Personality and Social Psychology Bulletin 30(2): 161–172.

Hudson, D., L. Seah, D. Hite, and T. C. Haab. 2004. “Telephone Presurveys, Self-selection, and Non-response Bias to Mail and Internet Surveys in Economic Research.” Applied Economics Letters 11: 237–240.

Hynes, S. and N. Hanley. 2006. “Preservation Versus Development on Irish Rivers: Whitewater Kayaking and Hydro-power in Ireland.” Land Use Policy 23: 170–180.

Internet World Stats. 2010. Internet Usage in European Union, http://www.internet world stats.com/stats9.htm

J¨ackle, A., C. Roberts, and P. Lynn. 2010. “Assessing the Effect of Data Collection Mode on Measurement.” International Statistical Review 78(1): 3–20.

Kramer, R. A. and J. I. Eisen-Hecht. 2002. “Estimating the Economic Value of Water Quality Protection in the Catawba River Basin.” Water Resources Research 38(9): 1–10.

Kreuter, F., S. Presser, and R. Tourangeau. 2008. “Social Desirability Bias in Cati, Ivr, and Web Surveys: The Effects of Mode and Question Sensitivity.” Public Opinion Quarterly 72(5): 847–865.

Kristofersson, D. and S. Navrud. 2005. “Validity Tests of Benefit Transfer — Are We Performing the Wrong Test?” Environmental and Resource Economics 30(3): 279–286.

Krosnick, J. 1991. “Response Strategies for Coping with the Cognitive Demands of Attitude Measures in Surveys.” Applied Cognitive Psychology 5: 213–236.

Ladenburg, J. and S. B. Olsen. 2008. “Gender-specific Starting Point Bias in Choice Experiments: Evidence From An Empirical Study.” Journal of Environmental Economics and Management 56(3): 275–285.

Legget, C. G., N. S. Kleckner, K. Boyle, J. W. Duffield, and R. C. Micthel. 2003. “Social Desirability Bias in Contingent Valuation Surveys Administered through In-Person Interviews.” Land Economics 79(4): 561–575.

Li, H., R. P. Berrens, A. K. Bohara, H. C. Jenkins-Smith, C. L. Silva, and L. Weimer. 2004. “Telephone versus Internet Samples for a National Advisory Referendum: Are the Underlying Stated Preferences the Same?” Applied Economics Letters 11(3): 173–176.

Li, H., H. C. Jenkins-Smith, C. L. Silva, R. P. Berrens, and K. G. Herron. 2009. “Public Support for Reducing US Reliance on Fossil Fuels: Investigating Household Willingnes sto-pay for Energy Research and Development.” Ecological Economics 68(3): 731–742.

Lienhoop, N. and A. Fischer. 2009. “Can You be Bothered? The Role of Participant Motivationin the Valuation of Species Conservation Measures.” Journal of Environmental Planning and Management 52(4): 519–534.

Lindberg, K., R. L. Johnson, and R. P. Berrens. 1997. “Contingent Valuation of Rural Tourism Development with Tests of Scope and Mode Stability.” Journal of Agricultural Resource and Economics 22(1): 44–60.

Lindhjem, H. 2007. “20 Years of Stated Preference Valuation of Non-timber Benefits from Fennoscandian Forests: A Meta-analysis.” Journal of Forest Economics 12(4): 251–277.

Lindhjem, H. and S. Navrud. 2009. “Asking for Individual or Household Willingness to Pay for Environmental Goods: Implication for AggregateWelfare Measures.” Environmental and Resource Economics 43(1): 11–29.

Lindhjem, H. and S. Navrud. 2011. “Are Internet Surveys an Alternative to Face-to-face Interviews in Contingent Valuation?” Ecological Economics 70(9): 1628–1637.

List, J. A., A. K. Bohara, and J. Kerkvliet. 2004. “Examining the Role of Social Isolation on Stated Preferences.” American Economic Review 94(3): 741–752.

Loomis, J. and M. King. 1994. “Comparison Of Mail And Telephone-Mail Contingent Valuation Surveys.” Journal of Environmental Management 41(4): 309–324.

Loomis, J., J. Miller, A. Gonzales-Caban, and P. A. Champ. 2006. “Testing the Convergent Validity of Videotape Survey Administration and Phone Interviews in Contingent Valuation.” Society and Natural Resources 19(4): 367–375.

Loureiro, M. L. and J. Lotade. 2005. “Interviewer Effects on the Valuation of Goods with Ethical and Environmental Attributes.” Environmental and Resource Economics 30: 49–72.

MacDonald, D. H., M. Morrison, J. Rose, and K. Boyle. 2010. “Untangling Differences in Values from Internet and Mail Stated Preference Studies.” Paper Presented at the World Congress of Environmental and Resource Economists, Montreal, Canada, June 28–July 2, 2010.

MacMillan, D., N. Hanley, and N. Lienhoop. 2006. “Contingent Valuation: Environmental Polling or Preference Engine?” Ecological Economics 60: 299–307.

Maguire, K. B. 2009. “Does Mode Matter? A Comparision of Telephone, Mail, and Inperson Treatments in Contingent Valuation Surveys.” Journal of Environmental Management 90: 3528–3533.

Malhotra, N. 2009. “Order Effects in Complex and Simple Tasks.” Public Opinion Quarterly 73(1): 180–198.

Malhotra, N. and J. Krosnick. 2007. “The Effect of Survey Mode and Sampling on Inferences about Political Attitudes and Behavior: Comparing the 2000 and 2004 ANES to Internet Surveys with Nonprobability Samples.” Political Analysis 286–323.

Manfreda, K. L., M. Bosniak, J. Berzelak, I. Haas, and V. Vehovar. 2008. “Web Surveys versus Other Survey Modes — A Meta-analysis Comparing Response Rates.” International Journal of Market Research 50(1): 79–104.

Mannesto, G. and J. B. Loomis. 1991. “Evaluation of Mail and In-person Contingent Value Surveys — Results of a Study of Recreational Boaters.” Journal of Environmental Management 32(2): 177–190.

Marta-Pedroso, C., H. Freitas, and T. Domingos. 2007. “Testing for the Survey Mode Effect on Contingent Valuation Data Quality: A Case Study of Web Based Versus In-person Interviews.” Ecological Economics 62: 388–398.

Mathews, K. E., M. L. Freeman, and W. H. Desvouges. 2006. “How and How Much? The Role of Information in Stated Choice Questionnaires.” In: Valuing Environmental Amenities Using Stated Choice Studies, B. Kanninen, ed., Springer.

Mattsson, L. and C. Z. Li. 1994. “Sample Nonresponse in a Mail Contingent Valuation Survey — An Empirical-test of the Effect on Value Inference.” Journal of Leisure Research 26(2): 182–188.

McFadden, D. 1999. “Rationality for Economists?” Journal Risk Uncertainly 19(1–3): 73–105.

Meyerhoff, J. and U. Liebe. 2009. “Status Quo Effect in Choice Experiments: Empirical Evidence on Attitudes and Choice Task Complexity.” Land Economics 85(3): 515–528.

Mitchell, R. C. and R. T. Carson. 1989. “Using Surveys to Value Public Goods: The Contingent Valuation Method.” Resources for the Future, Washington DC.

Navrud, S. 1997. “Communciation Devices in Contingent Valuation Surveys — Experiments With Video.” In: Determining the Value of Non-marketed Goods: Economics, Psychological and Policy Relevant Aspects of Contingent Valuation, R. J. Kopp, W.-W. Pommerehne, and N. Schwartz, eds., Holland: Kluwer Academic Publishers.

Navrud, S. and G. Pruckner. 1997. “Environmental Valuation — To Use or Not to Use? A Comparative Study of the United States and Europe.” Environmental and Resource Economics 10(1): 1–26.

Nielsen, J. S. 2011. “Use of the Internet for Willingness-to-pay Surveys. A Comparison of Face-To-Face and Web-Based Interviews.” Resource and Energy Economics 33(1): 119–129.

Olsen, S. B. 2009. “Choosing Between Internet and Mail Survey Modes for Choice Experiment Surveys Considering Non-Market Goods.” Environmental and Resource Economics 44(4): 591–610.

Olsen, S. B., T. H. Lundhede, J. B. Jacobsen, and B. J. Thorsen. 2011. “Tough and Easy Choices: Testing the Influence of Utility Difference on Stated Certainty-in-Choice in Choice Experiments.” Environmental and Resource Economics 49(4): 491–510.

Payne, J. W., J. R. Bettman, and D. A. Schade. 1999. “Measuring Constructed Preferences: Towards a Building Code.” Journal of Risk and Uncertainty 19(1–3): 243–270.

Rookey, B. D., S. Hanway and D. A. Dillman. 2008. “Does a Probability-Based Household Panel Benefit from Assignment to Postal Response as an Alternative to Internet-Only?” Public Opinion Quarterly 72(5): 962–984.

Sanders, D., H. D. Clarke, M. C. Stewart, and P. Whiteley. 2007. “Does Mode Matter for Modeling Political Choice? Evidence from the 2005 British Election Study.” Political Analysis 257–285.

Schkade, D. and D. Kahneman. 1998. “Does Living in California make People Happy? A Focusing Illusion in Judgments of Life Satisfaction.” Psychology Science 9: 340–346.

Schulze, W., G. McClelland, D. Waldman, and J. H. Lazo. 1996. “Sources of Bias in Contingent Valuation.” In: The Contingent Valuation of Environmental Resources: Methodological Resources and Research Needs, D. J. Bjornstad and J. Kahn, eds., Edward Elgar.

Schuman, H. 1996. “The Sensitivity of CV Outcomes to CV Survey Methods.” In: The Contingent Valuation of Environmental Resources: Methodological Issues and Research Needs, D. J. Bjornstad and J. Kahn, eds., Edward Elgar.

Schwappach, D. L. B. and T. J. Strasman. 2006. “Quick and Dirty Numbers? The Reliability of a Stated-preference Technique for the Measurement of Preferences for Resource Allocation.” Journal of Health Economics 25: 432–448.

Shaikh, S. L., L. Sun, and G. C. van. Kooten. 2007. “Treating Respondent Uncertainty in Contingent Valuation: A Comparison of Empirical Treatments.” Ecological Economics 62(1): 115–125.

Shih, T. H. and X. T. Fan. 2008. “Comparing Response Rates FromWeb and Mail Surveys: A Meta-analysis.” Field Methods 20(3): 249–271.

Shogren, J. F. 2005. “Experimental Methods and Valuation.” In: Handbook of Environmental Economics, K.-G. Maler and J. R. Vincent, eds., Amsterdam: North Holland.

Simon, H. A. 1956. “Rational Choice and the Structure of the Environment.” Psychological Review 63(2): 129–138.

Smith, R. D. 2006. “It’s Not Just What You Do, It’s the Way You Do It: The Effect of Different Payment Card Formats and Survey Administration on Willingness to Pay for Health Gains.” Health Economics 15: 281–293.

Smith, V. K. 2000. “JEEM and Non-market Valuation: 1974–1998.” Journal of Environmental Economics and Management 39(3): 351–374.

Stocke, V. and C. Hunkler. 2007. “Measures of Desirability Beliefs and Their Validity as Indicators for Socially Desirable Responding.” Field Methods 19(3): 313–336.

Taylor, P. A., N. M. Nelson, B. D. Grandjean, B. Anatchkova, and D. Aadland. 2009. “Mode Effects and Other Potential Biases in Panel-based Internet Surveys: Final Report.” Available from: http://yosemite1.epa.gov/ee/epa/eerm.nsf/Author/A62D95 F235503D03852575A800674D75, USEPA.

Thurston, H. W. 2006. “Non-market Valuation on the Internet.” In: Handbook on Contingent Valuation, A. Alberini and J. Kahn, eds., Edward Elgar.

Toepoel, V., C. Vis, M. Das, and A. van Soest. 2009. “Design of Web Questionnaires An Information-Processing Perspective for the Effect of Response Categories.” Sociological Methods and Research 37(3): 371–392.

Tourangeau, R., M. P. Couper, and F. Conrad. 2004. “Spacing, Position, and Order — Interpretive Heuristics for Visual Features of Survey Questions.” Public Opinion Quarterly 68(3): 368–393.

Tourangeau, R., M. P. Couper, and F. Conrad. 2007. “Color, Labels, and Interpretive Heuristics for Response Scales.” Public Opinion Quarterly 71(1): 91–112.

Tourangeau, R., R. M. Groves, C. Kennedy, and T. Yan. 2009. “The Presentation of a Web Survey, Nonresponse and Measurement Error among Members of Web Panel.” Journal of Official Statistics 25(3): 299–321.

Tourangeau, R., R. M. Groves, and C. D. Redline. 2010. “Sensitive Topics and Reluctant Respondents Demonstrating a Link Between Nonresponse Bias and Measurement Error.” Public Opinion Quarterly 74(3): 413–432.

Tourangeau, R., L. J. Rips, and K. A. Rasinski. 2000. The Psychology of Survey Response, Cambridge: Cambridge University Press.

Tsuge, T. and T. Washida. 2003. “Economic Valuation of the Seto Inland Sea by Using an Internet CV Survey.” Marine Pollution Bulletin 47: 230–236.

van der Heide, C. M., J. C. J. M. van den Bergh, E. C. van Ierland, and P. A. L. D. Nunes. 2008. “Economic Valuation of Habitat Defragmentation: A Study of the Veluwe, the Netherlands.” Ecological Economics 67: 205–216.

Vista, A. B., R. S. Rosenberger, and A. R. Collins. 2009. “If You Provide it, Will They Read It? Response Time Effects in a Choice Experiment.” Canadian Journal of Agricultural Economics 57(3): 365–377.

Whitehead, J. C., P. A. Groothuis, and G. C. Blomquist. 1993. “Testing For Nonresponse and Sample Selection Bias in Contingent Valuation—Analysis of a Combination Phone Mail Survey.” Economics Letters 41(2): 215–220.

Whittaker, D., J. J. Vaske, M. P. Donnelly, and D. S. DeRuiter. 1998. “Mail Versus Telephone Surveys: Potential Biases in Expenditure and Willingness-to-pay.” Journal of Park and Recreation Administration 16(3): 15–30.

Whittington, D., V. K. Smith, A. Okorafor, A. Okore, J. L. Liu, and A. McPhail. 1992. “Giving Respondents Time to Think in Contingent Valuation Studies — A Developing- Country Application.” Journal of Environmental Economics and Management 22(3): 205–225.

Windle, J. and J. Rolfe. 2011. “Comparing Responses From Internet and Paper-Based Collection Methods in More Complex Stated Preference Environmental Surveys.” Economic Analysis and Policy 41(1): 83–97.

Yeager, D. S., J. Krosnick, L. Chang, H. S. Javitz, M. S. Levindusky, A. Simpser, and R. Wang. 2009. Comparing the Accuracy of RDD Telephone Surveys and Internet Surveys Conducted with Probability and Non-probability Samples, Stanford University