Intertemporal stability of survey-based measures of risk and time preferences

Drichoutis, Andreas C. and Vassilopoulos, Achilleas (2016): Intertemporal stability of survey-based measures of risk and time preferences.

Abstract

Given the importance of risk and time preferences for economics and other disciplines, we seek to examine the intertemporal stability of six related survey-based measures. Using a panel of subjects over three waves, between 2013 and 2015, we find remarkably high aggregate stability over the examined period in all six measures while we observe significant patterns of instability at the individual level. Our results contribute to the discussion on the wider adoption of survey-based measures, especially considering the ease with which such measures can be incorporated in large-scale surveys.

• Item Type: MPRA Paper
• Language: English
• Keywords: patience; impulsiveness; cognitive reflection test; DOSPERT
• Subjects: D - Microeconomics > D8 - Information, Knowledge, and Uncertainty > D80 - General; D - Microeconomics > D9 - Intertemporal Choice > D90 - General

References

Aklin, W. M., M. T. Tull, C. W. Kahler, and C. Lejuez (2009). Risk-Taking Propensity Changes Throughout the Course of Residential Substance Abuse Treatment. Personality and individual dfferences 46 (4), 454-459.

Andersen, S., G. W. Harrison, M. I. Lau, and E. E. Rutstrom (2008a). Eliciting risk and time preferences. Econometrica 76 (3), 583-618.

Andersen, S., G. W. Harrison, M. I. Lau, and E. E. Rutstrom (2008b). Lost in state pace: Are preferences stable? International Economic Review 49 (3), 1091-1112.

Andersen, S., G. W. Harrison, M. I. Lau, and E. E. Rutstrom (2010). Preference heterogeneity in experiments: Comparing the _eld and laboratory. Journal of Economic Behavior and Organization 73 (2), 209-224.

Andreoni, J., M. A. Kuhn, and C. Sprenger (2015). Measuring time preferences: A comparison of experimental methods. Journal of Economic Behavior & Organization 116, 451-464.

Andreoni, J. and C. Sprenger (2012). Risk preferences are not time preferences. The American Economic Review 102 (7), 3357-3376.

Anokhin, A. P., S. Golosheykin, J. D. Grant, and A. C. Heath (2011). Heritability of Delay Discounting in Adolescence: A Longitudinal Twin Study. Behavior genetics 41 (2), 175-183.

Ashraf, N., D. Karlan, and W. Yin (2006). Tying Odysseus to the mast: Evidence from a commitment savings product in the Philippines. The Quarterly Journal of Economics, 635-672.

Baker, F., M. W. Johnson, and W. K. Bickel (2003). Delay discounting in current and never-before cigarette smokers: similarities and differences across commodity, sign, and magnitude. Journal of abnormal psychology 112 (3), 382.

Ballard, K. and B. Knutson (2009). Dissociable neural representations of future reward magnitude and delay during temporal discounting. NeuroImage 45 (1), 143-150.

Barseghyan, L., J. Prince, and J. C. Teitelbaum (2011). Are risk preferences stable across contexts? Evidence from insurance data. The American Economic Review 101 (2), 591-631.

Baucells, M. and A. Villass (2010). Stability of risk preferences and the reflection effect of prospect theory. Theory and Decision 68 (1), 193-211.

Belot, M., R. Duch, and L. Miller (2010). Who should be called to the lab? A comprehensive comparison of students and non-students in classic experimental games. Discussion Paper 2010001, University of Oxford, Nuffield College.

Bickel, W. K., R. Yi, R. D. Landes, P. F. Hill, and C. Baxter (2011). Remember the future: working memory training decreases delay discounting among stimulant addicts. Biological Psychiatry 69 (3), 260-265.

Blais, A.-R. and E. U. Weber (2006). A domain-speci_c risk-taking (DOSPERT) scale for adult populations. Judgment and Decision Making 1 (33-47).

Borghans, L. and B. H. Golsteyn (2006). Time discounting and the body mass index: Evidence from the Netherlands. Economics & Human Biology 4 (1), 39-61.

Bradford, W. D., P. Dolan, and M. M. Galizzi (2014). Looking ahead: Subjective time perception and individual discounting. Center for Economic Performance Discussion Paper No 1255.

Chabris, C. F., D. Laibson, C. L. Morris, J. P. Schuldt, and D. Taubinsky (2008). Individual laboratory-measured discount rates predict field behavior. Journal of Risk and Uncertainty 37 (2-3), 237-269.

Charness, G., U. Gneezy, and A. Imas (2013). Experimental methods: Eliciting risk preferences. Journal of Economic Behavior & Organization 87, 43-51.

Chuang, Y. and L. Schechter (2015). Stability of experimental and survey measures of risk, time, and social preferences: A review and some new results. Journal of Development Economics 117, 151-170.

Coller, M. and M. Williams (1999). Eliciting individual discount rates. Experimental Economics 2 (2), 107-127.

Coppola, M. (2014). Eliciting risk-preferences in socio-economic surveys: How do different measures perform? The Journal of Socio-Economics 48 (0), 1-10.

Dean, M. and A. Sautmann (2014). Credit constraints and the measurement of time preferences. Unpublished Manuscript.

Deck, C. A., J. Lee, J. A. Reyes, and C. Rosen (2008). Measuring risk attitudes controlling for personality traits. Available at SSRN 1148521.

Dohmen, T., A. Falk, D. Hu_man, U. Sunde, J. Schupp, and G. G.Wagner (2011). Individual risk attitudes: Measurement, determinants, and behavioral consequences. Journal of the European Economic Association 9 (3), 522-550.

Dreber, A., D. G. Rand, N. Wernerfelt, J. R. Garcia, M. G. Vilar, J. K. Lum, and R. Zeckhauser (2011). Dopamine and risk choices in di_erent domains: Findings among serious tournament bridge players. Journal of Risk and Uncertainty 43 (1), 19-38.

Drichoutis, A. C. and R. M. J. Nayga (2013). A reconciliation of time preference elicitation methods. Munich Personal RePEc Archive Paper No. 46916.

Eckel, C. C. and P. J. Grossman (2002). Sex di_erences and statistical stereotyping in attitudes toward financial risk. Evolution and human behavior 23 (4), 281-295.

Eckel, C. C. and P. J. Grossman (2008). Forecasting risk attitudes: An experimental study using actual and forecast gamble choices. Journal of Economic Behavior & Organization 68 (1), 1-17.

Einav, L., A. Finkelstein, I. Pascu, and M. R. Cullen (2012). How general are risk preferences? Choices under uncertainty in different domains. The American economic review 102 (6), 2606-2638.

Epps, T. W. and K. J. Singleton (1986). An omnibus test for the two-sample problem using the empirical characteristic function. Journal of Statistical Computation and Simulation 26 (3-4), 177-203.

Frederick, S. (2005). Cognitive reection and decision making. Journal of Economic Perspectives 19 (4), 25-42.

Gine, X., J. Goldberg, D. Silverman, and D. Yang (2016). Revising Commitments: Field Evidence on the Adjustment of Prior Choices. The Economic Journal.

Glockner, A. and T. Pachur (2012). Cognitive models of risky choice: Parameter stability and predictive accuracy of prospect theory. Cognition 123 (1), 21-32.

Gneezy, U. and J. Potters (1997). An experiment on risk taking and evaluation periods. The Quarterly Journal of Economics, 631-645.

Goerg, S. J. and J. Kaiser (2009). Nonparametric testing of distributions-the Epps Singleton two-sample test using the empirical characteristic function. The Stata Journal 9 (3), 454-465.

Goldstein, D. G., E. J. Johnson, and W. F. Sharpe (2008). Choosing outcomes versus choosing products: Consumer-focused retirement investment advice. Journal of Consumer Research 35 (3), 440-456.

Halevy, Y. (2015). Time Consistency: Stationarity and Time Invariance. Econometrica 83 (1), 335-352.

Harrison, G. W., E. Johnson, M. M. McInnes, and E. E. Rutstrom (2005). Temporal stability of estimates of risk aversion. Applied Financial Economics Letters 1 (1), 31-35.

Harrison, G. W., M. I. Lau, E. E. Rutstrom, and M. B. Sullivan (2005). Eliciting risk and time preferences using field experiments: Some methodological issues. Field experiments in economics 10, 125-218.

Harrison, G. W., M. I. Lau, and H. I. Yoo (2014). Risk attitudes, sample selection and attrition in a longitudinal Field experiment. CEAR WorkingPaper 2014-4

Hey, J. D. (2001). Does repetition improve consistency? Experimental economics 4 (1), 5-54.

Holt, C. A. and S. K. Laury (2002). Risk aversion and incentive effects. The American Economic Review 92 (5), 1644-1655.

Horowitz, J. K. (1992). A test of intertemporal consistency. Journal of Economic Behavior & Organization 17 (1), 171-182.

Johnson, M. W., W. K. Bickel, and F. Baker (2007). Moderate drug use and delay discounting: a comparison of heavy, light, and never smokers. Experimental and clinical psychopharmacology 15 (2), 187.

Josef, A. K., D. Richter, G. R. Samanez-Larkin, G. G. Wagner, R. Hertwig, and R. Mata (2016). Stability and Change in Risk-Taking Propensity Across the Adult Life Span. Journal of Personality and Social Psychology.

Kable, J. W. and P. W. Glimcher (2007). The neural correlates of subjective value during intertemporal choice. Nature Neuroscience 10 (12), 1625-1633.

Kirby, K. N. (2009). One-year temporal stability of delay-discount rates. Psychonomic Bulletin & Review 16 (3), 457-462.

Kirby, K. N., R. Godoy, V. Reyes-Garca, E. Byron, L. Apaza, W. Leonard, E. Perez, V. Vadez, and D. Wilkie (2002). Correlates of delay-discount rates: Evidence from Tsimane'Amerindians of the Bolivian rain forest. Journal of Economic Psychology 23 (3), 291-316.

Kolmogorov, A. N. (1933). Sulla determinazione empirica di una legge di distribuzione. Giornale dell' Istituto Italiano degli Attuari 4, 83-91.

Lejuez, C. W., J. P. Read, C. W. Kahler, J. B. Richards, S. E. Ramsey, G. L. Stuart, D. R. Strong, and R. A. Brown (2002). Evaluation of a behavioral measure of risk taking: the Balloon Analogue Risk Task (BART). Journal of Experimental Psychology: Applied 8(2), 75.

Leuermann, A. and B. Roth (2012). Does good advice come cheap? - on the assessment of risk preferences in the lab and the field. SOEPpapers on Multidisciplinary Panel DataResearch No 475 .

Levin, I. P. and S. S. Hart (2003). Risk preferences in young children: Early evidence of individual differences in reaction to potential gains and losses. Journal of Behavioral Decision Making 16 (5), 397-413.

Levin, I. P., S. S. Hart, J. A. Weller, and L. A. Harshman (2007). Stability of choices in a risky decision-making task: a 3-year longitudinal study with children and adults. Journal of Behavioral Decision Making 20 (3), 241-252.

Li, Y., M. Baldassi, E. J. Johnson, and E. U. Weber (2013). Complementary Cognitive Capabilities, Economic Decision-Making, and Aging. Psychology and aging 28 (3), 595-613.

Littlefield, A. K., A. K. Stevens, S. Cunningham, R. E. Jones, K. M. King, J. A. Schumacher, and S. F. Cffey (2015). Stability and change in multi-method measures of impulsivity across residential addictions treatment. Addictive Behaviors 42, 126-129.

Lonnqvist, J.-E., M. Verkasalo, G. Walkowitz, and P. C. Wichardt (2015). Measuring individual risk attitudes in the lab: Task or ask? an empirical comparison. Journal of Economic Behavior & Organization 119, 254-266.

Love, R. O. and L. J. Robison (1984). An empirical analysis of the intertemporal stability of risk preference. Southern Journal of Agricultural Economics 16 (01), 159-166.

MacCrimmon, K. R. and D. A. Wehrung (1990). Characteristics of risk taking executives. Management science 36 (4), 422-435.

Mann, H. B. and D. R. Whitney (1947). On a test of whether one of two random variables is stochastically larger than the other. The Annals of Mathematical Statistics 18 (1), 50-60.

Mantziki, K., A. Vassilopoulos, G. Radulian, J.-M. Borys, H. du Plessis, M. J. a. Gregorio, P. Graca, S. de Henauw, S. Handjiev, T. L. Visscher, and J. C. Seidell (2014). Promoting health equity in European children: Design and methodology of the prospective EPHE (Epode for the Promotion of Health Equity) evaluation study. BMC Public Health 14, 303.

McGlothlin, W. H. (1956). Stability of Choices among Uncertain Alternatives. The American Journal of Psychology 69 (4), 604-615.

Meier, S. and C. Sprenger (2010). Present-biased preferences and credit card borrowing. American Economic Journal: Applied Economics 2 (1), 193-210.

Meier, S. and C. D. Sprenger (2012). Time Discounting Predicts Creditworthiness. Psychological Science 23 (1), 56-58.

Meier, S. and C. D. Sprenger (2015). Temporal stability of time preferences. The Review of Economics and Statistics 97 (2), 273-286.

Mischel, W., Y. Shoda, and M. L. Rodriguez (1989). Delay of gratification in children. Science 244 (4907), 933-938.

Niv, S., C. Tuvblad, A. Raine, P. Wang, and L. A. Baker (2012). Heritability and longitudinal Stability of Impulsivity in Adolescence. Behavior Genetics 42 (3), 378-392.

Ohmura, Y., T. Takahashi, N. Kitamura, and P. Wehr (2006). Three-month stability of delay and probability discounting measures. Experimental and Clinical Psychopharmacology 14 (3), 318-328.

Olson, S. L., E. M. Schilling, and J. E. Bates (1999). Measurement of Impulsivity: Construct Coherence, Longitudinal Stability, and Relationship with Externalizing Problems in Middle Childhood and Adolescence. Journal of Abnormal Child Psychology 27 (2), 151-165.

Peters, J. and C. Buchel (2009). Overlapping and Distinct Neural Systems Code for Subjective Value during Intertemporal and Risky Decision Making. The Journal of Neuroscience 29 (50), 15727-15734.

Schoemaker, P. and J. C. Hershey (1992). Utility measurement: Signal, noise, and bias. Organizational Behavior and Human Decision Processes 52 (3), 397-424.

Sharpe, W. F., D. G. Goldstein, and P. W. Blythe (2000). The distribution builder: A tool for inferring investor preferences. Unpublished Manuscript.

Shiryayev, A. N. (1992). On the empirical determination of a distribution law. In A. N. Shiryayev (Ed.), Selected Works of A. N. Kolmogorov: Volume II Probability Theory and Mathematical Statistics, pp. 139-146. Dordrecht: Springer Netherlands.

Simpson, C. A. and R. E. Vuchinich (2000). Reliability of a measure of temporal discounting. The Psychological Record 50 (1), 3.

Smidts, A. (1997). The relationship between risk attitude and strength of preference: A test of intrinsic risk attitude. Management Science 43 (3), 357-370.

Smirnov, N. (1948). Table for estimating the goodness of fit of empirical distributions. The Annals of Mathematical Statistics 19 (2), 279-281.

Stigler, G. J. and G. S. Becker (1977). De Gustibus Non Est Disputandum. The American Economic Review 67 (2), 76-90.

Straznicka, K. (2012). Temporal stability of risk preference measures. Groupe d'Analyse et de Theorie Economique Lyon - St _ Etienne Working Paper No. 1236.

Szrek, H., L.-W. Chao, S. Ramlagan, and K. Peltzer (2012). Predicting (un)healthy behavior: A comparison of risk-taking propensity measures. Judgment and Decision Making 7 (6), 716-727.

Takahashi, T., A. Furukawa, T. Miyakawa, H. Maesato, and S. Higuchi (2007). Two-month stability of hyperbolic discount rates for delayed monetary gains in abstinent inpatient alcoholics. Neuro Endocrinology Letters 28 (2), 131-136.

Vischer, T., T. Dohmen, A. Falk, D. Hu_man, J. Schupp, U. Sunde, and G. G. Wagner (2013). Validating an ultra-short survey measure of patience. Economics Letters 120 (2), 142145.

Weber, E. U., A.-R. Blais, and N. E. Betz (2002). A domain-speci_c risk-attitude scale: measuring risk perceptions and risk behaviors. Journal of Behavioral Decision Making 15 (4), 263-290.

Wehrung, D. A., K. R. MacCrimmon, and K. M. Brothers (1984). Utility assessment: Domains, stability, and equivalence procedures. INFOR: Information Systems and Operational Research 22 (2), 98-115.

White, T. L., C. W. Lejuez, and H. de Wit (2008). Test-Retest Characteristics of the Balloon Analogue Risk Task (BART). Experimental and clinical psychopharmacology 16 (6), 565-570.

Wilcoxon, F. (1945). Individual comparisons by ranking methods. Biometrics Bulletin 1 (6),80-83.

Wolbert, E. and A. Riedl (2013). Measuring time and risk preferences: Reliability, stability, domain specificity. CESifo Working Paper Series No. 4339 .

Zeisberger, S., D. Vrecko, and T. Langer (2012). Measuring the time stability of prospect theory preferences. Theory and Decision 72 (3), 359-386.