Stochastic choice and imperfect judgments of line lengths: What is hiding in the noise?

Sean, Duffy and John, Smith (2023): Stochastic choice and imperfect judgments of line lengths: What is hiding in the noise?

Abstract

Noise is a pervasive feature of economic choice. However, standard economics experiments are not well equipped to study the noise because experiments are constrained: preferences are either unknown or only imperfectly measured by experimenters. As a result of these designs--where the optimal choice is not observable to the analyst--many important questions about the noise in apparently random choice cannot be addressed. We design an experiment to better understand stochastic choice by directing subjects to make incentivized binary choices between lines. Subjects are paid a function of the length of the selected line, so subjects will attempt to select the longer of the lines. We find a gradual (not sudden) relationship between the difference in the lengths of the lines and the optimal choice. Our analysis suggests that the errors are better described as having a Gumbel distribution rather than a normal distribution, and our simulated data increase our confidence in this inference. We find evidence that suboptimal choices are associated with longer response times than optimal choices, which appears to be consistent with the predictions of Fudenberg, Strack, and Strzalecki (2018). Although we note that the relationship between response time and the optimality of choice becomes weaker across trials. In our experiment, 54 of 56 triples are consistent with Strong Stochastic Transitivity and this is the median outcome in our simulated data. Finally, we find a relationship between choice and attention, although we find strong evidence that the relationship is endogenous.

• Item Type: MPRA Paper
• Language: English
• Keywords: Stochastic transitivity, choice theory, judgment, memory, search
• Subjects: C - Mathematical and Quantitative Methods > C9 - Design of Experiments > C91 - Laboratory, Individual Behavior; D - Microeconomics > D1 - Household Behavior and Family Economics > D12 - Consumer Economics: Empirical Analysis

References

Agranov, Marina and Ortoleva, Pietro (2017): "Stochastic choice and preferences for randomization," Journal of Political Economy, 125(1), 40--68.

Ahn, David S. and Sarver, Todd (2013): "Preference for flexibility and random choice," Econometrica, 81(1), 341--361.

Alós-Ferrer, Carlos, Fehr, Ernst, and Netzer, Nick (2021): "Time will tell: Recovering preferences when choices are noisy," Journal of Political Economy, 129(6), 1828--1877.

Alós-Ferrer, Carlos and Garagnani, Michele (2021): "Choice consistency and strength of preference," Economics Letters, 198, 109672.

Alós-Ferrer, Carlos and Garagnani, Michele (2022a): "Strength of preference and decisions under risk," Journal of Risk and Uncertainty, 64, 309--329.

Alós-Ferrer, Carlos and Garagnani, Michele (2022b): "The gradual nature of economic errors," Journal of Economic Behavior and Organization, 200, 55--66.

Alós-Ferrer, Carlos, Granić, Đura-Georg, Kern, Johannes, and Wagner, Alexander K. (2016): "Preference reversals: Time and again," Journal of Risk and Uncertainty, 52(1), 65--97.

Ariely, Dan, Gneezy, Uri, Loewenstein, George, and Mazar, Nina (2009): "Large Stakes and Big Mistakes," Review of Economic Studies, 76(2), 451--469.

Armel, K. Carrie and Rangel, Antonio (2008): "The Impact of Computation Time and Experience on Decision Values," American Economic Review, 98(2), 163--168.

Ballinger, T. Parker and Wilcox, Nathaniel T. (1997): "Decisions, error and heterogeneity," Economic Journal, 107(443), 1090--1105.

Baranski, Joseph V. and Petrusic, William M. (1999): "Realism of confidence in sensory discrimination," Perception and Psychophysics, 61(7), 1369--1383.

Bhui, Rahul (2019a): "A statistical test for the optimality of deliberative time allocation," Psychonomic Bulletin and Review, 26(3), 855--867.

Bhui, Rahul (2019b): "Testing optimal timing in value-linked decision making," Computational Brain and Behavior, 2(2), 85--94.

Blavatskyy, Pavlo R. and Pogrebna, Ganna (2010): "Models of stochastic choice and decision theories: Why both are important for analyzing decisions," Journal of Applied Econometrics, 25(6), 963--986.

Bowers, Dawn and Heilman, Kenneth M. (1980): "Pseudoneglect: Effects of hemispace on a tactile line bisection task," Neuropsychologia, 18(4-5), 491--498.

Brañas-Garza, Pablo and Smith, John (2023): "Imperfect perception and stochastic choice in experiments," working paper.

Butler, David J. and Loomes, Graham C. (2007): "Imprecision as an account of the preference reversal phenomenon," American Economic Review, 97(1), 277--297.

Camerer, Colin F. and Hogarth, Robin M. (1999): "The effects of financial incentives in experiments: A review and capital-labor-production framework," Journal of Risk and Uncertainty, 19(1), 7--42.

Caplin, Andrew, Csaba, Dániel, Leahy, John, and Nov, Oded (2020): "Rational inattention, competitive supply, and psychometrics," Quarterly Journal of Economics, 135(3), 1681--1724.

Caplin, Andrew and Dean, Mark (2015): "Revealed preference, rational inattention, and costly information acquisition," American Economic Review, 105(7), 2183--2203.

Cattell, J. McKeen (1902): "The time of perception as a measure of differences in intensity," Philosophische Studien, 19, 63--68.

Cerreia-Vioglio, Simone, Dillenberger, David, Ortoleva, Pietro, and Riella, Gil (2019): "Deliberately stochastic," American Economic Review, 109(7), 2425--2445.

Charles, Jennifer, Sahraie, Arash, and McGeorge, Peter (2007): "Hemispatial asymmetries in judgment of stimulus size," Perception and Psychophysics, 69, 687--698.

Charness, Gary, and Kuhn, Peter (2011): "Lab labor: What can labor economists learn from the lab?" Handbook of Labor Economics, 4, 229--330.

Civelli, Andrea, Deck, Cary and Tutino, Antonella (2022): "Attention and choices with multiple states and actions: A laboratory experiment," Journal of Economic Behavior and Organization, 199, 86--102.

Corgnet, Brice, Hernán-González, Roberto, and Kujal, Praveen (2020): "On booms that never bust: Ambiguity in experimental asset markets with bubbles," Journal of Economic Dynamics and Control, 110, 103754.

Dean, Mark, and Neligh, Nathaniel (2022): "Experimental tests of rational inattention," Working paper, Columbia University.

Debreu, Gerard (1958): "Stochastic choice and cardinal utility," Econometrica, 26(3), 440-444.

Dewan, Ambuj and Neligh, Nathaniel (2020): "Estimating information cost functions in models of rational inattention," Journal of Economic Theory, 187, 105011.

Dickinson, David L. (1999): "An experimental examination of labor supply and work intensities," Journal of Labor Economics, 17(4), 638--670.

Duffy, Sean, Gussman, Steven, and Smith, John (2021): "Visual judgments of length in the economics laboratory: Are there brains in stochastic choice?" Journal of Behavioral and Experimental Economics, 93, 101708.

Duffy, Sean and Smith, John (2022): "An economist and a psychologist form a line: What can imperfect perception of length tell us about stochastic choice?" Working paper, Rutgers University-Camden.

Dutilh, Gilles and Rieskamp, Jörg (2016): "Comparing perceptual and preferential decision making," Psychonomic Bulletin and Review, 23(3), 723--737.

Echenique, Federico and Saito, Kota (2017): "Response time and utility," Journal of Economic Behavior and Organization, 139, 49--59.

Falmagne, Jean-Claude (2002): Elements of Psychophysical Theory. Oxford University Press: New York.

Fechner, Gustav Theodor (1860): Elemente der Psychophysik. (Elements of psychophysics, translated 1966. Holt, Rinehart, and Winston, New York.)

Frederick, Shane (2005): "Cognitive reflection and decision making," Journal of Economic Perspectives, 19(4), 25--42.

Fudenberg, Drew, Strack, Philipp, and Strzalecki, Tomasz (2018): "Speed, accuracy, and the optimal timing of choices," American Economic Review, 108(12), 3651--3684.

Gerasimou, Georgios (2021): "Simple preference intensity comparisons," Journal of Economic Theory, 192, 105199.

Gescheider, George A. (1997): Psychophysics: The Fundamentals. Routledge Press, New York.

Gneezy, Uri and Rustichini, Aldo (2000): "Pay enough or don't pay at all," Quarterly Journal of Economics, 115(3), 791--810.

Goryunov, Maxim and Rigos, Alexandros (2022): "Discontinuous and continuous stochastic choice and coordination in the lab," Journal of Economic Theory, 206, 105557.

Heng, Joseph A., Woodford, Michael, and Polania, Rafael (2020): "Efficient sampling and noisy decisions," eLife, 9, e54962.

Henmon, V. A. C. (1911): "The relation of the time of a judgment to its accuracy," Psychological Review, 18(3), 186--201.

Hey, John D. (2005): "Why we should not be silent about noise," Experimental Economics, 8(4), 325--345.

Hey, John D. and Orme, Chris (1994): "Investigating generalizations of expected utility theory using experimental data," Econometrica, 62(6), 1291--1326.

Jesteadt, Walt, Luce, R. Duncan, and Green, David M. (1977): "Sequential effects in judgments of loudness," Journal of Experimental Psychology: Human Perception and Performance, 3(1), 92--104.

Kamenica, Emir (2012): "Behavioral economics and psychology of incentives," Annual Review of Economics, 4(1), 427--452.

Kellogg, W. N. (1931): "The time of judgment in psychometric measures," American Journal of Psychology, 43(1), 65--86.

Kingdom, Frederick A. and Prins, Nicolaas (2016): Psychophysics: A Practical Introduction. San Diego: Elsevier Science and Technology.

Konovalov, Arkady and Krajbich, Ian (2019): "Revealed strength of preference: Inference from response times," Judgment and Decision Making, 14(4), 381--394.

Krajbich, Ian (2019): "Accounting for attention in sequential sampling models of decision making," Current Opinion in Psychology, 29, 6--11.

Krajbich, Ian, Armel, Carrie, and Rangel, Antonio (2010): "Visual fixations and the computation and comparison of value in simple choice," Nature Neuroscience, 13(10), 1292--1298.

Krajbich, Ian and Rangel, Antonio (2011): "Multialternative drift-diffusion model predicts the relationship between visual fixations and choice in value-based decisions," Proceedings of the National Academy of Sciences, 108(33), 13852--13857.

Laming, Donald and Laming, Janet (1992): "F. Hegelmaier: On memory for the length of a line," Psychological Research, 54(4), 233--239.

Loomes, Graham, Starmer, Chris, and Sugden, Robert (1989): "Preference reversal: information-processing effect or rational non-transitive choice?" Economic Journal, 99(395), 140--151.

Luce, R. Duncan (1959): Individual choice behavior: A theoretical analysis. Wiley: New York.

Luce, R. Duncan and Suppes, Patrick (1965): "Preference, Utility and Subjective Probability," In Handbook of Mathematical Psychology, (Eds.) Luce, R. Duncan, Bush, Robert R., Galanter, Eugene, Wiley, New York, 3, 249--410.

Manzini, Paola, and Mariotti, Marco (2014): "Stochastic choice and consideration sets," Econometrica, 82(3), 1153--1176.

Masatlioglu, Yusufcan, Nakajima, Daisuke, and Ozbay, Erkut Y. (2012): "Revealed Attention," American Economic Review, 102(5), 2183--2205.

Matějka, Filip and McKay, Alisdair (2015): "Rational inattention to discrete choices: A new foundation for the multinomial logit model," American Economic Review, 105(1), 272--98.

McFadden, Daniel (1974): "Conditional Logit Analysis of Qualitative Choice Behavior," in Frontiers in Econometrics, Zarembka, Paul (Ed.), New York, Academic Press, 105--142.

McFadden, Daniel (2001): "Economic choices," American Economic Review, 91(3), 351--378.

Moffatt, Peter G. (2005): "Stochastic choice and the allocation of cognitive effort," Experimental Economics, 8(4), 369--388.

Mosteller, Frederick and Nogee, Philip (1951): "An experimental measurement of utility," Journal of Political Economy, 59(5), 371--404.

Münsterberg, Hugo (1894): "Studies from the Harvard Psychological Laboratory: (I)," Psychological Review, 1(1), 34--60.

Nicholls, Michael ER, Bradshaw, John L., and Mattingley, Jason B. (1999): "Free-viewing perceptual asymmetries for the judgement of brightness, numerosity and size," Neuropsychologia, 37(3), 307--314.

Nicholls, Michael ER, Mattingley, Jason B., Berberovic, Nadja, Smith, Amanda, and Bradshaw, John L. (2004): "An investigation of the relationship between free-viewing perceptual asymmetries for vertical and horizontal stimuli," Cognitive Brain Research, 19(3), 289--301.

Olsson, Henrik and Winman, Anders (1996): "Underconfidence in sensory discrimination: The interaction between experimental setting and response strategies," Perception and Psychophysics, 58(3), 374--382.

Oud, Bastiaan, Krajbich, Ian, Miller, Kevin, Cheong, Jin Hyun, Botvinick, Matthew, and Fehr, Ernst (2016): "Irrational time allocation in decision-making," Proceedings of the Royal Society B: Biological Sciences, 283(1822), 20151439.

Payne, John W., Bettman, James R., and Johnson, Eric J. (1993): The Adaptive Decision Maker. Cambridge University Press, Cambridge UK.

Payzan-LeNestour, Elise and Woodford, Michael (2022): "Outlier blindness: A neurobiological foundation for neglect of financial risk," Journal of Financial Economics, 143(3), 1316--1343.

Petzold, Peter and Haubensak, Gert (2004): "The influence of category membership of stimuli on sequential effects in magnitude judgment," Perception and Psychophysics, 66(4), 665--678.

Pirrone, Angelo, Wen, Wen, and Li, Sheng (2018): "Single-trial dynamics explain magnitude sensitive decision making," BMC Neuroscience, 19, 54.

Pleskac, Timothy J., Yu, Shuli, Hopwood, Christopher, and Liu, Taosheng (2019): "Mechanisms of deliberation during preferential choice: Perspectives from computational modeling and individual differences," Decision, 6(1), 77--107.

Pokorny, Kathrin (2008): "Pay---but do not pay too much: An experimental study on the impact of incentives," Journal of Economic Behavior and Organization, 66(2), 251--264.

Read, Daniel (2005): "Monetary incentives, what are they good for?" Journal of Economic Methodology, 12(2), 265--276.

Regenwetter, Michel, Dana, Jason, and Davis-Stober, Clintin P. (2011): "Transitivity of preferences," Psychological Review, 118(1), 42--56.

Regenwetter, Michel and Davis-Stober, Clintin P. (2018): "The role of independence and stationarity in probabilistic models of binary choice," Journal of Behavioral Decision Making, 31(1), 100--114.

Regenwetter, Michel, Davis-Stober, Clintin. P., Lim, Shiau Hong, Guo, Ying, Popova, Anna, Zwilling, Chris, Cha, Yun-Shil, Messner, William (2014): "QTest: Quantitative testing of theories of binary choice," Decision, 1(1), 2--34.

Reutskaja, Elena, Nagel, Rosemarie, Camerer, Colin F., and Rangel, Antonio (2011): "Search dynamics in consumer choice under time pressure: An eye-tracking study." American Economic Review, 101(2), 900--926.

Saito, Kota (2015): "Preferences for flexibility and randomization under uncertainty," American Economic Review, 105(3), 1246--1271.

Shevlin, Blair R. K., Smith, Stephanie M., Hausfeld, Jan, and Krajbich, Ian (2022): "High-value decisions are fast and accurate, inconsistent with diminishing value sensitivity," Proceedings of the National Academy of Sciences, 119(6), e2101508119.

Sillamaa, Mary-Anne (1999a): "How work effort responds to wage taxation: An experimental test of a zero top marginal tax rate," Journal of Public Economics, 73(1), 125--134.

Sillamaa, Mary-Anne (1999b): "How work effort responds to wage taxation: A non-linear versus a linear tax experiment," Journal of Economic Behavior and Organization, 39(2), 219--233.

Smith, Vernon L. (1976): "Experimental economics: Induced value theory," American Economic Review, 66(2), 274--279.

Sopher, Barry and Gigliotti, Gary (1993): "Intransitive cycles: Rational Choice or random error? An answer based on estimation of error rates with experimental data," Theory and Decision, 35, 311--336.

Stevens, S. S. (1957): "On the Psychophysical Law," Psychological Review, 64(3), 153--181.

Stevens, S. S. (1961): "To honor Fechner and repeal his law," Science, 133(3446), 80--86.

Suavansri, Ketchai, Falchook, Adam D., Williamson, John B., and Heilman, Kenneth M. (2012): "Right up there: Hemispatial and hand asymmetries of altitudinal pseudoneglect," Brain and Cognition, 79(3), 216--220.

Teghtsoonian, Robert (1971): "On the exponents in Stevens' Law and the constant in Ekman's Law," Psychological Review, 78(1), 71--80.

Thurstone, L. L. (1927a): "A law of comparative judgment," Psychological Review, 34(4), 273--286.

Thurstone, L. L. (1927b): "Psychophysical Analysis," American Journal of Psychology, 38(3), 368--389.

Treisman, Michel and Williams, Thomas C. (1984): "A theory of criterion setting with an application to sequential dependencies," Psychological Review, 91(1), 68--111.

Tsetsos, Konstantinos, Moran, Rani, Moreland, James, Chater, Nick, Usher, Marius and Summerfield, Christopher (2016): "Economic irrationality is optimal during noisy decision making," Proceedings of the National Academy of Sciences, 113(11), 3102--3107.

Tversky, Amos (1969): "Intransitivity of preferences," Psychological Review, 76(1), 31--48.

Verplanck, William S., Collier, George H., and Cotton, John W. (1952): "Nonindependence of successive responses in measurements of the visual threshold," Journal of Experimental Psychology, 44(4), 273--283.

Volkmann, John (1934): "The relation of the time of judgment to the certainty of judgment," Psychological Bulletin, 31(9), 672--673.

Weber, Ernst (1834): De Tactu. (The Sense of Touch, translated 1978. Academic Press, New York.)

Willemsen, Martijn C. and Johnson Eric J. (2019): "(Re) visiting the decision factory: Observing cognition with MouselabWEB," in A handbook of process tracing methods, Schulte-Mecklenbeck, Michael, Kuehberger, Anton, and Johnson, Joseph G. (Eds.), Routledge, New York, 76--95.

Woodford, Michael (2014): "Stochastic choice: An optimizing neuroeconomic model," American Economic Review, 104(5), 495--500.

Yellott, John I. (1977): "The relationship between Luce's Choice Axiom, Thurstone's Theory of Comparative Judgment, and the double exponential distribution," Journal of Mathematical Psychology, 15(2), 109--144.

Zeigenfuse, Matthew D., Pleskac, Timothy J. and Liu, Taosheng (2014): "Rapid decisions from experience," Cognition, 131(2), 181--194.