On the dynamics of the responses in Frydman and Jin (2022): Nullius in verba

Hertel, Johanna and Igan, Deniz and Smith, John (2023): On the dynamics of the responses in Frydman and Jin (2022): Nullius in verba.

Abstract

Frydman and Jin (2022) ["Efficient coding and risky choice," Quarterly Journal of Economics, 137, 161---213] present a model of efficient coding whereby decision makers are Bayesian learners of a stochastic distribution. The model predicts that decision makers will devote more cognitive resources to---and therefore be more sensitive to--values that appear more frequently. The authors conduct two experiments where subjects make binary choices between a certain amount and a lottery, where the trial-specific values are drawn from a stochastic distribution. While unknown to the subjects, the distribution can be learned over the course of the experiment. The authors conclude that the observations are consistent with efficient coding. However, we note that the authors do not examine observations across trials. When we examine the data from Experiment 1, we do not find evidence that the relationship between sensitivity and frequency increased across trials. When we include specifications that account for the parameters in the previous trial, the treatment interaction estimates are no longer significant. The effects identified by Frydman and Jin (2022) in Experiment 1 are simply a recency bias and not the result of Bayesian learning. We find that subjects in Experiment 2 are less---not more---sensitive to values they encounter more frequently. In summary, we do not find support for the central claims made by the authors. Finally, we describe some unreported details in the preregistration reports of Frydman and Jin (2022). We encourage economists to exercise more skepticism until convinced by the authors' arguments.

• Item Type: MPRA Paper
• Language: English
• Keywords: data reanalysis, Bayesian learning, Bob Critique
• Subjects: C - Mathematical and Quantitative Methods > C3 - Multiple or Simultaneous Equation Models ; Multiple Variables > C30 - General; G - Financial Economics > G0 - General > G02 - Behavioral Finance: Underlying Principles

References

Aczel, Balazs, et al., "A consensus-based transparency checklist." Nature Human Behaviour, 4 (2020), 4--6.

Barlow, Horace, "Possible Principles Underlying the Transformations of Sensory Messages," in Sensory Communication, Walter A. Rosenblith, ed. (Cambridge,MA: MIT Press, 1961), 217--234.

Blackwell, David, and Lester Dubins, "Merging of opinions with increasing information," Annals of Mathematical Statistics, 33 (1962), 882--886.

Bush, Robert R., and Frederick Mosteller, Stochastic Models for Learning, (1955), Wiley, New York.

Camerer, Colin F., et al., "Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015," Nature Human Behaviour, 2 (2018), 637--644.

Duffy, Sean, Janellen Huttenlocher, Larry V. Hedges, and L. Elizabeth Crawford, "Category effects on stimulus estimation: Shifting and skewed frequency distributions," Psychonomic Bulletin & Review, 17 (2010), 224--230.

Duffy, Sean, Johanna Hertel, Deniz Igan, Marcelo Pinheiro, and John Smith, "On Bayesian integration in sensorimotor learning: Another look at Kording and Wolpert (2004)," Cortex, 153 (2022), 87-96.

Duffy, Sean, and John Smith, "Category effects on stimulus estimation: Shifting and skewed frequency distributions---A reexamination," Psychonomic Bulletin & Review, 25 (2018), 1740--1750.

Duffy, Sean, and John Smith, "On the Category Adjustment Model: Another look at Huttenlocher, Hedges, and Vevea (2000)," Mind and Society, 19 (2020), 163--193.

Edwards, Ward, Harold Lindman, and Leonard J. Savage, "Bayesian statistical inference for psychological research," Psychological Review, 70 (1963), 193--242.

Estes, William K. "The problem of inference from curves based on group data," Psychological Bulletin, 53 (1956), 134--140.

Frydman, Cary, and Lawrence J. Jin, "Efficient coding and risky choice," Quarterly Journal of Economics, 137 (2022),161--213.

Girshick, Ahna R., Michael S. Landy, and Eero P. Simoncelli, "Cardinal Rules: Visual Orientation Perception Reflects Knowledge of Environmental Statistics," Nature Neuroscience, 14 (2011), 926--932.

Hayes, K. J. (1953). The backward curve: A method for the study of learning. Psychological Review, 60, 269--275.

Heng, Joseph, Michael Woodford, and Rafael Polanía, "Efficient Sampling and Noisy Decisions," eLife, 9 (2020), e54962

Huttenlocher, Janellen, Larry V. Hedges, and Jack L. Vevea, "Why do categories affect stimulus judgment?" Journal of Experimental Psychology: General, 129 (2000), 220--241.

Körding, Konrad P., and Daniel M. Wolpert, "Bayesian integration in sensorimotor learning," Nature, 427 (2004), 244--247.

Laughlin, Simon, "A Simple Coding Procedure Enhances a Neuron's Information Capacity," Zeitschrift fur Naturforschung, 36 (1981), 910--912.

Munafò, Marcus R., and George Davey Smith, "Robust research needs many lines of evidence," Nature, 553 (2018), 399-401.

Munafò, Marcus R., et al., "A manifesto for reproducible science," Nature Human Behaviour, 1 (2017), 0021.

Pan, Wei , "Akaike's information criterion in generalized estimating equations," Biometrics, 57 (2001), 120--125.

Payzan-LeNestour, Elise, and Michael Woodford, "Outlier Blindness: A Neurobiological Foundation for Neglect of Financial Risk," Journal of Financial Economics, 143 (2022), 1316--1343.

Polanía, Rafael, Michael Woodford, and Christian Ruff, "Efficient Coding of Subjective Value," Nature Neuroscience, 22 (2019), 134--142.

Rahnev, Dobromir, et al., "The Confidence Database," Nature Human Behaviour, 4 (2020), 317--325.

Rahnev, Dobromir, and Rachel N. Denison, "Suboptimality in perceptual decision making," Behavioral and Brain Sciences, 41 (2018), E223.

Rustichini, Aldo, Katherine E. Conen, Xinying Cai, and Camillo Padoa-Schioppa, "Optimal Coding and Neuronal Adaptation in Economic Decisions," Nature Communications, 8 (2017), 1208.

Savage, Leonard J., The Foundations of Statistics, (1954), Wiley, New York.

Siegler, R. S. (1987). The perils of averaging data over strategies: An example from children's addition. Journal of Experimental Psychology: General, 116, 250--264.

Wei, Xue-Xin, and Alan A. Stocker, "A Bayesian Observer Model Constrained by Efficient Coding Can Explain 'Anti-Bayesian' Percepts," Nature Neuroscience,18 (2015), 1509--1517.

Wei, Xue-Xin, and Alan A. Stocker, "Lawful Relation between Perceptual Bias and Discriminability," Proceedings of the National Academy of Sciences, 114 (2017), 10244--10249.