Category effects on stimulus estimation: Shifting and skewed frequency distributions - A reexamination

Duffy, Sean and Smith, John (2017): Category effects on stimulus estimation: Shifting and skewed frequency distributions - A reexamination.

Abstract

Duffy, Huttenlocher, Hedges, and Crawford (2010) [Psychonomic Bulletin & Review, 17(2), 224-230] report on experiments where participants estimate the lengths of lines. These studies were designed to test the Category Adjustment Model (CAM), a Bayesian model of judgments. CAM predicts that there will exist a bias toward the running mean of the lines and that judgments will not be differentially affected by recent stimuli. The authors report that their analysis provides evidence consistent with CAM. We reexamine their data. First, we attempt to replicate their analysis and we obtain different results. Second, we conduct a different statistical analysis. We find significant recency effects and we identify several specifications where the running mean is not significantly related to judgment. Third, we conduct a test of an auxiliary prediction of CAM: that the bias towards the mean will increase with exposure to the distribution. We do not find such a relationship. Fourth, we produce a simulated dataset that is consistent with CAM and our methods correctly identify it as consistent with CAM. We conclude that the Duffy et al. (2010) dataset is not consistent with CAM. We also discuss how conventions in psychology do not sufficiently reduce the likelihood of these mistakes in future research.

• Item Type: MPRA Paper
• Language: English
• Keywords: judgment; memory; Category Adjustment Model; central tendency bias; recency effects; Bayesian judgments
• Subjects: C - Mathematical and Quantitative Methods > C9 - Design of Experiments > C91 - Laboratory, Individual Behavior

References

Allred, S., Crawford, L.E., Duffy, S., & Smith, J. (2017). Working memory and spatial judgments: Cognitive load increases the central tendency bias. Psychonomic Bulletin & Review, forthcoming.

Bowers, J. S., & Davis, C. J. (2012). Bayesian just-so stories in psychology and neuroscience. Psychological Bulletin, 138(3), 389-414.

Duffy, S., Huttenlocher, J., Hedges, L. V., & Crawford, L. E. (2010). Category effects on stimulus estimation: Shifting and skewed frequency distributions. Psychonomic Bulletin & Review, 17, 224-230.

Goldstone, R. (1994). Influences of categorization on perceptual discrimination. Journal of Experimental Psychology: General, 23, 178-200.

Hollingworth, H. L. (1910). The central tendency of judgment. The Journal of Philosophy, Psychology and Scientific Methods, 7(17), 461-469.

Huttenlocher, J., Hedges, L. V., & Vevea, J. L. (2000). Why do categories affect stimulus judgment? Journal of Experimental Psychology: General, 129, 220-241.

Sailor, K. M., & Antoine, M. (2005). Is memory for stimulus magnitude Bayesian? Memory & Cognition, 33, 840-851.