Polar Bear Population Forecasts: A Public-Policy Forecasting Audit

Armstrong, J. Scott and Green, Kesten C. and Soon, Willie (2007): Polar Bear Population Forecasts: A Public-Policy Forecasting Audit.

Abstract

The extinction of polar bears by the end of the 21st century has been predicted and calls have been made to list them as a threatened species under the U.S. Endangered Species Act. The decision on whether or not to list rests upon forecasts of what will happen to the bears over the 21st Century. Scientific research on forecasting, conducted since the 1930s, has led to an extensive set of principles—evidence-based procedures—that describe which methods are appropriate under given conditions. The principles of forecasting have been published and are easily available. We assessed polar bear population forecasts in light of these scientific principles. Much research has been published on forecasting polar bear populations. Using an Internet search, we located roughly 1,000 such papers. None of them made reference to the scientific literature on forecasting. We examined references in the nine unpublished government reports that were prepared “…to Support U.S. Fish and Wildlife Service Polar Bear Listing Decision.” The papers did not include references to works on scientific forecasting methodology. Of the nine papers written to support the listing, we judged two to be the most relevant to the decision: Amstrup, Marcot and Douglas et al. (2007), which we refer to as AMD, and Hunter et al. (2007), which we refer to as H6 to represent the six authors. AMD’s forecasts were the product of a complex causal chain. For the first link in the chain, AMD assumed that General Circulation Models (GCMs) are valid. However, the GCM models are not valid as a forecasting method and are not reliable for forecasting at a regional level as being considered by AMD and H6, thus breaking the chain. Nevertheless, we audited their conditional forecasts of what would happen to the polar bear population assuming that the extent of summer sea ice will decrease substantially in the coming decades. AMD could not be rated against 26 relevant principles because the paper did not contain enough information. In all, AMD violated 73 of the 90 forecasting principles we were able to rate. They used two un-validated methods and relied on only one polar bear expert to specify variables, relationships, and inputs into their models. The expert then adjusted the models until the outputs conformed to his expectations. In effect, the forecasts were the opinions of a single expert unaided by forecasting principles. Based on research to date, approaches based on unaided expert opinion are inappropriate to forecasting in situations with high complexity and much uncertainty. Our audit of the second most relevant paper, H6, found that it was also based on faulty forecasting methodology. For example, it extrapolated nearly 100 years into the future on the basis of only five years of data – and data for these years were of doubtful validity. In summary, experts’ predictions, unaided by evidence-based forecasting procedures, should play no role in this decision. Without scientific forecasts of a substantial decline of the polar bear population and of net benefits from feasible policies arising from listing polar bears, a decision to list polar bears as threatened or endangered would be irresponsible.

• Item Type: MPRA Paper
• Language: English
• Keywords: adaptation, bias, climate change, decision making, endangered species, expert opinion, evaluation, evidence-based principles, expert judgment, extinction, forecasting methods, global warming, habitat loss, mathematical models, scientific method, sea ice
• Subjects: C - Mathematical and Quantitative Methods > C5 - Econometric Modeling > C53 - Forecasting and Prediction Methods ; Simulation Methods; H - Public Economics > H0 - General; C - Mathematical and Quantitative Methods > C5 - Econometric Modeling; C - Mathematical and Quantitative Methods > C0 - General; H - Public Economics > H2 - Taxation, Subsidies, and Revenue > H23 - Externalities ; Redistributive Effects ; Environmental Taxes and Subsidies; C - Mathematical and Quantitative Methods > C4 - Econometric and Statistical Methods: Special Topics

References

Amstrup, S.C, Marcot, B.G. and Douglas, D.C. (2007). Forecasting the rangewide status of polar bears at selected times in the 21st century. USGS Alaska Science Center, Anchorage, Administrative Report. Amstrup, S.C., McDonald, T.L. and Durner, G.M. (2004). Using satellite radiotelemetry data to delineate and manage wildlife populations. Wildlife Society Bulletin, 32, 661-679. Amstrup, S.C., McDonald, T.L. and Stirling, I. (2001). Polar bears in the Beaufort Sea: A 30-year mark-recapture case history. Journal of Agricultural, Biological, and Environmental Statistics, 6, 221-234. Amstrup, S.C., Stirling, I. and Lentfer, J.W. (1986). Past and present status of polar bears in Alaska. Wildlife Society Bulletin, 14, 241-254. Angliss, R.P., and Outlaw, R.B. (2007). Alaska marine mammal stock assessments, 2006. U.S. Dep. Commer., NOAA Tech. Memo. NMFS-AFSC-168, 244 p. Available at http://www.nmfs.noaa.gov/pr/pdfs/sars/ak2006.pdf Armstrong, J.S. (1978; 1985). Long-Range Forecasting: From Crystal Ball to Computer. New York: Wiley-Interscience. Armstrong, J.S. (1980). The Seer-sucker theory: The value of experts in forecasting. Technology Review 83 (June-July), 16-24. Armstrong, J.S. (2001). Principles of Forecasting: A Handbook for Researchers and Practitioners. Kluwer Academic Publishers. Ascher W. 1978. Forecasting: An Appraisal for Policy Makers and Planners. Baltimore: Johns Hopkins University Press. Bergen, S., Durner, G. M., Douglas, D. C. and Amstrup, S. C. (2007). Predicting movements of female Polar bears between summer sea ice foraging habitats and terrestrial denning habitats of Alaska in the 21st Century: Proposed Methodology and Pilot Assessment, USGS Alaska Science Center, Anchorage, Administrative Report. Brigham-Grette, J., and Hopkins, D.M. (1995). Emergent marine record and paleoclimate of the Last Interglaciation along the Northwest Alaskan coast. Quaternary Research, 43, 159-173. Cerf, C. and Navasky, V. (1998). The Experts Speak. New York: Pantheon. Baltimore, MD: Johns Hopkins University Press. DeWeaver, E. (2007). Uncertainty in climate model projections of Arctic sea ice decline: An evaluation relevant to polar bears. USGS Alaska Science Center, Anchorage, Administrative Report. Durner, G.M., Douglas, D.C. Nielson, R.M. Amstrup, S.C. and McDonald, T.L. (2007). Predicting the future distribution of polar bear habitat in the Polar Basin from resource selection functions applied to 21st century general circulation model projections of sea ice. USGS Alaska Science Center, Anchorage, Administrative Report. Dyck, M.G., and Romberg, S. (2007). Observations of a wild polar bear (Ursus maritimus) successfully fishing Arctic charr (Salvelinus alpinus) and Fourhorn sculpin (Myoxocephalus quadricornis). Polar Biology, 30, 1625-1628. Dyck, M.G., Soon, W., Baydack, R.K., Legates, D.R., Baliunas, S., Ball, T.F., and Hancock, L.O. (2007). Polar bears of western Hudson Bay and climate change: Are warming spring air temperatures the “ultimate” survival control factor? Ecological Complexity, 4, 73-84. Green, K.C. and Armstrong, J.S. (2007), Global warming: forecasts by scientists versus scientific forecasts. Energy and Environment, 18, 997-1021. Hamilton, T.D., and Brigham-Grette, J. (1991). The last interglaciation in Alaska: Stratigraphy and paleoecology of potential sites. Quaternary International, 10-12, 49-71. Holloway, G., Sou, T. (2002). Has Arctic sea ice rapidly thinned? Journal of Climate, 15, 1691-1701. Hunter, C.M., Caswell, H., Runge, M.C., Amstrup, S.C., Regehr, E.V. and Stirling I. (2007). Polar bears in the Southern Beaufort Sea II: Demography and population growth in relation to sea ice conditions. USGS Alaska Science Center, Anchorage, Administrative Report. Makridakis, S., Wheelwright, S.C., and Hyndman, R.J. (1998). Forecasting: Methods and Applications (3rd ed.), Hoboken, NJ: John Wiley. Melling, H., Riedel, D.A., and Gedalof, Z. (2005). Trends in the draft and extent of seasonal pack ice, Canadian Beaufort Sea. Geophysical Research Letters, 32, L24501, doi:10.1029/2005GL024483. Nghiem, S.V., Rigor, I.G., Perovich, D.K., Clemente-Colon, P., Weatherly, J.W., and Neumann, G. (2007). Ra[id reduction of Arctic perennial sea ice. Geophysical Research Letters, 34, L19504, doi:10.1029/2007GL031138 Norgaard-Pedersen, N., Mikkelsen, N., Lassen, S.J., Kristoffersen, Y., and Sheldon, E. (2007). Reduced sea ice concentrations in the Arctic Ocean during the last interglacial period revealed by sediment cores off northern Greenland. Paleoceanography, 22, PA1218, doi:10.1029/2006PA001283. Obbard, M.E., McDonald, T.L. Howe, E.J. Regehr, E.V. and Richardson, E.S. (2007). Trends in abundance and survival for polar bears from Southern Hudson Bay, Canada, 1984-2005. USGS Alaska Science Center, Anchorage, Administrative Report. Ogi, M., and Wallace, J.M. (2007). Summer minimum Arctic sea ice extent and the associated summer atmospheric circulation. Geophysical Research Letters, 34, L12705, doi:10.1029/2007GL029897 Regehr, E.V., Hunter, C.M. Caswell, H. Amstrup, S.C. and Stirling, I. (2007). Polar bears in the Southern Beaufort Sea I: Survival and breeding in relation to sea ice conditions, 2001-2006. USGS Alaska Science Center, Anchorage, Administrative Report. Richter-Menge, J. and Coauthors (2007). State of the climate in 2006: Arctic. Bulletin of the American Meteorological Society, 88, S62-S71. Rode, K. D., Amstrup, S. C., and Regehr, E.V. (2007), Polar bears in the Southern Beaufort Sea III: Stature, mass, and cub recruitment in relationship to time and sea ice extent between 1982 and 2006. USGS Alaska Science Center, Anchorage, Administrative Report. Soon, W., Baliunas, S., Idso, S. B., Kondratyev, K. Ya., Posmentier, E. S. (2001). Modeling climatic effects of anthropogenic carbon dioxide emissions: Unknowns and uncertainties. Climate Research, 18, 259 – 275. Stempniewicz, L. 2006. Polar bear predatory behaviour toward moulting barnacle geese and nesting glaucous gulls on Spitsbergen. Arctic, 59. 247-251. Stirling, I. (2002). Polar bears and seals in the Eastern Beaufort Sea and Amundsen Gulf: A synthesis of population trends and ecological relationships over three decades. Arctic, 55 (Suppl. 1), 59-76. Stirling, I., McDonald, T.L. Richardson, E.S. and Regehr, E.V. (2007). Polar bear population status in the Northern Beaufort Sea. USGS Alaska Science Center, Anchorage, Administrative Report. Tetlock, P.E. (2005). Expert Political Judgment: How Good Is It? How Can We Know? Princeton, NJ: Princeton University Press. Zhang, J. (2007). Increasing Antarctic sea ice under warming atmospheric and oceanic conditions. Journal of Climate, 20, 2515-2529.