Terminology and Methodology for Benchmarking Foresight Programmes

Havas, Attila (2005): Terminology and Methodology for Benchmarking Foresight Programmes.

Abstract

This report, prepared for the ForSociety ERANET project, addresses a need to develop a common language and approach in comparing national foresight programmes. An appropriate terminology and methodology is particularly important, as foresight activities in various countries are characterised by a high level of diversity of structures, as well as varying levels of maturity, intensity, and efforts. This is often based on a diversity of perception and understanding of the role of foresight, linked to differing country context and approach. A meaningful comparison of foresight depends on a deeper understanding of the background to the evolution of foresight in each country and the template developed in this report is aimed at providing this level of detail. The report is organised in three parts: (1) the underlying concepts and framework for benchmarking – presenting (a) an overview of evolutionary economics of innovation, as a theoretical background, (b) a taxonomy of foresight programmes, as well as (c) the concept of intelligent benchmarking –; (2) a template for individual programme descriptions, together with (3) a glossary of key terms. The report claims that mechanistic or naïve benchmarking is likely to produce misleading policy conclusions. Intelligent benchmarking – learning by comparison, taking into account the broader context – is a more promising way forward. There is no ‘one best way’, and thus actual foresight programmes should not be benchmarked against an ‘ideal’, ‘optimal’ or ‘best practice’ design of foresight. They can be benchmarked against 3-4 ‘ideal types’ of future-oriented programmes, and this can lead to meaningful methodological and policy lessons.

• Item Type: MPRA Paper
• Language: English
• Keywords: Technology foresight; A taxonomy of technology foresight programmes; Intelligent benchmarking; Evolutionary economics of innovation; National innovation systems; Science, technology and innovation policies
• Subjects: B - History of Economic Thought, Methodology, and Heterodox Approaches > B5 - Current Heterodox Approaches > B52 - Institutional ; Evolutionary; O - Economic Development, Innovation, Technological Change, and Growth > O3 - Innovation ; Research and Development ; Technological Change ; Intellectual Property Rights > O38 - Government Policy

References

Aichholzer, Georg [2001a]: Searching for leadership in innovation niches: Technology Foresight in Austria, Proceedings of International Conference on Technology Foresight, NISTEP, 7-8 March 2001, Tokyo.

Aichholzer, Georg [2001b]: The Austrian foresight program: organization and expert profile, International Journal of Technology Management, Vol. 21, No. 7-8, pp. 739-755.

Barré, Rémi [2001]: Synthesis of Technology Foresight, in: Strategic Policy Intelligence: Current trends, the state of play and perspectives, pp. 71-88, ESTO, IPTS Technical Report Series, EUR 20137 EN, Sevilla.

Barré, Rémi [2002]: Foresights and Their Themes: Analysis, typology and perspectives, in: The role of Foresight in the Selection of Research Policy Priorities, 13-14 May, 2002, Conference papers, pp. 88-109.

Blind, Knut, Kerstin Cuhls and Hariolf Grupp [1999]: Current Foresight Activities in Central Europe, Technological Forecasting and Social Change, Vol. 60, No. 1, pp. 15-35.

Cassingena Harper, Jennifer [2003]: EFORESEE Project report on Malta Foresight Pilot: Exploring knowledge futures in information and communications technologies and education in 2020, manuscript, Malta: MCST.

Coates, Joseph F. [1985]: Foresight in Federal Government Policymaking, Futures Research Quarterly, Summer 1985, pp. 29-53.

Cuhls, Kerstin [2003]: From forecasting to foresight processes: New participative foresight activities in Germany, Journal of Forecasting, Vol. 22, No. 2-3, pp. 93-111.

Cuhls, Kerstin, Knut Blind and Hariolf Grupp [2002]: Innovations for our Future, Delphi '98: New foresight on science and technology, Physica-Verlag, Heidelberg, 2002.

DACCST [1999]: Dawn of the African Century: A Nation at work through Science and Technology for a better future, Department of Arts, Culture, Science and Technology: Pretoria.

Dodgson, Mark and John Bessant [1996]: Effective Innovation Policy: A new approach, London: International Thomson.

Dodgson, Mark and Roy Rothwell (eds) [1994]: The Handbook of Industrial Innovation, Cheltenham: Edward Elgar.

Dosi, Giovanni [1988a]: The nature of the innovative process, in Dosi et al. (eds.) [1988]

Dosi, Giovanni [1988b]: Sources, procedures and microeconomic effects of innovation, Journal of Economic Literature, Vol. 26, September, pp. 1120-1171.

Dosi, Giovanni [1992]: The research on innovation diffusion: An assessment, in: Nakicenovic, N. and Grübler, A. (eds.): Diffusion of Technologies and Social Behaviour, Berlin: Springer-Verlag, pp. 179-208.

Dosi, Giovanni, Christopher Freeman and Silvia Fabiani [1994]: The process of economic development: Introducing some stylized facts and theories on technologies, firms and institutions, Industrial and Corporate Change, Vol. 3, No. 1, pp. 1-45.

Dosi, Giovanni, Christopher Freeman, Richard R. Nelson, Gerald Silverberg, and Luc Soete (eds) [1988]: Technical Change and Economic Theory, London: Pinter.

EC [2000]: Innovation policy in a knowledge-based economy, Luxembourg: Office for Official Publications of the European Communities, EUR 17023.

EC [2003]: European Innovation Scoreboard 2003, CORDIS focus supplement, Luxembourg: European Commission, Enterprise Directorate-General.

EC DG Research [2002]: Thinking, debating and shaping the future: Foresight for Europe, final report of the High Level Expert Group, Office for Official Publications of the European Communities, Luxembourg.

Edquist, Charles (ed.) [1997]: Systems of Innovations: Technologies, institutions and organizations, London: Pinter.

Ergas, Henry [1987]: The importance of technology policy, in: Partha Dasgupta and Paul Stoneman (eds): Economic Policy and Technological Performance, Cambridge: Cambridge University Press, pp. 51-96.

EUROFORE [2003]: European Foresight Competence Mapping (Pilot) Project, final report, Seville: JRC/IPTS-ESTO.

Fageberg, Jan [2003]: The Potential of Benchmarking as a Tool for Policy Learning, IPTS Report, No. 71, pp. 13-19.

Fagerberg, Jan, David C. Mowery and Richard R. Nelson (eds) [2005]: The Oxford Handbook of Innovation, Oxford: Oxford UP.

Fleissner, Peter et al. [1998]: Recent national foresight studies, IPTS: Sevilla.

FOREN [2001]: A Practical Guide to Regional Foresight, Foresight for Regional Development Network, European Commission, Research Directorate General, Strata Programme, Brussels.

Freeman, Christopher [1991]: Networks of innovators, a synthesis of research issues, Research Policy, Vol. 20, No. 5, pp.499-514.

Freeman, Christopher [1994a]: The economics of technical change: A critical survey, Cambridge Journal of Economics, Vol. 18, No. 5, pp. 463-514.

Freeman, Christopher [1994b]: Marching to the Sound of a Different Drum, paper presented at the EUNETIC Conference on “Evolutionary Economics of Technological Change: Assessment of results and new frontiers”, Strasbourg, 6-8 October.

Freeman, Christopher [1995]: The ‘National System of Innovation' in historical perspective, Cambridge Journal of Economics, Vol. 19, No. 1, pp. 5-24.

Freeman, Christopher and Luc Soete [1997]: The Economics of Industrial Innovation [3rd edn], London: Pinter.

Garvin, David A. [1993]: Building a learning organisation, Harvard Business Review, Vol. 71, No. 4, pp. 78-91.

Gavigan James P. and Eamon Cahill [1997]: Overview of recent European and non-European national technology foresight studies, IPTS: Sevilla.

Georghiou, Luke [1996]: The UK Technology Foresight Programme, Futures, Vol. 28, No. 4, pp. 359-377.

Georghiou, Luke [2001]: Third Generation Foresight: Integrating the Socio-economic Dimension, in: Technology Foresight - the approach to and potential for New Technology Foresight, Conference proceedings, NISTEP Research Material 77.

Georghiou, Luke [2002]: Policy rationales, sponsors and objectives, presentation at the eFORESEE Workshop on Foresight Basics, Malta, 24-26 July 2002.

Godet, Michel [2001]: Creating Futures: Scenario planning as a strategic management tool, London: Economica.

Grupp, Hariolf [1996]: Foresight in Science and Technology: Selected methodologies and recent activities in Germany, OECD STI Review, Special Issue on Government Technology Foresight Exercises, No. 17, pp. 71-100.

Grupp, Hariolf and Harold A. Linstone [1999]: National Technology Foresight Activities Around the Globe: Resurrection and New Paradigms, Technological Forecasting and Social Change, Vol. 60, No. 1, pp. 85-94.

Havas, Attila [2003a]: Evolving Foresight in a Small Transition Economy, Journal of Forecasting, Vol. 22, No. 2-3, pp. 179-201.

Havas, Attila [2003b]: The Relevance of Foresight for Accession Countries and Possibilities for Co-operation, IPTS Report, No. 73, pp. 4-11.

Johnston, Ron [2002]: The State and Contribution of International Foresight: New challenges, in: The role of Foresight in the Selection of Research Policy Priorities, 13-14 May, 2002, Conference papers, pp. 59-74.

Joss, Simon and Sergio Belluci (eds) [2002]: Participatory Technology Assessment: European perspectives, London: Centre for the Study of Democracy, University of Westminster.

Keenan, Michael [2003]: Strategic Framework for Scoping Technology Foresight, in: UNIDO [2003], pp. 34-52.

Klusacek, Karel [2004]: Technology foresight in the Czech Republic, International Journal of Foresight and Innovation Policy, Vol. 1, No. 1-2, pp. 89-105.

Kuwahara, Terutaka [1996]: Technology Foresight in Japan: A new approach in methodology and analysis, OECD STI Review, Special Issue on Government Technology Foresight Exercises, No. 17, pp. 52-70.

Kuwahara, Terutaka [1999]: Technology Forecasting Activities in Japan, Technological Forecasting and Social Change Vol. 60, No. 1, pp. 5-14.

Kuwahara, Terutaka [2004]: Technology Foresight in Japan, presentation at a UNIDO Seminar on Technology Foresight Methods and Practices for Ukraine, 31 August - 4 September, Kiev.

Lipsey, Richard G. and Kenneth Carlaw [1998]: Technology policies in neo-classical and structuralist-evolutionary models, STI Review, No. 22, pp. 31-73.

Lundvall, Bengt-Åke (ed.) [1992]: National Systems of Innovation: Towards a theory of innovation and interactive learning, London: Pinter.

Lundvall, Bengt-Åke and Susana Borrás [1999]: The Globalising Learning Economy: Implications for Innovation Policy, Luxembourg: Office for Official Publications of the European Communities.

Lundvall, Bengt-Åke and Mark Tomlinson [2002]: International benchmarking as a policy learning tool, in: Maria João Rodrigues (ed.): The New Knowledge Economy in Europe, pp. 203-231, Cheltenham: Edward Elgar.

Lundvall, Bengt-Åke, Björn Johnson, Esben Sloth Andersen, Bent Dalum [2002]: National systems of production, innovation and competence building, Research Policy, Vol. 31, No. 2, pp. 213-231.

Malerba, Franco [2002]: Sectoral systems of innovation and production, Research Policy, Vol. 31, No. 2, pp. 247-264.

Martin, Ben [1996]: Technology Foresight: A review of recent government exercises, OECD STI Review, Special Issue on Government Technology Foresight Exercises, No. 17, pp. 15-50.

Martin, Ben and John Irvine [1989]: Research Foresight: Priority-setting in science, Pinter Publishers: London and New York.

Martin, Ben and Ron Johnston [1999]: Technology Foresight for Wiring up the National Innovation System: Experiences in Britain, Australia and New Zealand, Technological Forecasting and Social Change, Vol. 60, No. 1, pp. 37-54.

Molitor, Graham T.T. [2000]: Five Economic Activities Likely to Dominate the New Millennium: III Life Sciences Era, Technological Forecasting and Social Change, Vol. 65, No. 3, pp. 297-310.

Metcalfe, Stanley J. and Luke Georghiou [1998]: Equilibrium and evolutionary foundations of technology policy, STI Review, No. 22, pp. 75-100.

Nelson, Richard R. (ed.) [1993]: National Innovation Systems: A comparative study, New York: Oxford University Press.

Nelson, Richard R. [1995]: Recent evolutionary theorizing about economic change, Journal of Economic Literature, Vol. 33, January, pp. 48-90.

Nelson, Richard R. and Sidney G. Winter [1982]: An Evolutionary Theory of Economic Change, Cambridge, Mass.: The Belknap Press of Harvard University.

Niosi, Jorge [2002]: National systems of innovation are “x-efficient” (and x-effective): Why some are slow learners, Research Policy, Vol. 31, No. 2, pp. 291-302.

OECD [1992]: TEP: The Key Relationships, Paris: OECD.

OECD [1997]: Creativity, Innovation and Job Creation, Paris: OECD.

OECD [1998]: New Rationale and Approaches in Technology and Innovation Policy, STI Review, No. 22.

OECD [2000]: Science, Technology and Industry Outlook 2000, Paris: OECD.

OECD [2001a]: OECD Science, Technology and Industry Scoreboard: Towards a knowledge based economy, 2001 edition, Paris: OECD.

OECD [2001b]: Innovative Networks: Co-operation in national innovation systems, Paris: OECD.

OECD [2002]: Science, Technology and Industry Outlook 2002, Paris: OECD.

OST [1998]: The Future in Focus: A summary of national foresight programmes, HMSO: London.

Pavitt, Keith [1984]: Patterns of technical change: Towards a taxonomy and theory, Research Policy, Vol. 13, No. 6, pp. 343-373.

Renn, Ortwin [2002]: Foresight and Multi-level Governance, in: The role of Foresight in the Selection of Research Policy Priorities, 13-14 May, 2002, Conference papers, pp. 35-45.

Salo, Ahti and Kerstin Cuhls (eds) [2003]: Special Issue on Technology Foresight, Journal of Forecasting, Vol. 22, No. 2-3.

Shin, Taeyoung [1998]: Using Delphi for a Long-Range Technology Forecasting and Assessing Directions of Future R&D Activities in Korea, Technological Forecasting and Social Change, Vol. 58, No. 1-2, pp.125-154.

Shin, Taeyoung [2004]: Korean Delphi for Technology Forecasting and S&T Planning, presentation at a UNIDO seminar on Technology Foresight for Organizers, 13-17 December, Gebze, Turkey.

Smith, Keith [1997]: Economic Infrastructures and Innovation Systems, in: Edquist, Charles (ed.) [1997], pp. 86-106.

Smith, Keith [2001]: Comparing economic performance in the presence of diversity, Science and Public Policy, Vol. 28, No. 4, pp. 267-276.

Smith, Keith [2002]: What is the ‘Knowledge Economy'? Knowledge intensity and distributed knowledge bases, UNU/INTECH Discussion Paper Series, 2002-6.

Soete, Luc and Dimitri Corpakis [2003]: R&D for Competitiveness and Employment - The role of Benchmarking, IPTS Report, No. 71, pp. 2-12.

TAMI [2004]: Technology Assessment in Europe: Between Method and Impact.

Teubal, Morris [1998]: Enterprise restructuring and embeddedness: An innovation systems and policy perspective, paper presented at INTECH Conference on The Economics of Industrial Structure and Innovation Dynamics, Lisbon, 16-17 October.

Tidd, Joe, John Bessant and Keith Pavitt [1997]: Managing Innovation: Integrating technological, market and organizational change, Chichester: John Wiley & Sons.

Tümer, Turgut [2004]: Technology Foresight in Turkey: Vision 2023 Project, presentation at a UNIDO seminar on Technology Foresight for Organizers, 13-17 December, Gebze, Turkey.

UNIDO [2003]: Technology Foresight Methodologies, text book, Regional Initiative for Central and Eastern Europe (CEE) and the Newly Independent States (NIS), Training Module 2, Vienna: UNIDO.

Weber, Max [1947]: Legitimate Authority and Bureaucracy, in: The Theory of Social and Economic Organisation (translated and edited by A.M. Henderson and T. Parsons), pp. 328-340, Free Press {reprinted in D.S. Pugh (ed.) [1985]: Organization Theory: Selected readings, pp. 15-27, London: Penguin Group}.