Matching methods for impact evaluation of public subsidies to business R&D: Measuring heterogeneous effects

Heijs, Joost and Guerrero, Alex J. and Huergo, Elena (2020): Matching methods for impact evaluation of public subsidies to business R&D: Measuring heterogeneous effects.

Abstract

The objective of this paper is to offer a broad profile of firms with publicly supported R&D projects, which allows us to explain their different degrees of additionality. With this objective, in a first step we use standard Propensity Score Matching techniques to estimate treatment effects at the firm level, and then we explore the determinants of the heterogeneity in these individual effects through the estimation of an equation for their determinants. For our analysis, we use information from a sample of 8,168 Spanish firms for the period 2007-2014. We report three main results. First, firms with multiple program participation show higher additionality. However, individual treatment effects, which are positive for firms with low support intensities, go sharply below the average for firms with very high support intensities. Second, the degree of additionality is positively related to firm characteristics denoting a more innovative nature, while it is negatively associated with features present in firms involved in more market-oriented R&D projects. Third, firm size has a positive relation to the probability of full additionality, but a negative association with the degree of additionality in terms of net R&D intensity. These results can provide public agencies with some tools for adjusting their selection procedures.

• Item Type: MPRA Paper
• Language: English
• Keywords: R&D support; policy evaluation; heterogeneous treatment effects; propensity score matching
• Subjects: L - Industrial Organization > L2 - Firm Objectives, Organization, and Behavior > L25 - Firm Performance: Size, Diversification, and Scope; O - Economic Development, Innovation, Technological Change, and Growth > O3 - Innovation ; Research and Development ; Technological Change ; Intellectual Property Rights > O32 - Management of Technological Innovation and R&D

References

Afcha, S., & García-Quevedo, J. (2016). The impact of R&D subsidies on R&D employment composition. Industrial and Corporate Change, 25(6), 955-975.

Arrow, K. (1962). Economic welfare and the allocation of resources for invention. NBER Chapters, in: The Rate and Direction of Inventive Activity: Economic and Social Factors, pages 609-626, National Bureau of Economic Research, Inc.

Aschhoff, B. (2009). The effect of subsidies on R&D investment and success: Do subsidy history and size matter? ZEW Discussion Papers, No. 09-032, Zentrum für Europäische Wirtschaftsforschung (ZEW), Mannheim.

Beck, M., Lopes-Bento, C., & Schenker-Wicki, A. (2016). Radical or incremental: Where does R&D policy hit? Research Policy, 45(4), 869–883.

Blanes, J. V., & Busom, I. (2004). Who participates in R&D subsidy programs? The case of Spanish manufacturing firms. Research Policy, 33(10), 1459-1476.

Bogliacino, F., & Pianta, M. (2016). The Pavitt Taxonomy, revisited: Patterns of innovation in manufacturing and services. Economia Politica, 33, 153-180.

Busom, I. (2000). An empirical evaluation of the effects of R&D subsidies. Economics of Innovation and New Technology, 9(2), 111-148.

Buisseret, T., Cameron, H., & Georghiou, L. (1995). What difference does it make? Additionality in the public support of R&D in large firms, International Journal of Technology Management, 10(4/5/6), 587-600.

Caliendo, M., & Kopeinig, S. (2008). Some practical guidance for the implementation of propensity score matching. Journal of Economic Surveys, 22(1), 31-72.

Carboni, O. A. (2011). R&D subsidies and private R&D expenditures: Evidence from Italian manufacturing data. International Review of Applied Economics, 25(4), 419-439.

Cerulli, G., & Potì, B. (2012). Evaluating the robustness of the effect of public subsidies on firms' R&D: An application to Italy. Journal of Applied Economics, 15(2), 287-320.

Chapman, G., Lucena, A., & Afcha, S. (2018). R&D subsidies & external collaborative breadth: Differential gains and the role of collaboration experience. Research Policy, 47(3), 623-636.

Clausen, T. H. (2009). Do subsidies have positive impacts on R&D and innovation activities at the firm level? Structural Change and Economic Dynamics, 20(4), 239-253.

Colombo, M.G., Grilli, L., & Murtinu, S. (2011). R&D subsidies and the performance of high-tech start-ups. Economics Letters, 112(1), 97–99.

Correa, P., Andrés, L., & Borja-Vega, C. (2013). The impact of government support on firm R&D investments. A meta-analysis. Policy Research Working Paper 6532, Entrepreneurship and Innovation Unit, The World Bank.

Crespi, G., Giuliodori, D., Giuliodori, R., & Rodriguez, A. (2016). The effectiveness of tax incentives for R&D+i in developing countries: The case of Argentina. Research Policy, 45(10), 2023-2035.

Czarnitzki, D., & Delanote, J. (2015). R&D policies for young SMEs: Input and output effects. Small Business Economics, 45(3), 465-485.

Czarnitzki, D., & Hussinger, K. (2004). The link between R&D subsidies, R&D spending and technological performance. ZEW Discussion Papers 04-56, ZEW - Leibniz Centre for European Economic Research.

Czarnitzki, D., & Licht, G. (2006). Additionality of public R&D grants in a transition economy: The case of Eastern Germany. Economics of Transition, 14(1), 101-131.

Czarnitzki, D., & Lopes-Bento, C. (2013). Value for money? New microeconometric evidence on public R&D grants in Flanders. Research Policy, 42(1), 76-89.

Czarnitzki, D., & Lopes-Bento, C. (2014). Innovation subsidies: Does the funding source matter for innovation intensity and performance? Empirical evidence from Germany. Industry and Innovation, 21(5), 380-409.

Dachs, B., & Ebersberger, B. (2009). Does foreign ownership matter for the innovative activities of enterprises? International Economics and Economic Policy, 6(1), 41-57.

Dai, X., & Cheng, L. (2015). The effect of public subsidies on corporate R&D investment: An application of the generalized propensity score. Technological Forecasting and Social Change, 90, 410-419.

García-Quevedo, J., Pellegrino, G., & Savona, M. (2017). Reviving demand-pull perspectives: The effect of demand uncertainty and stagnancy on R&D strategy. Cambridge Journal of Economics, 41(4), 1087-1122.

Georghiou, L. (1994). Impact of the Framework Programme on European Industry. EUR 15907 EN, Office for Official Publications of the EC, Luxembourg.

González, X., & Pazó, C. (2008). Do public subsidies stimulate private R&D spending? Research Policy, 37(3), 371-389.

Görg, H., & Strobl, E. (2007). The effect of R&D subsidies on private R&D. Economica, 74(294), 215-234.

Heckman, J. J. (1979). Sample selection bias as a specification error. Econometrica, 44(1), 153-161.

Heijs, J. (2012). ERAWATCH Country Reports 2011: SPAIN. JRC Working Papers JRC77842, Joint Research Centre (Seville site).

Herrera, L., & Bravo, E. (2010). Distribution and effect of R&D subsidies: A comparative analysis according to firm size. Intangible Capital, 6(2), 272-299.

Holland, P. W. (1986). Statistics and causal inference. Journal of the American Statistical Association, 81(396), 945-960.

Hottenrott, H., Lopes-Bento, C., & Veugelers, R. (2017). Direct and cross scheme effects in a research and development subsidy program. Research Policy, 46(6), 1118-1132.

Hud, M., & Hussinger, K. (2015). The impact of R&D subsidies during the crisis. Research Policy, 44(10), 1844-1855.

Huergo, E., & Moreno, L. (2017). Subsidies or loans? Evaluating the impact of R&D support programmes. Research Policy, 46(7), 1198-1214.

Kamien, M., & Schwartz, N. (1982). Market Structure and Innovation, Cambridge University Press, Cambridge.

Marino, M., Parrotta, P., & Lhuillery, S. (2015). An overall evaluation of public R&D subsidy on private R&D expenditure in absence or in combination with R&D tax credit incentives. Paper presented at the DRUID15 Conference on the Relevance of Innovation, Rome, Italy. https://conference.druid.dk/acc_papers/arlixjutu74vl8ct298hi8fyc8ph.pdf

Neicu, D. (2019). Evaluating the effects of an R&D policy mix of subsidies and tax credits. Management and Economics Review, 4(2), 1-13.

Nelson, R. R. (1959). The simple economics of basic scientific research. Journal of Political Economy, 67(3), 297-306.

Pavitt, K. (1984). Sectoral patterns of technical change: Towards a taxonomy and a theory. Research Policy, 13(6), 343–373.

Pellegrino, G., & Savona, M. (2017). No money, no honey? Financial versus knowledge and demand constraints on innovation. Research Policy, 46, 510-521.

Rosenbaum, P. R., & Rubin, D. B. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70(1), 41-55.

Rubin, D. B. (1977). Assignment to treatment group on the basis of a covariate. Journal of Educational Statistics, 2(1), 1-26.

Sterlacchini, A., & Venturini, F. (2018). R&D tax incentives in EU countries: Does the impact vary with firm size? Small Business Economics, 53, 687–708.

Zúñiga-Vicente, J. Á, Alonso-Borrego, C., Forcadell, F. J., & Galán, J. I. (2014). Assessing the effect of public subsidies on firm R&D investment: A survey. Journal of Economic Surveys, 28(1), 36-67.