Evaluating direct and indirect treatment effects in Italian R&D expenditures

Di Gennaro, Daniele and Pellegrini, Guido (2016): Evaluating direct and indirect treatment effects in Italian R&D expenditures.

Abstract

During the last decades SUTVA has represented the "gold standard" for the identification and evaluation of causal effects. However, the presence of interferences in causal analysis requires a substantial review of the SUTVA hypothesis. This paper proposes a framework for causal inference in presence of spatial interactions within a new spatial hierarchical Difference-in-Differences model (SH-DID). The novel approach decomposes the ATE, allowing the identification of direct (ADTE) and indirect treatment effects. In addition, our approach permits the identification of different indirect causal impact both on treated (AITET) and on controls (AITENT). The performances of the SH-DID are evaluated by a Montecarlo Simulation. The results confirm how omitting the presence of interferences produces biased parameters of direct and indirect effects, even though the estimates of the ATE in the traditional model are correct. Conversely, the SH-DID provides unbiased estimates of both total, direct and indirect effects. On this basis, we provide empirical evidence on the effectiveness of public policies in Italy. The estimates show the additionality of the policies on R&D expenditures. Decomposing the ATE, we demonstrate positive and significant direct effects, while the indirect impact is negative and meaningful, even if limited to the treated.

• Item Type: MPRA Paper
• Language: English
• Keywords: policy evaluation; spatial interferences; spillover effects; spatial hierarchical approach
• Subjects: O - Economic Development, Innovation, Technological Change, and Growth > O3 - Innovation ; Research and Development ; Technological Change ; Intellectual Property Rights > O38 - Government Policy; R - Urban, Rural, Regional, Real Estate, and Transportation Economics > R1 - General Regional Economics > R12 - Size and Spatial Distributions of Regional Economic Activity; R - Urban, Rural, Regional, Real Estate, and Transportation Economics > R1 - General Regional Economics > R15 - Econometric and Input-Output Models ; Other Models; R - Urban, Rural, Regional, Real Estate, and Transportation Economics > R3 - Real Estate Markets, Spatial Production Analysis, and Firm Location > R38 - Government Policy

References

Anselin, L., Varga, A., and Acs, Z. (1997). Local geographic spillovers between university research and high technology innovations. Journal of urban economics, 42(3):422–448.

Arpino, B. and Mattei, A. (2013). Assessing the impact of financial aids to firms: Causal inference in the presence of interference. MPRA Paper 51795, University Library of Munich, Germany.

Audretsch, D. B. and Feldman, M. P. (1996). R&d spillovers and the geography of innovation and production. The American economic review, 86(3):630–640.

Audretsch, D. B. and Feldman, M. P. (2004). Knowledge spillovers and the geography of innovation. Handbook of regional and urban economics, 4:2713–2739.

Becker, B. (2015). Public r&d policies and private r&d investment: A survey of the empirical evidence. Journal of Economic Surveys, 29(5):917–942.

Breschi, S. and Lissoni, F. (2001). Knowledge spillovers and local innovation systems: A critical survey. Industrial and Corporate Change, 10(4):975–1005.

Bronzini, R. and Piselli, P. (2016). The impact of r&d subsidies on firm innovation. Research Policy, 45(2):442–457.

Caloffi, A., Mariani, M., and Sterlacchini, A. (2016). Evaluating public supports to the investment activities of business firms: A meta-regression analysis of italian studies. Working Paper 01-2016, Centre for Research on the Economics of Institutions (CREI).

Camagni, R. (1991). Introduction: from the local ”milieu” to innovation through cooperation networks. Innovation networks: spatial perspectives, pages 1–9.

Camagni, R. and Capello, R. (2013). Regional innovation patterns and the eu regional policy reform: toward smart innovation policies. Growth and change, 44(2):355–389.

Cerqua, A. and Pellegrini, G. (2014). Beyond the sutva: how policy evaluations change when we allow for interactions among firms. Working Papers 2/14, Sapienza University of Rome, DISS.

Cerulli, G., Gabriele, R., and Tundis, E. (2014). Evaluating locally-based policies in the presence of neighbourhood effects: The case of touristic accommodation in the garda district of trentino.Ersa conference papers, European Regional Science Association.

Corrado, L. and Fingleton, B. (2012). Where is the economics in spatial econometrics? Journal of Regional Science, 52(2):210–239.

Cox, D. (1959). The Planning of Experiments. Oxford, England: Wiley.

De Castris, M. and Pellegrini, G. (2015). Neighborhood effects on the propensity score matching. Working Paper 05-2015, Centre for Research on the Economics of Institutions (CREI).

Di Gennaro, D. and Pellegrini, G. (2016a). Are regional policies effective? an empirical evaluation on the diffusion of the effects of r&d incentives. Sapienza University of Rome, Doctoral School of Economics Working Paper, 17.

Di Gennaro, D. and Pellegrini, G. (2016b). Policy evaluation in presence of interferences: A spatial multilevel did approach. Working Papers 0416, CREI Università degli Studi Roma Tre.

Feldman, M. P. (1994). The geography of innovation. Kluwer Academic Publishers, Boston.

Feser, E. (2013). Isserman’s impact: quasi-experimental comparison group designs in regional research. International Regional Science Review, 36(1):44–68.

Foray, D., David, P. A., and Hall, B. H. (2011). Smart specialisation from academic idea to political instrument, the surprising career of a concept and the difficulties involved in its implementation. Technical report, EPFL.

Fritsch, M. and Slavtchev, V. (2011). Determinants of the efficiency of regional innovation systems. Regional Studies, 45(7):905–918.

Gibbons, S., Overman, H. G., and Patacchini, E. (2014). Spatial methods. CEPR Discussion Paper No. DP10135.

Hong, G. and Raudenbush, S. W. (2012). Evaluating kindergarten retention policy. Journal of the American Statistical Association.

Hudgens, M. G. and Halloran, M. E. (2012). Toward causal inference with interference. Journal of the American Statistical Association.

Jaffe, A. B., Trajtenberg, M., and Henderson, R. (1993). Geographic localization of knowledge spillovers as evidenced by patent citations. the Quarterly journal of Economics, pages 577–598.

Jensen, M. B., Johnson, B., Lorenz, E., and Lundvall, B. Å. (2007). Forms of knowledge and modes of innovation. Research policy, 36(5):680–693.

Manski, C. F. (1993). Identification of endogenous social effects: The reflection problem. The review of economic studies, 60(3):531–542.

Manski, C. F. (2000). Economic analysis of social interactions. Technical report, National bureau of economic research.

Manski, C. F. (2013). Identification of treatment response with social interactions. The Econometrics Journal, 16(1):S1–S23.

McCann, P. and Ortega-Argilés, R. (2013). Transforming european regional policy: a results driven agenda and smart specialization. Oxford Review of Economic Policy, 29(2):405- 431.

McCann, P. and Ortega-Argilés, R. (2015). Smart specialization, regional growth and applications to european union cohesion policy. Regional Studies, 49(8):1291–1302.

MISE (2015). Relazione sugli interventi di sostegno alle attività economiche e produttive.

Porter, M. (1998). Clusters and the new economics of competition. Harvard business review, 76(6):77.

Rosenbaum, P. R. (2012). Interference between units in randomized experiments. Journal of the American Statistical Association.

Rubin, D. B. (1974). Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of educational Psychology, 66(5):688.

Rubin, D. B. (1980). Randomization analysis of experimental data: The fisher randomization test comment. Journal of the American Statistical Association, 75(371):591–593.

Sinclair, B., McConnell, M., and Green, D. P. (2012). Detecting spillover effects: Design and analysis of multilevel experiments. American Journal of Political Science, 56(4):1055–1069.

Verbitsky-Savitz, N. and Raudenbush, S. W. (2012). Causal inference under interference in spatial settings: a case study evaluating community policing program in chicago. Epidemiologic Methods, 1(1):107–130.

von Tunzelmann, N. (2009). Regional capabilities and industrial regeneration. Technological Change and Mature Industrial Regions: Firms, Knowledge and Policy, Edward Elgar, Cheltenham,pages 11–28.

Zúñiga-Vicente, J. Á., Alonso-Borrego, C., Forcadell, F. J., and Galán, J. I. (2014). Assessing the effect of public subsidies on firm r&d investment: a survey. Journal of Economic Surveys, 28(1):36–67.