Evaluation of training for the unemployed in Mexico: learning by comparing methods

Delajara, Marcelo and Freije, Samuel and Soloaga, Isidro (2013): Evaluation of training for the unemployed in Mexico: learning by comparing methods. Published in: Políticas Públicas , Vol. 1, No. 1 (August 2013): pp. 9-41.

Abstract

We evaluate the Mexican training program for the unemployed PROBECAT/SICAT using methods that control for observable and non-observable factors. Comparing the different results over time allows us to gauge the size and evolution of hidden bias. We also compute the average treatment effect and the treatment effect on the treated. Our approach reveals the evolution of the program’s selection mechanism and judges the consequences of its expansions and contractions. We find that the program has a small though significant effect on employability, but no effect on wages. The hidden bias is large but declines over time and the selection mechanism turns from negative to neutral. These two aspects seem to be related to an important structural change in the design of the program that took place during the period under evaluation. All these results lead us to conclude that a parametric method controlling for un-observables provides the most complete tool for evaluating this program.

• Item Type: MPRA Paper
• Language: English
• Keywords: Evaluation, Training Programs, PROBECAT/SICAT, Parametric methods, Mexico
• Subjects: J - Labor and Demographic Economics > J6 - Mobility, Unemployment, Vacancies, and Immigrant Workers > J64 - Unemployment: Models, Duration, Incidence, and Job Search

References

Aportela Rodríguez, F. (2003). “Efectos del programa mexicano de capacitación en la duración del desempleo de sus participantes”, El Trimestre Económico, 70 (278), 275-314.

Baker, J. (2002). Evaluating the Impact of Development Projects on Poverty. The World Bank. Washington, D.C.

Becker, S. O., & Ichino, A. (2002). “Estimation of average treatment effects based on propensity scores”, The Stata Journal, 2 (4), 358-377.

Calderón-Madrid, Á. (2005). Estimación de Impacto de los Programas SICAT V SAEBE durante 2004, mimeo.

Cameron, A. C. & Trivedi, P. K. (2005). Microeconometrics. Methods and Applications. Cambridge University Press.

De Ibarrola, M. & Bernal, E. (1997). “Perspectivas de la educación técnica y de la formación profesional 40 Marcelo Delajara, Samuel Freije and Isidro Soloaga en México”. Boletín Cinterfor: Boletín Técnico Interamericano de Formación Profesional, Montevideo, OIT/Cinterfor, (141), 145-190.

De Ibarrola, M. (2001). “Los cambios estructurales y las políticas de capacitación y formación para el trabajo en México. Un análisis de la expresión local de políticas nacionales”. In: E. Pieck, Los jóvenes y el trabajo. La educación frente a la exclusión social, Universidad Iberoamericana, México, 221-250.

Dehejia, R. H., & Wahba, S. (2002). “Propensity score-matching methods for non experimental causal studies”. Review of Economics and statistics, 84 (1), 151-161.

Delajara, M., Freije, S., & Soloaga, I. (2006). An evaluation of training for the unemployed in Mexico (No. 0906). Inter-American Development Bank, Office of Evaluation and Oversight (OVE).

IBERGOP (2005). El Reto de la Informalidad y la Pobreza Moderada Escuela Iberoamericana de Gobierno Políticas Públicas. Memorias 2005. México, D.F.: Editorial Porrúa.

INEGI (2013). Banco de Información Económica. Retrieved from: http://www.inegi.org.mx/sistemas/bie/

Gallart, M. A. (1998). La articulación entre el sector público y la empresa privada en la formación profesional en América Latina. Santiago de Chile, CEPAL.

García, B. (1999). “Los problemas laborales de México a principios del siglo XXI”. Papeles de población, (21), 9-19.

Heckman, J., Tobias, J. L. & Vytlacil, E. (2003). “Simple Estimators for Treatment Parameters in a Latent- Variable Framework”. The Review of Economics and Statistics, 85 (3), 748-755.

Heckman, J., Tobias, J. L. & Vytlacil, E. (2001). “Four parameters of Interest in the Evaluation of Social Programs”. Southern Economic Journal, 68 (2), 210-223.

Heckman, J., LaLonde, R. & Smith, J. (1999). “The Economics and Econometrics of Active Labor Market Programs”. Handbook of Labor Economics. Vol. 3ª.

Lee, M. (2005). Micro-Econometrics for Policy, Program and Treatment Effects. London: Oxford University Press.

Loayza, N. (1997). “The Economics of the Informal Sector: A simple model and some empirical evidence from Latin America”, World Bank Policy Research Working Paper, (1727).

Maloney, W. F. (2002). “Distortion and Protection in the Mexican Labor Market”, Stanford University Working Paper, (138).

Márquez, G. (2000). “Training the workforce in Latin America: what needs to be done”, Inter-American Development Bank (Paper).

Mazza, J., Morrison A. & Fentes, I. (2003). “Iniciativas del BID en temas de mercado laboral 1990-2002” Inter-American Development Bank (Paper).

Mertens, L. (1997). “La descentralización y el sector privado en la trayectoria de la formación profesional en México”. CEPAL (Paper).

Navarro-Lozano, S. (2002). “Matching, Selection and the Propensity Score: evidence from Training in Mexico”. LACEA, (Paper).

Navarro-Lozano, S. (2003). “Matching, selección y la marca de propensión: Evidencia del Programa de Entrenamiento Laboral en México”. El Economista Mexicano, (3), 282-306.

Pieck, E. (2003). “La oferta de formación para el trabajo en México”, Universidad Iberoamericana (Paper).

Ravallion, M. (2005). “Evaluating Anti-Poverty Programs”. The World Bank Working Paper (3625).

Ravallion, M. (2001). “The Mystery of the Vanishing Benefits: Ms. Speedy Analyst’s Introduction to Evaluation”. The World Bank (Paper).

Ravallion, M. (1998). “Evaluación de los programas de empleo”. Inter-American Development Bank Working Paper, (POV-102).

Revenga, A., Riboud, M. & Tan, H. (1994). “The impact of Mexico’s retraining program on employment and wages”. The World Bank Economic Review. 8 (2), 247-278.

Rosenbaum, P. R. & Rubin, D. B. (1983). “The Central Role of the Propensity Score in Observational Studies for Causal Effects”. Biometrika. 70 (1), 41-55.

Samaniego, N. (2000). “Los principales desafíos que enfrenta el mercado de trabajo en México en los Evaluation of training for the unemployed in Mexico: learning by comparing methods 41 inicios del siglo XXI”. Oficina Internacional del Trabajo, (Paper).

Spiller, P. T. & Tommasi, M. (2003). “The Institutional Foundations of Public Policy: A Transactions Approach with Application to Argentina” Journal of Law, Economics, and Organization, 19 (2), 281-306.

STPS (1995). “Estudio de Evaluación del Programa de Becas de Capacitación para Desempleados”. Secretaría del Trabajo Previsión Social (Dirección General de Empleo), (Paper).

Wodon, Q. & Minowa, M. (1999). “Training for the urban unemployed: a reevaluation of Mexico’s PROBECAT”. Government Programs and Poverty in Mexico. Report No. 19214-ME.

Wooldridge, J. M. (2002). The Econometric Analysis of Cross Section and Panel Data. Massachusetts: MIT Press.

Zapata, F. (2000). “El sindicalismo y la política laboral en México 1995-1998”. Región y Sociedad, 12 (19).