A Consideration of Impact Evaluation Methodology at the Sector Level

A Case Study Using Donors' Assistance Projects in Primary and Secondary Education in Indonesia Since 1990

Abstract

This paper proposes a framework for impact evaluation of donors' assistance projects at the sub-sector level, using the case of PSE in Indonesia. It presents: 1) methodological procedures in four stages, using a program theory model and an interrupted time series model in impact evaluation; 2) types of necessary data for analysis; and 3) analysis results based on collected data, focusing on higher outcome levels in the target sub-sector. It also identifies threats to the validity and adequacy of evaluation designs and results, and proposes some solutions for them. Finally, it reconsiders key issues observed in this study, such as: 1) the issue of contribution and attribution; and 2) donors' roles and responsibilities.