Design Considerations for Evaluating the Impact of PEPFAR is the summary of a 2-day workshop on methodological, policy, and practical design considerations for a future evaluation of human immunodeficiency virus/acquired immunodeficiency syndrome (HIV/AIDS) interventions carried out under the President’s Emergency Plan for AIDS Relief (PEPFAR), which was convened by the Institute of Medicine (IOM) on April 30 and May 1, 2007. Participants at the workshop included staff of the U.S. Congress; PEPFAR officials and implementers; major multilateral organizations such as The Global Fund to Fight AIDS, Malaria, and Tuberculosis (The Global Fund), the Joint United Nations Programme on HIV/AIDS (UNAIDS), and the World Bank; representatives from international nongovernmental organizations; experienced evaluation experts; and representatives of partner countries, particularly the PEPFAR focus countries. The workshop represented a final element of the work of the congressionally mandated IOM Committee for the Evaluation of PEPFAR Implementation, which published a report of its findings in 2007 evaluating the first 2 years of implementation, but could not address longer term impact evaluation questions.

Contents

• THE NATIONAL ACADEMIES
• Reviewers
• Preface
• Overview
• 1. Introduction to Impact Evaluation for PEPFAR
  • MEANING AND USES OF IMPACT EVALUATION
  • PEPFAR’S EVALUATIVE APPROACH
  • EVALUATIVE APPROACH AND MAJOR FINDINGS OF THE IOM PEPFAR EVALUATION COMMITTEE
• 2. Envisioning a Meaningful Impact Evaluation for PEPFAR: Moving Beyond Counting
  • COST-EFFECTIVENESS
  • CONCEPTUAL APPROACH
  • HEALTH IMPACTS
  • IMPACTS BEYOND HEALTH
  • IMPACTS ON SUSTAINABILITY, CAPACITY BUILDING, AND HEALTH SYSTEMS STRENGTHENING
  • COORDINATION AND HARMONIZATION
  • SUSTAINABILITY IMPACTS
  • EQUITY AND FAIRNESS IMPACTS
  • UNINTENDED IMPACTS
• 3. Designing an Evaluation That Incorporates the Guiding Principles of Coordination, Harmonization, and Capacity Building
  • BENEFITS, COSTS, AND OPPORTUNITIES OF COORDINATION AND HARMONIZATION IN EVALUATION
  • BENEFITS, CONSTRAINTS, AND OPPORTUNITIES OF BUILDING CAPACITY IN EVALUATION
• 4. Designing an Impact Evaluation with Robust Methodologies
  • CONCEPTUAL MODELS AND METHODOLOGICAL APPROACHES: CASE STUDIES
  • METHODOLOGICAL CHALLENGES AND OPPORTUNITIES IN EVALUATING IMPACT
  • THEMES COMMON TO EVALUATION METHODOLOGIES AND APPROACHES
• Appendix A Agenda
• Appendix B Abbreviations and Acronyms
• Appendix C List of Participants
• Appendix D References

Rapporteurs: Clara Cohen, Michele Orza and Deepali Patel.

This study was supported by Contract No. SAQMPD05D1147 (STAT-7394) between the National Academy of Sciences and the Department of State. Any opinions, findings, conclusions, or recommendations expressed in this publication are those of the author(s) and do not necessarily reflect the view of the organizations or agencies that provided support for this project.

Suggested citation:

IOM (Institute of Medicine). 2008. Design considerations for evaluating the impact of PEPFAR: Workshop summary. Washington, DC: The National Academies Press.

NOTICE: The project that is the subject of this report was approved by the Governing Board of the National Research Council, whose members are drawn from the councils of the National Academy of Sciences, the National Academy of Engineering, and the Institute of Medicine.