J-PAL/MIT Evaluating Social Programs Course, 2022

Course overview

Held live over Zoom, this five-day training will equip participants with the resources and knowledge to engage with impact evaluations of social programs. The interactive course provides an in-depth look at why and when randomized evaluations can be used to rigorously measure social impact, methods and considerations for their design and implementation, and how findings can inform evidence-based policies and programs.

Lectures and case studies using real-world examples will prepare participants to apply learnings at their home organizations. The course covers both technical design and pragmatic considerations for measuring impact with a randomized evaluation. The immersive format enables participants to forge connections with peers, academic researchers, and experts in the field.

Who is a good candidate for this course?

The course is designed for a range of participants from governments, NGOs, international organizations, private sector companies, and foundations, including, but not limited to:

• Policymakers and decision makers in government
• Leaders in philanthropy
• Program implementers and practitioners
• Monitoring & evaluation personnel in NGOs and international organizations
• Research and teaching staff in academic and research institutions

The typical participant is a mid-career professional with an interest in incorporating randomized evaluations into their work. Although not required, some familiarity with economics and basic statistical concepts is helpful. Not sure if you’re the right fit? Contact Katharina Kaeppel at [email protected] for more information.

Course format

J-PAL affiliated professors and senior staff with extensive experience implementing randomized evaluations will lead interactive lecture sessions on how to generate rigorous evidence to inform decision-making. Participants will also engage in small group discussions with J-PAL staff and fellow participants in similar areas of work, providing opportunities to collaborate and network with their peers. By working through case studies and examples in small groups with the support of staff, participants will solidify new lecture concepts and discuss how they might apply these skills to their own work.

Over the course of the five-day training, participants will spend roughly four hours each day in live Zoom lectures and small-group sessions to apply learnings to case study examples, exercises, and individual projects. The schedule includes opportunities to network with peers and engage in office hours with the teaching team, and participants will come away from the course with resources and materials to map out an evaluation strategy for their own programs and policies.

View a sample agenda for the course here >>

Course objectives

Participants can expect to:

• Develop a foundational toolkit for measuring impact that includes needs assessments, logical frameworks, and theories of change;

• Gain a clear understanding of why and when a rigorous evaluation of social impact is needed and how randomized evaluations are designed in real-world settings;
• Gain insight on threats to the validity of experiments, determining the appropriate sample size, and interpreting results;
• Learn strategies to maximize policy impact and assess the generalizability of research findings; and
• Join a community of practice with other decision-makers who can provide support in the design and use of impact evaluations.

Former J-PAL course participants say:

“Great opportunity to design and receive feedback on our own evaluations.”

“Really enjoyed the teaching methods. The initial exposure to case studies was then solidified through lectures and small group work. The constant interaction kept students engaged throughout.”

“I enjoyed this training very much and thought the experience was excellent. I still am buzzing whenever I speak about it. There were many wonderful aspects: the working groups, the quality of the other students, the quality of the TAs and the seriousness and dedication of the training effort. It was absolutely first-class.”

“The teaching assistants assigned to my group were wonderful! They were very supportive and provided great insight and advice on current research projects.”

“It’s a very useful course. Very practical. Very applied.”

Fees

Fees for the course vary depending on organization type and operating budget. Please refer to the table below to determine your course fee. Please note that participants paying by credit card will additionally be responsible for any associated service and payment processing fees.

Key information

• How can I apply? Applications for the course are now closed. Applicants will be notified of their application status via email.

• What is the application deadline? Applications will close on May 11, but as spots in the course are limited and we will review applications on a rolling basis, we encourage you to apply as soon as possible.

• What is the criteria for admission? Although we have no fixed requirements, selection for admission is based on applicants’ organizational responsibilities and organizations’ alignment with J-PAL’s mission of reducing poverty through evidence-informed policy.
• Where can I find more information on the course? For further information on J-PAL’s Evaluating Social Programs course, including frequently asked questions, please refer to our website.
• Who can I contact with questions? Please contact Katharina Kaeppel at [email protected] with questions about applying or details about the course.