Your search

Experimental evaluations—especially when grounded in theory-based impact evaluation—can provide insights into the mechanisms that generate program impacts. This chapter details variants of experimental evaluation designs and also analytic strategies that leverage experimental evaluation data to learn about causal mechanisms. The design variants are poised to illuminate causal mechanisms related to program implementation and the contribution of selected components of multifaceted programs....

when it was reduced to a subsidiary internal service lacking all kind of political attributions. The work done in those years had been formidable, but too many things had passed since, especially the 15M Spanish Indignados Movement, the raise of technopolitics… and the raise of populism and fascism all across Europe. We urgently needed a theoretical framework in which to substantiate our political strategy, so I came up with a Theory of Change of citizen participation (see Figure 1) which...

Measuring Governance, Advocacy, and Power is an excel sheet that brings together existing indicators, tools, and indices that may be useful to practitioners responsible for the measurement of outcomes in the field of governance, advocacy, and power in an easily accessible and filterable format.

Some years ago, you could say “Scrum is agile” and ask “is Agile Scrum?” Now we know there is much more flesh on the bones. At this moment there are more than fifty known and less known agile approaches, frameworks or methods available. To get a first impression of the different approaches, I try to bring some structure in the jungle to approaches, methods and frameworks. In Figure 1, I position the best-known agile approaches in a structure. The approaches, frameworks or methods are...

Planning for and assessing system change is a strategic management issue. It is critical for everything from developing a strategy and designing interventions, to adapting strategy, improving implementation and reporting impact. But many programmes get stuck when it comes to assessing system change. The private sector development field has struggled to agree on an approach that programmes can implement and stakeholders can understand. However some mature programmes are starting to assess...

This chapter explores the use of mechanisms within the realist evaluation of the Building Capacity to Use Research Evidence (BCURE) program, a £15.7 million initiative aiming to improve the use of evidence in decision-making in low and middle-income countries. The evaluation was commissioned to establish not just whether BCURE worked but also how and why capacity building can contribute to increased use of evidence in policymaking in the very different contexts in which the program operated....

Over the past decade, the field of development evaluation has seen a renewed interest in methodological approaches that can answer compelling causal questions about what works, for whom, and why. Development evaluators have notably started to experiment with Bayesian Process Tracing to unpack, test, and enhance their comprehension of causal mechanisms triggered by development interventions. This chapter conveys one such experience of applying Bayesian Process Tracing to the study of citizen...

Realist evaluation is an approach with a strong emphasis on causal mechanisms and the context in which they are triggered. However, recent reviews of published realist evaluations show that context is often understudied. This is problematic, as a thorough understanding of the relationship between context and causal mechanisms is crucial in assisting policymakers to make appropriate and targeted decisions that improve the intervention. Therefore, we set out to test whether combining realist...

Pando is a platform that gives organizations a way to visualize, learn from, and engage with the social systems in which they work. We have designed Pando to help users build trust, strengthen relationships, and work together to achieve greater social impact. Grounded in social network analysis, Pando allows users to collect and visualize organizations and their relationships in real-time on simple and easy-to-use relationship maps. Relationship maps are managed by map administrators. These...

Despite increased discussions in the community and a common understanding about the virtue of mechanism-based explanation, little is known about the true benefits and challenges of applying causal mechanism analysis in practice. This chapter aims to introduce the reader to the topic of causal mechanisms and synthesize significant findings on this special issue. It begins by laying out definitions and concepts of causal mechanisms in evaluation literature and proposes a two-way classification...

The Si Network is an online platform for building the developing of systems innovation - connecting people around the world to learn and apply the ideas and methods of systems innovation towards addressing complex challenges and building better systems that work for all. Not sure what systems innovation is? Systems innovation is a new approach to innovation that tries to tackle complex social and environmental challenges through the use of more holistic & innovation driven approaches. It is...

Most people agree that monitoring and evaluation (M&E) should be used for both learning and accountability. However, there is no consensus about which one is more important. The debate matters as there is sometimes tension between the two purposes. In the past there has often been a disconnect between M&E and learning. Many M&E systems are primarily designed to enable accountability to donors.

USAID maintains staff and operations in more than 80 countries around the world, all of which the COVID-19 pandemic will disrupt. USAID remains committed to protecting the health and safety of our staff, while continuing appropriate oversight of our programs and ensuring the accountable and effective use of U.S. taxpayer funds. In the current operating environment, USAID and implementing partners face new challenges in implementing activities, monitoring progress, collecting data, and...

This guide provides an introductory overview of a range of methods that have been selected for their actual and potential use in the field of international development evaluation. For each method, a detailed guidance note presents the method’s main features and procedural steps, key advantages and disadvantages, as well as its applica­bility. Each guidance note includes references for relevant background readings (basic and advanced) as well as references to other additional resources of...

Pressure is mounting on international development cooperation agencies to prove the impact of their work. Private and public commissioners as well as the general public are increasingly asking for robust evidence of impact. In this context, rigorous impact evaluation (RIE) methods are increasingly receiving attention within the broader German development system and in GIZ. Compared to other implementing agencies such as DFID or USAid, the Deutsche Gesellschaft für Internationale...

Why should I integrate an impact assessment in my programme? How will the programme benefit from it? Are the benefits worth the effort and expenses? How do I design and implement it in detail? Who is addressable for support? What should I pay attention to in order to get the most out of it? This note is meant to answer these questions. It addresses leaders and project staff of governance programmes who are interested in using this tool within their specific governance programme or project....

From the Waters Center For Systems Thinking. See: https://thinkingtoolsstudio.waterscenterst.org/courses/habits https://thinkingtoolsstudio.waterscenterst.org/cards