Your search

This paper reviews promising methods for the evaluation of complex interventions that are new or have been used in a limited way. It offers a taxonomy of complex interventions in international development and draws on literature to discuss several methods that can be used to evaluate these interventions. Complex interventions are those that are characterised by multiple components, multiple stakeholders, or multiple target populations. They may also be interventions that incorporate...

In community engagement and participatory processes, facilitators must make intentional efforts and adopt inclusive strategies to include marginalized and frequently overlooked groups. Yet, there is a lack of guidance on how to inclusively facilitate participatory processes. Facilitators are therefore often poorly prepared to engage with the power relations that underlie these processes, including those between the facilitator and participants and among participants themselves. This guide...

As with all public policy work, education policies are demanding. Policy workers need to ‘know’ a lot—about the problems they are addressing, the people who need to be engaged, the promises they can make in response, the context they are working in, and the processes they will follow to implement. Most policy workers answer questions about such issues within the structures of plan and control processes used to devise budgets and projects. These structures limit their knowledge gathering,...

The Method Positive Deviance (PD) is based on the observation that in every community or organization, there are a few individuals who achieve significantly better outcomes than their peers, despite having similar challenges and resources. These individuals are referred to as positive deviants, and adopting their solutions is what is referred to as the PD approach¹. The method described in this Handbook follows the same logic as the PD approach but uses pre-existing, non-traditional data...

In Building Better Systems, we introduced four keys to unlock system innovation: purpose and power, relationships and resource flows. These four keys make up a set. Systems are often hard to change because power, relationships, and resource flows are locked together in a reinforcing pattern to serve the system’s current purpose. Systems start to change fundamentally when this pattern is disrupted and opened up. Then a new configuration can emerge, serving a new purpose. In this essay...

This report presents six learnings from four pilot projects conducted by the Data Powered Positive Deviance (DPPD) initiative, a global collaboration between the GIZ Data Lab, the UNDP Accelerator Labs Network, the University of Manchester Center for Digital Development, and UN Global Pulse Lab Jakarta. The pilots seek out grassroots solutions to development challenges that range from the interaction between livestock farming and deforestation to gender-based violence and insecurity in dense...

This is the second blog in our series ‘Lessons on using Contribution Analysis for impact evaluation’. In our first blog, we introduced Contribution Analysis (CA) as an overarching approach to theory-based evaluation and the idea of causal hotpots as a way to zoom in, unpack and make the hard choices of where to focus evaluation research. Identifying specific links in the theory of change (ToC) with specific evaluation questions enables you to then choose appropriate methods. We have applied...

Over the past five years, colleagues from the Centre for Development Impact (CDI) – a joint initiative between the Institute of Development Studies, Itad and University of East Anglia – have been innovating with and learning how to use Contribution Analysis as an overarching approach to impact evaluation. In this blog series, we share our learning and insights, some of them in raw emergent form, highlight the complexities, nuances, excitements, and challenges of embracing new ways of doing...

There is broad recognition of the challenges in evaluating policy and programmes on their contribution to sustainable development. Impact evaluations of PSD programmes are carried out at the behest of a particular configuration of interest groups with different expectations. Some groups want to know whether a programme has worked, others want to know how to do these programmes better, others fear that PSD programmes might result in sub-optimal or adverse development outcomes in recipient...

In all the jobs I have held, the only training that has ever stayed with me was a three-day course on logframes, held in a very pleasant beach hotel on Fiji’s beautiful coral coast. This was a few months after I joined what was then the Overseas Development Administration, DFID’s forerunner. Three days on logframes. Yes really. Our Pacific team were gathered together to learn this new skill. The course was designed not only to help us think rigorously about how change happens, but also to...

This Emerging Evidence Report shares evidence of how, for whom, and under what circumstances, Participatory Action Research (PAR) leads to innovative actions. A rapid realist review was undertaken to develop programme theories that explain how PAR generates innovation. The methodology included peer-reviewed and grey literature and moments of engagement with programme staff, such that their input supported the development and refinement of three resulting initial programme theories (IPTs)...

External consultants, learning partners or critical friends -whatever we call them- can seldom change the system or organisational (learning) culture from outside. So, how can Monitoring Evaluation and Learning (MEL) consultants support real change instead of creating tools or processes that are quickly forgotten without any real institutional ownership? Consultants and learning partners can seldom change a learning system or organisational culture – it just does not work like that. What...

CLARISSA (Child Labour: Action-Research-Innovation in South and South-Eastern Asia) is a large-scale Participatory Action Research programme which aims to identify, evidence, and promote effective multi-stakeholder action to tackle the drivers of the worst forms of child labour in selected supply chains in Bangladesh, Nepal, and Myanmar. CLARISSA places a particular focus on participants’ own ‘agency’. In other words, participants’ ability to understand the situation they face, and to...

How does Small Foundation think about the impact…

Background: Addressing today’s sustainability challenges requires adopting a systemic approach where social and ecological systems are treated as integrated social-ecological systems. Such systems are complex, and the international development sector increasingly recognises the need to account for the complexity of the systems that they seek to transform. Purpose: This paper sketches out the elements of a complexity-aware monitoring and evaluation (M&E) system for international...

In 2015, leaders from around the world agreed to 17 Sustainable Development Goals (SDGs) to be achieved by 2030. The seventh goal (SDG7) is: “Ensure access to affordable, reliable, sustainable and modern energy for all.” In the same year, the world’s leaders concluded the Paris Agreement to tackle climate change, which will require a global transition in the energy sector away from the use of fossil fuels. Yet, despite growing investments in clean energy in many developing countries, the...

Global efforts to improve energy access and quality and to tackle climate change need a different approach to addressing poor energy governance. In 2015, leaders from around the world agreed to 17 Sustainable Development Goals (SDGs) to be achieved by 2030.1 The seventh goal (SDG7) is “Ensure access to affordable, reliable, sustainable and modern energy for all.” In the same year, the world’s leaders concluded the Paris Agreement to tackle climate change, which will require a global...

This learning paper highlights how elements of outcome mapping were used by Save the Children Sweden in a project (2018-2020) that supports adolescents, affected by the Syria crisis, to become more resilient. The paper first outlines how the spheres of influence framework has been applied to develop an actor focused theory of change. It then describes how progress markers, as an alternative to SMART indicators, were formulated to monitor the programme’s results. The paper also outlines how...

Many education systems in low- and middle-income countries are experiencing a learning crisis. Many efforts to address this crisis do not account for the system features of education, meaning that they fail to consider the ways that interactions and feedback loops produce outcomes. Thinking through the feedback relationships that produce the education system can be challenging. The RISE Education Systems Framework, which is sufficiently structured to give boundaries to the analysis but...