Your search

This paper lays out a series of steps people can take to create the new systems we need to meet shared, public challenges. Systems are ubiquitous and powerful. We rely on them to support our daily lives: every time we turn on a tap, flick a switch for electricity, drop our child at school, jump on a bus or visit a doctor we rely on a wider system. There is a widespread sense, among decision makers and citizens that in the coming decades society will need not just new products, software and...

There is a glaring gap and compelling need for approaches and methods that realign to new rigour through timeliness, cost-effectiveness, relevance and being actionable. Over the past few years, the Sanitation Learning Hub, in collaboration with the Government of India, Praxis, WSSCC and WaterAid India, have been developing Rapid Action Learning approaches. Multiple approaches have been trialled, with flexible formats, but the essential criteria is that learning is timely, relevant and...

Systemcraft is our applied framework to help leaders and organisations get started and keep going when faced with complex problems. It is built on our practical experience. It draws on a broad body of research, action and theory from the worlds of complexity thinking, systems theory, adaptive management, leadership development, social movements, development theory and beyond. Systemcraft has been designed to make systems thinking something any leader can apply when they find themselves faced...

This paper probes trends in the use of big data by a community of early adopters working in monitoring, evaluation, research, and learning (MERL) in the development and humanitarian sectors. Qualitative analysis was conducted on data from MERL Tech conference records and key informant interviews. Findings indicate that MERL practitioners are in a fragmented, experimental phase, with use and application of big data varying widely, accompanied by shifting terminologies. We take an in-depth...

Emerging technology is making monitoring, evaluation, research and learning (MERL) more precise and enriching data. However, this evolution is so rapid that it can be difficult to stay informed about the field overall. This paper presents examples of emerging technology that are most often used in MERL for development programs, describes the pros and cons of their use, and discusses technology and ethics concerns that practitioners should keep in mind. The paper covers new types of data...

Children end up in child labour as a result of many, often unknown or hidden, interactions between multiple actors and multiple factors within households, communities, and labour systems, leading to unpredictable outcomes for children and other sector stakeholders and sometimes resulting in the worst forms of child labour (WFCL). It is a complex problem, and interventions aimed at tackling it are also, inevitably, complex and challenging. The way they influence change is non-linear,...

This paper explores the peer-reviewed evidence base of “traditional” technology-enabled monitoring, evaluation, research, and learning (MERL Tech) in international development assistance from 2015 to 2019. The authors conducted a scoping review that searched seven databases, screened 3,054 reference titles and abstracts, coded 886 abstracts, and extracted and analyzed conclusions and recommendations from the full texts of 256 studies. The findings reveal the most frequently reported...

The COVID-19 pandemic has significantly shifted the context in which aid and development is being delivered. The global scale of the pandemic and the speed at which it is spreading mean that the ‘normal’ economic, ideological and organisational influences which shape (if not determine) aid delivery are in flux. This means that – for a relatively short-period – there is scope for aid actors to work collectively to embed more locally-led, politically-informed and adaptive forms of MERL in aid...

In September of 2014, USAID’s Office of Learning, Evaluation & Research (LER) awarded the Learning and Knowledge Management (LEARN) contract to Dexis Consulting Group and subcontractor RTI International.1 This document—the End of Contract Report—captures five and half years of results and reflections for our stakeholders. Our intention is to share the good and the bad, and while this report would not be considered a “tell all,” we think we have a story worth sharing, particularly to USAID...

Internal and external stakeholders have different information needs over a project’s life, for purposes that include adaptive management, accountability, compliance, reporting and learning. A project’s monitoring, evaluation, accountability and learning, or MEAL, system should provide the information needed by these stakeholders at the level of statistical reliability, detail and timing appropriate to inform data use. In emergency contexts where the situation is still fluid, ‘informal...

- This short paper draws out lessons for working effectively with and through partners, based on the experience of the Institutions for Inclusive Development (I4ID) programme – an adaptive, politically smart governance programme in Tanzania. • Cultivating effective partnerships can be a key part of delivering locally legitimate projects that have the potential to create sustainable change. Adaptive and politically informed ways of working create specific opportunities and challenges for...

Research on empowerment and accountability tends to focus on collective action and its potential for empowering citizens undertaking the action and on achieving state accountability. In fragile, conflict and violence-affected settings (FCVAS) collective action is rare and risky. So how do citizens, particularly the chronically poor and most marginalised, interact and make claims on the different public authorities that exist in these settings, and how do these interactions contribute to...

This document explores how organisations can measure the level of influence that they had over an outcome. It summarises influence in terms of the significance of the outcome, the level of contribution and the strength of evidence.

This briefing note shares practical learning on the use of contribution analysis for adaptive management (CA4AM). It examines how the approach enables programmes to work with theories of change in a practical, reflexive way, and how, combined with assessing evidence of a programme’s contribution to change, its findings can inform programme adaptation. It also examines both how and to what extent CA enables AM through the experiences of four large complex programmes all working towards...

Adaptive programmes recognise that certain changes, particularly in behaviours, are complex, non-linear and difficult to measure. This briefing note explores the use of outcome mapping (OM) as a monitoring, evaluation and learning (MEL) approach to track behavioural change and inform adaptation for two programmes: the Pathways to Resilience in Semi-arid Economies (PRISE) research consortium and the Accountability in Tanzania programme (AcT I and AcT II). It discusses the implementation of...

These Checklists for Exit along the Sustainability Project Cycle are based on lessons from ex-post evaluations that Valuing Voices has done or researched. Ex-post project completion evaluations are rare and even more so those that consulted partners and participants in the field about sustained impacts. Over $3.5 trillion has been spent on public foreign aid projects in the past 70 years (OECD 2019) yet we have evaluated less than 1% of these projects for sustainability. Our Valuing Voices...

There is a growing emphasis among NGOs and donors on ensuring that the voices of beneficiaries are heard. A range of beneficiary feedback mechanisms (BFMs) exist which enable beneficiary perspectives and suggestions to be gathered and used within an M&E system. BFMs are tools designed to enable a continuous cycle of interaction between those receiving and those delivering aid-funded interventions.

Theory of Change is thought to be very useful for learning and adaptive management of complex interventions such as advocacy. Nevertheless, the use of Theory of Change is also under critique. One common criticism is that Theory of Change is often used as a framework that fixes agreements rather than as a living, guiding tool that helps reflection and adaptation. However, while such criticism stresses forms of control, little research has looked at the way Theory of Change and advocacy...