Search

In this blog we are sharing a digest of some of the many useful and innovative monitoring, evaluation and learning resources and efforts that have come through the M&E Sandbox in 2022. A lot of these resources have been shared by our community in response to the overwhelmingly positive feedback from the launch of the Sandbox (please keep them coming!). We hope you find it useful. We have grouped these efforts and resources under six broad questions: - How do we measure systems...

Considering Systems Thinking (ST) as a cognitive skill can create greater acceptability of and openness to the discipline from practitioners and researchers outside operations research and management science. Rather than associating ST with frameworks and methodologies, ST as a cognitive skill can help popularize and democratize the discipline. This paper highlights how the conceptual lens of Holistic Flexibility can help practitioners deploy ST as a cognitive skill without the application...

We are a dynamic non-profit organization with a unique approach to managing change and catalyzing innovation to support global systems transformation. We know that to achieve equal, just, and safe communities, we must collectively challenge and change the systems that people rely on — especially those most vulnerable. Together, we must RE!BUILD a system's resilience and capacity to take on our biggest generational challenges. Justice, housing, health, and other systems in every country are...

Most development practitioners have long recognized that deep contextual knowledge is crucial to understanding how projects interact with their local systems and, in turn, to navigating these systems. Moreover, this knowledge must complement projects' technical solutions, or they will fall flat and may even undercut project objectives as they clatter down. What, then, explains practitioners' particular interest in TWP as an explicit strategy and more than just "doing good development"? This...

How can we transform monitoring and evaluation (M&E) into a more adaptive, emergent process to address uncertainty and complexity in todays’ world? How do we move from compliance and accountability to learning – to support better, more timely, decisions? Join GEI Program Manager, Dugan Fraser, as he discusses these questions and others with Special Guest, Søren Haldrup, from UNDP's Strategic Innovation Unit where he manages UNDP's innovation facility and leads a new initiative called the M&E Sandbox.

This CDI Practice Paper by Tom Aston and Marina Apgar makes the case for ‘bricolage’ in complexity-aware and qualitative evaluation methods. It provides a framework based on a review of 33 methods to support evaluators to be more intentional about bricolage and to combine the component parts of relevant methods more effectively. It discusses two cases from practice to illustrate the value added of taking a more intentional approach. It further argues that navigating different forms of...

In order to support the digital transformation of government operations Digital Learning Modules for Civil Servants are available, an off-the-shelf package of capacity development in form of replicable training modules to empower public servants at both the local and central government level to be leaders of digital transformation for delivering better public services. The modules cover a multitude of fundamental areas: comprehending digital government and services, human-centered design...

In recent decades, the World Bank and many bilateral development partners have provided funding to support land administration reform. Traditional land administration reform projects focus on the economic and technical design of interventions based on a library of best practice, commonly avoiding the “messy politics” typically involved in land governance. Experience and lessons from land administration reform initiatives have been documented and a recurrent theme is that many projects fail...

“Civic tech” broadly refers to the use of digital technologies to support a range of citizen engagement processes. From allowing individuals to report problems to local government to enabling the crowdsourcing of national legislation, civic tech aims to promote better policies and services – while contributing to more inclusive democratic institutions. But could civic tech affect public issues in a way that benefits some and excludes others? Over the decades, the question of who...

This Research and Evidence Paper presents the theory-based and participatory evaluation design of the Child Labour: Action-Research- Innovation in South and South-Eastern Asia (CLARISSA) programme. The evaluation is embedded in emergent Participatory Action Research with children and other stakeholders to address the drivers of the worst forms of child labour (WFCL). The report describes the use of contribution analysis as an overarching approach, with its emphasis on crafting, nesting and...

Headed off recently to discuss the state of Thinking and Working Politically within the aid sector. This is a loose network of aid wonks that came together to try and move aid from a pure focus on technical issues, towards taking account of power and politics and why they can facilitate/frustrate attempts to make change happen in any given context. It was great to be in a room with others (50/50 in person and online) – the neurons fire in a way that just doesn’t happen online (but I also...

The objective of this report, Integrating Local Knowledge in Development Programming is to share knowledge of how development donors and implementing organizations leverage local knowledge to inform programming. In a recent speech at Georgetown University, United States Agency for International Development (USAID) Administrator Samantha Power said, “As Americans with a fraught history living up to our own values, we’ve got to approach this work with intention and humility. But the...

Diverse approaches to promoting disability inclusive employment aim to transform workplaces into truly inclusive environments, usually with intervention strategies targeting two main groups: employers and jobseekers with disabilities. However, they do not always consider other relevant stakeholders or address the relationships and interactions between diverse actors in the wider social ecosystem. These approaches often neglect deeper ‘vexing’ difficulties which block progress towards...

Calls for more ‘adaptive programming’ have been prominent in international development practice for over a decade. Learning-by-doing is a crucial element of this, but programmes have often found it challenging to become more learning oriented. Establishing some form of reflective practice, against countervailing incentives, is difficult. Incorporating data collection processes that generate useful, timely and practical information to inform these reflections is even more so.This paper...

Sensemaking and Participatory Narrative Inquiry (PNI) are similar approaches, based on collecting stories about a real life experience from a large number of stakeholders on a topic of interest to the evaluation, and giving the storytellers themselves the responsibility for analyzing and making sense of the stories. Because a large number of stories are collected and self-interpreted, it is possible to conduct quantitative analysis of recurrent themes, perspectives and feelings emerging in...

Steff had the pleasure to co-author the first SenseMaker Practitioner Guide with a group of friends and colleagues supported and published by Oxfam and CRS. This practical guide is for those who wish to use SenseMaker to conduct assessments, monitor progress, and undertake evaluations or research. Drawing on more than a decade of experience, the authors share dozens of examples from international development, providing practical tips and ideas for context-specific adaptations. They show how...

Great overview of what to read on adaptive management. It’s a long one, so I’ve split it into two – second installment tomorrow. Christian Aid Ireland’s recent publication The Difference Learning Makes by Stephen Gray and Andy Carl made a bit of a splash. The study found that Christian Aid Ireland’s application of adaptive programming contributed to better development outcomes and supported more flexible delivery. The much vaunted MUVA programme in Mozambique is also coming to a close and...

Calls for more ‘adaptive programming’ have been prominent in international development practice for over a decade. Learning-by-doing is a crucial element of this, but programmes have often found it challenging to become more learning oriented. Establishing some form of reflective practice, against countervailing incentives, is difficult. Incorporating data collection processes that generate useful, timely and practical information to inform these reflections is even more so.This paper...

What might a different way of understanding rigour for work in complex adaptive systems look like?