Your search

The complexity of issues addressed by research for development (R4D) requires collaborations between partners from a range of disciplines and cultural contexts. Power asymmetries within such partnerships may obstruct the fair distribution of resources, responsibilities and benefits across all partners. This paper presents a cross-case analysis of five R4D partnership evaluations, their methods and how they unearthed and addressed power asymmetries. It contributes to the field of R4D...

Evaluation practitioners in the international development sector have given considerable attention in recent years to process tracing as a method for evaluating impact, including discussion of how to assess the relative importance of causal factors. Despite the increasing interest, there is a relative dearth of examples of practical learning and evidence of applying process tracing in practice. This CDI Practice Paper draws on comparative learning from applying three different types of...

Nearly all challenges in international development tend to be complex because they depend on constantly evolving human behaviour, systems, and contexts, involving multiple actors, entities, and processes. As a result, both the discovery and scaling of innovations to address challenges in development often involve changes in system behaviour or even system-level transformation. This is rarely a linear process over time and can result in unexpected outcomes. Existing evaluation techniques...

In this blog we are sharing a digest of some of the many useful and innovative monitoring, evaluation and learning resources and efforts that have come through the M&E Sandbox in 2022. A lot of these resources have been shared by our community in response to the overwhelmingly positive feedback from the launch of the Sandbox (please keep them coming!). We hope you find it useful. We have grouped these efforts and resources under six broad questions: - How do we measure systems...

In the decades since the Army created the After Action Review (AAR), businesses have embraced the practice as a way of learning from both failure and success. But all too often the practice gets reduced to nothing more than a pro forma exercise. The authors of this article describe the history and philosophy of the original AAR, debunk three myths about the practice that impede its proper use, and finally suggest three improvements that can help business leaders make the most of it.

On December 13, 2022, Social Impact hosted a webinar in our Evidence for Impact series, "Strengthen Your Team's CLA Practices: Introducing the CLA Maturity Tool for USAID Implementers." Through the session, we shared more about the origin and history of the USAID tool upon which this version is based, why and how we updated

The Collaborating, Learning & Adapting (CLA) Maturity Tool has been used by USAID operating units since 2015. The tool enables staff to self-assess their current CLA practice and plan ways to improve their internal and external collaboration, organizational learning efforts, and adaptive management practices. Recently, SI built on this resource to create the CLA Maturity Tool for implementing partners (IPs) to provide a version that speaks more directly to the experience of international and local organizations. Learn more here.

How can donors and grantees work together to create effective monitoring, evaluation, and learning (MEL) practices that drive field-wide transformation? The Open Society Foundation’s Fiscal Governance Program found success by focusing on six key approaches, including empowering grantees and relinquishing power. In 2021, an external close-out evaluation by Intention to Impact of the program (which ran for 7 years and gave over $150 million in grants) revealed something pretty remarkable—the...

“Hacking by the prompt”—writing simple yet creative conversational instructions in ChatGPT's message window—revealed many valuable additions to the evaluator's toolbox for all stages of the evaluation process. This includes the production of terms of reference and proposals for the dissemination of final reports. ChatGPT does not come with an instruction book, so evaluators must experiment creatively to understand its potential. The surprising performance of ChatGPT leads to the question:...

Effective learning is a key driver of market systems change, with the potential to enhance system competitiveness, resilience, and inclusiveness. Shifting the Locus of Learning: Catalyzing Private Sector Learning to Drive Systemic Change recently outlined a rationale for enhancing the scale and quality of learning in a system and identifying 10 strategies programs can contextualize to catalyze learning. These strategies are also backed with robust examples from 13 programs doing this work...

Large language models (LLMs) are a type of generative artificial intelligence (AI) designed to produce text-based content. LLMs use deep learning techniques and massively large data sets to understand, summarize, generate, and predict new text. LLMs caught the public eye in early 2023 when ChatGPT (the first consumer facing LLM) was released. LLM technologies are driven by recent advances in deep-learning AI techniques, where language models are trained on extremely large text data from the...

This document describes key principles of the Value for Investment evaluation approach and provides guidance on how to use it to design and implement evaluations, using the evaluation of the Youth Primary Mental Health and Addictions (Youth PMHA) initiative as an illustrative example.

This document offers practical guidance for assessing the Value for Money (VfM) of government- and donor-financed programmes and policy interventions. In line with OPM’s focus and mission, it has been predominantly applied in the international development sector, but the approach upon which it is based is also used in the context of domestic public policy and programmes.1 There is increasing scrutiny on VfM in international development, but a lack of appropriate methods to support its...

How can we measure and learn when promoting systems change? It’s a challenge that has inspired Laudes Foundation to develop a rubrics-based methodology to help us, our partners and the wider field of philanthropy, understand our contribution to change, while learning and adapting to new and unforeseen circumstances. Change cannot be captured by numbers alone because metrics put the focus on what can be counted, not always what’s most important. Rubrics are a framework that set a standard...

Systems thinking approaches are gaining traction as an effective way of understanding and working with increasing complexity. They are being put forward by the Organisation for Economic Co-operation and Development as well as the World Health Organisation as a way to tackle the complex and unpredictable environments we now operate in. As the world has become increasingly interconnected, national or local boundaries cannot isolate and control social problems. The climate emergency, war and...

While many knowledge workers may fear that the rise of artificial intelligence (AI) will threaten their jobs, this article argues that small evaluation businesses should embrace AI tools to increase their value in the marketplace and remain relevant. In this article, consultants from a research, evaluation, and strategy firm, Intention 2 Impact, Inc., make a case for using AI tools to disrupt business as usual in evaluation from theoretical and practical perspectives. Theoretically, AI may...

Audience This guidance is primarily aimed at development and humanitarian professionals who design or manage monitoring and evaluation processes to support design and implementation of qualitative monitoring using Most Significant Change (MSC), Outcome Harvesting (OH), or Outcome Mapping (OM), which are participatory, outcome-focused qualitative methods. Purpose This guidance is a resource to strengthen qualitative monitoring, specifically addressing commonplace gaps or weakness in the...