Your search

In all the jobs I have held, the only training that has ever stayed with me was a three-day course on logframes, held in a very pleasant beach hotel on Fiji’s beautiful coral coast. This was a few months after I joined what was then the Overseas Development Administration, DFID’s forerunner. Three days on logframes. Yes really. Our Pacific team were gathered together to learn this new skill. The course was designed not only to help us think rigorously about how change happens, but also to...

The enthusiasm for the potential of RCTs in development rests in part on the assumption that the use of the rigorous evidence that emerges from an RCT (or from a small set of studies identified as rigorous in a “systematic” review) leads to the adoption of more effective policies, programs or projects. However, the supposed benefits of using rigorous evidence for “evidence based” policy making depend critically on the extent to which there is external validity. If estimates of causal impact...

- The United Kingdom’s Foreign, Commonwealth and Development Office (FCDO)’s standard economy, efficiency, effectiveness/cost-effectiveness and equity (4E) framework is still relevant for approaching, measuring and managing value for money (VfM) for adaptive programmes. • However, this framework needs to be reframed to capture and incentivise flexibility, learning and adaptation. • VfM appraisal and reporting should be done in a way that draws on beneficiary feedback and informs good...

Development cooperation has spent decades wrangling over the merits, evidence, and implications of what we may term “the learning hypothesis”: the idea that increased knowledge by development organisations must logically lead to increased effectiveness in the performance of their development activities. Organisations of all stripes have built research and monitoring and evaluation (M&E) departments, adopted a multitude of knowledge management systems and tools, and tinkered with...

When asserting the value of theory-based methods, you often here words like “black boxes” and “causal mechanisms.” These are commonly…

In this final blog in the series, I want to look at the potential value of rubrics. While evaluability assessments can help us to…

In my last blog on theory-based Monitoring Evaluation and Learning (MEL), I explained why relationships matter, and how to assess change…

Abstract Background: Program logic is one of the most used tools by the public policy evaluator. There is, however, little explanation in the evaluation literature about the logical foundations of program logic or discussion of how it may be determined if a program is logical. This paper was born on a long journey that started with program logic and ended with the logic of evaluation. Consistent throughout was the idea that the discipline of program evaluation is a pragmatic one, concerned...

A-ha! A moment etched in my memory: 20 or so researchers were...

A recent conversation with a good governance programme in Myanmar tried to identify its underlying rules of thumb. Was that a good idea?

What can middle-level theory do? Middle-level theory (MLT) has several uses in development planning and evaluation. „ It helps predict whether a programme can be expected to work in a new setting. „ It offers insights into what design features are needed for success. „ It provides invaluable information for monitoring to see if the programme is on track and to fix problems that arise. „ It reveals the causal processes and related assumptions to be tested in an evaluation and helps identify...

To celebrate the publication of our latest Frontiers of Sanitation, we had a series of conversations with our colleagues and partners on our work on Rapid Action Learning so far. To download the publication in full, head to https://sanitationlearninghub.org/res...

Monitoring and Evaluation needs to be different to support the new generation of 'adaptive programmes' in aid. 4 M&E specialists in Tanzania explain how.

A smart new report explores how a good idea - theories of change - is distorted by the way it is implemented in the aid sector

On June 24th under GLocal’s UNConference, “Co-creating our future stories of hope and action”, Jindra Cekan, Holta Trandafili, and Isabella Jean presented their work on sustainability evaluations and exit strategies via local voices. We chaired a 2-hour discussion session on the following topics: Sustainability of global development projects and exit from them, The importance of valuing local partners’ and participants’ voices, How to embed ex-post evaluation of sustainability into the...

This paper probes trends in the use of big data by a community of early adopters working in monitoring, evaluation, research, and learning (MERL) in the development and humanitarian sectors. Qualitative analysis was conducted on data from MERL Tech conference records and key informant interviews. Findings indicate that MERL practitioners are in a fragmented, experimental phase, with use and application of big data varying widely, accompanied by shifting terminologies. We take an in-depth...

Emerging technology is making monitoring, evaluation, research and learning (MERL) more precise and enriching data. However, this evolution is so rapid that it can be difficult to stay informed about the field overall. This paper presents examples of emerging technology that are most often used in MERL for development programs, describes the pros and cons of their use, and discusses technology and ethics concerns that practitioners should keep in mind. The paper covers new types of data...

Knowledge management strategies are important for firms’ competitive positioning. This paper examines how knowledge management codification and personalisation strategies are developed in response to environmental and organisational dynamics in an international non-governmental organisation. A longitudinal case study of the organisation’s strategic reformulation of its KM strategy over a 2.5 period is drawn upon. The research examines how pressures in the firm’s operating environment led to...

This paper explores the peer-reviewed evidence base of “traditional” technology-enabled monitoring, evaluation, research, and learning (MERL Tech) in international development assistance from 2015 to 2019. The authors conducted a scoping review that searched seven databases, screened 3,054 reference titles and abstracts, coded 886 abstracts, and extracted and analyzed conclusions and recommendations from the full texts of 256 studies. The findings reveal the most frequently reported...

The COVID-19 pandemic has significantly shifted the context in which aid and development is being delivered. The global scale of the pandemic and the speed at which it is spreading mean that the ‘normal’ economic, ideological and organisational influences which shape (if not determine) aid delivery are in flux. This means that – for a relatively short-period – there is scope for aid actors to work collectively to embed more locally-led, politically-informed and adaptive forms of MERL in aid...