Results 402 resources
In all the jobs I have held, the only training that has ever stayed with me was a three-day course on logframes, held in a very pleasant beach hotel on Fiji’s beautiful coral coast. This was a few months after I joined what was then the Overseas Development Administration, DFID’s forerunner. Three days on logframes. Yes really. Our Pacific team were gathered together to learn this new skill. The course was designed not only to help us think rigorously about how change happens, but also to...
Let’s Take the Con Out of Randomized Control Trials in Development (CID Faculty Working Paper No. 399; p. 40)Pritchett, L. - 2021 - Center for International Development, Harvard University
The enthusiasm for the potential of RCTs in development rests in part on the assumption that the use of the rigorous evidence that emerges from an RCT (or from a small set of studies identified as rigorous in a “systematic” review) leads to the adoption of more effective policies, programs or projects. However, the supposed benefits of using rigorous evidence for “evidence based” policy making depend critically on the extent to which there is external validity. If estimates of causal impact...
Value for money and adaptive programming - Approaches, measures and management [Working Paper]Laws, E., & Valters, C. - 2021 - ODI
- The United Kingdom’s Foreign, Commonwealth and Development Office (FCDO)’s standard economy, efficiency, effectiveness/cost-effectiveness and equity (4E) framework is still relevant for approaching, measuring and managing value for money (VfM) for adaptive programmes. • However, this framework needs to be reframed to capture and incentivise flexibility, learning and adaptation. • VfM appraisal and reporting should be done in a way that draws on beneficiary feedback and informs good...
What have we learned about learning? Unpacking the relationship between knowledge and organisational change in development agencies (Discussion Paper No. 9/2021)Yanguas, P. - 2021 - DIE - Deutsches Institut für Entwicklungspolitik
Development cooperation has spent decades wrangling over the merits, evidence, and implications of what we may term “the learning hypothesis”: the idea that increased knowledge by development organisations must logically lead to increased effectiveness in the performance of their development activities. Organisations of all stripes have built research and monitoring and evaluation (M&E) departments, adopted a multitude of knowledge management systems and tools, and tinkered with...
When asserting the value of theory-based methods, you often here words like “black boxes” and “causal mechanisms.” These are commonly…
In this final blog in the series, I want to look at the potential value of rubrics. While evaluability assessments can help us to…
Windows on the world: The power of assumptions in uncertain timesAston, T. - 2020, December 23 - Medium
In my last blog on theory-based Monitoring Evaluation and Learning (MEL), I explained why relationships matter, and how to assess change…
Program Logic Foundations: Putting the Logic Back into Program LogicHawkins, A. J. - 2020 - Journal of MultiDisciplinary Evaluation, 16(37), 38–57
Abstract Background: Program logic is one of the most used tools by the public policy evaluator. There is, however, little explanation in the evaluation literature about the logical foundations of program logic or discussion of how it may be determined if a program is logical. This paper was born on a long journey that started with program logic and ended with the logic of evaluation. Consistent throughout was the idea that the discipline of program evaluation is a pragmatic one, concerned...
A-ha! A moment etched in my memory: 20 or so researchers were...
Rules of Thumb – good idea or double-edged sword?Green, D. - 2020, October 1 - From Poverty to Power
A recent conversation with a good governance programme in Myanmar tried to identify its underlying rules of thumb. Was that a good idea?
Using middle-level theory to improve programme and evaluation design [Methods Brief]Cartwright, N. - 2020 - CEDIL
What can middle-level theory do? Middle-level theory (MLT) has several uses in development planning and evaluation. It helps predict whether a programme can be expected to work in a new setting. It offers insights into what design features are needed for success. It provides invaluable information for monitoring to see if the programme is on track and to fix problems that arise. It reveals the causal processes and related assumptions to be tested in an evaluation and helps identify...
What is Rapid Action Learning and how was it developed?Sanitation Learning Hub - 2020, September 22
To celebrate the publication of our latest Frontiers of Sanitation, we had a series of conversations with our colleagues and partners on our work on Rapid Action Learning so far. To download the publication in full, head to https://sanitationlearninghub.org/res...
How to Monitor and Evaluate an Adaptive Programme: 7 TakeawaysSikustahili, G., Adkins, J., Makongo, J., & Milligan, S. - 2020, September 18 - From Poverty to Power
Monitoring and Evaluation needs to be different to support the new generation of 'adaptive programmes' in aid. 4 M&E specialists in Tanzania explain how.
A smart new report explores how a good idea - theories of change - is distorted by the way it is implemented in the aid sector
Webinar - Sustainability Ready: what it takes to support & measure lasting changeCekan, J. - 2020, July 7 - Valuing Voices
On June 24th under GLocal’s UNConference, “Co-creating our future stories of hope and action”, Jindra Cekan, Holta Trandafili, and Isabella Jean presented their work on sustainability evaluations and exit strategies via local voices. We chaired a 2-hour discussion session on the following topics: Sustainability of global development projects and exit from them, The importance of valuing local partners’ and participants’ voices, How to embed ex-post evaluation of sustainability into the...
Big Data to Data Science -Moving from “What” to “How” in the MERL Tech Space (p. 20)Bertermann, K., Robinson, A., Bamberger, M., … Raftre, L. - 2020 - MERL Tech
This paper probes trends in the use of big data by a community of early adopters working in monitoring, evaluation, research, and learning (MERL) in the development and humanitarian sectors. Qualitative analysis was conducted on data from MERL Tech conference records and key informant interviews. Findings indicate that MERL practitioners are in a fragmented, experimental phase, with use and application of big data varying widely, accompanied by shifting terminologies. We take an in-depth...
Emerging Technologies and Approaches in Monitoring, Evaluation, Research, and Learning for International Development Programs (p. 20)Bruce, K., Gandhi, V. J., & Vandelanotte, J. - 2020 - MERL Tech
Emerging technology is making monitoring, evaluation, research and learning (MERL) more precise and enriching data. However, this evolution is so rapid that it can be difficult to stay informed about the field overall. This paper presents examples of emerging technology that are most often used in MERL for development programs, describes the pros and cons of their use, and discusses technology and ethics concerns that practitioners should keep in mind. The paper covers new types of data...
Dynamic knowledge management strategy development in international non-governmental organisationsWalsh, J. N., & Lannon, J. - 2020 - Knowledge Management Research & Practice, 0(0), 1–12
Knowledge management strategies are important for firms’ competitive positioning. This paper examines how knowledge management codification and personalisation strategies are developed in response to environmental and organisational dynamics in an international non-governmental organisation. A longitudinal case study of the organisation’s strategic reformulation of its KM strategy over a 2.5 period is drawn upon. The research examines how pressures in the firm’s operating environment led to...
What We Know About Traditional MERL Tech - Insights from a Scoping Review (p. 27)Tilton, Z., Harnar, M., Raftree, L., … Behr, M. - 2020 - Western Michigan University
This paper explores the peer-reviewed evidence base of “traditional” technology-enabled monitoring, evaluation, research, and learning (MERL Tech) in international development assistance from 2015 to 2019. The authors conducted a scoping review that searched seven databases, screened 3,054 reference titles and abstracts, coded 886 abstracts, and extracted and analyzed conclusions and recommendations from the full texts of 256 studies. The findings reveal the most frequently reported...
Uncertainty and COVID-19: A turning point for Monitoring Evaluation, Research and Learning? - A discussion note for aid actors, policymakers and practitionersTyrrel, L., Roche, C., & Jackson, E. - 2020 - Abt Associates
The COVID-19 pandemic has significantly shifted the context in which aid and development is being delivered. The global scale of the pandemic and the speed at which it is spreading mean that the ‘normal’ economic, ideological and organisational influences which shape (if not determine) aid delivery are in flux. This means that – for a relatively short-period – there is scope for aid actors to work collectively to embed more locally-led, politically-informed and adaptive forms of MERL in aid...
- Adaptive Approaches [+] (77)
- Cases (24)
- Courses (2)
- Donors (20)
- Geography (11)
MEL4 Adaptive Management
- Action Research (1)
- Appreciative Inquiry (6)
- Beneficiary Assessment (4)
- Case Study (6)
- Causal Mechanisms (12)
- Collaborative Outcome Mapping (6)
- Comparisons/Benchmarking (1)
- Contribution Analysis (7)
- Cost-Benefit Analysis (2)
- Cost-effectiveness analysis (1)
- Critical Systems Hueristics (7)
- cross-sectional study (1)
- Data mining (1)
- Delphi Survey (1)
- Democratic Evaluation (3)
- Descriptive Statistics (1)
- Desk based research/lit review (2)
- Developmental Evaluation (15)
- Empowerment Evaluation (5)
- Ethnography (4)
- Evaluability assessment (6)
- Evaluating Multi-project programmes (4)
- Focus Group Discussions (3)
- Horizontal Evaluation (2)
- Impact evaluation (7)
- Impact Oriented Monitoring and Evaluation System (3)
- Indicator-based approaches (11)
- Innovation History (3)
- Innovation System Analysis (3)
- Institutional Histories (4)
- Knowledge Management (8)
- Logical Framework (7)
- Mapping Visualization Methods (12)
- Most Significant Change (6)
- Narrative Based Approaches (1)
- Network Analysis (2)
- Objectives and options analysis (1)
- Outcome Harvesting (11)
- Outcome Mapping (26)
- Participatory Evaluation (13)
- Participatory Learning for Action/Participatory Rural Appraisal (2)
- Peer-Group Review (1)
- Policy Scientific Approach (2)
- Political Economy Analysis (10)
- Political Sentiment Analysis (PSA) (1)
- Portfolio Management (9)
- Positive Deviance (4)
- Post Project Evaluations (1)
- Process Tracing (5)
- Public Management Theory (2)
- Qualitative Comparative Analysis (7)
- Qualitative data analysis and grounded theory (2)
- Qualitative Impact Assessment Protocol (4)
- Quality Improvement (1)
- Randomized Controlled Trials (9)
- Rapid Action Learning (4)
- Realist Evaluation (8)
- Remote Monitoring (1)
- Rubrics (2)
- Rules of Thumb (3)
- Scenario Planning (6)
- SenseMaker (6)
- Social Media Metrics (1)
- Social Return on Investment (4)
- Stakeholder analysis (2)
- Stakeholder Feedback (3)
- Strategy testing (1)
- Success Case Method (5)
- Surveys (3)
- Sustainability (2)
- SWOT Analysis (1)
- Systemic Action Research (3)
- Systemic Change (4)
- Systems Mapping (2)
- Tech 4 MEL (4)
- Theory-based evaluations (5)
- TOC (Theory of Change) (45)
- Utilisation focused evaluation (8)
- Value for Money (7)
- Networks and Communities of Practice (7)
- Practical (22)
- Sectors [+] (42)
- Tools (2)