Your search
Results 307 resources
-
One of the main questions evaluators have when using AI is: "How can I know if it performs well?" To answer this question, we have developed a guidance note aimed at capturing what we have learned so far about integrating AI into evaluation and to offer a framework for further exploration. Since we began our experiments with Large Language Models (LLMs) in the Spring of 2023, we have made significant progress in using Generative Artificial Intelligence (GenAI) for processing and analyzing...
-
Hey there 👋We've created a new presentation called "Questions you can answer with causal mapping." It's designed to help you get a better handle on what causal mapping is all abou
-
Process tracing (PT) involves a detailed analysis of the processes that link interventions to outcomes. PT is particularly useful for evaluating interventions that are difficult to quantify, such as knowledge work or institution building. It involves creating a detailed causal theory, tracking the process theory of change (pToC) by examining the observable evidence, and learning general lessons from the cases studied. PT offers two main benefits to evaluators: first, it provides a clear way...
-
This article presents an artificial intelligence-assisted causal mapping pipeline for gathering and analysing stakeholder perspectives at scale. Evidence relevant to constructing a programme theory, as well as evidence for the causal influences flowing through it, are both collected at the same time, without the evaluator needing to possess a prior theory. The method uses an artificial intelligence interviewer to conduct interviews, automated coding to identify causal claims in the...
-
Generative AI (GenAI) is evolving rapidly, and its use in violence against women research remains new and largely experimental. While researchers are beginning to explore GenAI’s potential, uncertainty around its risks, ethical challenges, and real-world application persists. Recognising the need for clear guidance, the Sexual Violence Research Initiative (SVRI) partnered with The MERL Tech Initiative (MTI) to develop this resource. This guide aims to provide background on GenAI, strengthen...
-
The post outlines the background and development of a new approach to assessing value for money (VfM) in public policies and social programs. King identifies a key problem: while there's increasing pressure to demonstrate VfM in public programs, traditional assessment methods are incomplete, with economics and evaluation operating as separate rather than integrated disciplines. Key points about the research development: 1. King developed a conceptual model for VfM evaluation, published in...
-
Ripple effects mapping is a qualitative and participatory method, developed to capture the dynamic nature and interacting elements of an initiative, and its impacts. We present our experiences of using ripple effects mapping to evaluate complex public health initiatives across seven case studies in Bradford, UK. Seven researchers engaged in qualitative reflective practice to capture their individual experiences of using ripple effects mapping within their research and practice; outlining how...
-
Be a real advocate for those we’re trying to serve. Be accountable for impact.
-
The conventional paradigm in political economy routinely treats living, complex, adaptive social systems as machine-like objects. This treatment has driven political economists to oversimplify big, complex social processes using mechanical models, or to ignore them altogether. In development, this has led to theoretical dead ends, trivial agendas, or failed public policies. This article proposes an alternative paradigm: adaptive political economy. It recognizes that social systems are...
-
The Evaluation Handbook – 2025 Edition reflects the European Commission’s steadfast commitment to promoting a culture of results, accountability, and learning across the EU’s external action. As one of the world’s leading development and international cooperation actors, the European Commission bears a particular responsibility to ensure that its interventions are informed by robust evidence, deliver tangible results, and represent the highest standards of transparency and effectiveness in...
-
Introduction Phase 1 - Power Up Phase 2 - Level Up
-
This paper describes, synthesises and analyses the work of 25 Action Research Groups that were the heartbeat of the CLARISSA Systemic Action Research programme. The CLARISSA programme worked to create participatory and systemic solutions to the worst forms of child labour in the adult entertainment sector in Nepal, and the leather sector in Bangladesh. The paper explores how the action research groups were set up, and how they worked through key stages of trust and relationship building,...
-
This article provides a comprehensive overview of rubric development in evaluation practice, focusing on stakeholder engagement and practical implementation. King explains that rubrics are essential tools for implementing evaluative reasoning, serving as frameworks that combine evidence, criteria, and standards to make transparent value judgments. The piece emphasizes that effective rubric development is inherently participatory, requiring meaningful stakeholder engagement for both ethical...
-
After eight years, I am leaving Porticus. From January 2025, I'll be starting a new chapter - working in a freelance capacity to support systems change efforts through strong learning, evaluation and strategy. Having worked with the amazing Porticus UK team for the first four years, I moved to Amsterdam in 2020 to work in the central strategy and learning team, supporting colleagues around the globe to embed strategy, evaluation and learning in their work. I loved this work. I learned a...
-
Explore Climate KIC’s S-ToC guide A practical and flexible resource designed to help teams and partners navigate the complexity of systems change in the face of the climate crisis. Our S-ToC approach integrates systems thinking to support adaptive monitoring, evaluation, and ongoing learning. This guide empowers users to analyse systems, identify leverage points, and co-create change-oriented strategies that evolve with context. Whether you’re working on a small-scale pilot or a...
-
This five-step framework, developed and tested by a foundation, embeds learning in emergent systems change strategies. It prioritizes the testing of hypotheses and assumptions, uses learning questions, and calls for examining both confirming and disconfirming evidence. --- A framework for embedding learning in systems change strategies and for testing strategic uncertainties. Learning and evaluation approaches that accompany systems change efforts need to fit with and support the emergent...
Explore
Theme
-
MEL4 Adaptive Management
- Action Inquiry/Collective Leadership (5)
- After Action Reviews (5)
- AI support (15)
- Artificial Intelligence (7)
- Beneficiary Assessment/Engagement (3)
- Capacity Development (3)
- Case Study (2)
- Causal mapping, pahtways, mechanisms (17)
- Circular charts applications (radar, pie, sunburst, spiderweb, orbic, etc) (4)
- Community Led MEL (2)
- Context Monitoring (3)
- Contribution Analysis (9)
- Cost-Benefit Analysis (1)
- Critical Friends (3)
- Critical Systems Heuristics (1)
- Democratic Evaluation (1)
- Desk based research/lit review (1)
- Diaries/Journals/Logs (3)
- Emergent Learning (3)
- Equitable Evaluation (9)
- Ethnography / Rapid Ethnography (1)
- Evaluability assessment (2)
- Evaluating Multi-project programmes (2)
- Ex-post Evaluation (5)
- Feedback Systems (4)
- Horizon Scanning / Scenario Planning (5)
- Humour (1)
- Impact evaluation (8)
- Impact Oriented Monitoring and Evaluation System (2)
- Innovation System Analysis (1)
- Institutional Histories (1)
- Knowing Unknowns (1)
- Knowledge Management (4)
- Logical Framework (2)
- MEL Bricolage (3)
- MEL in International Development (41)
- Most Significant Change (3)
- Narrative Based Approaches (2)
- Network Analysis (6)
- Outcome Harvesting (6)
- Outcome Mapping (6)
- Participatory Action Research (12)
- Participatory Approaches and Evaluation (9)
- Participatory Learning and Action - PLA (3)
- Participatory Rural Appraisal - PRA, RRA (1)
- Peers/Peer-Group Review (2)
- Place-based initiatives (2)
- Political Economy Analysis (5)
- Political Settlements Analysis (1)
- Portfolio Approach & Management (13)
- Positive Deviance (3)
- Post Project Evaluations (1)
- Power Analysis (1)
- Process Tracing (11)
- Qualitative Comparative Analysis (1)
- Qualitative data analysis and grounded theory (1)
- Randomized Controlled Trials (6)
- Realist Evaluation (5)
- Relationships weaving and facilitation (4)
- Remote Monitoring (1)
- Rigour (9)
- Rubrics (17)
- Rules of Thumb (1)
-
Sense-making
(10)
- SenseMaker (4)
- Stakeholder analysis (2)
- Strategy testing (2)
- Surveys (1)
- Sustainability (4)
- Systemic Change (46)
- Systems Mapping (7)
- Tech 4 MEL (5)
- Theory-based evaluations (7)
- TOC (Theory of Change) (34)
- Trust-based evaluation (/philanthropy /learning) (7)
- Value for Investment (6)
- Value for Money (6)
-
Adaptive Approaches [+]
(119)
- Adaptive/Emergent Learning (16)
- Adaptive Management (38)
- Adaptive Rigour (2)
- Agile & Lean approaches (4)
- CLA (Collaborating Learning Adapting) (6)
- Design Thinking / HCD / Appropriate tech (2)
- MSD - Market Systems Development (6)
- Multi-Stakeholder Partnerships (1)
- Other sectors (6)
- Participation (6)
- PDIA (Problem-Driven Iterative Adaptation) (2)
- PEA (Political Economy Analysis) (4)
- Positive Deviance, 2 loops models, agentic capacity (2)
- Results Based Management (1)
- Systemcraft (1)
- Systems Thinking / Complexity (48)
- TWP (Thinking & Working Politically) (6)
- Cases (38)
- Courses (1)
-
Development Actors Perspectives
(59)
- Adaptive Management orgs (1)
- AFD (Agence Française de Développement) (1)
- China (1)
- Develpment Industry - Private Companies and ThinkTanks (4)
- EU (1)
- FCDO/DFID (UK) (11)
- GIZ (Germany) (5)
- Hivos - Netherlands (1)
- Irish Aid (1)
- KOICA (Korea's International Co-operation Agency) (1)
- NGO Perspectives (13)
- OECD/DAC - Results Based Management (2)
- Private Donors (OSF, Hewlett...) (3)
- UNDP, UN Global Pulse, UN... (10)
- USAID (12)
- World Bank (2)
-
Geography
(39)
-
Africa
(21)
- Central Africa (3)
-
Eastern Africa
(18)
- Kenya (2)
- Malawi (3)
- Mozambique (5)
- Rwanda (2)
- Somalia (4)
- South Sudan (1)
- Tanzania (2)
- Uganda (4)
- Zambia (3)
- Zimbabwe (4)
- Northern Africa (3)
-
Southern Africa
(3)
- Lesotho (1)
- South Africa (1)
- Swaziland (1)
- West Africa (13)
-
Americas
(7)
-
Central America
(4)
- Ecuador (2)
- El Salvador (1)
- Guatemala (2)
- Mexico (3)
- North America (1)
- South America (4)
-
Central America
(4)
-
Asia
(20)
- South-eastern Asia (2)
-
Southern Asia
(15)
- Bangladesh (10)
- India (1)
- Nepal (9)
- Pakistan (3)
- Sri Lanka (1)
-
Western Asia
(3)
- Israel (1)
- Jordan (1)
- Lebanon (1)
- State of Palestine (1)
- Syrian Arab Republic (1)
-
Europe
(4)
-
Northern Europe
(2)
- United Kingdom (2)
-
Southern Europe
(1)
- Spain (1)
-
Western Europe
(1)
- Germany (1)
-
Northern Europe
(2)
- Oceania (2)
-
Africa
(21)
- Networks and Communities of Practice (1)
-
Practical
(50)
- Tools (14)
-
Sectors [+]
(102)
- Advocacy and Activism (3)
- Agriculture (3)
- Alternative Development (9)
- Cash Trasfers (2)
- Children (9)
- Citizen Engagement (2)
- Climate Change (6)
- Economic development (7)
- Education (5)
- Employment (1)
- Fragile and Conflict Aflicted Settings (3)
- Gender (3)
- Governance and Accountability (17)
- Health (2)
- Humanitarian Aid (3)
- Innovation (in Development) (5)
- Institutional Capacity & Change (2)
- Knowledge to Practice (4)
- Locally driven development (4)
- Organizational Change (3)
- Peace Building (2)
- Philanthropy/Funding (14)
- Private Sector Development (1)
- Research for Development (R4D) (5)
- Scaling up / Propagating (6)
- Social Accountability (2)
- Social Change (1)
- Social Protection (4)
- Technology (in Development) (1)
- Youth (1)
Resource type
- Blog Post (52)
- Book (12)
- Book Section (12)
- Conference Paper (1)
- Journal Article (63)
- Magazine Article (4)
- Manuscript (1)
- Presentation (4)
- Radio Broadcast (1)
- Report (139)
- Software (1)
- Thesis (2)
- Video Recording (8)
- Web Page (7)