Your search

One of the main questions evaluators have when using AI is: "How can I know if it performs well?" To answer this question, we have developed a guidance note aimed at capturing what we have learned so far about integrating AI into evaluation and to offer a framework for further exploration. Since we began our experiments with Large Language Models (LLMs) in the Spring of 2023, we have made significant progress in using Generative Artificial Intelligence (GenAI) for processing and analyzing...

Hey there 👋We've created a new presentation called "Questions you can answer with causal mapping." It's designed to help you get a better handle on what causal mapping is all abou

Process tracing (PT) involves a detailed analysis of the processes that link interventions to outcomes. PT is particularly useful for evaluating interventions that are difficult to quantify, such as knowledge work or institution building. It involves creating a detailed causal theory, tracking the process theory of change (pToC) by examining the observable evidence, and learning general lessons from the cases studied. PT offers two main benefits to evaluators: first, it provides a clear way...

This article presents an artificial intelligence-assisted causal mapping pipeline for gathering and analysing stakeholder perspectives at scale. Evidence relevant to constructing a programme theory, as well as evidence for the causal influences flowing through it, are both collected at the same time, without the evaluator needing to possess a prior theory. The method uses an artificial intelligence interviewer to conduct interviews, automated coding to identify causal claims in the...

Generative AI (GenAI) is evolving rapidly, and its use in violence against women research remains new and largely experimental. While researchers are beginning to explore GenAI’s potential, uncertainty around its risks, ethical challenges, and real-world application persists. Recognising the need for clear guidance, the Sexual Violence Research Initiative (SVRI) partnered with The MERL Tech Initiative (MTI) to develop this resource. This guide aims to provide background on GenAI, strengthen...

The post outlines the background and development of a new approach to assessing value for money (VfM) in public policies and social programs. King identifies a key problem: while there's increasing pressure to demonstrate VfM in public programs, traditional assessment methods are incomplete, with economics and evaluation operating as separate rather than integrated disciplines. Key points about the research development: 1. King developed a conceptual model for VfM evaluation, published in...

Ripple effects mapping is a qualitative and participatory method, developed to capture the dynamic nature and interacting elements of an initiative, and its impacts. We present our experiences of using ripple effects mapping to evaluate complex public health initiatives across seven case studies in Bradford, UK. Seven researchers engaged in qualitative reflective practice to capture their individual experiences of using ripple effects mapping within their research and practice; outlining how...

Be a real advocate for those we’re trying to serve. Be accountable for impact.

The conventional paradigm in political economy routinely treats living, complex, adaptive social systems as machine-like objects. This treatment has driven political economists to oversimplify big, complex social processes using mechanical models, or to ignore them altogether. In development, this has led to theoretical dead ends, trivial agendas, or failed public policies. This article proposes an alternative paradigm: adaptive political economy. It recognizes that social systems are...

The Evaluation Handbook – 2025 Edition reflects the European Commission’s steadfast commitment to promoting a culture of results, accountability, and learning across the EU’s external action. As one of the world’s leading development and international cooperation actors, the European Commission bears a particular responsibility to ensure that its interventions are informed by robust evidence, deliver tangible results, and represent the highest standards of transparency and effectiveness in...

Introduction Phase 1 - Power Up Phase 2 - Level Up

This paper describes, synthesises and analyses the work of 25 Action Research Groups that were the heartbeat of the CLARISSA Systemic Action Research programme. The CLARISSA programme worked to create participatory and systemic solutions to the worst forms of child labour in the adult entertainment sector in Nepal, and the leather sector in Bangladesh. The paper explores how the action research groups were set up, and how they worked through key stages of trust and relationship building,...

This article provides a comprehensive overview of rubric development in evaluation practice, focusing on stakeholder engagement and practical implementation. King explains that rubrics are essential tools for implementing evaluative reasoning, serving as frameworks that combine evidence, criteria, and standards to make transparent value judgments. The piece emphasizes that effective rubric development is inherently participatory, requiring meaningful stakeholder engagement for both ethical...

After eight years, I am leaving Porticus. From January 2025, I'll be starting a new chapter - working in a freelance capacity to support systems change efforts through strong learning, evaluation and strategy. Having worked with the amazing Porticus UK team for the first four years, I moved to Amsterdam in 2020 to work in the central strategy and learning team, supporting colleagues around the globe to embed strategy, evaluation and learning in their work. I loved this work. I learned a...

Explore Climate KIC’s S-ToC guide A practical and flexible resource designed to help teams and partners navigate the complexity of systems change in the face of the climate crisis. Our S-ToC approach integrates systems thinking to support adaptive monitoring, evaluation, and ongoing learning. This guide empowers users to analyse systems, identify leverage points, and co-create change-oriented strategies that evolve with context. Whether you’re working on a small-scale pilot or a...

This five-step framework, developed and tested by a foundation, embeds learning in emergent systems change strategies. It prioritizes the testing of hypotheses and assumptions, uses learning questions, and calls for examining both confirming and disconfirming evidence. --- A framework for embedding learning in systems change strategies and for testing strategic uncertainties. Learning and evaluation approaches that accompany systems change efforts need to fit with and support the emergent...