Your search

The growing interest in systems-change initiatives sits alongside increasing pressure to demonstrate value for money (VFM), which is challenging for emergent, interconnected and often intangible work. A new way to assess the VFM of systems-change work involves considering the value of changing system conditions and the creation of potential value for future systems transformation. This innovation combines the Water of Systems Change framework with the Cycles of Value Creation to create five...

This blog by Jonathan Kuhn-Patrick (UK Evaluation Society Trustee and AI Working Group Lead) explores the five emotional stages many evaluators experience as they begin working with AI.

Quality assurance strategies when working on unfamiliar topics

This practical guide from the UK Evaluation Society explores how evaluators can use AI tools responsibly and transparently across all stages of the evaluation process.

Track to Change homepage

Earlier this year we spoke to 102 leaders from across the globe to ask: Ten years from now, what will we regret not having done today? This framing turned out to be a powerful device for collective horizon scanning and foresight. Across every conversation there was a sense that this moment demands more from us all, along with a strong eagerness to explore what we can own and act on. More than that, these discussions surfaced direction, hope and a way forward. From CEOs, professors, PhDs,...

This paper shares an insider's perspective on the spread of Thinking and Working Politically (TWP) across the US Agency for International Development (USAID), highlighting lessons learned along the way that are relevant even beyond the dissolution of the Agency in 2025.

Despite an emerging body of scholarship on applying generative AI (GenAI) to qualitative data analysis, this area remains underdeveloped. This article evaluates how GenAI can support thematic analysis using a publicly available interview dataset from Lumivero. It introduces Guided AI Thematic Analysis (GAITA), an adaptation of King et al.’s (2018) Template Analysis. This framework positions researchers as a reflexive instrument and intellectual leader while thoroughly guiding GPT-4 in four...

The CGIAR 2030 Research and Innovation Strategy commits organizational change with seven ways of working, including “Making the digital revolution central to our way of working”. In that context, Artificial Intelligence (AI), introduces both opportunities and risks to evaluation practice. Guided by the CGIAR-wide Evaluation Framework, integrating AI tools requires a governance approach to balance innovation with ethical responsibility, ensuring transparency, fairness, accountability, and...

One of the main questions evaluators have when using AI is: "How can I know if it performs well?" To answer this question, we have developed a guidance note aimed at capturing what we have learned so far about integrating AI into evaluation and to offer a framework for further exploration. Since we began our experiments with Large Language Models (LLMs) in the Spring of 2023, we have made significant progress in using Generative Artificial Intelligence (GenAI) for processing and analyzing...

This article presents an artificial intelligence-assisted causal mapping pipeline for gathering and analysing stakeholder perspectives at scale. Evidence relevant to constructing a programme theory, as well as evidence for the causal influences flowing through it, are both collected at the same time, without the evaluator needing to possess a prior theory. The method uses an artificial intelligence interviewer to conduct interviews, automated coding to identify causal claims in the...

Generative AI (GenAI) is evolving rapidly, and its use in violence against women research remains new and largely experimental. While researchers are beginning to explore GenAI’s potential, uncertainty around its risks, ethical challenges, and real-world application persists. Recognising the need for clear guidance, the Sexual Violence Research Initiative (SVRI) partnered with The MERL Tech Initiative (MTI) to develop this resource. This guide aims to provide background on GenAI, strengthen...

The post outlines the background and development of a new approach to assessing value for money (VfM) in public policies and social programs. King identifies a key problem: while there's increasing pressure to demonstrate VfM in public programs, traditional assessment methods are incomplete, with economics and evaluation operating as separate rather than integrated disciplines. Key points about the research development: 1. King developed a conceptual model for VfM evaluation, published in...

Be a real advocate for those we’re trying to serve. Be accountable for impact.

This paper describes, synthesises and analyses the work of 25 Action Research Groups that were the heartbeat of the CLARISSA Systemic Action Research programme. The CLARISSA programme worked to create participatory and systemic solutions to the worst forms of child labour in the adult entertainment sector in Nepal, and the leather sector in Bangladesh. The paper explores how the action research groups were set up, and how they worked through key stages of trust and relationship building,...

This article provides a comprehensive overview of rubric development in evaluation practice, focusing on stakeholder engagement and practical implementation. King explains that rubrics are essential tools for implementing evaluative reasoning, serving as frameworks that combine evidence, criteria, and standards to make transparent value judgments. The piece emphasizes that effective rubric development is inherently participatory, requiring meaningful stakeholder engagement for both ethical...

This five-step framework, developed and tested by a foundation, embeds learning in emergent systems change strategies. It prioritizes the testing of hypotheses and assumptions, uses learning questions, and calls for examining both confirming and disconfirming evidence. --- A framework for embedding learning in systems change strategies and for testing strategic uncertainties. Learning and evaluation approaches that accompany systems change efforts need to fit with and support the emergent...

The Reduced Access Analytical Methods (RAAM) toolkit is a practical resource designed to help humanitarian practitioners overcome monitoring challenges in reduced access environments. Reduced access can be caused by natural disaster, conflict, political instability, or other factors, and typically makes it difficult to conduct normal monitoring of program implementation. The RAAM toolkit offers technical and managerial tools for a menu of analytical methods that can fill information gaps...

Over the course of this paper we lay out the basis of the Carve-Out method, an approach that leverages a behavioural framework to allow organisations (even those burdened with layers of bureaucracy and entrenched ideas) to create intentionally designed environments that give people the space, resources and support they need to explore and test new ideas. Ideas that may go on to transform the core of their organisation. The Carve-Out method is based on a simple insight: That if we want to...