Your search

Evaluators who take a complexity-aware approach must consider tradeoffs related to theoretical parsimony, falsifiability, and measurement validity. These tradeoffs may be particularly pronounced with ex-post evaluation designs in which program theory development and monitoring frameworks are often completed before the evaluator is engaged. In this chapter, we argue that theory-based evaluation (TBE) approaches can address unique ex-post evaluation challenges that complexity-aware evaluation...

Our new guide provides practical advice to help any organisation working in public service apply the Human Learning Systems approach to their work. In doing so, they will be better equipped to explore, learn and respond to the unique strengths and needs of each person, family and community they serve.

Evaluability assessments (EAs) have differing definitions, focus on various aspects of evaluation, and have been implemented inconsistently in the last several decades. Climate change adaptation (CCA) programming presents particular challenges for evaluation given shifting baselines, variable time horizons, adaptation as a moving target, and uncertainty inherent to climate change and its extreme and varied effects. The Adaptation Fund Technical Evaluation Reference Group (AF-TERG) developed...

Some years ago, you could say “Scrum is agile” and ask “is Agile Scrum?” Now we know there is much more flesh on the bones. At this moment there are more than fifty known and less known agile approaches, frameworks or methods available. To get a first impression of the different approaches, I try to bring some structure in the jungle to approaches, methods and frameworks. In Figure 1, I position the best-known agile approaches in a structure. The approaches, frameworks or methods are...

This paper presents the case for systemic organisational change in the humanitarian system. The paper firstly shows that that organisational learning has tended to reinforce existing ways of working and has not been able to shift a culture that values action over reflection. As a result, the rest of the paper asks about the most significant changes in the humanitarian sector

CLARISSA (Child Labour: Action-Research-Innovation in South and South-eastern Asia) is a participatory evidence and innovation generating programme. We are generating evidence on the drivers of the worst forms of child labour (WFCL) and exploring how to address them through participatory Action Research (PAR) with children and other stakeholders in the leather supply chain in Dhaka, Bangladesh. Our main intervention modality is Systemic Action Research (SAR) (Burns, 2007), of which life...

Violent conflict and its aftermath are pressing problems, particularly for international development initiatives. However, the results of development in conflict contexts have generally been disappointing and their preventative potential thus questionable. Available Open Access, Lives Amid Violence argues that this is because practitioners adhere to a mental model that emphasises linearity, certainty, and causality, assuming that violence is best addressed through work plans that deliver...

This chapter examines good practices in implementing effective Monitoring, Evaluation, and Learning (MEL) systems within complex international development Democracy, Human Rights, and Governance (DRG) programs, which are characterized by challenges of non-linearity, limited evidence of theories of change, and contextual and politically contingent nature of outcomes. The chapter presents three cases of MEL systems in complex projects implemented by Pact across distinct and diverse operating...

My focus here is on the realities of evaluating in complexity where ‘nothing is clear, and everything keeps changing’. I outline how I use a series of ‘provocations’ that allow people to choose their own starting point. Sharing those choices fuels conversations that discover, explore, and co-create (rather than manage) our mutual expectations and assumptions and track how these might themselves be influenced by the work as it unfolds. This account draws on a review of literature and my...

Capturing the impact of community-led work The Centre for Public Impact, Dusseldorp Forum, and Hands Up Mallee have been exploring how stories can be used to more effectively communicate the impact of community-led systems change work. Community-led place based initiatives are modelling new ways of working - shifting away from top down, program-focussed approaches towards an approach grounded in systems thinking and community-led innovations. However, while these stories of change are...

Trust-based philanthropy is a holistic approach that requires alignment in a grantmaking organization’s four interrelated areas: 1) culture, 2) structure, 3) leadership, and 4) practices. This tool is designed to help funders at various stages of the trust-based journey examine how trust shows up across your organization, and identify areas that may need more inquiry, refinement, or deepening. This is intended as a reflection tool rather than a prescriptive tool.

The Outcomes Stars are a suite of evidence-based outcomes measurement and keywork tools, which drive an ‘enabling help’ approach to service delivery. They support a person-centred, collaborative and trauma informed approach and give service users, workers, managers and commissioners vital information about needs and progress. Since the first version was published in 2006, the unique features of the Outcomes Star contributed to its popularity and widespread use, with over 1,000 organisations...

This document is a an Introductory Toolkit for for civil servants. It is one component of a suite of documents that aims to act as a springboard into systems thinking for civil servants unfamiliar with this approach. These documents introduce a small sample of systems thinking concepts and tools, chosen due to their accessibility and alignment to civil service policy development, but which is by no means comprehensive. They are intended to act as a first step towards using systems thinking...

The UNDP Accelerator Labs were designed as an agile and dynamic Network to allow communication and information transfer between 91 Accelerator Labs in 115 countries, and with the global innovation ecosystem, UNDP as a whole, and thousands of partners including grassroots innovators and their communities. The accumulated knowledge of this Network creates new pathways to the solutions that hold the key to sustainable development problems. What it looked like and how it unfolded last year will...

USAID’s Bureau for Policy, Planning and Learning (PPL) and its support mechanism, LEARN, have developed a Collaborating, Learning, and Adapting (CLA) Framework and Maturity tool to help USAID missions think more deliberately about how to plan for and implement CLA approaches that fit the mission’s context and assist them in achieving their development objectives. While the tool is intended primarily for USAID audiences to be used in participatory self-assessment workshops, the CLA Framework...

USAID’s Bureau for Policy, Planning and Learning (PPL) and its support mechanism, LEARN, have developed a Collaborating, Learning, and Adapting (CLA) Framework and Maturity tool to help USAID missions think more deliberately about how to plan for and implement CLA approaches that fit the mission’s context and assist them in achieving their development objectives. While the tool is intended primarily for USAID audiences to be used in participatory self-assessment workshops, the CLA Framework...

Although collaborating, learning, and adapting (CLA) are not new to USAID and its implementing partners, they often do not happen regularly or systematically and are not intentionally resourced. The CLA Framework above identifies components and subcomponents to help you think more deliberately about what approach to CLA might be best tailored to your organizational or project context. The framework recognizes the diversity of what CLA can look like in various organizations and projects while...

This paper reviews promising methods for the evaluation of complex interventions that are new or have been used in a limited way. It offers a taxonomy of complex interventions in international development and draws on literature to discuss several methods that can be used to evaluate these interventions. Complex interventions are those that are characterised by multiple components, multiple stakeholders, or multiple target populations. They may also be interventions that incorporate...