Building a culture of learning at scale: learning networks for systems change. - McKenzie, Fiona (Orange Compass & Paul Ramsay Foundation, 2021)
This scoping paper explores the question ‘what would it take to build a culture of learning at scale?’. It focuses on systems-wide learning that can help to inform systems change efforts in complex contexts. To answer this question, literature was reviewed from across diverse disciplines and the realms of education, innovation systems, systems thinking and knowledge management. This inquiry was also supported by in-depth interviews with numerous specialists from the for-purpose sector and the examination of several case studies of learning across systems. The goal was to derive common patterns to inform a ‘learning for systems change’ framework. Learning for systems change is critical when working with complexity. The dynamic nature of complex adaptive systems requires an ability to continually sense and learn from the system and adapt accordingly. This is because the nature of the challenge and ‘what works’ to meet the challenge is continually shifting (Lowe and Plimmer, 2019). This requires an ongoing process of iterative inquiry that draws upon wisdom and insights from across the system. Such learning challenges traditional siloes of expertise and organisational boundaries (Clarke et al., 2019). Learning is not simply a nice to have. It is critical for greater impact and improved outcomes, particularly in mission-driven organisations and initiatives (Price et al., 2019). In this paper, a ‘learning networks’ approach is proposed, one that draws upon individual, group and systems-wide learning to build capacity and resilience for systems change in uncertain environments. This fills a gap in the literature where the focus is largely on learning within organisations. Instead, the focus here is on what is required to support learning to occur across scales and boundaries - from the individual to system-wide. A simple meta-framework for developing learning networks is proposed that includes high level guidance on the enabling conditions - the mindsets, relationships, processes and structures- that would enable learning networks to flourish.

Building a Better International NGO: Greater than the Sum of the Parts? - Crowley, James; Ryan, Morgana (Kumarian Press, 2013)
In the wake of tremendous growth in the size and scope of their activities, as well as the increased complexity of their programs, how can large international NGOs work effectively―so that the whole is greater than the sum of the parts? James Crowley and Morgana Ryan address this question, drawing on their extensive hands-on experience to offer a practical and even provocative guide. The authors cover a range of essential topics, among them: What are INGOs good at? What should they be good at? Where does new technology fit in? What about accountability? What’s the best way to tackle strategic planning? In the process, they challenge those in leadership positions to recognize and implement the changes that are needed so that their organizations can perform better―and stay relevant―in the decades to come.

Budgeting for Developmental Evaluation: An Interview with Michael Quinn Patton - Better Evaluation (2012)

Broadening the range of designs and methods for impact evaluations - Stern, Elliot; Stame, Nicoletta; Mayne, John; Forss, Kim; Davies, Rick; Befani, Barbara (DFID, 2012)

Broad Agency Announcement for Locally Led Development Innovation - USAID (USAID, 2019)
This BAA allows USAID Operating Units (OUs) to co-create, co-design, co-invest, and collaborate in the research, development, piloting, testing, and scaling of innovative, practical, and cost-effective interventions to catalyze locally led development. The BAA aligns with a number of Agency priorities and policies, including the Journey to Self-Reliance, resilience, procurement innovation, and expanding and diversifying the partner base - as well as the New Partnerships Initiative and Acquisition and Assistance Strategy. E3/LS has put up the BAA’s first Addendum, "New Directions in Advancing Locally Led Development," which seeks Expressions of Interest on the following: - Engaging the Local Private Sector - Conflict, Post-Conflict, and Non-Permissive Environments - Effective Partnerships - The Changing Role of the Donor - Local Giving, Philanthropy, and Other Private Resources

Bringing Participation into Complexity-Aware MEL: What is the evidence? - Apgar, Marina; Higdon, Grace Lyn (2018)

Bringing children into the life story collection process - Shrestha, Kapil (CLARISSA, 2021)
The CLARISSA Social Protection (SP) intervention provided six months of unconditional cash transfers to every household in the Gojmohol neighbourhood,...

Bringing adaptive management to life: Insights from practice - Arora, Anmol; Gogoi, Elizabeth; Joy, Divya; Kumar, Pankaj; Luthra, Rajni; Pal, Uma; Pervaiz, Arif (Oxford Policy Management, 2019)

Bridging the Gap: Synthesising Evidence from Secondary Quantitative and Primary Qualitative Data - Roelen, Keetie (IDS, 2016)

Bridging the Gap: How Real-Time Data Can Contribute to Adaptive Management in International Development - Ben Ramalingam; Inka Barnett; Kevin Hernandez; Panthea Lee; Anna Levy; Carrie Oppenheimer; Dennis Whittle; Craig Valters; Leni Wild (USAID, 2017)
The ongoing digital revolution has seen rapid growth in the deployment of technology enabled real-time data initiatives in international development and humanitarian work, developed with the goal of accelerating decision-making processes and enhancing aid effectiveness and efficiency.

Bridging Real-Time Data and Adaptive Management: Ten Lessons for Policy Makers and Practitioners - Ben Ramalingam; Inka Barnett; Kevin Hernandez; Panthea Lee; Anna Levy; Carrie Oppenheimer; Dennis Whittle; Craig Valters; Leni Wild (USAID, 2017)
The ongoing digital revolution has seen rapid growth in the deployment of technology enabled real-time data initiatives in international development and humanitarian work, developed with the goal of accelerating decision-making processes and enhancing aid effectiveness and efficiency.

Bridging Real-Time Data and Adaptive Management in International Devepment - Case Study Report - Ramalingam, Ben; Barnett, Inka; Valters, Craig; Oppenheimer, Carrie; Levy, Anna; Hernandez, Kevin (IDS, 2017)

Bridging & Bonding: Improving Links between Transparency & Accountability Actors - Wanjiku Kelbert, Alexandra (2014)

Breaking the Mould: Alternative approaches to monitoring and evaluation - Dillon, Neil (ALNAP, 2019)
This paper looks at a range of M&E innovations that are designed specifically to provide input to ongoing iterative decision-making and learning at the project level. It identifies three key areas for potential innovation: 1) timing of M&E data provision; 2) flexibility of M&E frameworks to evolve with programme change; and 3) approaches to integrate diverse perspectives on project implementation in a meaningful way. It then looks at a collection of approaches currently being used in each of these three areas through a series of ‘practice examples’, considering the key lessons learned. Finally, the paper discusses the major opportunities and challenges for applying and scaling up the use of these approaches inside the humanitarian sector.

(Breaking) The Iron Triangle of Evaluation - Reynolds, Martin (IDS Bulletin, 2015)
Keywords: Evaluation; impact

Breaking free from the theory of change straight jacket - Apgar, Marina; Snijder, Mieke; Paul, Sukanta (CLARISSA, 2024)
The CLARISSA Social Protection Intervention was set us as an innovative social policy intervention for tackling social ills, with a...

Bradford Hill Criteria for Causal Inference - King, Julian (2015)
We think we’re good at determining causality, but we suck at it One of the great challenges in evaluation is determining whether the results we’re seeing are because of the program we’re evaluating, some other influences out there in the big world, or random chance. At one level, this is an everyday, common sense task. As a species we’ve been making judgments about causation for a million years or so. Unfortunately, though, the way we are wired does not predispose us to logical thinking. We are inclined to be led astray by all sorts of biases and heuristics. Over time, the rocket science for dealing with causation has become more sophisticated – a key example being the experimental study design or randomised controlled trial (RCT). And our evidence base about what works has been enriched as a result. But deep down we’re still biased, heuristical beings and not very good at thinking things through. We’ve become so enthusiastic about experimental designs we’re a little inclined to think they are the only way to determine whether A causes B. Such a rigid view is no much use in the real world, where there are all sorts of ethical, conceptual, practical and economic barriers that mean we can’t always conduct RCTs. Even where technically possible, they are not necessarily the best tool for every job.

Bootcamp Bootleg Design Thinking Toolkit - d.school (Institute of Design, Stanford University, 2010)
Keywords: IMPORTANT

Book Review: ‘Thinking and Working Politically in Development’ - Green, Duncan (From Poverty to Power, 2020)
Review of a new book that explores the 'secret sauce' of Coalitions for Change - an unusually successful governance programme in the Philippines

Book Review: Branko Milanovic's brilliant take on Global Inequality (From Poverty to Power, 2016)
Some of my favourite development economists are nomads, people with feet in different regions, which seems to make them better able to identify interesting patterns and similarities/differences bet...

Blurring the Boundaries: Citizen Action Across States and Societies - Benequista, Nicholas; Gaventa, John (Brighton: Citizenship DRC, 11., 2011)

Black Box Thinking: The Surprising Truth About Success - Syed, Matthew (Hachette UK, 2015)
The Sunday Times No.1 Bestseller From the Bestselling Author of BounceWhat links the Mercedes Formula One team with Google?What links Team Sky and the aviation industry?What connects James Dyson and David Beckham?They are all Black Box Thinkers.Black Box Thinking is a new approach to high performance, a means of finding an edge in a complex and fast-changing world. It is not just about sport, but has powerful implications for business and politics, as well as for parents and students. In other words, all of us.Drawing on a dizzying array of case studies and real-world examples, together with cutting-edge research on marginal gains, creativity and grit, Matthew Syed tells the inside story of how success really happens - and how we cannot grow unless we are prepared to learn from our mistakes.
Google-Books-ID: f1eNBQAAQBAJ
Keywords: Psychology; Sports & Recreation / Sports Psychology; Strategic Planning

Biodiversity How-To Guide 3: Defining Outcomes & Indicators for Monitoring, Evaluation, and Learning in USAID Biodiversity Programming - USAID (USAID, 2016)
The Biodiversity How-To Guide 3: Defining Outcomes and Indicators for Monitoring, Evaluation, and Learning in USAID Biodiversity Programming is the third in a series of three guides that provide in-depth guidance on key tools and practices to support design teams as they design and manage biodiversity programs within the Program Cycle and in accordance with the USAID Biodiversity Policy. It uses the results chains developed in the second guide and provides help identifying key results for developing outcome statements and indicators, as required by USAID’s Biodiversity Code, updated in the Biodiversity Policy.

Biodiversity How-To Guide 2: Using Results Chains to Depict Theories of Change in USAID Biodiversity Programming - USAID (USAID, 2016)
The Biodiversity How-To Guide 2: Using Results Chains to Depict Theories of Change in USAID Biodiversity Programming is the second in a series of three guides that provide in-depth guidance on key tools and practices to support design teams as they design and manage biodiversity programs within the Program Cycle and in accordance with the USAID Biodiversity Policy. It builds off the situation model guide to help design teams clearly state the expected results and assumptions behind the proposed strategic approaches that make up the program’s theory of change. The situation model provides the foundation to identify necessary results to reduce threats; brainstorm and prioritize strategic approaches; and then develop results chains to clarify assumptions behind selected approaches.

Biodiversity How-To Guide 1: Developing Situation Models in USAID Biodiversity Programming - USAID (USAID, 2016)
The Biodiversity How-To Guide 1: Developing Situation Models in USAID Biodiversity Programming is the first in a series of three guides that provide in-depth guidance on key tools and practices to support design teams as they design and manage biodiversity programs within the Program Cycle and in accordance with the USAID Biodiversity Policy. It focuses on how to develop situation models to map out the biodiversity conservation problem context to be addressed.

Big Data to Data Science - Moving from “What” to “How” in the MERL Tech Space - Bertermann, Kecia; Robinson, Alexandra; Bamberger, Michael; Higdon, Grace Lyn; Raftre, Linda (MERL Tech, 2020)
This paper probes trends in the use of big data by a community of early adopters working in monitoring, evaluation, research, and learning (MERL) in the development and humanitarian sectors. Qualitative analysis was conducted on data from MERL Tech conference records and key informant interviews. Findings indicate that MERL practitioners are in a fragmented, experimental phase, with use and application of big data varying widely, accompanied by shifting terminologies. We take an in-depth look at barriers to and enablers of use of big data within MERL, as well as benefits and drawbacks. Concerns about bias, privacy, and the potential for big data to magnify existing inequalities arose frequently. The research surfaced a need for more systematic and broader sharing of big data use cases and case studies in the development sector.

Biased Policy Professionals - Banuri, Sheheryar; Dercon, Stefan; Gauri, Varun (The World Bank Economic Review, 2019)
Although the decisions of policy professionals are often more consequential than those of individuals in their private capacity, there is a dearth of studies on the biases of policy professionals: those who prepare and implement policy on behalf of elected politicians. Experiments conducted on a novel subject pool of development policy professionals (public servants of the World Bank and the Department for International Development in the UK) show that policy professionals are indeed subject to decision-making traps, including the effects of framing outcomes as losses or gains, and, most strikingly, confirmation bias driven by ideological predisposition, despite having an explicit mission to promote evidence-informed and impartial decision making. These findings should worry policy professionals and their principals in governments and large organizations, as well as citizens themselves. A further experiment, in which policy professionals engage in discussion, shows that deliberation may be able to mitigate the effects of some of these biases.
Keywords: bias

Beyond Tweets and Screams: Action for Empowerment and Accountability in Nigeria – The Case of the #BBOG Movement - Aina, Tade Akin; Atela, Martin; Ojebode, Ayo; Dayil, Plangsat; Aremu, Fatai (IDS, 2019)
This paper explores the nature, role and dynamics of new forms of social and political action as pathways to empowerment and accountability in fragile conflict- and violence-affected settings in Africa. Through an in-depth analysis of the case of the Bring Back Our Girls (#BBOG) movement in Nigeria and a multi-methods approach, the paper provides new knowledge that addresses evidence gaps in the following areas: (1) the multiple ways through which social and political action play out in fragile, conflict- and violence-affected settings; (2) whether the conditions in which new forms of social and political action applicable to fragile, conflict- and violence-affected settings – the settings most dominant in African countries – emerge as currently projected in the literature; and (3) whether these social and political actions necessarily produce accountability and empowerment in fragile, conflict- and violence-affected settings. Although often expressed as contentious and/or unruly politics, experiences from the BBOG movement suggest that the new forms of social and political action possess a wide range of implications for citizen action and governance, including leading to multiple forms of empowerment in fragile settings.

Beyond the tools: supporting adaptation when organisational resources and capacities are in short supply - Fünfgeld, Hartmut; Lonsdale, Kate; Bosomworth, Karyn (Climatic Change, 2018)
Climate change adaptation is increasingly concerned with how organisations develop capacity to adapt to uncertain futures. A participatory action research project conducted in Victoria, Australia, examined how health and social service organisations developed their organisational adaptive capacity through the use of adaptation decision-support tools. It can be challenging for any organisation to select and apply a decision-support tool, but this is particularly the case where resources and capacities are limited. For most organisations, climate change is only one of a complex set of dynamic stressors they must consider in meeting organisational goals. This paper shows that while decision-support tools can help co-generate knowledge and facilitate customised organisational adaptation processes, for them to be practically helpful for organisations with limited resources and capacities, intensive collaborative and discursive processes are needed to adjust such tools to fit specific organisational contexts and needs. Facilitators and participatory approaches that enable co-inquiry can play a critical role in supplementing scarce resources and initiating adaptation processes that go well beyond the scope and purpose of the decision-support tool used. Organisations working effectively with decision-support tools to adapt to climate change will need to feel ownership of them and have confidence in modifying them to suit their particular adaptation needs and organisational goals.
Keywords: Adaptive capacity; Climate change; Community services; Decision-support tools; Facilitation; Health and social services; Organizational change

Beyond the toolkit: supporting peace processes in Asia - Denney, Lisa; Barron, Patrick (The Asia Foundation, 2015)

Beyond the Pioneer: Getting inclusive industries to scale - Koh, Harvey; Hedge, Nidhi; Karamchandani, Ashish (Deloitte Touche Tohmatsu India Private Ltd (DTTIPL), 2014)

Beyond the log frame: a new tool for examining health and peacebuilding initiatives - Grove, Natalie J.; Zwi, Anthony B. (Development in Practice, 2008)
How do we move from identifying ethical principles to enhancing development practice? How can donors and NGOs move beyond the reporting of technical outputs to explore less tangible aspects of their health projects: contributions to rebuilding trust, promoting social cohesion, and enhancing good governance at community level? This article considers these questions in relation to health and peace-building activities in conflicted settings. It describes difficulties facing practitioners and donors seeking to undertake health and peace work, in particular focusing on the lack of appropriate tools for screening, monitoring, and evaluating projects. It critiques the logical framework, a tool commonly used in project planning, monitoring, and evaluation, and considers it alongside a new tool, the Health and Peace Building Filter, which has been designed to reflect on health programming in fragile or conflicted settings. The authors argue that such tools can help to move us beyond focusing on inputs and outputs to examining processes, relationships, and the indirect consequences of aid programmes.
Publisher: Routledge _eprint: https://doi.org/10.1080/09614520701778850

Beyond 'Technology for Development' and 'Sustainability' towards Systemic and Holistic Rural Innovation: Success Factors from the Southern African Experience over 20 years - Buisson, Uys Du; Cronje, Braam; Marais, Mario; Haruperi, Emmanuel; Rensburg, Johann (2014)
Abstract: This paper describes essential, real-world activities and processes needed to develop and deploy people-centred networks enabled with innovative technologies that in turn produce "...

Beyond Participation and Accountability: Theorizing Representation in Local Democracy - Fischer, Harry W. (World Development, 2016)
Recent decades have seen growing emphasis on enhancing public participation and accountability in governance processes. Yet the valence of these discussions has focused almost entirely on the character of citizen engagement itself, with little attention to the ways in which citizens’ agency is constituted in relation to changing forms of public authority. In this paper, I advance a theoretical account of political representation, a concept that is central to analysis of democracy, but which has seen only limited attention in the scholarship on democratic decentralization. I draw on two contrasting models—selection and sanction—to elaborate an understanding of representation that recognizes both mechanisms that enable citizens to hold their leaders to account as well as the character of leaders’ own intrinsic motivations. Through a qualitative account of three decades’ political change from a locality in the Indian Himalayas, I document a gradual process of institutional and social change that has enabled a new generation of more diverse elected leaders to ascend to positions of elected authority, including many from historically marginalized sections of society. By examining the experiences of three such individuals in detail, I demonstrate the importance of understanding who leaders are and what they do—their skills and aspirations, their identity and aﬃliations, and the kinds of representative relationships that they embody. Placing the selection and sanction models in dialog reveals new and productive avenues to explore the interplay between external incentive structures and leaders’ intrinsic motivations in shaping broader process of political change.

Beyond magic bullets in governance reform - de Gramont, Diane (Carnegie Endowment for International Peace, 2014)

Beyond Logframes - Simister, Nigel (Intrac, 2017)
The logical framework, otherwise known as a logframe, is a commonly used planning tool. Initially designed for use within simple projects, it is increasingly being applied to complex programmes and organisations. In these cases the logical framework has limitations. There are several options that can help overcome these limitations. These include expanding the logframe, and using multiple logframes.

Beyond Logframe: Critique, Variations and Alternatives - Hummelbrunner, Richard (Beyond Logframe; Using Systems Concepts in Evaluation, 2010)
Over the last decades, the Logical Framework Approach (LFA) has become universally known and has assumed a key role for planning and managing development interventions. LFA, however, is not uncontroversial and the approach has been subject to criticism, concerning both its theoretical foundations and practical use. Despite these criticisms LFA’s position has not been fundamentally weakened and while many donors acknowledge its limits and weaknesses, they maintain (some would say impose) its use as a planning and monitoring tool. This chapter reviews some of the experience gained with LFA and outlines major attempts to develop variations – or move beyond it altogether. The first section briefly describes the LFA concept and summarizes the main points of critique. Section 2 then explores some variations which have been developed in response to this critique and to improve LFA as a management tool. Section 3 proposes a systemic alternative to logframe and Section 4 outlines alternatives to LFA which have recently been introduced in German development aid.

Beyond "Lack of Political Will": Elaborating Political Economy Concepts to Advance "Thinking and Working Politically" Comment on "Health Coverage and Financial Protection in Uganda: A Political Economy Perspective" - Ssennyonjo, Aloysius (International Journal of Health Policy and Management, 2022)
Political economy analysis (PEA) has been advanced as critical to understanding the political dimensions of policy change processes. However, political economy (PE) is not a theory on its own but draws on several concepts. Nannini et al, in concert with other scholars, emphasise that politics is characterised by conflict, contestation and negotiation over interests, ideas and power as various agents attempt to influence their context. This commentary reflects how Nannini et al wrestled with these PEA concepts - summarised in their conceptual framework used for PEA of the Ugandan case study on financial risk protection reforms. The central premise is that a common understanding of the PEA concepts (mainly structure-agency interactions, ideas, interests, institutions and power) forms a basis for strategies to advance thinking and working politically. Consequently, I generate several insights into how we can promote politically informed approaches to designing, implementing and evaluating policy reforms and development efforts.

Beyond enforcement: communities, governance, incentives and sustainable use in combating wildlife crime. Symposium Report. - Roe, Dilys (IIED, 2015)

Beyond Ballotocracy: Citizens' Voices and the Many Faces of Unruly Politics - Tadros, Mariz (IDS Bulletin, 2014)

Between logframes and theory of change: reviewing debates and a practical experience - Prinsen, Gerard; Nijhof, Saskia (Development in Practice, 2015)
Theory of Change (ToC) is an emerging methodology in the practice of development programmes, often contrasted with the dominant logical framework. This article reviews current debates around ToC before identifying five aspects that are appreciated in practice. It appears that these aspects mostly cover areas where the logical framework is not – or is no longer – meeting the needs of practitioners. Subsequently, the article analyses experiences in ToC training for NGO staff and concludes that ToC can address shortcomings of the logical framework – if only by going back to some of the roots of the logical framework.
Publisher: Routledge _eprint: https://doi.org/10.1080/09614524.2015.1003532

Berkana Two Loop Model: A quick introduction to an accessible model for systems change - Proud, Emma (LinkedIn - Emma Proud, 2023)
A model I've been using a lot recently, to bring systems thinking to life, is the Berkana Two Loop model. It doesn't describe complexity or systems thinking. But it does describe systems change in a way that's simple and oriented to action.

Beneficiary Feedback Mechanisms - Hayman, Rachel (INTRAC, 2020)
There is a growing emphasis among NGOs and donors on ensuring that the voices of beneficiaries are heard. A range of beneficiary feedback mechanisms (BFMs) exist which enable beneficiary perspectives and suggestions to be gathered and used within an M&E system. BFMs are tools designed to enable a continuous cycle of interaction between those receiving and those delivering aid-funded interventions.

Beneficiary feedback mechanisms - UK Aid (FCDO, 2022)
This guidance seeks to ensure that UK Aid Direct applicants and grant holders understand what the Foreign, Commonwealth & Development Office (FCDO) means by beneficiary feedback mechanisms, and more specifically, that they: • Understand the terms used that relate to beneficiary feedback mechanisms in UK Aid Direct guidance and templates • Understand beneficiary feedback mechanisms and why they are a useful tool for project monitoring and learning • Learn how to use beneficiary feedback mechanisms during project implementation. • Can demonstrate that using beneficiary feedback mechanisms can lead to greater accountability.

Beneficiary Assessment: An Approach Described - Salmen, Lawrence (World Bank, 2002)
Beneficiary assessment is a tool for managers who wish to improve the quality of development operations. This is an approach to information gathering which assesses the value of an activity as it is perceived by its principal users. The approach is qualitative in that it attempts to derive understanding from shared experience as well as observation, and gives primacy to the centrality of the other person’s point of view. As the Bank and others engaged in development activities seek to do their work better, one key indicator will need to be how the ultimate customer, or intended beneficiary, assesses the value of this work, project or policy, as it affects his or her life. The illumination of how an intended beneficiary appreciates a planned or ongoing developmental activity is the primary objective of this approach. Beneficiary assessment is a systematic inquiry into people’s values and behavior in relation to a planned or ongoing intervention for social and economic change. This method draws heavily from the tradition in social science known as "qualitative research...that fundamentally depends on watching people in their own territory and interacting with them in their own language, on their own terms" (Kirk and Miller). Yet beneficiary assessment also includes direct observation, incorporating simple counting, and is expressed in quantitative terms. The ultimate goal of beneficiary assessment is to reveal the meaning people give to particular aspects of their lives so that development activities may better enhance people’s ability to improve their own living conditions, as they see fit. This demands close rapport between the practitioner of this approach, the beneficiary and the development manager. The beneficiary assessment approach is not intended to supplant the questionnaire survey but to provide reliable qualitative, indepth information on the socio-cultural conditions of a beneficiary population which is intended to be of immediate use to managers and policymakers responsible for improving people’s lives.

Being Spherical: Reshaping Our Lives and Our World for the 21st Century - Lawson, Phil; Lindstrom, Robert L. (Sphericity Press, 2004)
In this concise, illustrated work exploring the dynamics of living in the 21st century, Phil Lawson and Robert L. Lindstrom show us how we individually and collectively shape the future - a future no longer dominated by traditional hierarchies and concentrated power centers. The authors explain why, in this dawning era of interconnection and interdependency, we require a dramatic transformation in the way we see, think and act. Using mythological imagery in the form of The Sphere and an innovative and adaptive vocabulary, they introduce us to concepts and processes for reshaping our lives, our organizations and our world for the better. In addition, they introduce the Spherical Modeling Tool (SMT), a practical hands-on awareness application. BEING SPHERICAL GUIDES US AS WE LEARN TO: * Prepare for a future we cannot even vaguely predict. * Raise our children well in a climate of moral uncertainty. * Create viable organizations in an era of extreme complexity. * Come to the aid of an abused and ailing planet. AS WE LEARN TO SEE THE SPHERE WE: * Understand why we do what we do and what to do differently. * Discover creative solutions to longstanding problems. * Connect and reconnect within ourselves and with others. * Ready ourselves of quantum leaps in inspiration and awareness. THE GREATER OUR SPHERICAL INTEGRITY THE BETTER WE: * Flex with internal and external pressures. * Adapt to disorienting and accelerating change. * Respond to unpredictable and uncontrollable conditions. * Roll through hard times and bounce forward from adversity. Excerpted from Being Spherical: Reshaping Our Lives and Our World for the 21st Century by Phil Lawson, Robert L. Lindstrom. Copyright 2004. Reprinted by permission. All rights reserved.

Behind the scenes: International NGOs’ influence on reproductive health policy in Malawi and South Sudan - Storeng, Katerini T.; Palmer, Jennifer; Daire, Judith; Kloster, Maren O. (Global Public Health, 2019)
Global health donors increasingly embrace international nongovernmental organisations (INGOs) as partners, often relying on them to conduct political advocacy in recipient countries, especially in controversial policy domains like reproductive health. Although INGOs are the primary recipients of donor funding, they are expected to work through national affiliates or counterparts to enable ‘locally-led’ change. Using prospective policy analysis and ethnographic evidence, this paper examines how donor-funded INGOs have influenced the restrictive policy environments for safe abortion and family planning in South Sudan and Malawi. While external actors themselves emphasise the technical nature of their involvement, the paper analyses them as instrumental political actors who strategically broker alliances and resources to shape policy, often working ‘behind the scenes’ to manage the challenging circumstances they operate under. Consequently, their agency and power are hidden through various practices of effacement or concealment. These practices may be necessary to rationalise the tensions inherent in delivering a global programme with the goal of inducing locally-led change in a highly controversial policy domain, but they also risk inciting suspicion and foreign-national tensions.

Behavioral Design: A New Approach to Development Policy - Datta, Saugato; Mullainathan, Sendhil (Review of Income and Wealth, 2014)

Before the Backlash, Let’s Redefine User-Centered Design - Lee, Panthea (Stanford Social Innovation Review, 2015)
We must better understand user-centered design’s limitations—not just its strengths—in the context of international development. And we must adapt it from its original uses designing commercial products to solving for social good.

Be a participant not a spectator - Sharp, Cathy (The Evaluator - UK Evaluation Society, 2022)
My focus here is on the realities of evaluating in complexity where ‘nothing is clear, and everything keeps changing’. I outline how I use a series of ‘provocations’ that allow people to choose their own starting point. Sharing those choices fuels conversations that discover, explore, and co-create (rather than manage) our mutual expectations and assumptions and track how these might themselves be influenced by the work as it unfolds. This account draws on a review of literature and my practice experience, including reflections from others brought into local, national, and international conversations about what it means for evaluation to recognise complexity.

Barrio Mio and Katye: PCI’s neighbourhood approach in cities - Campbell, Leah (ALNAP/ODI, 2019)

Barriers to Political Analysis in Aid Bureaucracies: From Principle to Practice in DFID and the World Bank - Yanguas, Pablo; Hulme, David (World Development, 2015)
Politics has become a central concern in development discourse, and yet the use of political analysis as a means for greater aid effectiveness remains limited and contested within development agencies. This article uses qualitative data from two governance “leaders” – the United Kingdom Department for International Development and the World Bank – to analyze the administrative hurdles facing the institutionalization of political analysis in aid bureaucracies. We find that programing, management, and training practices across headquarters and country offices remain largely untouched by a political analysis agenda which suffers from its identification with a small cross-national network of governance professionals.
Keywords: DFID; United Kingdom; World Bank; aid effectiveness; foreign aid; political economy analysis

Barriers and enablers to climate change adaptation in hierarchical governance systems: the case of Vietnam - Phuong, Le Thi Hong; Biesbroek, G. Robbert; Wals, Arjen E. J. (Journal of Environmental Policy & Planning, 2018)
Governments fulfil important roles in increasing the adaptive capacity of local communities to respond to climate change impacts, particularly in developing countries. Existing studies on how governments enable and constrain the ways in which local level communities learn and build their adaptive capacity, however, generally adopt network or market-oriented types of governance. However, the most vulnerable regions to climate change impact in the world are generally governed through hierarchical policy systems. This research aims to understand how the hierarchical policy system in Vietnam creates enables and/or constrains the policy capacity of policy actors to contribute to effective climate change adaptation. We conducted interviews (n = 26) with key actors at multiple levels of government. Our findings show the importance of clear legal institutions, available financing for implementing policies, and the training of governmental staff, particularly at district and commune levels where the policy capacities are generally too low to deal with climate change impacts. We conclude that any efforts to support local actors (i.e. smallholder farmers) should include investments in policy capacity to ensure uptake and upscaling of adaptation actions more broadly.

Balancing Inclusiveness, Rigour and Feasibility: Insights from Participatory Impact Evaluations in Ghana and Vietnam - van Hemelrijck, Adinda; Guijt, Irene (CDI, 2016)
This paper by Adinda Van Hemelrijck and Irene Guijt explores how impact evaluation can live up to standards broader than statistical rigour in ways that address challenges of complexity and enable stakeholders to engage meaningfully. A Participatory Impact Assessment and Learning Approach (PIALA) was piloted to assess and debate the impacts on rural poverty of two government programmes in Vietnam and Ghana funded by the International Fund for Agricultural Development (IFAD). We discuss the trade-offs between rigour, inclusiveness and feasibility encountered in these two pilots. Trade-offs occur in every impact evaluation aiming for more than reductionist rigour, but the pilots suggest that they can be reduced by building sufficient research and learning capacity.

Back to the Drawing Board: How to improve monitoring of outcomes - Dillon, Neil; Sundberg, Amelie (ODI/ALNAP, 2019)

Assumptions, conjectures, and other miracles: The application of evaluative thinking to theory of change models in community development - Archibald, Thomas; Sharrock, Guy; Buckley, Jane; Cook, Natalie (Evaluation and Program Planning, 2016)
Unexamined and unjustified assumptions are the Achilles’ heel of development programs. In this paper, we describe an evaluation capacity building (ECB) approach designed to help community development practitioners work more effectively with assumptions through the intentional infusion of evaluative thinking (ET) into the program planning, monitoring, and evaluation process. We focus specifically on one component of our ET promotion approach involving the creation and analysis of theory of change (ToC) models. We describe our recent efforts to pilot this ET ECB approach with Catholic Relief Services (CRS) in Ethiopia and Zambia. The use of ToC models, plus the addition of ET, is a way to encourage individual and organizational learning and adaptive management that supports more reflective and responsive programming.
Keywords: Assumptions; Community development; Critical thinking; Evaluation capacity building; Evaluative thinking; International Development; Theory of change

Assumptions and triple loop learning - Aston, Thomas (Medium, 2021)
Triple loop learning

Assumption-aware tools and agency; an interrogation of the primary artifacts of the program evaluation and design profession in working with complex evaluands and complex contexts - Morrow, Nathan; Nkwake, Apollo M. (Evaluation and Program Planning, 2016)
Like artisans in a professional guild, we evaluators create tools to suit our ever evolving practice. The tools we use as evaluators are the primary artifacts of our profession, reflect our practice and embody an amalgamation of paradigms and assumptions. With the increasing shifts in evaluation purposes from judging program worth to understanding how programs work, the evaluator’s role is changing to that of facilitating stakeholders in a learning process. This involves clarifying purposes and choices, as well as unearthing critical assumptions. In such a role, evaluators become major tool-users and begin to innovate with small refinements or produce completely new tools to fit a specific challenge or context. We interrogate the form and function of 12 tools used by evaluators when working with complex evaluands and complex contexts. The form is described in terms of traditional qualitative techniques and particular characteristics of the elements, use and presentation of each tool. Then the function of each tool is analyzed with respect to articulating assumptions and affecting the agency of evaluators and stakeholders in complex contexts.
Keywords: Agency; Assumption-aware; Complex context; Complex programs; Participatory approaches; Program design; Program evaluation; Program tools; Theory-based

Assessing Value for Money: the Oxford Policy Management Approach - King, Julian; Daniel Wate; Esther Namukasa; Alex Hurrell; Frances Hansford; Patrick Ward; Shiva Faramarzifar (Oxford Policy Management, 2023)
This document offers practical guidance for assessing the Value for Money (VfM) of government- and donor-financed programmes and policy interventions. In line with OPM’s focus and mission, it has been predominantly applied in the international development sector, but the approach upon which it is based is also used in the context of domestic public policy and programmes.1 There is increasing scrutiny on VfM in international development, but a lack of appropriate methods to support its assessment. There is a risk of reaching invalid conclusions if VfM evaluation is tied to a narrow set of indicators devoid of any evaluative judgement—for example, by emphasising the most readily quantifiable measures rather than the most important (but harder to quantify) aspects of performance, or by focusing on the quantification of outputs and outcomes at the expense of more nuanced consideration of their quality, value, and importance. The approach presented in this guide combines theory and practice from evaluation and economics to respond to requirements for accountability and good resource allocation, as well as to support reflection, learning, and adaptive management. It involves developing and implementing a framework for: • organising evidence of performance and VfM; • interpreting the evidence on an agreed basis; and • presenting a clear and robust performance story. This guide sets out a framework for making and presenting judgements in a way that opens both the reasoning process and the evidence to scrutiny. The approach is designed to be used in alignment with broader monitoring, evaluation, and learning (MEL) systems—both for efficiency's sake, and to ensure conceptual coherence between VfM evaluation and wider MEL work. The VfM framework achieves these aims by: • using explicit criteria (aspects of performance) and standards (levels of performance) to provide a transparent basis for making sound judgements about performance and VfM; • combining quantitative and qualitative forms of evidence to support a richer and more nuanced understanding than can be gained from the use of indicators alone; • accommodating economic evaluation (where feasible and appropriate) without limiting the analysis to economic methods and metrics alone; and • incorporating and building on an approach to VfM evaluation which is familiar to international aid donors.

Assessing the use of technological tools and strategies by Oxfam Novib partners in Angola, Burundi, Egypt, Niger, Pakistan, Rwanda and Uganda - The Engine Room (2014)
This report presents findings and insights from the Oxfam Novib pilot module of TechScape, which assessed how Oxfam Novib partners in seven countries related to the use of technology in their work. This report does not aim to draw conclusions about the nature of technology use by Oxfam Novib partners per se, or even the partners included in this assessment. The dramatic difference in organizational activities, contexts and objectives are too great for that. Detailed analysis of how partners are relating to technology in their work, and specific recommendations for greater efficiency and impact are presented in the TechScape Country Briefs. This report aims instead: • to describe the context in which the assessments took place, • to propose insights gained from the cumulative process about measurement, learning and capacity development, and • to identify opportunities for Oxfam Novib to pursue capacity development and knowledge sharing between countries and across the network, through mechanisms that minimize resource demands and directly target documented needs.

Assessing the strength of Evidence - DFID (2014)

Assessing the Evidence: The Effectiveness and Impact of Public Governance-Oriented Multi-Stakeholder Initiatives - Brockmyer, Brandon; Fox, Jonathan A. (Transparency & Accountability Initiative, 2015)
Transnational multi-stakeholder initiatives (MSIs) – voluntary partnerships between governments, civil society, and the private sector – are an increasingly prevalent strategy for promoting government responsiveness and accountability to citizens. While most transnational MSIs involve using voluntary standards to encourage socially and environmentally responsible private sector behavior, a handful of these initiatives – the Extractive Industries Transparency Initiative (EITI), the Construction Sector Transparency Initiative (CoST), the Open Government Partnership (OGP), the Global Initiative on Fiscal Transparency (GIFT) and the Open Contracting Partnership (OCP) – focus on information disclosure and participation in the public sector. Unlike private sector MSIs, which attempt to supplement weak government capacity to enforce basic social and environmental standards through partnerships between businesses and civil society, public sector MSIs ultimately seek to bolster public governance. But how exactly are these MSIs supposed to work? And how much has actually been achieved?The purpose of this study is to identify and consolidate the current state of the evidence for public governance-oriented MSI effectiveness and impact. Researchers collected over 300 documents and interviewed more than two-dozen MSI stakeholders about their experiences with five public governance oriented multi-stakeholder initiatives.This report provides a ‘snapshot’ of the evidence related to these five MSIs, and suggests that the process of leveraging transparency and participation through these initiatives for broader accountability gains remains uncertain. The report highlights the ongoing process of defining MSI success and impact, and how these initiatives intersect with other accountability actors and processes in complex ways. The study closes with key recommendations for MSI stakeholders.
Keywords: Accountability; Participation; Program evaluation; Transparency; global governance; multi-stakeholder

Assessing the Demand for a Global Evidence Network. Mapping Existing Initiatives and Understanding Network Lessons and Opportunities - Gandolfo, Ari; Taddese, Abeba (Results for all, 2018)

Assessing Rural Transformations: Piloting a Qualitative Impact Protocol in Malawi and Ethiopia - Copestake, James; Remnant, Fiona (Centre for Development Studies (CDS), 2014)

Assessing Innovation Potential for Social Impact: Overview for Social Sector Leaders - Global Knowledge Initiative (2016)

Assessing Impact in Dynamic and Complex Environments: Systemic Action Research and Participatory Systemic Inquiry - Burns, Danny (IDS, 2014)
This CDI Practice Paper is about the uses of Systemic Action Research (SAR) and Participatory Systemic Inquiry (PSI) for impact assessment (Burns 2006, 2007, 2011, 2012, 2013; Wadsworth 2001, 2010).

Are you doing what’s needed to get the state to respond to its citizens? Or are you part of the problem? - Herringshaw, Vanessa (Making All Voices Count, 2017)
Three challenges from Making All Voices Count research on responsive governance

Are we there yet? Localisation as the journey towards locally led practice: models, approaches and challenges - Baguios, Arbie; King, Maia; Martins, Alex; Pinnington, Rose (ODI, 2021)
Localisation and locally led international development practice has long been discussed, but has still not been delivered. Systemic barriers have posed challenges, and the term itself is contested. Now, the last tumultuous 18 months could provide a critical juncture to finally move forward with this crucial agenda. The pandemic has highlighted structural inequalities in the global system, and disrupted ways of working in the international development sector. The Black Lives Matter movement has brought conversations about racism and colonialism to the fore. And the climate crisis has highlighted the need for global action on humanity’s challenges that remain rooted in local realities. The emerging analysis in this review aims to set out the key issues in this agenda, building on a wealth of existing knowledge. It aims to span sectors, highlighting many new and existing models and approaches in the humanitarian, development, philanthropic and private sectors. It reviews the barriers and challenges to localisation and locally led practice, with a view to informing a campaign for systemic change to move forward with this agenda. The review is based on: a rapid review of the literature and evidence on localisation and locally led practice; two consultations with over 100 total participants, targeted at Global South actors; and analysis of 28 existing models and approaches.

Are we suffering from obsessive measurement disorder? - Pasanen, Tiina (From Poverty to Power, 2019)
ODI’s Tiina Pasanen argues that more data doesn’t necessarily mean we make better decisions, and sets out some ideas for how we count what counts.

Are unmanned aircraft systems (UASs) the future of wildlife monitoring? A review of accomplishments and challenges - Linchant, Julie; Lisein, Jonathan; Semeki, Jean; Lejeune, Philippe; Vermeulen, Cédric (Mammal Review, 2015)
Regular monitoring of animal populations must be established to ensure wildlife protection, especially when pressure on animals is high. The recent development of drones or unmanned aircraft systems (UASs) opens new opportunities. UASs have several advantages, including providing data at high spatial and temporal resolution, providing systematic, permanent data, having low operational costs and being low-risk for the operators. However, UASs have some constraints, such as short flight endurance. We reviewed studies in which wildlife populations were monitored by using drones, described accomplishments to date and evaluated the range of possibilities UASs offer to provide new perspectives in future research. We focused on four main topics: 1) the available systems and sensors; 2) the types of survey plan and detection possibilities; 3) contributions towards anti-poaching surveillance; and 4) legislation and ethics. We found that small fixed-wing UASs are most commonly used because these aircraft provide a viable compromise between price, logistics and flight endurance. The sensors are typically electro-optic or infrared cameras, but there is the potential to develop and test new sensors. Despite various flight plan possibilities, mostly classical line transects have been employed, and it would be of great interest to test new methods to adapt to the limitations of UASs. Detection of many species is possible, but statistical approaches are unavailable if valid inventories of large mammals are the purpose. Contributions of UASs to anti-poaching surveillance are not yet well documented in the scientific literature, but initial studies indicate that this approach could make important contributions to conservation in the next few years. Finally, we conclude that one of the main factors impeding the use of UASs is legislation. Restrictions in the use of airspace prevent researchers from testing all possibilities, and adaptations to the relevant legislation will be necessary in future.
Keywords: detection; drone; survey; wildlife

Appropriating technology for accountability: messages from Making All Voices Count - McGee, Rosemary; Edwards, Duncan; Hudson, Hannah; Anderson, Colin; Feruglio, Francesca (IDS, 2018)
Making All Voices Count was a programme designed to solve the ‘grand challenge’ of creating more effective democratic governance and accountability around the world. It used funding from four donors to support the development and spread of innovative ideas for solving governance problems – many of them involving tools and platforms based on mobile phone and web technologies. Between 2013 and 2017, the programme made grants for innovation and scaling projects that aimed to amplify the voices of citizens and enable governments to listen and respond. It also conducted research and issued research grants to explore the roles that technology can play in securing responsive, accountable government and building an evidence base. This synthesis report reviews the Making All Voices Count’s four-and-a-half years of operational experience and learning. It shares 14 key messages on the roles technologies can play in enabling citizen voice and accountable and responsive governance. These messages are presented in four sections: (1) Applying technologies as technical fixes to solve service delivery problems; (2) Applying technologies to broader, systemic governance challenges ; (3) Applying technologies to build the foundations of democratic and accountable governance systems; (4) Applying technologies for the public ‘bad’, when tech can be dangerous for democracy. The tech optimism of the era in which the programme was conceived can now be reappraised from the better-informed vantage point of hindsight. Making All Voices Count’s wealth of diverse and grounded experience and documentation provides an evidence base that should enable a more sober and mature position of tech realism as the field of tech for accountable governance continues to evolve.

Appropriate ICT as a Tool to Increase Effectiveness in ICT4D: Theoretical considerations and illustrating cases - Reijswoud, Victor van (The Electronic Journal of Information Systems in Developing Countries, 2009)
The need to bridge the digital divide is no longer a point of discussion and therefore focus has shifted to the design and implementation of programs that have the potential to close the information and knowledge gap between the developing and developed nations. Unfortunately, the majority of these programs are small and mimic what has been successful in the developed world. It has become increasingly clear that these successes do not necessarily translate well in the context of developing nations. This paper develops the hypothesis that Information and Communication Technology (ICT) projects in developing countries will become successful only when they are adapted to local conditions. The general concept of Appropriate Technology (AT) will be explored for the field of ICT. AT has already been embraced by fields like architecture, building technology and agriculture, but has not yet been rooted in ICT. The paper proposes a preliminary theory of Appropriate ICT along the lines of existing theories in AT and System development. The theory identifies Appropriate Technology principles at three levels: hardware, software and ICT change management. By means of real life mini cases in the ICT for Development context in Africa, the guiding principles for Appropriate ICT are illustrated. The paper will conclude with an agenda for further research in the three identified levels. The research agenda targets academia, governments, NGO's and industry.
Keywords: IMPORTANT

Approaches for addressing complexity in programme theory: Experiences in applying the Actor-based Change (ABC) Framework to a variety of international development programmes and evaluations - Koleros, Andrew; Oldenbeuving, Mark (2018)

Appreciative Inquiry: Three decades of generative impact - Godwin, Lindsey N. (AI Practitioner, 2016)

Appreciative Inquiry Principles - Coaching Leaders (2015)
This article, written by Emotional Intelligence Coach Andy Smith, describes the anticipatory principle which is one of the underpinnings of Appreciative Inquiry (AI). It argues that it is easier and more effective to move towards a positive imagined future than away from a negative one. It is principle number 4 in a series of principles outlined. More principle are listed below.

Appreciative Inquiry: Organization Development and the Strengths Revolution - Stavros, Jacqueline M.; Godwin, Lindsey N.; Cooperrider, David L. (Practicing Organization Development, 2015)
A ppreciative Inquiry (AI) is a theory and practice of inquiry-and-changethat shifts the perspective of organization development (OD) methodsby suggesting that the very act of asking generative questions has pro-found impact in organizational systems. Inquiry and change are not separatemoments. Our questions focus our attention on what is “there” to be noticed.Reflecting its social constructionist roots (Cooperrider, Barrett, and Srivastva1995; Gergen 1995), which suggest that words create worlds, AI offers a newchange imperative by suggesting that we be aware of the negativity bias thatpervades our investigations into organizational life and instead shift our focusto the good, the better, and the possibilities that often go undernoticed in oursystems. Building on Gergen (1995) and Cooperrider and Avital (2003), Cooper-rider and Godwin (2012) summarize, “AI posits that human systems move in thedirection of the questions they most frequently and authentically ask; knowl-edge and organizational destiny are intimately interwoven; what we know andhow we study it has a direct impact on where we end up” (740).Leveraging the power of generative questions, AI changes the focus of whatwe typically study in organizational life, questioning the prevailing mindset that“organizations are problems to be solved,” (Cooperrider and Srivastva 1987).Instead, AI suggests that “organizations are mysteries and miracles of humanrelatedness; they are living systems, alive and embedded in ever-wideningwebs of infinite strength and limitless human imagination. Organizations, ascenters of human connectivity and collaboration, are ‘universes of strengths,’” (Cooperrider and Godwin 2010, 10). AI invites change agents to look intotheir organizations with “appreciative eyes”—scanning the system for thingsfor which to be grateful, seeking out what is next and what is possible, andfocusing on valuing those things of value worth valuing. AI theorists posit thatsuch a shift in our approach to organizational change is needed if we are toinspire our imaginative capacities to their fullest potential.

Appreciative Inquiry Australia - Appreciative Inquiry Australia (2015)
The site provides news and information on AI events and learning opportunities in Australia and also provides an archive of articles and discussions centred on the use of AI.

Appreciative Inquiry: An approach for learning and change based on our own best practices​ - Acosta, Anne; Douthwaite, Boru (Institute of Learning and Change, 2005)
Since it was conceptualized in the late 1980s as a research methodology and change paradigm, the technique of ‘appreciative inquiry’ (AI) has proved to be highly effective for capturing the positive features of an organization or social system and energizing the members to strive for higher levels of performance. This Brief outlines the basic principles and methods of AI, describes various domains in which it has been undertaken and provides a recent example of its use in a centre affiliated with the Consultative Group on International Agricultural Research (CGIAR).

Applying the River of Life Method to Support Reflection and Learning in Terre des hommes Nepal - Karki, Shanta; Giri, Roju; Neupane, Sudarshan; Snijder, Mieke; Apgar, Marina (Institute of Development Studies, 2023)
The RoL method is a visual narrative method that helps people tell stories of the past, present, and future. Individuals can use this method to introduce themselves in a fun and descriptive way. A group can use it to understand and reflect on the past and imagine the future of a project. Besides, it can also be used to build a shared view of a process over time while acknowledging different and perhaps contradictory perspectives. The method uses drawings rather than text, making it useful in groups that do not share a common language. Metaphors from a river are used to explore aspects of a story – such as whirlpools depicting challenges or lakes suggesting a sense of calm etc. When used in a group, it is an active method, engaging people in the process of storytelling and listening through visualising their experiences and using metaphors to explore in depth. In CLARISSA, we adapted the RoL method to document our collective understanding of the story of implementation of the programme as part of the programme’s monitoring, evaluation and learning component. The purpose was to surface the details of our process of the systemic Action Research that we are undertaking with children in the worst forms of child labour and business owners. We used the same river metaphors as is often applied when the method is used with individuals.
Accepted: 2023-09-18T10:13:55Z Publisher: Institute of Development Studies

Applying Systems Thinking via Systemigrams™ for Defining the Body of Knowledge and Curriculum to Advance Systems Engineering (BKCASE) Project - Squires, Alice; Pyster, Art; Sauser, Brian; Olwell, David; Enck, Stephanie; Gelosh, Don; Anthony, Jim (INCOSE International Symposium, 2010)
Systems thinking is commonly accepted as the backbone of a successful systems engineering approach. As such, the Body of Knowledge and Curriculum to Advance Systems Engineering (BKCASE) team chose to leverage a systems thinking based tool, called Systemitool, to describe our project to the vast audience that would potentially become involved directly or indirectly in the success of the project. This paper describes the process and steps used by the authors and the BKCASE team to develop the project's systemic diagram, or Systemigram™, and the story behind the project, the products, and the vision of the BKCASE project. The goal of the paper is to provide guidance so that readers can leverage the lessons learned from this effort to successfully develop their own project definitions and stories.

Applying Systems Thinking to Education: The RISE Systems Framework - Spivack, Marla (Research on Improving Systems of Education (RISE), 2021)
Many education systems in low- and middle-income countries are experiencing a learning crisis. Many efforts to address this crisis do not account for the system features of education, meaning that they fail to consider the ways that interactions and feedback loops produce outcomes. Thinking through the feedback relationships that produce the education system can be challenging. The RISE Education Systems Framework, which is sufficiently structured to give boundaries to the analysis but sufficiently flexible to be adapted to multiple scenarios, can be helpful. The RISE Framework identifies four key relationships in an education system: politics, compact, management, and voice and choice; and five features that can be used to describe these relationships: delegation, finance, information, support, and motivation. This Framework can be a useful approach for characterising the key actors and interactions in the education system, thinking through how these interactions produce systems outcomes, and identifying ways to intervene that can shift the system towards better outcomes.

Applying social learning where ‘business-as-usual’ solutions no longer work for complex problems and programs - Le Borgne, Ewen (CCSL Learning Brief, 2016)
Key messages • Social learning facilitates sharing and learning beyond individuals to networks and systems. Through a facilitated, iterative process of joint work, dialogue and reflection, new shared ways of knowing emerge that lead to changes in practice. • Social learning has real potential to unlock change and transform relationships between actors involved in complex programs and/or dealing with ‘wicked problems’. Adversely it is not advisable to pursue for simple initiatives. • Social learning offers many thematic and pragmatic entry points to be embedded in the CGIAR research programs around partnerships, innovation systems, monitoring and evaluation.

Applying Rigorous Impact Evaluation in GIZ Governance Programmes: Results of a GIZ Initiative on Impacts in Governance - von Schiller, Armin (GIZ GmbH, 2020)
Pressure is mounting on international development cooperation agencies to prove the impact of their work. Private and public commissioners as well as the general public are increasingly asking for robust evidence of impact. In this context, rigorous impact evaluation (RIE) methods are increasingly receiving attention within the broader German development system and in GIZ. Compared to other implementing agencies such as DFID or USAid, the Deutsche Gesellschaft für Internationale Zusammenarbeit (GIZ) GmbH has so far relatively little experience in systematically applying rigorous methods of impact evaluation. This is particularly true in the governance sector. In order to gain more experience and to understand which methods and formats are best suited for GIZ governance programmes, the Governance and Conflict division and the Africa department launched the ‘Impact Initiative Africa’ in 2016, a cooperative effort with several programmes in Africa. The Initiative set out to apply the experiences from GIZ governance programmes to design and conduct RIEs, and to use the results to steer programme implementation. Initially, the Initiative included three countries: Benin (Programme for Decentralisation and Local Development), Malawi (Support to Public Financial and Economic Management) and Mozambique (Good Financial Governance in Mozambique). During its implementation, the Initiative also benefitted from the experience of two additional governance programmes which had already undertaken RIEs, namely Peru (Citizen-oriented State Reform Programme) and Pakistan (Support to Local Governance Programme II). This report summarizes the insights gained from these experiences and discusses opportunities and limitations regarding the use and usability of RIEs in GIZ governance programmes as well as proposals on how to organise RIEs to maximise learning potential and benefits for the specific programmes and the GIZ Governance sector at large.

Applying Power Analysis: Using the ‘Powercube’ to explore forms, levels and spaces - Gaventa, John (Power, Empowerment and Social Change, 2019)
In a complex, globalised and rapidly changing world, power dynamics are multidimensional, constantly evolving, and full of complexity. The ‘powercube’ (Gaventa, 2006) is an approach to power analysis which can be used to examine the multiple forms, levels and spaces of power, and their interactions. Building on earlier work on power, and elaborated and popularised in collaboration with other colleagues through the web site powercube.net and numerous other resources, the powercube has been widely used around the world for analysis of power, education and awareness building, context analysis, programme and strategy development, and monitoring and evaluation. This article briefly outlines the evolution of the powercube, and provides examples of the issue areas in which it has been used, and for what purposes. Drawing on these, we then offer eight lessons of how to apply the powercube framework for analysing and transforming power relations.

Applying Evaluation Criteria Thoughtfully - OECD (OECD, 2021)
Relevance, coherence, effectiveness, efficiency, impact, and sustainability are widely used evaluation criteria, particularly in international development co-operation. They help to determine the merit or worth of various interventions, such as strategies, policies, programmes or projects. This guidance aims to help evaluators and others to better understand those criteria, and improve their use. It starts by describing what they are, and how they are meant to be used. Then the definitions and concepts underpinning each criterion are explained. Finally, examples provide the reader with concrete ideas for using them. The criteria were originally laid out in the early 2000s by the Network on Development Evaluation (EvalNet) of the OECD Development Assistance Committee (DAC). Although they have been widely used in evaluation, and beyond, this document is the first to comprehensively explore the concepts in detail, explain their intended use and offer practical guidance. It captures current thinking and best practice in evaluation, drawing on the inputs of internationally renowned evaluation experts from EvalNet and beyond.
Type: doi:https://doi.org/10.1787/543e84ed-en

Applying Adaptive Management in a Fragile Context – Case Study - Lonsdale, Jane; Green, Duncan; Robertson, Kelly (DT Global, 2023)
DT Global is proud to introduce our new Guidance Note: Practical Introduction to Adaptive Management There is a growing consensus around adaptive management as an effective (even necessary) approach when programs are tackling complex development problems. While there is no standard definition of adaptive management, there is general agreement that such programs need to routinely engage with and respond to program context; constantly test what works in that context; and adjust approaches, plans, and activities based on continuous learning. However, there remains a more limited body of evidence about what this looks like in practice—the enabling conditions, systems, resourcing, skills, and attitudes to effectively operationalise adaptive management. There is also limited guidance around when adaptive management is required, and to what extent—both critical and often overlooked considerations when planning for successful adaptive management. This Guidance Note draws together lessons and good practice in adaptive management from across DT Global’s diverse portfolio of donor-funded programs. It outlines our conceptual framework for adaptive management, with practical guidance on how it can be applied by our program teams. It is also designed to help our teams distinguish adaptive management from good (non adaptive) project management, consider when adaptive management is most useful on a program, and how adaptive a program (or part of a program) should be.

Applied political economy analysis for human rights programs and campaigns: A guide for practitioners (second edition) - Pact (Pact, 2023)
This updated guide provides practical guidance to practitioners in the human rights sector and beyond on how to integrate Applied Political Economy Analysis

Appendix 3. ToC Examples - Vogel, Isabel; Stephenson, Zoe (DFID, 2012)

Announcement of CLA Learning Network Launch - Lab, Learning (USAID Learning Lab, 2016)
USAID’s Bureau for Policy, Planning and Learning (PPL), together with the Bureau for Economic Growth, Education, and Environment’s localworks program, is pleased to announce the launch of a Learning Network focused on building the evidence base for Collaborating, Learning and Adapting (CLA).

Anatomy of Social Accountability 3.0: A working framework for moving forward - Guerzovich, Florencia; Aston, Tom (Florianopolis, SC, Brazil: Grupo Politeia, ESAG, University of the State of Santa Catarina and act4delivery, 2023)
This note presents the key components of a potential next generation of social accountability programming. The key aspects outlined emerge from a review of over 150 cases as well as tacit knowledge from dozens of practitioners (Guerzovich and Aston, 2023).The main thread of social accountability 3.0 and what distinguishes it from previous generations is a focus on its contribution towards more responsive systems and accountable social contracts. In particular, social accountability should be considered as an operational means to rework social contracts.Over the last two decades, the field has been defined by a supposed dichotomy between minimalist (i.e., “widget” based) approach or a maximalist (“go big or go home”) approaches. Yet, most practice sits somewhere between these extremes. The paper presents various options derived from practice; practitioners should choose whichever best fits their own particular circumstances.Those hoping to improve and expand their practice with a systems-lens may benefit from considering how they approach the key elements of social accountability 3.0.
Keywords: accountability; development; responsiveness; social accountability; social contract; systems

Analysis of the factors affecting the sustainability of ICT4D initiatives - Marais, Mario (IDIA2011 Conference Proceedings, 2011)

Analysing ICT and Development from the Perspective of the Capabilities Approach: A Study in South Brazil - Coelho, Taiane Ritta; Segatto, Andréa Paula; Frega, José Roberto (The Electronic Journal of Information Systems in Developing Countries, 2015)
Certain international agencies propose that Information and Communication Technology (ICT) allows development to be reached more efficiently and quickly. While there are success stories galore, there is acknowledgement of not all investments in ICT bringing positive effects towards development. Following the Capabilities Approach, this paper discusses how the use of ICT can promote a more effective development by studying the case of Sudotec (association for technological and industrial development), a non-profit organization that saw in ICT the opportunity to change the local scenario. The results revealed positive effects of the use of ICT in social, economical and cultural spheres, but not presenting political effect.

An Upside Down View of Governance - IDS (Centre for the Future State, IDS, 2010)
Informal institutions and personalised relationships are usually seen as governance problems. However the research presented in this synthesis paper suggests that they can also be part of the solution...

An Upside Down View of Governance - Unsworth, Sue (Institute of Development Studies, 2010)
Informal institutions and personalised relationships are usually seen as governance problems. However the research presented in this synthesis paper suggests that they can also be part of the solution...

An inventory and review of countering violent extremism and insurgency monitoring systems - Carter, Lynn; Phyllis, Dinino (USAID, 2012)

An introductory systems thinking toolkit for civil servants - UK Government (UK Government Office for Science, 2022)
This document is a an Introductory Toolkit for for civil servants. It is one component of a suite of documents that aims to act as a springboard into systems thinking for civil servants unfamiliar with this approach. These documents introduce a small sample of systems thinking concepts and tools, chosen due to their accessibility and alignment to civil service policy development, but which is by no means comprehensive. They are intended to act as a first step towards using systems thinking approaches to solve complex problems and the reader is encourage to explore the wider systems thinking field further.

An introduction to the Learning Architecture - HLA (Humanitarian Leadership Academy, 2017)
The Learning Architecture is built on a flexible Learning Methodology and provides principles, technologies and behaviours of Scaffolded Social Learning.

An Introduction to the DCED Standard for Results Measurement - Bekkers, Nabanita Sen (2018)
Introduction used in the DCED-BEAM seminar

An introduction to systems thinking and tools for systems thinking - Allen, Will; Kilvington, Margaret (Learning fro Sustainability, 2018)
Systems thinking is an approach to integration that is based on the belief that the component parts of a system will act differently when isolated from the system’s environment or other parts of the system. THIS PAGE PROVIDES PLENTY OF RESOURCES ON SYSTEM THINKING

An introduction to multi-stakeholder partnerships - Stibbe, Darian; Prescott, Dave (The Partnering Initiative, 2016)
This briefing document for the GPEDC High Level Meeting in November 2016 offers a definition of multi-stakeholder partnerships (MSPs) and shows how they are being used, where they have come from, and what the different sectors bring to the table. It provides an overview of the challenges the present, what they require from individuals and organisations, and how they get started. The report was written with the support of the PEP Initiative, and funded by the Netherlands Ministry of Foreign Affairs.

An Introduction to Adaptive Management for Threatened and Endangered Species - Runge, Michael C. (Journal of Fish and Wildlife Management, 2011)
Management of threatened and endangered species would seem to be a perfect context for adaptive management. Many of the decisions are recurrent and plagued by uncertainty, exactly the conditions that warrant an adaptive approach. But although the potential of adaptive management in these settings has been extolled, there are limited applications in practice. The impediments to practical implementation are manifold and include semantic confusion, institutional inertia, misperceptions about the suitability and utility, and a lack of guiding examples. In this special section of the Journal of Fish and Wildlife Management, we hope to reinvigorate the appropriate application of adaptive management for threatened and endangered species by framing such management in a decision-analytical context, clarifying misperceptions, classifying the types of decisions that might be amenable to an adaptive approach, and providing three fully developed case studies. In this overview paper, I define terms, review the past application of adaptive management, challenge perceived hurdles, and set the stage for the case studies which follow.

An analysis of what CLA looks like in Development Programming - Learning Lab (USAID, 2017)

An analysis of factors influencing success of ICT4D projects: a case study of the Schools Computerisation Programme in Mashonaland West Province, Zimbabwe. - Musiyandaka, Donna; Ranga, Gideon; Kiwa, Jacqueline Fungai (The Journal of Community Informatics, 2013)
Keywords: ICT4D programmes; success factors

An Adaptive Capacity Guide Book: assessing, building and evaluating the capacity of communities to adapt in a changing climate - Jacobs, B.; Nelson, R.; Kuruppu, N.; Leith, P. (University of Technology and University of Tasmania, 2015)
A capacity to adapt to change is essential for managing Australia’s natural resources. The individuals, communities and organisations who manage our natural resources all have an innate capacity to adapt to change. Changes in climate, markets and technology have shaped the way we adapt the management of natural resources in urban, rural and coastal landscapes. Some of these changes are predictable and easy to manage. Others are expected, but their timing and magnitude are uncertain. Whatever the future holds, this guide can be used to build our capacity to meet future change with confidence.

Amateur hour: CfC's 'surprising' success in addressing school congestion in the philippines - Sidel, John T. (Asia Foundation, 2017)
The international development community has increasingly embraced the idea that finding durable solutions to complex development problems requires new ways of working that move beyond industry norms. This paper makes an important contribution to the current debate by outlining an innovative monitoring system called Strategy Testing (ST). This is the third paper in the Working Politically in Practice paper series, launched together with the Australian Department of Foreign Affairs and Trade.
Keywords: IMPORTANT

ALPS in action: a review of the shift in ActionAid towards a new Accountability, Learning and Planning System | Participatory Methods - Guijt, Irene (2004)

Alps - Accountability, Learning and Planning System - 2011 Update - ActionAid (ActionAid International, 2011)
Alps is ActionAid’s over arching accountability framework, containing within it our programme planning system. Alps is distinctive in that it is strongly driven by principles, and sets out necessary personal attitudes and behaviours alongside organisational processes for planning, strategy formulation, learning, monitoring reviews/evaluations and audit. Alps defines our standards, not only about what we do but also how we do it. Alps is part of ActionAid’s human rights-based work.

Alps - Accountability, Learning and Planning System - ActionAid (ActionAid International, 2006)
Alps is ActionAid’s over arching accountability framework, containing within it our programme planning system. Alps is distinctive in that it is strongly driven by principles, and sets out necessary personal attitudes and behaviours alongside organisational processes for planning, strategy formulation, learning, monitoring reviews/evaluations and audit. Alps defines our standards, not only about what we do but also how we do it. Alps is part of ActionAid’s human rights-based work.

ALL - The question of inclusiveness in ICT-mediated citizen engagement - Berdou, Evangelia (MAVC, 2014)

All about behaviour: KAPE, Adaptation and ' Sticky' Institutional Change - Power, Greg (Global Partners Governance, 2016)
This paper describes Global Partners Governance’s (GPG’s) approach to institutional reform and political change. Developed over the last decade of working in some of the most complex and sensitive political environments with politicians and officials in parliaments, political parties, ministries and local government, it describes the KAPE® (knowledge-application-practice-effect) methodology that we adopt to get ‘sticky’ institutional and behavioural change. Contents 1) Two dimensions of ‘adaptive programmes’: Flexible delivery and getting behaviour change 2) Enabling Change: KAPE and The Logic of Institutional Reform (Knowledge-Application-Practice-Effect) - K: Knowledge – Defining the problem and what to do about it - A: Application – Making Systems Work in Practice - P: Practice – Pockets of good practice and establishing ‘the new normal’ - E: Effect – Improved performance and the ‘Ripple Effect’ 3) Measuring Impact: Monitoring and Evolving 4) Conclusion: Behavioural insights, adaptive management and sticky change

Alignment at Scale - Kniberg, Henrik (2016)

Aiming at the Wrong Targets: The Domestic Consequences of International Efforts to Build Institutions - Buntaine, Mark T.; Parks, Bradley C.; Buch, Benjamin P. (International Studies Quarterly, 2017)
We explain why international development organizations have had so little success building and reforming public sector institutions in developing countries. They often fail despite their apparently strong commitment to achieving measurable results and extraordinary amounts of time, money, and effort. We demonstrate that, when donors and lenders make access to financing contingent upon achievement of performance targets, recipient countries tend to choose easy and shallow institutional targets. These targets measure the organization of public sector institutions, rather than their effectiveness at addressing public problems. Such targets provide countries with low-cost opportunities to signal commitment to institution-building to international development organizations. We demonstrate the explanatory and predictive power of our argument in the context of a sector of World Bank lending—environment and natural resource management—that focuses heavily on improving public sector institutions.

Aiding Institutional Reform in Developing Countries: Lessons from the Philippines on what works, what doesn't and why - Booth, David (The Asia Foundation, 2014)

AID Programming Guide - DFAT (Australian Government, 2019)

Aid on the Edge of Chaos: Rethinking International Cooperation in a Complex World - Ramalingam, Ben (Oxford University Press, 2014)
It is widely recognised that the foreign aid system - of which every country in the world is a part - is in need of drastic overhaul. There are conflicting opinions as to what should be done. Some call for dramatic increases to achieve longstanding promises. Others bang the drum for cutting it altogether, and suggest putting the fate of poor and vulnerable people in the hands of markets or business. A few argue that what is needed is creative, innovative transformation. The arguments in Aid on the Edge of Chaos are firmly in the third of these categories. In this ground-breaking book, Ben Ramalingam shows that the linear, mechanistic models and assumptions that foreign aid is built on are more at home in early twentieth century industry than in the dynamic, complex world we face today. The reality is that economies and societies are less like machines and more like ecosystems. Aid on the Edge of Chaos explores how thinkers and practitioners in economics, business, and public policy have started to embrace new, ecologically literate approaches to thinking and acting, informed by the ideas of complex adaptive systems research. It showcases insights, experiences, and dramatic results of a growing network of practitioners, researchers, and policy makers who are applying a complexity-informed approach to aid challenges. From transforming approaches to child malnutrition, to rethinking process of macroeconomic growth, from rural Vietnam to urban Columbia, Aid on the Edge of Chaos shows how embracing the ideas of complex systems thinking can help make foreign aid more relevant, more appropriate, more innovative, and more catalytic. It argues that taking on these ideas will be a vital part of the transformation of aid, from a post-WW2 mechanism of resource transfer, to a truly innovative and dynamic form of global cooperation fit for the twenty-first century.

Agility and Evolution. How Mercy Corps Adapts at the Organizational Level - Mercy Corps (2017)
How Mercy Corps Adapts at the Organizational Level

Agile – where are we at? - Kniberg, Henrik (2017)

Agile vs Lean vs Design Thinking - Gothelf, Jeff (Medium, 2016)
There’s an unforgettable scene in my favorite movie, Goodfellas, where Joe Pesci, Robert DeNiro and Ray Liotta pay a late night visit to…

Agile Software Development: Adaptive Systems Principles and Best Practices - Meso, Peter; Jain, Radhika (Information Systems Management, 2006)
Today's environments of increasing business change require software development methodologies that are more adaptable. This article examines how complex adaptive systems (CAS) theory can be used to increase our understanding of how agile software development practices can be used to develop this capability. A mapping of agile practices to CAS principles and three dimensions (product, process, and people) results in several recommendations for “best practices” in systems development.
Keywords: IMPORTANT

Agile Project Management For Dummies - Layton, Mark C. (John Wiley & Sons, 2012)
Be flexible and faster with Agile project management As mobile and web technologies continue to evolve rapidly, there is added pressure to develop and implement software projects in weeks instead of months. Agile Project Management For Dummies can make that happen. This is the first book to provide a simple, step–by–step guide to Agile Project Management approaches, tools, and techniques. With the fast pace of mobile and web technology development, software project development must keep pace; Agile Project Management enables developers to complete and implement projects more quickly and this book shows you how. Offers a practical context for understanding and applying Agile techniques, moving from theory into actual practice Explains when to use Agile and how to avoid common pitfalls Written by experts who know how to apply the principles in real–world situations Agile Project Management For Dummies enables you to understand and apply Agile principles for faster, more accurate development.

Agile Project Management: Creating Innovative Products - Highsmith, Jim (Addison Wesley, 2009)
Best practices for managing projects in agile environments―now updated with new techniques for larger projectsToday, the pace of project management moves faster. Project management needs to become more flexible and far more responsive to customers. Using Agile Project Management (APM), project managers can achieve all these goals without compromising value, quality, or business discipline. In Agile Project Management, Second Edition, renowned agile pioneer Jim Highsmith thoroughly updates his classic guide to APM, extending and refining it to support even the largest projects and organizations. Writing for project leaders, managers, and executives at all levels, Highsmith integrates the best project management, product management, and software development practices into an overall framework designed to support unprecedented speed and mobility. The many topics added in this new edition include incorporating agile values, scaling agile projects, release planning, portfolio governance, and enhancing organizational agility. Project and business leaders will especially appreciate Highsmith’s new coverage of promoting agility through performance measurements based on value, quality, and constraints. This edition’s coverage includes: Understanding the agile revolution’s impact on product development Recognizing when agile methods will work in project management, and when they won’t Setting realistic business objectives for Agile Project Management Promoting agile values and principles across the organizationUtilizing a proven Agile Enterprise Framework that encompasses governance, project and iteration management, and technical practicesOptimizing all five stages of the agile project: Envision, Speculate, Explore, Adapt, and CloseOrganizational and product-related processes for scaling agile to the largest projects and teamsAgile project governance solutions for executives and management The “Agile Triangle”: measuring performance in ways that encourage agility instead of discouraging itThe changing role of the agile project leader

Agile on steroids through the RenDanHeYi - Quintarelli, Emanuele (Boundaryless, 2023)
This article offers initial insights into the overlap, positioning, shared values, and convergences between RenDanHeYi compared to agile practices.

Agile Metrics: The Good, the Bad, and the Ugly - Wolpers, Stefan (dzone.com, 2017)
Suitable agile metrics reflect either a team’s progress in becoming agile or your organization’s progress in becoming a learning organization.

Agile, is it just a delivery mechanism? - Carignan, Louis-Philippe (Scrum.org Community Blog, 2014)
As a Agile coach, I refer to a few tools to help me think about where my Scrum teams should go next on their path to Agility. One of these tools is the Agile subway map, a list of Agile practices grouped in different categories. It helps me think how a specific practice could help …

Agile Glossary and Terminology - Agile Alliance (Agile Alliance, 2015)
Learn the unique terminology used in Agile development from the experts at Agile Alliance.

Agile distributed software development in nine Central European teams: challenges, benefits and recommendations - Stadler, Manuel; Vallon, Raoul; Pazderka, Martin; Grechenig, Thomas (Information Technology, 2019)

Agile Development in the Age of Adaptive Management - Davis, Taryn; Orton-Vipond, Sarah; Staid, Martha (Development Gateway, 2019)
Adaptive management – the idea that development projects should respond to real life complexities and be flexible enough to respond to unforeseen changes – is an often-praised approach to doing development differently, with donors and partners exploring how to apply it within their programming.

Agile: A New Way of Governing - Mergel, Ines; Ganapati, Sukumar; Whitford, Andrew B. (Public Administration Review, 2021)
The evolving concept of “agile” has fundamentally changed core aspects of software design, project management, and business operations. The agile approach could also reshape government, public management, and governance in general. In this Viewpoint essay, the authors introduce the modern agile movement, reflect on how it can benefit public administrators, and describe several challenges that managers will face when they are expected to make their organizations more flexible and responsive.
_eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1111/puar.13202

Agency in the face of path dependence: how organizations can regain scope for maneuver - Fortwengel, Johann; Keller, Arne (Business Research, 2020)
This paper tackles a key problem in path dependence research: how can locked-in organizations regain their scope for maneuver? Leveraging insights from two surprising and thus revelatory cases of organizations that have successfully escaped from path dependence, we develop the theoretical argument that regaining scope for maneuver can be achieved by interrupting the logic of a path’s underlying self-reinforcing mechanisms. More specifically, we argue that, through a targeted interruption of the working of these mechanisms, hyper-stable patterns inscribed in an organization can be gradually rewound—and alternative futures become possible. We position our paper within larger debates around the role of agency in path dependence theorizing, and we outline research frontiers to better understand the necessary antecedents of and exact relationship between mechanisms interruption and pattern unwinding.

Afterword: Alabert Hirschman observed - Alacevich, Michele (Development Projects Observed, 2015)
Albert Hirschman considered Development Projects Observed a natural sequel to his earlier work. As Hirschman put it to an old acquaintance at the World Bank, his previous books identified the inner and often hidden mechanisms of development sequences: “Having worked out a few basic hypotheses …, I could perhaps test them (and hit on some new ones) by looking at Bank-financed projects that have had enough time to give rise to such sequences.”¹ But as much as it appeared as the logical evolution of Hirschman’s intellectual trajectory, this new research was also the offshoot of an important crisis in development

Affordances Explained - Scarantino, Andrea (Philosophy of Science, 2003)
I examine the central theoretical construct of ecological psychology, the concept of an affordance. In the first part of the paper, I illustrate the role affordances play in Gibson's theory of perception. In the second part, I argue that affordances are to be understood as dispositional properties, and explain what I take to be their characteristic background circumstances, triggering circumstances and manifestations. The main purpose of my analysis is to give affordances a theoretical identity enriched by Gibson's visionary insight, but independent of the most controversial claims of the Gibsonian movement.

Advancing Work with the Grain at USAID - Jacobstein, David (USAID Learning Lab, 2018)
In December 2017, I wrote a blog about some of the insights gained during a workshop on Context-Driven Adaptation, where many of our sharpest field officers shared the ways that they assessed and adapted to shifts in context to keep programming relevant and effective.

Advancing urban adaptation where it counts: reshaping unequal knowledge and resource diffusion in networked Indonesian cities - Geldin, Samuel (Environment and Urbanization, 2019)
Climate adaptation literature vocalizes the need for transnational municipal networks (TMNs) to expand activities in vulnerable medium-sized cities, but little work has examined the granular extent of city participation and processes constraining TMN growth. This study explores the effectiveness of TMNs in reaching adaptation outcomes and how financial, material, and knowledge exchanges of TMNs tend to exclude adaptation in high-priority intermediary cities. Nearly 40 semi-structured interviews with Indonesian city actors and a preliminary catalogue of cities participating in TMNs reveal that risk-averse selection criteria, insufficient impact assessments, and duplicative institutional efforts reinforce disparities between primary and intermediary cities. To effectively build adaptive capacity in the most vulnerable regions, TMNs should remove participation barriers for intermediary cities, improve incentives for institutional collaboration, and adopt more rigorous evaluative metrics. These results directly inform the governance, resource allocation, and operational goals of TMN stakeholders to advance distributive climate justice.

ADS 201 Additional Help- Whole-of-Project Evaluation - USAID (USAID, 2017)

Addressing the evaluation-of-sustainability-paradox: A relational rubric for evidencing… - Guerzovich, Florencia (Medium, 2024)
Florencia Guerzovich and Alix Wadeson

Addressing Maladaptive Coping Strategies of Local Communities to Changes in Ecosystem Service Provisions Using the DPSIR Framework - Ehara, Makoto; Hyakumura, Kimihiko; Sato, Ren'ya; Kurosawa, Kiyoshi; Araya, Kunio; Sokh, Heng; Kohsaka, Ryo (Ecological Economics, 2018)
The Driver-Pressure-State-Impact-Response (DPSIR) framework has been applied to various environmental problems at multiple spatial and temporal scales and attempts have been made to conceptually improve the framework to encompass various stakeholder perspectives. However, recent literature experiences in the field have challenged the inclusive character of the framework applications. In particular, the framework's inability to incorporate the aggregated informal responses of people affected by changes in ecosystem service provisions has not been fully addressed. This limits the framework's validity in categorizing and disseminating information for addressing particular environmental challenges. Herein, we address this problem by analyzing a case study of deforestation and its impact on non-timber forest product collections by rural residents in Cambodia. We incorporate the concept of maladaptive coping strategies into the DPSIR framework and then further elaborate Ness et al.'s (2010) approach of merging the DPSIR framework with Hägerstrand's (2001) system of nested spatial domains. This conceptualizes the incorporation of the aggregated informal responses into the system, as exemplified in the case study.
Keywords: DPSIR framework; Ecosystem services; Maladaptive coping strategy; Nested spatial domains

Addressing gender in impact evaluation: What should be considered? - Fletcher, Gillian (Methods Lab, 2015)
Gender and sexuality are intimately entwined; we must not lose sight of the ways in which gender affects non-heterosexual people, transgender people and people who do not identify as either male or female. • Gender and gender-related injustice is a feature of all interventions, whatever the focus, be it agriculture, capacity building, disaster management, education, health, peace building, water, sanitation and hygiene, or other. • Showing an increase in the number of women participants in an intervention is not the same as demonstrating gender impact. An ‘add women and stir’ approach is not good enough. • A good intervention design will identify critical inequalities and conduct a needs assessment that clearly identifies gender-related issues. If this needs assessment feeds directly into the programme theory, it will facilitate assessment of the intervention’s gender-related impact and will be more likely it is to have positive gender-related impact.

Addressing challenges in communicating adaptation practices to smallholder farmers in Kenya through a radio intervention - Mwaniki, Fiona Nyawira; Gichuki, Charity; Mwangi, Maina; Mburia, Pamela; Wandago, Benson (Journal of Agriculture and Environment for International Development (JAEID), 2017)

Addressing attribution through contribution analysis: Using performance measures sensibly - Mayne, John (The Canadian Journal of Program Evaluation, 2001)
The changing culture of public administration involves accountability for results and outcomes. This article suggests that performance measurement can address such attribution questions. Contribution analysis has a major role to play in helping managers, researchers, and policymakers to arrive at conclusions about the contribution their program has made to particular outcomes. The article describes the steps necessary to produce a credible contribution story. Contents Accountability for Outcomes The Problem of Attribution The Case of Performance Measurement Recognizing the Limits of Measurement Two Uses of Performance Measurement: Understanding and Reporting Approaches to Attribution: Contribution Analysis Techniques for Strengthening Your Performance Story

Adding Up to Peace: The Cumulative Impacts of Peace Initiatives - Diana Chigas; Peter Woodrow (CDA Collaborative Learning Projects, 2018)
Adding Up to Peace: The Cumulative Impacts of Peace Initiatives aims to identify how cumulative impacts in peace practice operate at all levels, in order to provide practical lessons for policymakers, donors and practitioners to develop more effective strategies for greater progress towards peace. This book builds on CDA’s Reflecting on Peace Practice Project (RPP), launched to answer the question: What works—and what doesn’t work—in peacebuilding? It seeks to deepen our understanding of how multiple peacebuilding initiatives in a conflict zone interacted and added up (or didn’t), to result in progress towards larger societal level peace, or Peace Writ Large. The findings are a product of sixteen case studies conducted between 2007 and 2012, gathering the perceptions of both local and international stakeholders. The finalization of this book was generously funded by Humanity United. The opinions expressed are those of the authors and do not necessarily reflect the views of Humanity United or of CDA Collaborative Learning Projects.

AdaptScan - Improving your Team's Adaptive Management - Mercy Corps (Mercy Corps, 2020)

Adaptiveness through ‘simplest tools and practices’ - Prieto Martin, Pedro (Institute of Development Studies, 2017)
In recent years, more and more influential development organisations have been openly recognising the central role that adaptive management capacities – the ability to keep improving strategies and actions as programmes unfold – play for the success of complex interventions. As a result, there has been a rich exchange of ideas and experiences on how to promote adaptiveness in development. But development organisations and professionals are having a hard time translating the many adaptive theories and recommendations into improved practices and outcomes. They are generally failing to adjust the design and operation of programmes to accommodate incipient lessons learnt and the unexpected changes in the context. Nowadays, most programme adaptations still take the form of a change of direction once it is clear that things have gone really wrong. Why is so difficult to put what we know about adaptiveness into practice? And more importantly: what can be done to improve this situation?

Adaptive Software Development: A Collaborative Approach to Managing Complex Systems - Highsmith, Jim (Dorset House Publishing, 2000)
In today's turbulent e-business world, software project teams that survive and thrive won't be those that continue their traditions of optimization, efficiency, and control, but those that exhibit adaptability, speed, and collaboration. Adaptive Software Development is targeted at software teams where competition creates extreme pressure on the delivery process. Four goals of the book are * to support an adaptive culture in which change and uncertainty are assumed to be the natural state * to introduce frameworks to guide the iterative process of managing change * to institute collaboration, the interaction of people on interpersonal, cultural, and structural levels * to add rigor and discipline to the RAD approach, making it scalable to the uncertainty and complexity of real-world undertakings. This innovative text, grounded in the science of complex adaptive systems theory, offers a practical, realistic approach to managing the high-speed, high-change projects characteristic of our highly uncertain economy.

Adaptive Programming: The “Space of Possibility” - Seavey, Sara Mizuta (USAID Learning Lab, 2016)
Sara Mizuta Seavey, M.A., is a Senior Program Officer at FHI360 for the Mobile Solutions Technical Assistance and Research (mSTAR) project, where she works with USAID’s Digital Development Team to conceive, design, and test how real-time data systems can enable a more adaptive and participatory approach to development. She is passionate about systems thinking and participatory approaches to international development. What does space travel have to do with international development?

Adaptive programming in practice: shared lessons from the DFID-funded LASER and SAVI programmes - Derbyshire, Helen; Donovan, Elbereth (DFID-LASER Programme, 2016)
LASER synthesis papers aim to help donors and other stakeholders better understand why and how to approach investment climate reform programming differently. The papers reflect emerging best practice and lessons learnt on what works and what does not work in doing development differently. The papers have been peer-reviewed by experts in the field including senior advisers at DFID, World Bank, IFC and the Donor Committee for Enterprise Development (amongst others).
Keywords: IMPORTANT; Practice

Adaptive Programming in Fragile, Conflict and Violence-Affected Settings, What Works and Under What Conditions?: The Case of Pyoe Pin, Myanmar - Christie, Angela; Green, Duncan (Itad, Oxfam and IDS, 2018)
This paper examines adaptive approaches in aid programming in a fragile, conflict and violence-affected setting (FCVAS), namely Myanmar. A combination of desk review and field research has been used to examine some of the assertions around the ‘adaptive management’ approach, which has arisen in recent years as a response to critiques of overly rigid, pre-designed, blue-print and linear project plans. This paper explores if and how adaptive approaches, including rapid learning and planning responses (fast feedback loops and agile programming) are particularly relevant and useful for promoting empowerment and accountability in such ‘messy places’. This case study focuses on Pyoe Pin (‘Young Shoots’), a DFID-funded, British Council managed governance programme, which has been running since 2007.
Keywords: A4EA; Adaptive Development; Economy; Fishery

Adaptive Programming in Fragile, Conflict and Violence-Affected Settings, What Works and Under What Conditions?: The Case of PERL, Nigeria - Punton, Melanie; Burge, Richard (Itad, Oxfam and IDS, 2018)
This paper examines adaptive approaches to aid programming in Nigeria. Through field research and desk reviews, we have investigated some of the assertions around the ‘adaptive management and programming’ approach, which has arisen in recent years as a response to critiques of overly rigid, pre-designed, blueprint and linear project plans. This is the second of three case studies in a series which explore if and how adaptive approaches, including rapid learning and planning responses, are particularly relevant and useful for promoting empowerment and accountability in fragile, conflict and violence-affected settings (FCVAS). This case study focuses on PERL (Partnership to Engage, Reform and Learn) in Nigeria, a five-year governance programme (2016-21) with a total budget of £100 million. It aims to promote better service delivery through bringing together government and citizens groups to collectively address governance challenges. PERL is viewed by DFID as the final stage of a 20-year investment, building on learning, experience and partnerships from 15 years of DFID-funded governance programming in Nigeria. It was designed to incorporate learning and adaptation through a ‘living’ theory of change, continuous political economy analysis at different levels, adaptive implementation by location-based delivery teams who are encouraged to be flexible and let partners take the lead, regular learning and reflection, and adaptive resourcing, HR and administrative systems. The case study draws on a conceptual framework (the ‘adaptive triangle’) that looks at three types of adaptation – adaptive management, adaptive programming and adaptive delivery – and the interconnections and tensions between them.
Keywords: A4EA; Adaptive Development; Economy; Fishery

Adaptive Programming in Fragile, Conflict and Violence-Affected Settings, What Works and Under What Conditions?: The Case of Institutions for Inclusive Development, Tanzania - Green, Duncan; Guijt, Irene (Itad, Oxfam and IDS, 2019)
Adaptive Management involves a dynamic interaction between three elements: delivery, programming and governance. This case study focuses on a large DfID governance project, the Institutions for Inclusive Development (I4ID), a five-year initiative in Tanzania. The study forms part of a research project to examine whether and how adaptive approaches can strengthen aid projects promoting empowerment and accountability in fragile, conflict and violence-affected settings (FCVAS). The research examines some of the assertions around the adaptive management approach and explores if and how adaptive approaches, including rapid learning and planning responses (fast feedback loops and agile programming) are particularly relevant and useful for citizen empowerment and government accountability (E&A) in FCVAS.
Keywords: A4EA; Adaptive Development; Economy; Fishery

Adaptive Programming and going with the grain: IMAGINE's new water governance model in Goma, DRC - Kirk, Tom; Green, Duncan; Stys, Patrycja; Mosquera, Tom (Development Policy Review, 2023)
Motivation This paper explores adaptive approaches to development programmes that aim at improving service provision in underperforming sectors in fragile and conflict affected states (FCAS). It does this through a case study of the Integrated Maji Infrastructure and Governance Initiative for eastern Democratic Republic of the Congo's (IMAGINE) public-private partnership model for water provision. Purpose The processes and decisions that culminated in IMAGINE's model emphasize the need for programming that is culturally and politically aware, responsive to events, learns in real-time, is entrepreneurial, and works with the grain of local institutions to support change. Detailed case studies of such ways of working are crucial for programmes that seek to challenge and reform the status quo in FCAS. Methods and approach The paper is based on 42 semi-structured interviews conducted in the summers of 2019 and 2020. They reflect the broad spectrum of actors – individuals, public authorities, and organisations – involved in IMAGINE's evolution. Findings The narrative focuses on IMAGINE's attempts to professionalise and commercialise Goma's water sector. It shows how as IMAGINE repeatedly adapted to ground realities, it took on the characteristics of a public authority, thereby, engendering backlashes that threated its longer-term goals. However, by revisiting its initial values and logics it was able to get things done and achieve it aims. Policy implications IMAGINE's story suggests that adaptive programmes should put politically savvy local development professionals in key positions and enable them to carefully construct coalitions of allies across the systems they aim to disrupt. This may also require them to revisit and adapt their initial ideas, guiding principles and values as greater understandings of development problems are gained. A pubic authorities lens, attuned to the logics programmes seek to address and introduce to FCAS, may help analysts to foreground the implications of such adaptations.
_eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1111/dpr.12691

Adaptive Programming and Business Environment Reform – Lessons for DFID Zimbabwe - Donovan, Elbereth; Manuel, Clare (DFID, 2017)
Keywords: IMPORTANT

Adaptive programming - Vowles, Pete (DFID Bloggers, 2013)
Staff blogs from the UK Department for International Development. Get real-life perspectives from those on the ground to fight poverty and join in the debate.

Adaptive Peacebuilding Programming Through Effective Feedback Loops: Promising Practices - Barnard-Webster, Kiely; Jean, Isabella (CDA, 2018)
This case study report was developed by CDA’s part of Peacebuilding Evaluation Consortium collaborative research on the use of feedback loops in support of adaptive programming. Feedback loops are just one element of adaptive programming and are defined and used in different ways by organizations working on social change, peace and development issues. This document includes key findings from our desk review of reports and grey literature, key informant interviews, observations documented during CDA’s advisory and learning engagements with peacebuilding partners as well as the case study on SFCG’s feedback processes in Burundi. The findings are most relevant to program and M&E staff but have implications for senior management and policymakers in light of growing interest in strengthening adaptive management.

Adaptive monitoring: a new paradigm for long-term research and monitoring - Lindenmayer, David B.; Likens, Gene E. (Trends in Ecology & Evolution, 2009)
Long-term research and monitoring can provide important ecological insights and are crucial for the improved management of ecosystems and natural resources. However, many long-term research and monitoring programs are either ineffective or fail completely owing to poor planning and/or lack of focus. Here we propose the paradigm of adaptive monitoring, which aims to resolve many of the problems that have undermined previous attempts to establish long-term research and monitoring. This paradigm is driven by tractable questions, rigorous statistical design at the outset, a conceptual model of the ecosystem or other entity being examined and a human need to know about ecosystem change. An adaptive monitoring framework enables monitoring programs to evolve iteratively as new information emerges and research questions change.

Adaptive management: why we find it so hard to operationalise - Teskey, Graham (Abt Associates - Governance Soapbox, 2018)

Adaptive management: where are we now? - Rist, Lucy; Campbell, Bruce M.; Frost, Peter (Environmental Conservation, 2013)
Adaptive management (AM) emerged in the literature in the mid-1970s in response both to a realization of the extent of uncertainty involved in management, and a frustration with attempts to use modelling to integrate knowledge and make predictions. The term has since become increasingly widely used in scientific articles, policy documents and management plans, but both understanding and application of the concept is mixed. This paper reviews recent literature from conservation and natural resource management journals to assess diversity in how the term is used, highlight ambiguities and consider how the concept might be further assessed. AM is currently being used to describe many different management contexts, scales and locations. Few authors define the term explicitly or describe how it offers a means to improve management outcomes in their specific management context. Many do not adhere to the idea as it was originally conceived, despite citing seminal work. Significant confusion exists over the distinction between active and passive approaches. Over half of the studies reporting to implement AM claimed to have done so successfully, yet none quantified specific benefits, or costs, in relation to possible alternatives. Similarly those studies reporting to assess the approach did so only in relation to specific models and their parameterizations; none assessed the benefits or costs of AM in the field. AM is regarded by some as an effective and well-established framework to support the management of natural resources, yet by others as a concept difficult to realize and fraught with implementation challenges; neither of these observations is wholly accurate. From a scientific and technical perspective many practical questions remain; in particular real-world assessments of the value of experimentation within a management framework, as well as of identified challenges and pathologies, are needed. Further discussion and systematic assessment of the approach is required, together with greater attention to its definition and description, enabling the assessment of new approaches to managing uncertainty, and AM itself.
Keywords: Adaptive Management; Decision making; Natural resource management; conservation; experimental management; uncertainty

Adaptive management: What it means for CSOs - O’Donnell, Michael (Bond, 2016)
Keywords: IMPORTANT

Adaptive Management Tools: Concept Notes System - Mercy Corps (Mercy Corps, 2015)
Mercy Corps finds adaptive management is supported by four different but interconnected elements: Culture, People & Skills, Tools & Systems, and Enabling Environment. These elements are discussed in the context of one of Mercy Corps’ complex programmes in pastoral Ethiopia.

Adaptive Management, the Endangered Species Act, and the Institutional Challanges of New Age Environmental Protection - Doremus, Holly (Washburn Law Journal, 2001)

Adaptive Management Self-assessment tool - mercy Corps (Mercy Corps, 2016)
The Adaptive Management self-assessment tool has been designed to help teams assess the extent to which they have a supportive environment for adaptive management within their country program. The self-assessment tool helps you think about five different areas that have been identified as important for supporting adaptive management: 1. Culture & leadership 2. Dynamic teams 3. Appropriate analysis 4. Responsive implementation & operations 5. Enabling environment (for example donor funding and relationships)

Adaptive Management: Responding to the evolving needs of PRIME's complex systems - Picon, Diana; Wild, Lorenz (Mercy Corps, 2015)

Adaptive Management Practice in the UK Government - The MUVA case - HLS (Human Learning Systems, 2019)
Case study about the MUVA programme in Mozambique. (Maybe it "misses the point of AP which is not learning for learning. Is learning for impact. The word impact doesn’t even come up once!") Adaptive Management programming within the Foreign & Commonwealth Development Office demonstrates that the UK Government has examples of optimising for learning within its existing management practice. However, currently, the adaptive management practices are unhelpfully framed by an approach which limits both their effectiveness and scope. The programmes use learning as their metastrategy. They succeed in connecting practicebased learning with strategic learning, and make a shift towards reframing accountability as accountability for learning. This learning strategy is enabled by funding and contract management arrangements which prioritise learning. Both at macro-level of programme management and micro level of de-risking experimentation and enabling necessary failure by decoupling people’s job security from potential failure.

Adaptive management of natural resources: theory, concepts, and management institutions. - Stankey, George H.; Clark, Roger N.; Bormann, Bernard T. (U.S. Department of Agriculture, Forest Service, Pacific Northwest Research Station, 2005)
This report reviews the extensive and growing literature on the concept and application of adaptive management. Adaptive management is a central element of the Northwest Forest Plan and there is a need for an informed understanding of the key theories, concepts, and frameworks upon which it is founded. Literature from a diverse range of ﬁelds including social learning, risk and uncertainty, and institutional analysis was reviewed, particularly as it related to application in an adaptive management context. The review identiﬁes opportunities as well as barriers that adaptive management faces. It concludes by describing steps that must be taken to implement adaptive management.

Adaptive management of natural resources—framework and issues - Williams, Byron K. (Journal of Environmental Management, 2011)
Adaptive management, an approach for simultaneously managing and learning about natural resources, has been around for several decades. Interest in adaptive decision making has grown steadily over that time, and by now many in natural resources conservation claim that adaptive management is the approach they use in meeting their resource management responsibilities. Yet there remains considerable ambiguity about what adaptive management actually is, and how it is to be implemented by practitioners. The objective of this paper is to present a framework and conditions for adaptive decision making, and discuss some important challenges in its application. Adaptive management is described as a two-phase process of deliberative and iterative phases, which are implemented sequentially over the timeframe of an application. Key elements, processes, and issues in adaptive decision making are highlighted in terms of this framework. Special emphasis is given to the question of geographic scale, the difﬁculties presented by non-stationarity, and organizational challenges in implementing adaptive management.

Adaptive management of an environmental watering event to enhance native fish spawning and recruitment - King, A. J.; Ward, K. A.; O’connor, P.; Green, D.; Tonkin, Z.; Mahoney, J. (Freshwater Biology, 2010)
1. A common goal of many environmental flow regimes is to maintain and/or enhance the river’s native fish community by increasing the occurrence of successful spawning and recruitment events. However, our understanding of the flow requirements of the early life history of fish is often limited, and hence predicting their response to specific managed flow events is difficult. To overcome this uncertainty requires the use of adaptive management principles in the design, implementation, monitoring and adjustment of environmental flow regimes. 2. The Barmah-Millewa Forest, a large river red gum forest on the Murray River floodplain, south-east Australia, contains a wide variety of ephemeral and permanent aquatic habitats suitable for fish. Flow regulation of the Murray River has significantly altered the natural flood regime of the Forest. In an attempt to alleviate some of the effects of river regulation, the Forest’s water regime is highly managed using a variety of flow control structures and also receives targeted Environmental Water Allocations (EWA). In 2005, the largest environmental flow allocated to date in Australia was delivered at the Forest. 3. This study describes the adaptive management approach employed during the delivery of the 2005 EWA, which successfully achieved multiple ecological goals including enhanced native fish spawning and recruitment. Intensive monitoring of fish spawning and recruitment provided invaluable real-time and ongoing management input for optimising the delivery of environmental water to maximise ecological benefits at Barmah-Millewa Forest and other similar wetlands in the Murray-Darling Basin. 4. We discuss possible scenarios for the future application of environmental water and the need for environmental flow events and regimes to be conducted as rigorous, large-scale experiments within an adaptive management framework.
Keywords: floodplain river; regulated flows

Adaptive Management looks like it’s here to stay. Here’s why that matters. - Green, Duncan (From Poverty to Power, 2016)
First installment of reflections on my US trip. This is on the rise of adaptive management approaches in USAID, and some of the questions it raises
Keywords: IMPORTANT

Adaptive Management: Learning and Action Approaches to Implementing Norms-shifting Interventions - McLarnon, Courtney; Gayles, Jennifer; Deepan, Prabu (USAID / Passages, 2021)
What Passages has Learned about Adaptive Management: • Be reflective about information that is collected and create a culture of learning. • Be systematic about establishing monitoring and learning systems. • Be strategic about data sources and analysis, prioritizing areas for learning and addressing issues raised. • Be inclusive about information collection: who is collecting what, how, and how is it being used.

Adaptive Management Leaders Launch Practical Adaptation Network (PAN) - Labs, Feedback (FeedbackLabs, 2016)
Great things can happen at the frontier of theory and practice. When Feedback Labs worked with USAID’s Global Development Lab to bring together leaders in adaptive management at the White House on June 15th, we were pleased that we were able to move past the ongoing conceptual conversations toward discussing what we could do in concrete terms to implement adaptive management in practice.

Adaptive management intentions with a reality of evaluation: Getting science back into policy - Hasselman, Lyndal (Environmental Science & Policy, 2017)
In Australia’s Murray-Darling Basin water reform has been contentious as government attempts to reconcile historical over allocation of water to irrigation with the use of water for environmental outcomes. However, in many aspects, scientific knowledge of the environment is either imperfect, incomplete or environmental responses are unpredictable, with this uncertainty preventing definitive policy and closure of political arguments. In response to uncertainty and knowledge gaps, adaptive management has been written into the legislation, along with provisions for periodic evaluation. This research ascertains how adaptive management is understood by policy makers, with this indicative of future implementation of adaptive management. The way in which adaptive management is constructed by policy makers is determined through legislation, public speeches, government reports and semi-structured interviews. The findings demonstrate that adaptive management has been subsumed by evaluation. The loss of adaptive management as a distinct concept is seen as a loss of science and discovery from the policy process, with the dominance of evaluation discussed as limiting innovation and reinforcing a ‘muddling through’ of policy.
Keywords: Accountability; Adaptive Management; Evaluation; Science; Uncertainty

Adaptive management in wildlife conservation - Organ, John; Decker, D.J.; McDonald, J.E.; Riley, Shawn; Mahoney, S.P. (The Wildlife Society Techniques Manual, 2012)
Adaptive management in wildlife conservation emerged from the wildlife profession's search for better solutions to increasingly complex conservation challenges. Adaptive management is an effective process for wildlife managers to employ to (1) deal with uncertainty in the management system, (2) learn from their management actions, and (3) achieve desired results. Being adaptable or flexible in your management approach is not the same as managing adaptively or conducting adaptive management. Adaptive management requires adhering to a stepwise process and fully executing each step. A critical step is rigorous monitoring and assessment of management interventions. Without this, wildlife managers cannot achieve the essence of adaptive management, which is the explicit goal of learning more about the management system after each management action.

Adaptive Management in the Face of Climate Change and Endangered Species Protection - Gardner, Emily (Ecology Law Quarterly, 2013)

Adaptive Management in the Courts - Fischman, Robert L.; Ruhl, J.B. (Minnesota Law Review, 2010)
Adaptive management has become the tonic of natural resources policy. With its core idea of “learning while doing,” adaptive management has infused the natural resources policy world to the point of ubiquity, surfacing in everything from mundane agency permits to grand presidential proclamations. Indeed, it is no exaggeration to suggest that these days adaptive management is natural resources policy. But is it working? Does appending “adaptive” in front of “management” somehow make natural resources policy, which has always been about balancing competing claims to nature’s bounty, something more and better? Many legal and policy scholars have asked that question, with mixed reviews. Their evaluations, however, have rested on theory, program-specific surveys, and isolated case studies. This article provides the first comprehensive review of adaptive management from the perspective that likely matters most to the natural resource agencies practicing adaptive management - how is it faring in the courts? Part I of the Article examines the theory, policy, and practice of adaptive management, focusing on the experience of the federal resource management agencies. The end product in practice is something we call “a m-lite,” a watered down version of the theory that resembles ad hoc contingency planning more than it does planned “learning while doing.” This gap between theory and practice leads to profound disparities between how agencies justify decisions and how adaptive management in practice arrives at the courthouse doorsteps. In Part II we review how these disparities have played out in courts considering claims that agency practice of adaptive management has not lived up to its theoretical promise or to the legal demands of substantive and procedural environmental law. We extract three key themes from the body of case law in this respect. Part III extends from the existing case law to draw lessons for agencies and Congress about the future practice of adaptive management. Our ultimate message to agencies is that a m-lite can be an effective decision method - and one that survives judicial scrutiny - but agencies must be more disciplined about its design and implementation. This includes resisting the temptation to employ adaptive management to dodge burdensome procedural requirements, substantive management criteria, and contentious stakeholder participation. If faithfully followed and enforced, this model, despite its flaws, could serve as an important component of natural resources policy to confront problems of the future as daunting as climate change.

Adaptive Management in SDC: Challenges and Opportunities - Prieto Martin, Pedro; Apgar, Marina; Hernandez, Kevin (IDS, 2020)
Adaptive management (AM) is a programme management approach that helps international development organisations to become more learning-oriented and more effective in addressing complex development challenges. AM practices have been applied for decades within other sectors as varied as logistics, manufacturing, product design, military strategy, software development and lean enterprise. At its core, AM is not much more than common sense, as it essentially recognises that the solutions to complex and dynamic problems cannot be identified at the outset of a programme but need to emerge throughout the process of implementation as a result of systematic and intentional monitoring and learning. The generic AM process typically involves an iterative cycle of design, implementation, reflection and adaptation activities, supported both by system monitoring and stakeholder involvement to obtain a better understanding of the evolving system and improve how the intervention is managed. A favourable context for AM in development. During recent decades, the international development sector has aimed to increase its results and impact orientation. As a result, a growing number of development organisations and governments have become increasingly aware of the limitations of traditional ‘linear and prescriptive’ programming approaches. They are now recognising the need to handle complexity better, and have begun to adapt their policies and practices to facilitate adaptive approaches. The World Bank, for example, now acknowledges that aid agencies need to increase flexibility of implementation, tolerate greater risk and ambiguity, devolve power from aid providers to aid partners, and avoid simplistic linear schemes for measuring results. Multilateral and bilateral organisations such as the World Bank, the United Kingdom’s (UK) Department for International Development (DFID) and the United States Agency for International Development (USAID) are currently experimenting with adaptive approaches. A multitude of adaptive approaches and communities of practice have emerged that aim to improve the effectiveness of aid, including Collaborating, Learning, and Adapting, Thinking and Working Politically, Doing Development Differently, Market Systems Development, Conflict-Sensitive Programme Management, and Science of Delivery. Since generic AM approaches have existed for decades in other sectors, AM has the potential to act as a neutral ‘bridge language’ that facilitates exchange and learning among the different communities and donors. This report is the result of a learning partnership between the Swiss Agency for Development and Cooperation (SDC) and the Institute of Development Studies (IDS). It assesses the relevance of AM to SDC, how it relates to working practices across SDC, and the key challenges and opportunities for SDC. Its process of elaboration involved a literature review on AM, an exploration of AM approaches from several bilateral donors, a series of 6 interviews with SDC staff and partners working in different countries and thematic domains, and a learning workshop at SDC headquarters (HQ), where staff from several SDC divisions reflected on AM and on how to advance the organisation’s capacity for adaptive programming and learning.

Adaptive Management in Practice: a case study on the Prospects program - Maclay, Chris (Mercy Corps, 2016)
Recognising that aid and development programming takes place in complex contexts, Mercy Corps is increasingly seeking to understand how best to manage programs which iterate, adapt and respond to the consistently evolving settings in which we work. This brief Practice Paper provides some examples of what adaptive management looks like in practice on the Prospects youth employment program in Liberia. It does not seek to function as a manual or set of guidelines, but simply provides some practical examples and insights into how a youth employment program governed by principles of adaptive management operates.

Adaptive Management in Habitat Conservation Plans - Wilhere, George F. (Conservation Biology, 2002)
Habitat conservation plans (HCPs) allow incidental take of threatened or endangered species in exchange for conservation measures that minimize and mitigate such taking. Habitat conservation plans entail a compromise between regulatory certainty and scientific uncertainty. This compromise is controversial because many HCPs are thought to inadequately address scientific uncertainty. Adaptive management is the systematic acquisition and application of reliable information to improve natural resource management over time. Ideally, under adaptive management, conservation strategies are implemented as a deliberate experiment. This approach can establish cause-and-effect relationships and point the way toward optimal strategies. Adaptive management has been promoted as essential to management under uncertainty, but few HCPs incorporate genuine adaptive management. Habitat conservation plans will continue to lack adaptive management until certain conditions are met, such as acknowledgment that an HCP is a management hypothesis, landowner interest in improving biological outcomes, and sufficient financial resources. Economic incentives would encourage adaptive management in HCPs. Habitat conservation plan permittees might receive direct payments or tax deductions for reliable information that benefits a species. “Mitigation credits” could be awarded for information produced through adaptive management. In effect, habitat would be exchanged for information that benefits a species. Successful use of mitigation credits would depend on correctly valuing information and enforcement of the U.S. Endangered Species Act. Under a “precautionary polluter pays principle,” an HCP permittee would put up an environmental assurance bond. Portions of the bond are returned with interest as adaptive management demonstrates that environmental damages are unlikely to occur. Funds spent on adaptive management are funds unavailable for habitat protection, so limited financial resources may force a compromise between protecting habitat and acquiring knowledge.

Adaptive management in aid programmes (BEAM Exchange, 2014)
Aid works better – especially in complex and conflict-affected environments – when there is scope to trial and adapt programme strategies. So argues Amir Allana in Navigating Complexity, a case study of Northern Karamoja's Growth, Health and Governance (GHG) Programme that is adopting an 'adaptive management' approach. This BEAM Exchange webinar invited Amir, Tim Sparkman and Peter Roggekamp to discuss lessons from their work in Uganda and Cambodia. What does adaptive management look like in practice? And what does it require of managers and funders to make it happen? Tim and Peter share their experiences of applying adaptive management techniques to the Growth, Health and Governance Programme and the Cambodia Agricultural Value Chain Program (CAVAC). Amir highlight insights from the Navigating Complexity report, including the importance of office culture, consistent management signals, and the role of supportive tools and processes.

Adaptive Management: From More Talk to Real Action - Williams, Byron K.; Brown, Eleanor D. (Environmental Management, 2014)
The challenges currently facing resource managers are large-scale and complex, and demand new approaches to balance development and conservation goals. One approach that shows considerable promise for addressing these challenges is adaptive management, which by now is broadly seen as a natural, intuitive, and potentially effective way to address decision-making in the face of uncertainties. Yet the concept of adaptive management continues to evolve, and its record of success remains limited. In this article, we present an operational framework for adaptive decision-making, and describe the challenges and opportunities in applying it to real-world problems. We discuss the key elements required for adaptive decision-making, and their integration into an iterative process that highlights and distinguishes technical and social learning. We illustrate the elements and processes of the framework with some successful on-the-ground examples of natural resource management. Finally, we address some of the difficulties in applying learning-based management, and finish with a discussion of future directions and strategic challenges.
Keywords: IMPORTANT

Adaptive Management for International Development Programs - Loveridge, Donna (2007)
Capacity development, that is “the process whereby people, organisations and society as a whole unleash, strengthen, create, adapt and maintain capacity over time” (OECD 2005) has been a key aim of international aid programs. However, capacity development efforts have not met with resounding success despite approximately 25%, or USD15 billion a year, being spent by donors in recent years on technical assistance1 which has predominantly been aimed at developing capacity. A 1998 review by the World Bank (World Bank 1998) found that the success rate for capacity development efforts was between 30 – 40%. The Commission for Africa (2005) noted in 2005 that achievements were below expectations. The OECD (2007) sees capacity development as being one of the areas which are least responsive to development assistance and therefore one of the greatest challenges. This paper proposes that development practitioners and donors could benefit from taking an evaluative inquiry-type of approach to the design, implementation and monitoring and evaluation of capacity development programs. An alternative approach, “adaptive management”, is proposed. Adaptive management moves away from a rational linear A + B = C approach to capacity development towards constructing and testing theories of change2 for knowledge generation, adaptation and program improvement.

Adaptive Management and Social Learning in Collaborative and Community-Based Monitoring: a Study of Five Community-Based Forestry Organizations in the western USA - Fernandez-Gimenez, Maria; Ballard, Heidi; Sturtevant, Victoria (Ecology and Society, 2008)
Fernandez-Gimenez, M. E., H. L. Ballard, and V. E. Sturtevant. 2008. Adaptive management and social learning in collaborative and community-based monitoring: a study of five community-based forestry organizations in the western USA. Ecology and Society 13(2): 4. https://doi.org/10.5751/ES-02400-130204

Adaptive management: an overview of the concept and its practical application in the Scottish context - Blackstock, Kirsty; Brown, Katrina; Gimona, Alessandro; Prager, Katrin; Irvine, Justin (The James Hutton Institute, 2016)

Adaptive Management Across Project Cycles: Look into Coherence in Time - Guerzovich, Florencia (Medium, 2023)
This is a series about Monitoring, Evaluating and Learning (MEL) whether sets of interventions/portfolios are adding more together than each one would produce on their own. In post 1, I pointed to coherence, the new OECD-DAC evaluation criteria as a way to bridge the ambition of bringing bigger change with the MEL world. In post 2, I shared 3 of 4 practical lessons I’ve learned in experimenting with MEL systems and exercises that focus explicitly on interactions of interventions/portfolios. In the third post, I bring Paul Pierson’s groundbreaking argument for social science to MEL. Paraphrasing, most contemporary MEL takes a “snapshot” view of interventions and portfolios, distorting their effects and meaning by ripping them from their temporal context. Instead, we should place in time interventions/portfolios with the ambition to add more than the sum of the part by constructing MEL systems looking at “moving pictures” rather than taking snapshots. ...

Adaptive Management: A Tool for Conservation Practitioners - Salafsky, Nick; Margoluis, Richard; Redford, Kent (Foundations of Success, 2001)

Adaptive management: A practical guide to mitigating uncertainty and advancing evidence-based programming - Byom, K.; Ingram, M.; Oakley, A.; Serpe, L. (PACT, 2020)
Pact’s Adaptive Management Guide provides practical guidance to development practitioners globally on the mindsets, behaviors, resources, and processes that underpin an effective adaptive management system. It presents an approach to managing adaptively that is rooted in complexity analysis and program theory. It draws on Pact’s global experiences and work on topics as diverse as health, livelihoods, markets, governance, capacity development, women and youth, and more. This document begins with an introduction to adaptive management, then walks through successive steps to determine how much adaptation a project requires and how to design an appropriate system. The second half of this guidebook contains a toolkit of examples and templates that projects can tailor to their needs.

Adaptive Management - Jenal, Marcus; Cunningham, Shawn (Annual Reflection 2019, 2019)

Adaptive Learning Guide: A pathway to stronger collaboration, learning, and adapting - Ross, Joey; Karlage, James; Etheridge, James; Alade, Mayowa; Fifield, Jocelyn; Goodwin, Christian; Semrau, Katherine; Hirschhorn, Lisa (USAID MOMENTUM Knowledge Accelerator, 2021)
The purpose of this Adaptive Learning Guide is to provide MOMENTUM project teams with the information and resources to integrate adaptive learning into the design, implementation, and improvement of MNCH/FP/RH programs. This guide provides a conceptual introduction to adaptive learning using links to existing resources and real-world examples of how adaptive learning can drive continuous learning and improvement in project work. The guide is built upon three foundational assumptions: We work in dynamic, often unpredictable environments. Unexpected turns of events will occur. Progress is rarely, if ever, linear. Integrating the principles and practices of USAID’s Collaborating, Learning, and Adapting Toolkit into projects and initiatives requires designing for learning and adaptation. We intend the guide to serve as a “starting point” for interested individuals and teams to begin or strengthen the processes that support the integration of adaptive learning into project work.

Adaptive Learning - Guerzovich, Florencia; Poli, Maria (Global Partnership for Social Accountability, 2014)

Adaptive leadership in the coronavirus response - Ramalingam, Ben; Wild, Leni; Ferrari, Matt (ODI, 2020)
The coronavirus pandemic poses unprecedented challenges to science, policy and the interface between the two. How – and how quickly – policy-makers, practitioners and researchers react to this emerging and complex crisis is making a profound difference to people’s lives and livelihoods (WHO, 2020). But how can we ensure effective collective decision-making on the basis of emerging evidence, changing trends and shifting scientific understanding, all in the face of considerable uncertainty? Recent experience highlights the need for adaptive leadership in national and global responses to the outbreak. This briefing paper sets out key principles for what this might look like, and proposes a roadmap for policy-makers, practitioners and researchers to move towards such an approach as they tackle the unfolding crisis. Key messages Tackling the coronavirus outbreak requires adaptation at operational and leadership levels. Operationally, there is scope to strengthen evidence-based adaptive management practices, to adjust the mix and type of interventions being implemented and learn as we go so as to achieve shared goals. This requires adaptive leadership capacities, being open and transparent about learning, using collective decision-making processes and building trust with communities and individuals.

Adaptive Leadership in Development course - Moran, Mark; Curth-Bibb, Jodie; Grice, Tim; Glavey, Sarah (University of Queensland, 2017)

Adaptive Leadership: Accelerating Enterprise Agility - Highsmith, Jim (Addison-Wesley Professional., 2013)

Adaptive Impact Management: An Integrative Approach to Wildlife Management - Riley, Shawn; Siemer, William; Decker, Daniel; Carpenter, Len; Organ, John; Berchielli, Louis (Human Dimensions of Wildlife, 2003)

Adaptive Evaluation: A Complexity-based approach to Systematic Learning for Innovation and Scaling in Development - Gokhale, Siddhant; Walton, Michael (Center for International Development, Harvard University, 2023)
Nearly all challenges in international development tend to be complex because they depend on constantly evolving human behaviour, systems, and contexts, involving multiple actors, entities, and processes. As a result, both the discovery and scaling of innovations to address challenges in development often involve changes in system behaviour or even system-level transformation. This is rarely a linear process over time and can result in unexpected outcomes. Existing evaluation techniques commonly used in international development, including Randomized Control Trials (RCT) and quasi-experimental methods, are good at assessing specific effects of interventions but are not designed for the change processes inherent to innovation and scaling within a system. There is a need to reconstruct how we use existing measurement tools, techniques, and methodologies so that they capture the complexity of the environment in which an intervention or change occurs. We introduce Adaptive Evaluation, designed to learn at various levels of complexity while supporting the transformation needed to foster sustainable change. An Adaptive Evaluation uses three main approaches to work with complex questions—systems diagnosis, theorybased assessment of change processes, and iterative designs. An Adaptive Evaluation typically builds hypotheses from field-based interactions, emphasizes learning over testing, advocates open-mindedness with techniques, and appreciates the value of dialogue and participation in navigating complex processes. It can use RCT or similar techniques to analyse specific processes within a system or a development cycle, but these are embedded in a broader approach to assessment and interpretation. It is designed to be flexible and adjust to shifting contexts. Finally, an Adaptive Evaluation can be applied at any stage in a complex intervention's lifecycle, from the interpretation of the system and change processes to rapid experimentation, prototyping, and testing of select interventions, and then adaptation to different settings for impact at scale. This paper provides the theoretical basis for an Adaptive Evaluation—the main approaches, core ideology, process, and applications.

Adaptive Development Switchboard - Final Report (Internal Document) - Feedback Labs (LearnAdapt Programme, 2018)

Adaptive development: great progress and some niggles - Vowles, Pete (Medium, 2016)
After 3 years in DFID headquarters, championing adaptive approaches to the delivery of aid and development programmes, I am back in an…

Adaptive Bureaucracies: lessons from DFID to the world - Simpson, Lea (LearnAdapt, 2020)
How many times have you worked on something that you know is failing, or just isn’t going as well as we’d all have hoped, but haven’t had…

’Adaptive Authoritarianism’ in Contemporary China: Identifying Zones of Legitimacy Building - Ahlers, Anna Lisa; Schubert, Gunter (Reviving Legitimacy: Lessons for and from China, 2011)
Anna L. Ahlers and Gunter Schubert, ’Adaptive Authoritarianism’ in Contemporary China: Identifying Zones of Legitimacy Building, in: Deng Zhenglai and Guo Sujian (eds), Reviving Legitimacy: Lessons for and from China, Lanham: Lexington Books (2011),

Adapting to Learn and Learning to Adapt: Practical Insights from International Development Projects - Brinkerhoff, Derick W.; Frazer, Sarah; McGregor, Lisa (RTI Press, 2018)
Adaptive programming and management principles focused on learning, experimentation, and evidence-based decision making are gaining traction with donor agencies and implementing partners in international development. Adaptation calls for using learning to inform adjustments during project implementation. This requires information gathering methods that promote reflection, learning, and adaption, beyond reporting on pre-specified data. A focus on adaptation changes traditional thinking about program cycle. It both erases the boundaries between design, implementation, and evaluation and reframes thinking to consider the complexity of development problems and nonlinear change pathways.Supportive management structures and processes are crucial for fostering adaptive management. Implementers and donors are experimenting with how procurement, contracting, work planning, and reporting can be modified to foster adaptive programming. Well-designed monitoring, evaluation, and learning systems can go beyond meeting accountability and reporting requirements to produce data and learning for evidence-based decision making and adaptive management. It is important to continue experimenting and learning to integrate adaptive programming and management into the operational policies and practices of donor agencies, country partners, and implementers. We need to devote ongoing effort to build the evidence base for the contributions of adaptive management to achieving international development results.

Adapting to learn and learning to adapt: Practical insights from international development projects - Brinkerhoff, Derick; Frazer, Sarah (RTI, 2018)
Adaptive programming and management principles focused on learning, experimentation, and evidence-based decision making are gaining traction with donor agencies and implementing partners in international development. Adaptation calls for using learning to inform adjustments during project implementation. This requires information gathering methods that promote reflection, learning and adaption, beyond reporting on pre-specified data. A focus on adaptation changes traditional thinking about program cycle.

Adapting lean thinking to market systems development: Principles and practices for donors/funders - Rasmussen, Leanne (Engineers without borders, 2014)
The purpose of this paper is to provide funders and implementers of market systems development (MSD) projects with principles, practices, and structures that enables these projects to thrive. It is based on a book that has sold millions of copies worldwide, and a school of thought taught at institutions such as Harvard Business School and practiced in companies ranging from giants such as Toyota to the most successful tech start-ups in Silicon Valley. Published in 2011, Eric Ries wrote the Lean Startup as a remedy to the countless start-ups that create their own demises by getting started with the wrong goals, the wrong structures, and the wrong processes. He outlines an approach that enables the startup to navigate ambiguity and risk while using resources effectively. The conditions a MSD project faces are remarkably similar to those which a startup business faces; it needs structures and processes that are matched to the unpredictable, complex environment which it is attempting to influence. MSD projects can thus benefit from private-sector thought leadership on how start-ups can situate themselves for success. This paper starts with an overview of lean thinking, a concept that derives from lean manufacturing which is widely accepted as the leading approach to modern manufacturing. It explains how Ries’s Lean Startup adapts these principles, and then it in turn adapts these ideas for market systems development. The following three sections provide an overview of Lean Startup concepts, applying them to the development sector as appropriate. The final section summarizes and makes suggestions on next steps for funders who wish to set MSD projects up for success using a lean approach. Overall, the paper builds a case for how the Lean Startup’s approach can enable MSD projects to work successfully in ambiguity and increase their potential for achieving robust and sustainable results, all while using donor resources more efficiently.
Keywords: Adaptive Development; Lean

Adapting development: improving services to the poor - Wild, Leni; Booth, David; Cummings, Clare; Foresti, Marta; Wales, Joseph (ODI, 2015)
On current trends, it will take decades or longer to bring basic services to the world’s most disadvantaged people. Meeting this challenge means recognising the political conditions that enable or obstruct development progress - a radical departure from the approach of the Millennium Development Goals.
Keywords: Practice

Adapting data collection and utilisation to a Covid-19 reality: Monitoring, evaluation and learning approaches for adaptive management - Ziegler, Jessica; Mason, Paige (ODI/GLAM, 2020)
This briefing note focuses on the remote collection and use of data for adaptive management during the Covid-19 pandemic, setting out key considerations to help practitioners think through a transition from more ‘traditional’ monitoring, evaluation and learning (MEL) to MEL for adaptive management (MEL4AM) that reflects the unique data collection challenges presented by Covid-19. The brief provides an overview of some key considerations in remote data collection, when this is required, and identifies other sources that address these issues in more detail. It concludes with a discussion of how to bring the information resulting from remote monitoring into decision-making to enable adaptive management. Key messages - When planning for remote data collection during the Covid-19 pandemic, first determine what information is still necessary, because data needs may have changed, e.g. if programming has pivoted or needs to pivot due to Covid-19. Then identify how the programme’s information needs align with existing data sources and what gaps remain, which will guide the need for remote data collection. - Also consider what data is ‘good enough’ for current decision-making needs in order to provide sufficient information to the right people at the right time to an acceptable standard of rigour. - There may be pragmatic reasons to reduce the number or scope of MEL activities, such as logistical constraints or ethical considerations introduced by the pandemic. - MEL activities should be accompanied by frequent feedback loops and pause points to reflect on emergent needs and challenges, information needs that have been met, and contextual changes that may affect MEL. - Be clear with decision-makers about the assumptions and gaps in the data, including proxies used and their limitations, sampling changes, and how these changes and assumptions may affect the decisions/options being discussed.

Adapting Aid: Lessons from six case studies - Algoso, Dave; Beloe, Jon; Hemberger, Alison; Hill, Philippa; Proud, Emma (MercyCorps & IRC, 2016)
Keywords: IMPORTANT