Webimar - Adaptive Management at the Strategy Level: Portfolio Reviews and Mid Course Stocktaking - USAID (USAID, 2017)
On Wednesday, November 15, 2017 at 8:00 a.m. EST, the Bureau for Policy, Planning and Learning (PPL) held a one-hour webinar exploring Strategy-level Portfolio Reviews and Mid Course Stocktaking.

Course: Introduction to Collaborating, Learning and Adapting (CLA) in the Program Cycle - USAID LEARN (USAID Learning Lab, 2018)

Using Systemic M&E Tools in Feed The Future Uganda: Sensemaker ® - Webinar - USAID Learning Lab (2015)
This webinar is part of a series organized by SEEP's Market Facilitation Initiative (MaFI), USAID's LEO project and the BEAM Exchange as a part of the "Learning with the Toolmakers" webinar series. As part of a new cycle of webinars focusing on inclusive market facilitation tools. In this series, Eric Derks and Leanne Rasmussen will share learning from this five-year, multi-million dollar USAID program, the objective of which is to increase Ugandan farmers’ use of good quality agro-inputs by fostering more inclusive systemic changes in the agro-inputs industry. Using Systemic M&E Tools in Feed The Future Uganda: Sensemaker ® This third webinar in the series, titled “,” will look at how the project team used this tool and method to monitor systemic change. Leanne and Eric will share their experiences with using the tool and give recommendations to other practitioners who are interested in applying it. What is Sensemaker ®? SenseMaker combines an innovative research methodology with patented software to collect and analyze large quantities of narratives in order to understand complex change. It brings together insights from complexity sciences, anthropology, and cognitive science. It uses participants’ narratives to uncover foundational attitudes and norms that inform and influence behavior. This webinar is organized by SEEP's Market Facilitation Initiative (MaFI), USAID's LEO project and the BEAM Exchange as a part of the "Learning with the Toolmakers" webinar series.

Matrixing Aid: The Rise and Fall of 'Results Initiatives' in Swedish Development Aid - Vähämäki, Janet (Stockholm Business School, Stockholm University, 2017)

Learning from Results-Based Management evaluations and reviews - Vähämäki, Janet; Verger, Chantal (Development Co-operation Working Papers, 2019)
What have we learned from implementing results-based management in development co-operation organisations? What progress and benefits can be seen? What are the main challenges and unintended consequences? Are there good practices to address these challenges? To respond to these questions this paper reviews and analyses the findings from various evaluations and reviews of results-based management systems conducted by members of the Development Assistance Committee (DAC), the OECD/DAC Results Community Secretariat and other bodies in the past four years (2015-2018). It also draws on emerging lessons from new methods for managing development co-operation results. This analytical work aims to: identify recent trends in results-based management, explore challenges faced by providers when developing their results approaches and systems, select good practices in responding to these challenges that can be useful for the OECD/DACResults Community, considering new approaches, new technologies and evolving contexts. This body of evidence will inform the development of a core set of generic guiding principles for results-based management in development co-operation.

Building justice and peace from below? Supporting community dispute resolution in Asia - Valters, Craig (Working Politically in Practice Series: Case Study, 2016)

Learning and adaptation: 6 pitfalls to avoid - Valters, Craig (Devex, 2016)

Learning from adaptive programmes - 10 lessons and 10 case studies - Valters, Craig (Overseas Development Institute, 2018)
Internal DFID document from the DevAdapt Programme. Based on another previous document (also internal).

Theories of change in international development: Communication, learning, or accountability? - Valters, Craig (JSRP Paper 17, 2014)

Theories of Change: time for a radical approach to learning in development - Valters, Craig (ODI, 2015)
The Theory of Change approach demands a radical shift towards more and better learning in development thinking and practice, creating a productive and much-needed space for critical reflection.

Putting learning at the centre: Adaptive development programming in practice - Valters, Craig; Cummings, Clare; Nixon, Hamish (ODI, 2016)
Adaptive programming suggests, at a minimum, that development actors react and respond to changes in the political and socio-economic operating environment. It emphasises learning and the development practitioner is encouraged to adjust their actions to find workable solutions to problems that they may face. Being prepared to react to change may seem like common sense – and indeed it is. However much development thinking and practice remains stuck in a linear planning model which discourages learning and adaptation, in part because projects are seen as ‘closed, controllable and unchanging systems’ (Mosse, 1998: 5). This paper critically engages with this problem and makes clear why and how learning needs to be at the centre of adaptive development programming. It begins by clarifying why and what kind of learning matters for adaptive programming. The paper then turns its focus to how strategies and approaches applied throughout a programme’s conception, design, management and M&E can enable it to continually learn and adapt.
Keywords: IMPORTANT

Top Tips: How to design and manage adaptive programmes - Valters, Craig; Wild, Leni (Overseas Development Institute, 2019)
Within DFID, there is now a commitment to more flexible and adaptive programming. This recognises that: • DFID works in contexts that continuously evolve and change, sometimes in unpredictable ways. To respond to this, the agency needs to remain flexible – to expect change and have a good understanding of context, with resources that can be adjusted and scope to change direction if needed. All DFID programmes should be able to do this. • Some DFID programmes aim to support change in complex systems, behaviours and incentives. Efforts to address women’s empowerment, improve sanitation or build more sustainable health systems, for instance, all require engagement with the way in which complex systems operate and the people and behaviours within them. Trying to deliver reforms in these circumstances is challenging because the pathway to reform itself will be unclear: as a reform is rolled out, the system itself will react and respond. These types of programmes therefore need to build in from the start deliberate processes of learning and testing, to allow for adaptations as more information is gathered for what works over time. These top tips are concerned with programmes that aim to be flexible and adaptive – which work in dynamic contexts and are trying to address complex problems. While there is growing commitment to these approaches, feedback suggests staff still have questions about how to do this well. This document highlights some of the commonly reported issues related to adaptive programming and a set of tips, strategies and examples to help in addressing them. It is aimed at programme managers and advisors who may be Senior Responsible Owners (SROs) or those managing and supporting adaptive programming in a range of ways. We have collated these lessons from discussions with country offices and SROs, feedback from surveys and the wider evidence. We have looked specifically at the adaptive programmes we can find in the DFID portfolio, but this is not an exhaustive list. It should be noted that there is as yet no wide variety of case law to review, but there is a growing set of examples within DFID that can provide continuous learning for the organisation.

The guiding logics and principles for designing emergent transdisciplinary research processes: learning experiences and reflections from a transdisciplinary urban case study in Enkanini informal settlement, South Africa - van Breda, John; Swilling, Mark (Sustainability Science, 2019)
Transdisciplinarity is not a new science per se, but a new methodology for doing science with society. A particular challenge in doing science with society is the engagement with non-academic actors to enable joint problem formulation, analysis and transformation. How this is achieved differs between contexts. The premise of this paper is that transdisciplinary research (TDR) methodologies designed for developed world contexts cannot merely be replicated and transferred to developing world contexts. Thus a new approach is needed for conducting TDR in contexts characterised by high levels of complexity, conflict and social fluidity. To that end, this paper introduces a new approach to TDR titled emergent transdisciplinary design research (ETDR). A core element of this approach is that the research process is designed as it unfolds, that is, it transforms as it emerges from and within the fluid context. The ETDR outlined in this paper emerged through a case study in the informal settlement (slum) of Enkanini in Stellenbosch, South Africa. This case study demonstrates the context from and within which the ETDR approach and identifies a set of guiding logics that can be used to guide ETDR approaches in other contexts. The study demonstrates that the new logics and guiding principles were not simply derived from the TDR literature, but rather emerged from constant interacting dynamics between theory and practice. Learning how to co-design the research process through co-producing transformative knowledge and then implementing strategic interventions to bring about incremental social change is key to theory development in ways that are informed by local contextual dynamics. There are, however, risks when undertaking such TDR processes such as under-valuing disciplinary knowledge, transferring risks onto a society, and suppressing ‘truth-to-power’.

Cherry-Picked Intelligence. The Weapons of Mass Destruction Dispositive as a Legitimation for National Security in the Post 9/11 Age - van der Heide, Liesbeth (Historical Social Research / Historische Sozialforschung, 2013)
»Geheimdienste mit Scheuklappen: Das Dispositiv der Massenvernichtungswaffen als Legitimation für Nationale Sicherheit nach 9/11«. The claim that Iraq possessed Weapons of Mass Destruction (WMD) led to the invasion of Iraq in 2003 by the US army. For the George W. Bush administration, the likely presence of WMD in Iraq was the major justification for going to war. However, Bush' opponents suspected he used the WMD-dispositive as a legitimation for an invasion that was already set in motion for different reasons. The Iraq invasion and the underlying ideas about the presence of WMD thus provide a tangible case for the analysis of theories of conspiracy and security. The development of the WMD-dispositive will be contextualized using the toolkit of securitization theory. The article explores the notions of security and conspiracy that were used to build the dispositive and shows how it ultimately failed and turned into a counter-narrative in which the Bush administration itself became the Great Conspirator.

Making Sense of Complexity: Using SenseMaker as a Research Tool - Van der Merwe, Susara E.; Biggs, Reinette; Preiser, Rika; Cunningham, Charmaine; Snowden, David J.; O’Brien, Karen; Jenal, Marcus; Vosloo, Marietjie; Blignaut, Sonja; Goh, Zhen (Systems, 2019)
There is growing interest in studying processes of human sensemaking, as this strongly influences human and organizational behavior as well as complex system dynamics due to the diverse lenses people use to interpret and act in the world. The Cognitive Edge SenseMaker® tool is one method for capturing and making sense of people’s attitudes, perceptions, and experiences. It is used for monitoring and evaluation; mapping ideas, mind-sets, and attitudes; and detecting trends and weak signals. However, academic literature describing the tool-set and method is lacking. This introduction aims to guide researchers in choosing when to use SenseMaker and to facilitate understanding of its execution and limitations. SenseMaker can provide nuanced insight into system-level patterns of human sensemaking that can provide insight to nudge systems towards more desirable futures, and enable researchers to measure beyond what they know.
Keywords: Mixed methods; SenseMaker tool; complex systems; sensemaking; social complexity

A conceptual map of political participation - van Deth, Jan W. (Acta Politica, 2014)
How would you recognize a mode of participation if you see one? Owing to the rapid expansion of political activities in the last decades this question has become increasingly difficult to answer. Neither the development of all-embracing nominal definitions, nor deductive analyses of existing modes of participation seem to be helpful. In addition, the spread of expressive modes of participation makes it hard to avoid purely subjective definitions. The aim of this discussion paper is to develop an operational definition of political participation, which allows us to cover distinct conceptualizations systematically, efficiently and consistently. This goal can only be arrived at if the conventional approach of presenting nominal definitions to solve conceptual problems is left behind. Instead, available definitions are included in a set of decision rules to distinguish three main variants of political participation. A fourth variant is distinguished for non-political activities used for political purposes. Together, the four variants of political participation cover the whole range of political participation systematically without excluding any mode of political participation unknown yet. At the same time, the endless expansion of the modes of political participation in modern democracies does not result in an endless conceptual expansion. Implications for research and various examples are discussed.

Theory of Change Thinking in Practice - van Es, Marjan; Guijt, Irene; Vogel, Isabel (2015)
Want to know better how your interventions can contribute to change? A Theory of Change (ToC) approach helps in deepening your understanding - and that of your partners - of how you collectively think change happens and what the effect will be of your intervention. Not only does it show what political, social, economic, and/or cultural factors are in play, it also clarifies your assumptions. Once a ToC has been developed, it can be used to continually reflect on it in ways that allow for adaptation and checking of assumptions of your intervention. This user friendly guideline helps you to use a Theory of Change approach. Theories of change are the ideas and beliefs people have – consciously or not – about why and how the world and people change. How people perceive and understand change and the world around them is infused by their underlying beliefs about life, human nature and society. They are deep drivers of people’s behaviour and of the choices they make. Social change processes are complex and characterised by non-linear feedback loops: our own actions interact with those of others and a myriad of influencing factors. This triggers reactions that cannot be foreseen and makes outcomes of change interventions unpredictable. Given these uncertainties, how can we plan strategically and sensibly? How can social change initiatives move forward in emerging change processes in a flexible way, while remaining focused on the goal? In this context of complexity, Hivos has found a theory of change (ToC) approach useful in guiding its strategic thinking and action, as well as its collaborative efforts with others. As it fosters critical questioning of all aspects of change interventions and supports adaptive planning and management in response to diverse and quickly changing contexts. It contributes to the quality and transparency of strategic thinking, and therefore to personal, organisational and social learning. This guide builds on the experiences of Hivos working with a ToC approach. It is a practical guide for Hivos staff in applying a Theory of Change approach, but is also very useful for others working on social change such as social entrepreneurs and innovators. This guide builds on the work of a ToC Learning Group initiated by Hivos and comprising of staff of the Centre for Development Innovation (CDI) of Wageningen University and Research Centre and of experts Iñigo Retolaza Eguren, Isabel Vogel and Irene Guijt. For current thinking and work on the use of Theory of Change thinking in complex change processes, see http://www.theoryofchange.nl

Balancing Inclusiveness, Rigour and Feasibility: Insights from Participatory Impact Evaluations in Ghana and Vietnam - van Hemelrijck, Adinda; Guijt, Irene (Practice Paper, 2016)
This paper by Adinda Van Hemelrijck and Irene Guijt explores how impact evaluation can live up to standards broader than statistical rigour in ways that address challenges of complexity and enable stakeholders to engage meaningfully. A Participatory Impact Assessment and Learning Approach (PIALA) was piloted to assess and debate the impacts on rural poverty of two government programmes in Vietnam and Ghana funded by the International Fund for Agricultural Development (IFAD). We discuss the trade-offs between rigour, inclusiveness and feasibility encountered in these two pilots. Trade-offs occur in every impact evaluation aiming for more than reductionist rigour, but the pilots suggest that they can be reduced by building sufficient research and learning capacity.

Understanding and governing learning in sustainability transitions: A review - van Mierlo, Barbara; Beers, Pieter J. (Environmental Innovation and Societal Transitions, 2018)
Many transitions scholars underscore the importance of learning in sustainability transitions, but the associated learning processes have hardly been conceptualised. The diverse, well-established research fields related to learning are broadly ignored or loosely applied. In this paper, we systematically explore four interesting learning traditions in terms of their value for gaining an in-depth understanding of learning in sustainability transitions and their relevance for fostering learning, by connecting them to key features of transitions. The selected learning traditions from different disciplinary backgrounds provide valuable insights. None of them sufficiently addresses the complexity of transitions. They include, however, a diversity of relevant learning contexts. We conclude that they have value for investigating new areas such as learning in socio-technological regimes and in later phases of a transition, while enlightening forms of learning that have not yet been fully recognised in transition studies, such as superficial learning, unlearning, and learning to resist change.
Keywords: Collaborative learning; Interactive learning; Organizational learning; Social learning; Sustainability transition

Re-Perceiving Results: Aid Programs and Change in Fragile Societies - van Veen, Erwin; Rijper, Alies (Policy Brief, 2017)
Aid programmes need to be able to adapt their objectives and operations to changes in their political environment, since development processes are subject to political contestation. Change takes time and is often a matter of seizing the opportunity.
Keywords: IMPORTANT

What exactly do we mean by systems? - Vexler, Dan (Stanford Social Innovation Review, 2017)
Everyone is talking about systems. Or at least, that's how it seems in my wonkish corner of the philanthropic world. You can't attend a conference or even have a meeting without hearing about systems, whether it's people trying to disrupt them, map them, learn from them, or catalyze them.

Impact Evaluation: Taking stock and looking ahead - Conference report - Visser, Irene; Guijt, Irene; Kusters, Cecile (Centre for Development Innovation, 2013)
This report summarises the presentations and discussions of the Conference ‘Impact evaluation. Taking stock and looking ahead’, which took place in Wageningen on March 25 and 26, 2013. The Conference was organised and funded by the Centre for

Innovating in Development Learning Event - Challenge brief - Vogel, Isabel (Ideas to Impact / iMC, 2017)

Review of the use of ‘Theory of Change’ in International development - Vogel, Isabel (DFID, 2012)
A new report on Theory of Change (ToC) and its use in International development has just been produced.

Innovation in development: Sharing learning, improving impact - Vogel, Isabel; Minkley, Gabrielle; Chowdhury, Sajid (Ideas to Impact / IMC Worldwide, 2017)

Appendix 3. ToC Examples - Vogel, Isabel; Stephenson, Zoe (DFID, 2012)

What Are the Next Steps in Innovation for Good Governance? - von Sturmer, Lucy (Making All Voices Count, 2015)
What are the next steps in innovation for good governance? Lucy von Sturmer reflects on lessons learned at Buntwani 2015.

Adaptive development: great progress and some niggles - Vowles, Pete (Medium, 2016)
After 3 years in DFID headquarters, championing adaptive approaches to the delivery of aid and development programmes, I am back in an…

Adaptive programming - Vowles, Pete (DFID Bloggers, 2013)
Staff blogs from the UK Department for International Development. Get real-life perspectives from those on the ground to fight poverty and join in the debate.

Developing an effective adaptive monitoring network to support integrated coastal management in a multiuser nature reserve - Vugteveen, Pim; van Katwijk, Marieke M.; Rouwette, Etiënne; Lenders, H. J. Rob; Hanssen, Lucien (Ecology and Society, 2015)
ABSTRACT. We elaborate the necessary conceptual and strategic elements for developing an effective adaptive monitoring network to support Integrated Coastal Management (ICM) in a multiuser nature reserve in the Dutch Wadden Sea Region. We discuss quality criteria and enabling actions essential to accomplish and sustain monitoring excellence to support ICM. The Wadden Sea Long-Term Ecosystem Research project (WaLTER) was initiated to develop an adaptive monitoring network and online data portal to better understand and support ICM in the Dutch Wadden Sea Region. Our comprehensive approach integrates ecological and socioeconomic data and links research-driven and policy-driven monitoring for system analysis using indicators of pressures, state, benefits, and responses. The approach and concepts we elaborated are transferable to other coastal regions to accomplish ICM in complex social-ecological systems in which scientists, multisectoral stakeholders, resource managers, and governmental representatives seek to balance long-term ecological, economic, and social objectives within natural limits.
Keywords: IMPORTANT

Valuing peace: delivering and demonstrating mediation results - Dilemmas & options for mediators - Wadley, Ian (Mediation Practice Series, 2017)
Essential points for practitioners and donors • Mediation offers a cost-effective and proven method for resolving armed conflict. Between 1985 and 2015, 75 per cent of armed conflicts in the world were resolved through agreement rather than by force. In most cases these processes will have involved third party facilitation or support. • Professional mediators understand the high stakes involved in their work to prevent, mitigate and resolve armed conflict. In addition, they and their financial supporters are increasingly required to demonstrate ‘value-for-money’ to ensure continued funding. • However, traditional monitoring and evaluation (M&E) methods are not well suited to this task, typically imposing artificially linear project models on a dynamic conflict situation, as well as compliance reporting that moves attention away from real value. • Traditional M&E methods tend to focus on documenting the past and generating vast amounts of data, rather than enabling timely adaptation of the project in the present. • Traditional M&E approaches rely heavily on external evaluation consultants. Even in the best of cases this may interfere with the mediation process and impose a heavy time burden on the project team, leading to low acceptance of traditional M&E approaches by mediation practitioners. • In contrast, an ideal M&E approach for mediation should deliver useful insights in even the most dynamic and sensitive mediation environments, impose a light reporting burden, and be readily accepted by mediation teams. It should protect discretion and trust, enable rapid adaptation, and also provide some assurance that donor funds are being well spent.

MSP Guide - Wageningen University (MSP Guide, 2015)
The MSP Guide Designing and facilitating effective multi-stakeholder partnerships Get started Download now The MSP Guide(EN, FR, ES) Explore the rationale, principles and process of designing and facilitating effective MSPs Get it now The MSP Tool Guide Detailed descriptions of 60 tried-and-tested tools to facilitate multi-stakeholder partnerships Get it now Reflection Methods: Practical Guide Proven…

Designing Regenerative Cultures - Wahl, Daniel Christian (Triarchy Press Ltd, 2016)
This is a 'Whole Earth Catalog' for the 21st century: an impressive and wide-ranging analysis of what's wrong with our societies, organizations, ideologies, worldviews and cultures - and how to put them right. The book covers the finance system, agriculture, design, ecology, economy, sustainability, organizations and society at large. In this remarkable book, Daniel Wahl explores ways in which we can reframe and understand the crises that we currently face, and he explores how we can live our way into the future. Moving from patterns of thinking and believing to our practice of education, design and community living, he systematically shows how we can stop chasing the mirage of certainty and control in a complex and unpredictable world. The book asks how can we collaborate in the creation of diverse regenerative cultures adapted to the unique biocultural conditions of place? How can we create conditions conducive to life? *** "This book is a valuable contribution to the important discussion of the worldview and value system we need to redesign our businesses, economies, and technologies - in fact, our entire culture - so as to make them regenerative rather than destructive." --Fritjof Capra, author of The Web of Life, co-author of The Systems View of Life: A Unifying Vision *** "This is an excellent addition to the literature on ecological design and it will certainly form a keystone in the foundations of the new MA in Ecological Design Thinking at Schumacher College, Devon. It not only contains a wealth of ideas on what Dr Wahl has termed 'Designing Regenerative Cultures' but what is probably more important, it provides some stimulating new ways of looking at persistent problems in our contemporary culture and hence opens up new ways of thinking and acting in the future." -- Seaton Baxter OBE, Prof. in Ecological Design Thinking, Schumacher College, UK [Subject: Systems Thinking, Education, Social Anthropology, Environmentalism, Ecology, Regenerative Culture, Sociology]

Connecting the Dots: Systems Practice & Political Economy Analysis - Walker, Tjip; Jacobstein, David (Local Systems Community, 2017)
This slide deck, from a presentation to the Local Systems Community by Tjip Walker and David Jacobstein, shows various ways in which assessing the political economy of a context and understanding that context through the lens of systems thinking can reinforce each other. Effective systems practice should be grounded in the incentives and power dynamics of a particular local system; thinking and working politically requires understanding the systems dynamics of an issue or sector.

Using what we know: How to ensure tech projects meet the brief - Walker, Tom (Making All Voices Count, 2017)
Making tech effective - building on what we already know

Bridging & Bonding: Improving Links between Transparency & Accountability Actors - Wanjiku Kelbert, Alexandra (2014)

Understanding ‘the users’ in Technology for Transparency and Accountability Initiatives - Wanjiku Kelbert, Alexandra; McGee, Rosemary; Carlitz, Ruth (2013)

Monitoring Humanitarian Innovation - Warner, Alexandra; Obrecht, Alice (HIF-ALNAP working paper, 2017)

VANUATU GOVERNANCE FOR GROWTH PROGRAM – REVIEW - Warner, Robert; Gouy, Jonathan; Samson, Anthony (2017)

From principle to practice: Implementing the Principles for Digital Development - Waugaman, Adele (2016)
The Principles for Digital Development (download PDF here) find their roots in the efforts of individuals, development organizations, and donors alike who have called for a more concerted effort by donors and implementing partners to institutionalize lessons learned in the use of information and communication technologies (ICTs) in development projects.
Keywords: IMPORTANT

Policy-driven monitoring and evaluation: Does it support adaptive management of socio-ecological systems? - Waylen, Kerry A.; Blackstock, Kirsty L.; van Hulst, Freddy J.; Damian, Carmen; Horváth, Ferenc; Johnson, Richard K.; Kanka, Robert; Külvik, Mart; Macleod, Christopher J. A.; Meissner, Kristian; Oprina-Pavelescu, Mihaela M.; Pino, Joan; et al. (Science of The Total Environment, 2019)
Inadequate Monitoring and Evaluation (M&E) is often thought to hinder adaptive management of socio-ecological systems. A key influence on environmental management practices are environmental policies: however, their consequences for M&E practices have not been well-examined. We examine three policy areas - the Water Framework Directive, the Natura 2000 Directives, and the Agri-Environment Schemes of the Common Agricultural Policy - whose statutory requirements influence how the environment is managed and monitored across Europe. We use a comparative approach to examine what is monitored, how monitoring is carried out, and how results are used to update management, based on publicly available documentation across nine regional and national cases. The requirements and guidelines of these policies have provided significant impetus for monitoring: however, we find this policy-driven M&E usually does not match the ideals of what is needed to inform adaptive management. There is a tendency to focus on understanding state and trends rather than tracking the effect of interventions; a focus on specific biotic and abiotic indicators at the expense of understanding system functions and processes, especially social components; and limited attention to how context affects systems, though this is sometimes considered via secondary data. The resulting data are sometimes publicly-accessible, but it is rarely clear if and how these influence decisions at any level, whether this be in the original policy itself or at the level of measures such as site management plans. Adjustments to policy-driven M&E could better enable learning for adaptive management, by reconsidering what supports a balanced understanding of socio-ecological systems and decision-making. Useful strategies include making more use of secondary data, and more transparency in data-sharing and decision-making. Several countries and policy areas already offer useful examples. Such changes are essential given the influence of policy, and the urgency of enabling adaptive management to safeguard socio-ecological systems.
Keywords: Adaptive Management; Environmental governance; Monitoring and Evaluation; Policy making; Socio-ecological systems; Sustainability

The Global Wildlife Program - Knowledge Platform - 2016-2018 - WB (The World Bank, 2018)

Principles for Monitoring, Evaluation, and Adaptive Management of Environmental Water Regimes - Webb, J. Angus; Watts, Robyn J.; Allan, Catherine; Warner, Andrew T. (Water for the Environment, 2017)
Environmental water is often a contentious investment in the environment that must be delivered under uncertainty regarding the ecological and social benefits they deliver. Adaptive management can be used to facilitate decision making under uncertainty, and use new knowledge and understanding to improve management decisions and outcomes over time. However, there is a perception that adaptive management has failed to deliver improvements in decision making and learning. Monitoring and evaluation are an essential feature of adaptive management. However, past monitoring for river protection and restoration has too often been of insufficient quality to facilitate adaptive learning. Moreover, environmental water represents a class of protection and restoration that is inherently difficult to monitor, and some of the learnings are not evident in part because fragmented assessment, documentation, and reporting of adaptive management can obscure successes. We outline a set of general principles for improving monitoring, evaluation, and adaptive management of environmental water regimes, and provide several examples from Australia and North America. Successful adaptive management depends upon the formation and maintenance of strong partnerships and an appreciation of the importance of individuals in teams. Through such partnerships, it is possible to coordinate monitoring programs over large scales, create programs of requisite simplicity, and use innovative approaches to evaluation. Finally, we note that although adaptive management has occurred in the past, too often it has been poorly documented and reported. The inclusion of reflectors in monitoring and evaluation teams will better capture the lessons learned by individual programs, improving adaptive management into the future.
Keywords: Environmental water management; Knowledge exchange; Legitimacy; implementation challenge

Timely evaluation in international development - Webster, Jayne; Exley, Josephine; Copestake, James; Davies, Rick; Hargreaves, James (Journal of Development Effectiveness, 2018)
Impact and process evaluations are increasingly used in international development; however they are generally retrospective in outlook. A more timely approach to evaluation aims to identify necessary, feasible and effective changes during a programme or intervention’s lifetime. This paper aims to identify, categorise, describe and critically appraise methods to support more timely evaluation in international development. Potential methods were identified through scoping seminar, public symposium, targeted review of the literature, and the authors’ own experiences and opinions. Findings from the different data sources were reviewed collectively by the author group and triangulated to develop an analytical framework. We identified four purposes of timely evaluation for international development, and critiqued the use of approaches against four dimensions of timeliness and flexibility. Whilst we found significant interest in more timely approaches to evaluation in international development, there was a dearth of published empirical evidence upon which to base strong recommendations. There is significant potential for timely evaluation to improve international development outcomes. New approaches to mixing and adapting existing methods, together with new technologies offer increased potential. Research is needed to provide an empirical evidence base upon which to further develop the application, across sectors and contexts, of timely evaluation in international development.
Keywords: Adaptive learning; Outcome evaluation; Programme improvement; impact evaluation

Testing the Waters: A Qualitative Comparative Analysis of the Factors Affecting Success in Rendering Water Services Sustainable Based on ICT Reporting - Welle, Katharina; Williams, Jennifer; Pearce, Joseph; Befani, Barbara (MAVC, 2015)
This research conducted by WaterAid, Itad and IRC aims to understand the factors that facilitate and inhibit the success of ICT-based reporting to improve rural water supply sustainability.

Realist Impact Evaluation: An introduction - Westhorp, Gill (Methods Lab, 2014)
• Realist evaluation is a member of a family of theory-based evaluation approaches which begin by clarifying the ‘programme theory’: the mechanisms that are likely to operate, the contexts in which they might operate and the outcomes that will be observed if they operate as expected. • Realist approaches assume that nothing works everywhere for everyone: context makes a big difference to programme outcomes. A realist evaluation asks not ‘what works?’ but ‘how or why does this work, for whom, in what circumstances?’ • Realist impact evaluation is most appropriate for evaluating new initiatives or programmes that seem to work but where ‘how and for whom’ is not yet understood; programmes that have previously demonstrated mixed patterns of outcomes; and those that will be scaled up, to understand how to adapt the intervention to new contexts.

Governance and Service Delivery: Practical Applications of Social Accountability Across Sectors - Wetterberg, Anna; Brinkerhoff, Derick W.; Hertz, Jana C. (RTI Press, 2016)
The six case studies in Governance and Service Delivery: Practical Applications of Social Accountability Across Sectors illustrate the multiple ways citizen participation in accountability – called social accountability – can lead to positive effects on governance, citizen empowerment, and service delivery. Drawing on their extensive experience implementing international donor-funded programs and projects, the authors examine six recent RTI International projects in Africa and Asia. The analysis focuses on both intended and actual effects, and it unpacks the influence of context on implementation and outcomes achieved, as well as on prospects for sustainability. Donors, academics, policy makers, practitioners and others interested in sustainable development and governance will find this systematic review invaluable.

The Beginner’s Guide to Political Economy Analysis (PEA) - Whaites, Alan (National School of Government International, 2017)
Over the last two decades aid agencies and academics have been on a journey of lesson learning and adaptation in relation to `politics.’ This journey has been driven by a determination to improve impact in all areas of development, but for some time it was particularly associated with work on public sector reform. Now, however, there is an increasing expectation that Political Economy Analysis (PEA) should be part and parcel of designing and implementing any programme or activity (and a brief history of the meandering journey of development actors on PEA can be found in The Policy Practice’s Briefing Paper 11 – see below). DFID in the UK is fairly typical among large development organisations in running an excellent course on political economy analysis, complete with 200 pages of resources and various online videos and case studies (and this type of course is recommended for those who want to take their exploration of PEA further). Even so, PEA is not just for those who have `done the course and bought the T-shirt,’ it is something that can be absorbed and implemented quickly by everybody. Indeed, the growth of interest in PEA is a reminder that this can look like a complex and daunting field and so this guide aims to offer an entry-point for all those who want to use PEA in their own work. In doing so, this guide borrows from the best materials that are available while also adapting some approaches by incorporating wider ideas on politics and institutions. This guide affirms that there should never be an official `orthodoxy’ for PEA and so the emphasis here is on questions, prompts and ideas to help thinking and practice. There is also an attempt to clarify jargon wherever needed, while recognising that The Policy Practice (TPP) and the Overseas Development Institute (ODI) have produced a more complete glossary of PEA terminology. The note will instead focus on `the essentials’ of PEA as they relate to the following questions:  Why do we do political economy analysis, and what is it?  What kinds of issues and ingredients are often included in a PEA?  How do we make sense of the different varieties of PEA?  What tools are out there to help us conduct a PEA?  What is thinking and working politically?

A Governance Practitioner’s Notebook: Alternative Ideas and Approaches - Whaites, Alan; Gonzalez, Eduardo; Fyson, Sara; Teskey, Graham (OECD, 2015)
The Governance Practitioner’s Notebook takes an unusual approach for the OECD-DAC Network on Governance (GovNet). It brings together a collection of specially written notes aimed at those who work as governance practitioners within development agencies. It does so, however, without attempting to offer definitive guidance – instead aiming to stimulate thinking and debate. To aid this process the book is centred on a fictional Governance Adviser. The Notebook’s format provides space for experts to speak on today’s governance issues: politics, public sector reform and stakeholder engagement. It encourages debate, charts the evolution of donor thinking, and highlights future challenges in the age of the Sustainable Development Goals. Each section introduces both technical issues and major areas of debate, providing ideas for future development support to institutional reform.
Keywords: IMPORTANT

Impact Evaluation of Development Interventions: A Practical Guide - White, Howard; Raitzer, David (Asian Development Bank, 2017)
This book offers guidance on the principles, methods, and practice of impact evaluation. It contains material for a range of audiences, from those who may use or manage impact evaluations to applied researchers.

A Guide to Digital Feedback Loops. An approach to strengthening program outcomes through data for decision making - Whittle, Dennis; Campbell, Megan (USAID, 2019)
Feedback is information about what happens as a result of what you do. Using that information to adapt what you do or how you do it creates what is called a feedback loop. A digital feedback loop uses digital technology at some stage of the feedback loop. Digital feedback loops help USAID missions improve the effectiveness and efficiency of their activities and can support partner countries on their journey to self-reliance through increased information sharing and improved government and civil society capacity. USAID missions and their partners have used digital feedback loops to improve HIV treatment targeting in Zimbabwe, engage three million young people in Nigeria in policy, and reduce field reporting times from one month to one day. Digital feedback loops provide access to information faster and more cheaply than ever before. As part of an adaptive management approach, digital feedback loops increase our ability to act on opportunities and respond to challenges. That in turn can improve outcomes and reduce the risk of waste and failure. This guide outlines the case for integrating digital feedback loops into your work, and provides tools, resources and guiding questions to support you as you get started. The guide includes examples of how USAID missions are using digital feedback loops to improve their programs in various sectors and provides worksheets to help you apply digital feedback loops to your own context.

How We Model Matters: A Manifesto for the Next Generation of Program Theorizing - Whynot, Jane; Lemire, Sebastian; Montague, Steve (Canadian Journal of Program Evaluation, 2019)
In this concluding article, grounded on the exemplary contributions contained in the preceding pages, the guest editors scale the proverbial soapbox and present a manifesto to guide the pursuit and advancement of the next generation of program theorizing. Formulating ten declarations for program theory development and examination, the modest hope of the authors is to motivate and inspire reflective evaluation practitioners to broaden their views, approaches, and techniques for future program theorizing.

Wildlife laws monitoring as an adaptive management tool in protected area management in Ghana: a case of Kakum Conservation Area - Wiafe, Edward Debrah (SpringerPlus, 2016)
INTRODUCTION: The wildlife laws of Ghana alienated the rural communities from forests and material well-being depended upon for their livelihood and this manifests itself in the progressive conflict between the park patrol staff and poachers from the fringes of the protected areas. CASE DESCRIPTION: The main aim of this study was to determine the impact of quantification of patrol efforts on indicators of illegal hunting activities that occur in rainforest protected areas, as a result of monitoring patrol operations and modifying the original plan. The specific objectives were to determine the optimal patrol efforts necessary to reduce illegal wildlife use to minimal; and the influence of the rainfall and seasonal activities on illegal wildlife use. DISCUSSION AND EVALUATION: The results indicated that as the patrol efforts increased the encounter with illegal wildlife use also increased until a certain point that the encounter rates started decreasing. Neither rainfall nor seasonal activities influenced the illegal activities and the patrol efforts. The protection staff of rainforest protected areas would work effectively to bring down illegal wildlife off-take to the barest minimum if monitored, quantified and provide feed-back. CONCLUSIONS: Illegal wildlife off-take can also be reduced by the protection staff if the original plans are made flexible to be adjusted. Recommendations for further studies have been made.

Uncertainty, Precaution, and Adaptive Management in Wildlife Trade - Wiersema, Annecoos (Michigan Journal of International Law, 2015)

Adapting development: improving services to the poor - Wild, Leni; Booth, David; Cummings, Clare; Foresti, Marta; Wales, Joseph (ODI, 2015)
On current trends, it will take decades or longer to bring basic services to the world’s most disadvantaged people. Meeting this challenge means recognising the political conditions that enable or obstruct development progress - a radical departure from the approach of the Millennium Development Goals.
Keywords: Practice

Putting theory into practice: how DFID is doing development differently - Wild, Leni; Booth, David; Valters, Craig (ODI, 2017)
Keywords: IMPORTANT

Building a global learning alliance on adaptive management - Wild, Leni; Ramalingam, Ben (ODI, 2018)

Rewards and Risks Associated with Community Engagement in Anti-Poaching and Anti-Trafficking - Wilkie, David; Painter, Michael; Jacob, Anila (Measuring Impact, 2016)
This Biodiversity Technical Brief summarizes research on the roles communities do and should play in countering wildlife crime, motivations, and benefits for individuals and communities to engage in anti-poaching and anti-trafficking efforts, and risks and mitigation of risks associated with involvement. Peer-reviewed and grey literature, structured interviews, and case studies informed the research, with highlights from six case studies in Peru, Madagascar, Namibia, Philippines, Kenya, and Indonesia.

Passive and active adaptive management: Approaches and an example - Williams, Byron (Journal of Environmental Management, 2010)
Adaptive management is a framework for resource conservation that promotes iterative learning-based decision making. Yet there remains considerable confusion about what adaptive management entails, and how to actually make resource decisions adaptively. A key but somewhat ambiguous distinction in adaptive management is between active and passive forms of adaptive decision making. The objective of this paper is to illustrate some approaches to active and passive adaptive management with a simple example involving the drawdown of water impoundments on a wildlife refuge. The approaches are illustrated for the drawdown example, and contrasted in terms of objectives, costs, and potential learning rates. Some key challenges to the actual practice of AM are discussed, and tradeoffs between implementation costs and long-term benefits are highlighted.

Adaptive management of natural resources—framework and issues - Williams, Byron K. (Journal of Environmental Management, 2011)
Adaptive management, an approach for simultaneously managing and learning about natural resources, has been around for several decades. Interest in adaptive decision making has grown steadily over that time, and by now many in natural resources conservation claim that adaptive management is the approach they use in meeting their resource management responsibilities. Yet there remains considerable ambiguity about what adaptive management actually is, and how it is to be implemented by practitioners. The objective of this paper is to present a framework and conditions for adaptive decision making, and discuss some important challenges in its application. Adaptive management is described as a two-phase process of deliberative and iterative phases, which are implemented sequentially over the timeframe of an application. Key elements, processes, and issues in adaptive decision making are highlighted in terms of this framework. Special emphasis is given to the question of geographic scale, the difﬁculties presented by non-stationarity, and organizational challenges in implementing adaptive management.

Adaptive Management: From More Talk to Real Action - Williams, Byron K.; Brown, Eleanor D. (Environmental Management, 2014)
The challenges currently facing resource managers are large-scale and complex, and demand new approaches to balance development and conservation goals. One approach that shows considerable promise for addressing these challenges is adaptive management, which by now is broadly seen as a natural, intuitive, and potentially effective way to address decision-making in the face of uncertainties. Yet the concept of adaptive management continues to evolve, and its record of success remains limited. In this article, we present an operational framework for adaptive decision-making, and describe the challenges and opportunities in applying it to real-world problems. We discuss the key elements required for adaptive decision-making, and their integration into an iterative process that highlights and distinguishes technical and social learning. We illustrate the elements and processes of the framework with some successful on-the-ground examples of natural resource management. Finally, we address some of the difficulties in applying learning-based management, and finish with a discussion of future directions and strategic challenges.
Keywords: IMPORTANT

Technical challenges in the application of adaptive management - Williams, Byron K.; Brown, Eleanor D. (Biological Conservation, 2016)
Adaptive management is an approach for simultaneously managing and learning about natural resources, by acknowledging uncertainty and seeking to reduce it through the process of management itself. Adaptive decision making can be applied to pressing issues in conservation biology such as species reintroduction, disease and invasive species control, and habitat restoration, as well as to management of natural resources in general. After briefly outlining a framework and process for adaptive management, we focus on an overview of the key technical issues related to problem framing and the ability of resource managers to learn from their experience. These technical issues include the treatment of uncertainty and its propagation over time; nonstationarity in long-term environmental trends; the applicability of adaptive management across scales; requirements for models and management alternatives that promote learning; the value of the information produced with adaptive management; the challenge to management of uncertainty and surprise; and institutional (social) learning. To accommodate these and other challenges that are now coming into focus, the learning-based approach of adaptive management will need to be adjusted and expanded in the future.
Keywords: Adaptive Management; Learning; Nonstationarity; Resilience; Uncertainty; Value of information

External validity and policy adaptation. From impact evaluation to policy design - Williams, Martin J. (BSG Working Paper Series, 2017)
With the growing number of rigorous impact evaluations worldwide, the question of how best to apply this evidence to policymaking processes has arguably become the main challenge for evidence-based policymaking. How can policymakers predict whether a policy will have the same impact in their context as it did elsewhere, and how should this influence the design and implementation of policy? This paper introduces a simple and flexible framework to address these questions of external validity and policy adaptation. I show that failures of external validity arise from an interaction between a policy’s theory of change and a dimension of the context in which it is being implemented, and develop a method of “mechanism mapping” that maps a policy’s theory of change against salient contextual assumptions to identify external validity problems and suggest appropriate policy adaptations. In deciding whether and how to adapt a policy in a new context, I show there is a fundamental informational trade-o↵ between the strength and relevance of evidence on the policy from other contexts and the policymaker’s knowledge of the local context. This trade-o↵ can guide policymakers’ judgments about whether policies should be copied exactly from elsewhere, adapted, or invented anew.

Change in challenging contexts - Williamson, Tim (ODI, 2015)
This report explores how genuine institutional change takes place in fragile and conflict-affected states reforms can be supported.

Guidelines and good practices for evidence-informed policy-making in a government department - Wills, Alf; Tshangela, Mapula; Shaxson, Louise; Datta, Ajoy; Matomela, Bongani (2016)

Outcome Harvesting - Wilson-Grau, R. (Better Evaluation, 2015)
Outcome Harvesting collects (“harvests”) evidence of what has changed (“outcomes”) and, then, working backwards, determines whether and how an intervention has contributed to these changes. Outcome Harvesting has proven to be especially useful in complex situations when it is not possible to define concretely most of what an intervention aims to achieve, or even, what specific actions will be taken over a multi-year period.

What is Outcome Harvesting? - Wilson-Grau, Ricardo (2014)
Ricardo Wilson-Grau, former Chair of the Board of Stewards of the Outcome Mapping Learning Community, introduces Outcome Harvesting, an approach for retrospective identification of outcomes based on the principles of Outcome Mapping. More details here: http://www.outcomemapping.ca/nuggets/outcome-harvesting

Outcome Harvesting - Wilson-Grau, Ricardo; Britt, Heather (Ford Foundation, 2012)
Outcome Harvesting was developed by Ricardo Wilson-Grau with colleagues Barbara Klugman, Claudia Fontes, David Wilson-Sánchez, Fe Briones Garcia, Gabriela Sánchez, Goele Scheers, Heather Britt, Jennifer Vincent, Julie Lafreniere, Juliette Majot, Marcie Mersky, Martha Nuñez, Mary Jane Real, Natalia Ortiz, and Wolfgang Richert. Over the past 8 years, Outcome Harvesting and has been used to monitor and evaluate the achievements of hundreds of networks, non-governmental organizations, research centers, think tanks, and communitybased organizations around the world. This brief is intended to introduce the concepts and approach used in Outcome Harvesting to grant makers, managers, and evaluators, with the hope that it may inspire them to learn more about the method and apply it to appropriate contexts. Thus, it is not a comprehensive guide to or explanation of the method, but an introduction to allow evaluators and decision makers to determine if the method is appropriate for their evaluation needs. Where possible, we have included examples to illustrate how Outcome Harvesting is applied to real situations. For each case story, organizations were asked to provide a description of the outcome and a summary of the role played by the organization. Sometimes they added other information such as the outcome’s significance. Some details and identifiers were redacted for confidentiality purposes. A draft of this brief was graciously commented on by Bob Williams, Fred Carden, Sarah Earl, Richard Hummelbrunner and Terry Smutylo. The final text is, of course, the sole responsibility of the authors and editor.

Test It and They Might Come: Improving the Uptake of Digital Tools in Transparency and Accountability Initiatives - Wilson, Christopher; de Lanerolle, Indra (IDS Bulletin, 2016)
Keywords: IMPORTANT

What is adaptive management? - Wilson, Gregory (ΔNTYLLES, 2016)
Recently there has been growing recognition that most development challenges are in actual fact ‘wicked’ problem that requires development actors to recognize that the optimal management approaches…

Agile Metrics: The Good, the Bad, and the Ugly - Wolpers, Stefan (dzone.com, 2017)
Suitable agile metrics reflect either a team’s progress in becoming agile or your organization’s progress in becoming a learning organization.

Scrambling after Moving Targets: Monitoring & Evaluation Applied to Adaptive Management Approaches in Peacebuilding - Woodrow, Peter; Jean, Isabella (New Directions in Peacebuilding Evaluation, 2019)
In this landmark collection, the voices of pathMakers and innovators in peacebuilding evaluation are assembled to provide new direction for the field.
Keywords: IMPORTANT

A Practical Guide to Distributed Scrum - Woodward, Elizabeth; Surdek, Steffan; Ganis, Matthew (IBM Press, 2010)
Succeed with Scrum in Even the Largest, Most Complex Distributed Development Projects Forewords by Ken Schwaber, Scott Ambler, Roman Pichler, and Matthew Wang This is the first comprehensive, practical guide for Scrum practitioners working in large-scale distributed environments. Written by three of IBM’s leading Scrum practitioners--in close collaboration with the IBM QSE Scrum Community of more than 1000 members worldwide--this book offers specific, actionable guidance for everyone who wants to succeed with Scrum in the enterprise. Readers will follow a journey through the lifecycle of a distributed Scrum project, from envisioning products and setting up teams to preparing for Sprint planning and running retrospectives. Each chapter presents a baseline drawn from “conventional” Scrum, then discusses additional issues faced by distributed teams, and presents specific best-practice solutions, alternatives, and tips the authors have identified through hard, empirical experience. Using real-world examples, the book demonstrates how to apply key Scrum practices, such as look-ahead planning in geographically distributed environments. Readers will also gain valuable new insights into the agile management of complex problem and technical domains. Coverage includes•  Developing user stories and working with Product Owners as a distributed team•  Recognizing and fixing the flaws Scrum may reveal in existing processes•  Engaging in more efficient Release and Sprint planning•  Conducting intense, brief daily Scrum meetings in distributed environments•  Managing cultural and language differences•  Resolving dependencies, performing frequent integration, and maintaining transparency in geographically distributed environments•  Successfully running remote software reviews and demos•  Brainstorming what worked and what didn’t, to improve future Sprints This book will be an indispensable resource for every team leader, member, product owner, or manager working with Scrum or other agile methods in any distributed software development organization.

Forward Look - A vision for the World Bank Group in 2030 - World Bank (World Bank, 2016)

Learning and Results in World Bank Operations: Toward a New Learning Strategy - World Bank (IEG , The World Bank, 2015)
This report is the second in a program of evaluations that the Independent Evaluation Group (IEG) is conducting on the learning that takes place through World Bank projects. Learning and knowledge are treated as parts of a whole and are presumed to be mutually reinforcing.
Keywords: IMPORTANT

Strategic Framework for mainstreaming citizen engagemente in World Bank Group operations - World Bank (The World Bank, 2014)

World Development Report 2015: Mind, Society, and Behavior - World Bank (The World Bank, 2015)
Development economics and policy are due for a redesign. In the past few decades, research from across the natural and social sciences has provided stunning insight into the way people think and make decisions. Whereas the first generation of development policy was based on the assumption that humans make decisions deliberatively and independently, and on the basis of consistent and self-interested preferences, recent research shows that decision making rarely proceeds this way. People think automatically: when deciding, they usually draw on what comes to mind effortlessly. People also think socially: social norms guide much of behavior, and many people prefer to cooperate as long as others are doing their share. And people think with mental models: what they perceive and how they interpret it depend on concepts and worldviews drawn from their societies and from shared histories.The World Development Report 2015 offers a concrete look at how these insights apply to development policy. It shows how a richer view of human behavior can help achieve development goals in many areas, including early childhood development, household finance, productivity, health, and climate change. It also shows how a more subtle view of human behavior provides new tools for interventions. Making even minor adjustments to a decision-making context, designing interventions based on an understanding of social preferences, and exposing individuals to new experiences and ways of thinking may enable people to improve their lives.The Report opens exciting new avenues for development work. It shows that poverty is not simply a state of material deprivation, but also a “tax” on cognitive resources that affects the quality of decision making. It emphasizes that all humans, including experts and policy makers, are subject to psychological and social influences on thinking, and that development organizations could benefit from procedures to improve their own deliberations and decision making. It demonstrates the need for more discovery, learning, and adaptation in policy design and implementation. The new approach to development economics has immense promise. Its scope of application is vast. This Report introduces an important new agenda for the development community.

World Development Report 2017: Governance and the Law - World Bank (The World Bank, 2017)

Using beneficiary feedback to improve development programmes: findings from a multi-country pilot - World Vision (World Vision, 2016)
This briefing summarises the findings from Beneficiary Feedback Mechanisms pilots and is intended to inform organisations and their funders about the development and implementation of feedback mechanisms.

The five trademarks of agile organizations - Wouter Aghina; Karin Ahlbäck; Aaron De Smet; Clemens Fahrbach; Christopher Handscomb; Gerald Lackey; Michael Lurie; Monica Murarka; Olli Salo; Elizabeth Seem; Jannik Woxholth (McKinsey anc Company, 2017)
Our experience and research demonstrate that successful agile organizations consistently exhibit the five trademarks described in this article. The trademarks include a network of teams within a people-centered culture that operates in rapid learning and fast decision cycles which are enabled by technology, and a common purpose that co-creates value for all stakeholders. These trademarks complement the findings from The McKinsey Global Survey Results: How to create an agile organization.

Future oriented conservation: knowledge governance, uncertainty and learning - Wyborn, Carina; van Kerkhoff, Lorrae; Dunlop, Michael; Dudley, Nigel; Guevara, Oscar (Biodiversity and Conservation, 2016)
Despite signiﬁcant progress in understanding climate risks, adaptation efforts in biodiversity conservation remain limited. Adaptation requires addressing immediate conservation threats while also attending to long term, highly uncertain and potentially transformative future changes. To date, conservation research has focused more on projecting climate impacts and identifying possible strategies, rather than understanding how governance enables or constrains adaptation actions. We outline an approach to futureoriented conservation that combines the capacities to anticipate future ecological change; to understand the implications of that change for social, political and ecological values; and the ability to engage with the governance (and politics) of adaptation. Our approach builds on the adaptive management and governance literature, however we explicitly address the (often contested) rules, knowledge and values that enable or constrain adaptation. We call for a broader focus that extends beyond technical approaches to acknowledge the sociopolitical challenges inherent to adaptation. More importantly, we suggest that conservation policy makers and practitioners can use this approach to facilitate learning and adaptation in the context of complexity, transformational change and uncertainty.

Evaluation and learning in complex, rapidly changing health systems: China’s management of health sector reform - Xiao, Yue; Husain, Lewis; Bloom, Gerald (Globalization and Health, 2018)
Healthcare systems are increasingly recognised as complex, in which a range of non-linear and emergent behaviours occur. China’s healthcare system is no exception. The hugeness of China, and the variation in conditions in different jurisdictions present very substantial challenges to reformers, and militate against adopting one-size-fits-all policy solutions. As a consequence, approaches to change management in China have frequently emphasised the importance of sub-national experimentation, innovation, and learning. Multiple mechanisms exist within the government structure to allow and encourage flexible implementation of policies, and tailoring of reforms to context. These limit the risk of large-scale policy failures and play a role in exploring new reform directions and potentially systemically-useful practices. They have helped in managing the huge transition that China has undergone from the 1970s onwards. China has historically made use of a number of mechanisms to encourage learning from innovative and emergent policy practices. Policy evaluation is increasingly becoming a tool used to probe emergent practices and inform iterative policy making/refining. This paper examines the case of a central policy research institute whose mandate includes evaluating reforms and providing feedback to the health ministry. Evaluation approaches being used are evolving as Chinese research agencies become increasingly professionalised, and in response to the increasing complexity of reforms. The paper argues that learning from widespread innovation and experimentation is challenging, but necessary for stewardship of large, and rapidly-changing systems.

Future Democracies - Laboratory of Collective Intelligence for Participatory Democracy - Yago Bermejo (MediaLab Prado, 2019)
The Laboratory of Collective Intelligence for Participatory Democracy (2016-2019) is a project that arose out of Medialab Prado in coordination with the Government Area of Citizen Participation, Transparency and Open Government of the city of Madrid. Its work has been very connected with the analysis, reflection and innovation found on the digital participation platform Decide Madrid. The project has also organised many workshops and conferences that have brought together hundreds of people from the world of participatory democracy. This publication summarises the project’s core working principles as well as the open activities it has hosted over the course of these three years. These pilot experiences offer a possible vision of the future of democratic governance.
Keywords: Democracy

Evaluating development projects: exploring a synthesis model of the logical framework approach and outcome mapping - Yang, Ting (2018)
Under the current results-driven development agenda, sound evaluation, and a corresponding evaluation toolkit, need to be in place to examine whether and to what extent development interventions have achieved their targeted objectives and results, and to generate lessons for further development learning and improvement. My review of the literature shows that innovative and appropriate evaluation approaches are needed to address key challenges in evaluation such as the tension between learning and accountability objectives, the need to unpack the mechanisms linking outputs and outcomes or goal, and to add an actor perspective. Irrespective of project type, the Logical Framework Approach (LFA) is often a standard requirement of major official donor agencies on projects they fund, so as to fulfil bureaucratic imperatives. However, it is often considered inadequate in addressing key challenges in development evaluation. Given the dominant status of the LFA with such strong support from donors, it is helpful to seek a ‘middle way’: a combination of the LFA with other approaches in order to address some of its inadequacies, while satisfying donor agencies’ requirements. A synthesis of the LFA and Outcome Mapping (OM) is one such option. This thesis explores the practical value and usefulness of a synthesis model empirically. Applying the model in two case study aid projects, I found that it serves well as a theory-based evaluation tool with a double-stranded (actor strand and results chain) theory of change. The model helps reconcile learning and accountability and add explanatory power and an explicit actor perspective. It also helps establish causation and enable attribution claims at various results levels with its different elements. The model has some limitations but my results suggest it can be usefully adopted. The choice of its application depends on project evaluation context and purpose in specific cases.

Why We Lie About Aid: Development and the Messy Politics of Change - Yanguas, Pablo (Zed Books, 2018)
Foreign aid is about charity. International development is about technical fixes. At least that is what we, as donor publics, are constantly told. The result is a highly dysfunctional aid system which mistakes short-term results for long-term transformation and gets attacked across the political spectrum, with the right claiming we spend too much, and the left that we don't spend enough. The reality, as Yanguas argues in this highly provocative book, is that aid isn't – or at least shouldn't be – about levels of spending, nor interventions shackled to vague notions of ‘accountability’ and ‘ownership’. Instead, a different approach is possible, one that acknowledges aid as being about struggle, about taking sides, about politics. It is an approach that has been quietly applied by innovative development practitioners around the world, providing political coverage for local reformers to open up spaces for change. Drawing on a variety of convention-defying stories from a variety of countries – from Britain to the US, Sierra Leone to Honduras – Yanguas provides an eye-opening account of what we really mean when we talk about aid.

Barriers to Political Analysis in Aid Bureaucracies: From Principle to Practice in DFID and the World Bank - Yanguas, Pablo; Hulme, David (World Development, 2015)
Politics has become a central concern in development discourse, and yet the use of political analysis as a means for greater aid effectiveness remains limited and contested within development agencies. This article uses qualitative data from two governance “leaders” – the United Kingdom Department for International Development and the World Bank – to analyze the administrative hurdles facing the institutionalization of political analysis in aid bureaucracies. We find that programing, management, and training practices across headquarters and country offices remain largely untouched by a political analysis agenda which suffers from its identification with a small cross-national network of governance professionals.
Keywords: DFID; United Kingdom; World Bank; aid effectiveness; foreign aid; political economy analysis

Case Study Research and Applications: Design and Methods - Yin, Dr Robert K. (SAGE Publications, Inc, 2018)
Winner of the 2019 McGuffey Longevity Award from the Textbook & Academic Authors Association (TAA) Recognized as one of the most cited methodology books in the social sciences, the Sixth Edition of Robert K. Yin′s bestselling text provides a complete portal to the world of case study research. With the integration of 11 applications in this edition, the book gives readers access to exemplary case studies drawn from a wide variety of academic and applied fields. Ultimately, Case Study Research and Applications will guide students in the successful use and application ofthe case study research method.

Rapid outcome mapping approach: a guide to policy engagement and influence - Young, John; Shaxson, Louise; Jones, harry; Hearn, Simon; Datta, Ajoy; Cassidy, Caroline (ODI, 2014)

Engaging Stakeholders in Planning for Sea Level Rise and Resilience - Yusuf, Juita-Elena (Wie); John, Burton St; Covi, Michelle; Nicula, J. Gail (Journal of Contemporary Water Research & Education, 2018)
This case study describes a region-wide, multi-sectoral, and whole-of-community stakeholder engagement approach for addressing sea level rise (SLR) and flooding. This approach was implemented through a university-led community engagement event, the Hampton Roads Resilient Region Reality Check (H4RC), which allowed an examination of its effectiveness as a mechanism for capturing community-wide perceptions regarding SLR, flooding, and associated risks; engaging stakeholders in discussion within and across different groups; and assessing community willingness to address flooding and SLR. The results show that the event helped participants broaden their perspectives and understanding of flooding and SLR. In an approach that called for participants to engage in social learning across social networks, the event had some effect on individual efficacy. However, there was little impact on participants' already-established perception that the region does not possess significant willingness to take action.
Keywords: Social learning; flooding; resilience; social capital; stakeholder engagement

Data and monitoring needs for a more ecological agriculture - Zaks, David P. M.; Kucharik, Christopher J. (Environmental Research Letters, 2011)
Information on the life-cycle environmental impacts of agricultural production is often limited. As demands grow for increasing agricultural output while reducing its negative environmental impacts, both existing and novel data sources can be leveraged to provide more information to producers, consumers, scientists and policy makers. We review the components and organization of an agroecological sensor web that integrates remote sensing technologies and in situ sensors with models in order to provide decision makers with effective management options at useful spatial and temporal scales for making more informed decisions about agricultural productivity while reducing environmental burdens. Several components of the system are already in place, but by increasing the extent and accessibility of information, decision makers will have the opportunity to enhance food security and environmental quality. Potential roadblocks to implementation include farmer acceptance, data transparency and technology deployment.

Strengthening the results chain: Synthesis of case studies of results-based management by providers - Zwart, Rosie (OECD, 2017)
This paper presents an analysis of evidence from seven case studies of results-based management by development co-operation providers. Analysis of themes from the case studies reveal six interrelated challenges which providers face in their efforts to manage for the results of development co-operation. The six challenges are: linking results to development goals, ensuring the purpose of results systems is well-defined, weighing up the benefits of aggregating and attributing results from standard indicators, enabling country ownership, using performance information alongside results information, and building and embedding a results culture. Providers continue to adopt a range of approaches to pursue a focus on results and there are many examples of good practice. The case studies suggest that in a complex development landscape some providers are prioritising the use of aggregated results information for domestic accountability, communication, and performance management over their use for learning and policy direction. In this context, the paper argues that in agency-wide results frameworks development co-operation results are often detached (or de-contextualised) from development results and discusses the implications of this, including the use of standard indicators to measure aggregated outputs. The paper uses case study evidence to discuss and suggest practical ways providers can build and maintain a strong results focus which enables analysis, insights and learning, and has achievement of development outcomes as its objective.