Strengthening the results chain: Synthesis of case studies of results-based management by providers - Zwart, Rosie (OECD, 2017)
This paper presents an analysis of evidence from seven case studies of results-based management by development co-operation providers. Analysis of themes from the case studies reveal six interrelated challenges which providers face in their efforts to manage for the results of development co-operation. The six challenges are: linking results to development goals, ensuring the purpose of results systems is well-defined, weighing up the benefits of aggregating and attributing results from standard indicators, enabling country ownership, using performance information alongside results information, and building and embedding a results culture. Providers continue to adopt a range of approaches to pursue a focus on results and there are many examples of good practice. The case studies suggest that in a complex development landscape some providers are prioritising the use of aggregated results information for domestic accountability, communication, and performance management over their use for learning and policy direction. In this context, the paper argues that in agency-wide results frameworks development co-operation results are often detached (or de-contextualised) from development results and discusses the implications of this, including the use of standard indicators to measure aggregated outputs. The paper uses case study evidence to discuss and suggest practical ways providers can build and maintain a strong results focus which enables analysis, insights and learning, and has achievement of development outcomes as its objective.

Data and monitoring needs for a more ecological agriculture - Zaks, David P. M.; Kucharik, Christopher J. (Environmental Research Letters, 2011)
Information on the life-cycle environmental impacts of agricultural production is often limited. As demands grow for increasing agricultural output while reducing its negative environmental impacts, both existing and novel data sources can be leveraged to provide more information to producers, consumers, scientists and policy makers. We review the components and organization of an agroecological sensor web that integrates remote sensing technologies and in situ sensors with models in order to provide decision makers with effective management options at useful spatial and temporal scales for making more informed decisions about agricultural productivity while reducing environmental burdens. Several components of the system are already in place, but by increasing the extent and accessibility of information, decision makers will have the opportunity to enhance food security and environmental quality. Potential roadblocks to implementation include farmer acceptance, data transparency and technology deployment.

Engaging Stakeholders in Planning for Sea Level Rise and Resilience - Yusuf, Juita-Elena (Wie); John, Burton St; Covi, Michelle; Nicula, J. Gail (Journal of Contemporary Water Research & Education, 2018)
This case study describes a region-wide, multi-sectoral, and whole-of-community stakeholder engagement approach for addressing sea level rise (SLR) and flooding. This approach was implemented through a university-led community engagement event, the Hampton Roads Resilient Region Reality Check (H4RC), which allowed an examination of its effectiveness as a mechanism for capturing community-wide perceptions regarding SLR, flooding, and associated risks; engaging stakeholders in discussion within and across different groups; and assessing community willingness to address flooding and SLR. The results show that the event helped participants broaden their perspectives and understanding of flooding and SLR. In an approach that called for participants to engage in social learning across social networks, the event had some effect on individual efficacy. However, there was little impact on participants' already-established perception that the region does not possess significant willingness to take action.
Keywords: Social learning; flooding; resilience; social capital; stakeholder engagement

Rapid outcome mapping approach: a guide to policy engagement and influence - Young, John; Shaxson, Louise; Jones, harry; Hearn, Simon; Datta, Ajoy; Cassidy, Caroline (ODI, 2014)

Case Study Research and Applications: Design and Methods - Yin, Dr Robert K. (SAGE Publications, Inc, 2018)
Winner of the 2019 McGuffey Longevity Award from the Textbook & Academic Authors Association (TAA) Recognized as one of the most cited methodology books in the social sciences, the Sixth Edition of Robert K. Yin′s bestselling text provides a complete portal to the world of case study research. With the integration of 11 applications in this edition, the book gives readers access to exemplary case studies drawn from a wide variety of academic and applied fields. Ultimately, Case Study Research and Applications will guide students in the successful use and application ofthe case study research method.

Barriers to Political Analysis in Aid Bureaucracies: From Principle to Practice in DFID and the World Bank - Yanguas, Pablo; Hulme, David (World Development, 2015)
Politics has become a central concern in development discourse, and yet the use of political analysis as a means for greater aid effectiveness remains limited and contested within development agencies. This article uses qualitative data from two governance “leaders” – the United Kingdom Department for International Development and the World Bank – to analyze the administrative hurdles facing the institutionalization of political analysis in aid bureaucracies. We find that programing, management, and training practices across headquarters and country offices remain largely untouched by a political analysis agenda which suffers from its identification with a small cross-national network of governance professionals.
Keywords: DFID; United Kingdom; World Bank; aid effectiveness; foreign aid; political economy analysis

Why We Lie About Aid: Development and the Messy Politics of Change - Yanguas, Pablo (Zed Books, 2018)
Foreign aid is about charity. International development is about technical fixes. At least that is what we, as donor publics, are constantly told. The result is a highly dysfunctional aid system which mistakes short-term results for long-term transformation and gets attacked across the political spectrum, with the right claiming we spend too much, and the left that we don't spend enough. The reality, as Yanguas argues in this highly provocative book, is that aid isn't – or at least shouldn't be – about levels of spending, nor interventions shackled to vague notions of ‘accountability’ and ‘ownership’. Instead, a different approach is possible, one that acknowledges aid as being about struggle, about taking sides, about politics. It is an approach that has been quietly applied by innovative development practitioners around the world, providing political coverage for local reformers to open up spaces for change. Drawing on a variety of convention-defying stories from a variety of countries – from Britain to the US, Sierra Leone to Honduras – Yanguas provides an eye-opening account of what we really mean when we talk about aid.

Evaluating development projects: exploring a synthesis model of the logical framework approach and outcome mapping - Yang, Ting (2018)
Under the current results-driven development agenda, sound evaluation, and a corresponding evaluation toolkit, need to be in place to examine whether and to what extent development interventions have achieved their targeted objectives and results, and to generate lessons for further development learning and improvement. My review of the literature shows that innovative and appropriate evaluation approaches are needed to address key challenges in evaluation such as the tension between learning and accountability objectives, the need to unpack the mechanisms linking outputs and outcomes or goal, and to add an actor perspective. Irrespective of project type, the Logical Framework Approach (LFA) is often a standard requirement of major official donor agencies on projects they fund, so as to fulfil bureaucratic imperatives. However, it is often considered inadequate in addressing key challenges in development evaluation. Given the dominant status of the LFA with such strong support from donors, it is helpful to seek a ‘middle way’: a combination of the LFA with other approaches in order to address some of its inadequacies, while satisfying donor agencies’ requirements. A synthesis of the LFA and Outcome Mapping (OM) is one such option. This thesis explores the practical value and usefulness of a synthesis model empirically. Applying the model in two case study aid projects, I found that it serves well as a theory-based evaluation tool with a double-stranded (actor strand and results chain) theory of change. The model helps reconcile learning and accountability and add explanatory power and an explicit actor perspective. It also helps establish causation and enable attribution claims at various results levels with its different elements. The model has some limitations but my results suggest it can be usefully adopted. The choice of its application depends on project evaluation context and purpose in specific cases.

Future Democracies - Laboratory of Collective Intelligence for Participatory Democracy - Yago Bermejo (MediaLab Prado, 2019)
The Laboratory of Collective Intelligence for Participatory Democracy (2016-2019) is a project that arose out of Medialab Prado in coordination with the Government Area of Citizen Participation, Transparency and Open Government of the city of Madrid. Its work has been very connected with the analysis, reflection and innovation found on the digital participation platform Decide Madrid. The project has also organised many workshops and conferences that have brought together hundreds of people from the world of participatory democracy. This publication summarises the project’s core working principles as well as the open activities it has hosted over the course of these three years. These pilot experiences offer a possible vision of the future of democratic governance.
Keywords: Democracy

Evaluation and learning in complex, rapidly changing health systems: China’s management of health sector reform - Xiao, Yue; Husain, Lewis; Bloom, Gerald (Globalization and Health, 2018)
Healthcare systems are increasingly recognised as complex, in which a range of non-linear and emergent behaviours occur. China’s healthcare system is no exception. The hugeness of China, and the variation in conditions in different jurisdictions present very substantial challenges to reformers, and militate against adopting one-size-fits-all policy solutions. As a consequence, approaches to change management in China have frequently emphasised the importance of sub-national experimentation, innovation, and learning. Multiple mechanisms exist within the government structure to allow and encourage flexible implementation of policies, and tailoring of reforms to context. These limit the risk of large-scale policy failures and play a role in exploring new reform directions and potentially systemically-useful practices. They have helped in managing the huge transition that China has undergone from the 1970s onwards. China has historically made use of a number of mechanisms to encourage learning from innovative and emergent policy practices. Policy evaluation is increasingly becoming a tool used to probe emergent practices and inform iterative policy making/refining. This paper examines the case of a central policy research institute whose mandate includes evaluating reforms and providing feedback to the health ministry. Evaluation approaches being used are evolving as Chinese research agencies become increasingly professionalised, and in response to the increasing complexity of reforms. The paper argues that learning from widespread innovation and experimentation is challenging, but necessary for stewardship of large, and rapidly-changing systems.

Future oriented conservation: knowledge governance, uncertainty and learning - Wyborn, Carina; van Kerkhoff, Lorrae; Dunlop, Michael; Dudley, Nigel; Guevara, Oscar (Biodiversity and Conservation, 2016)
Despite signiﬁcant progress in understanding climate risks, adaptation efforts in biodiversity conservation remain limited. Adaptation requires addressing immediate conservation threats while also attending to long term, highly uncertain and potentially transformative future changes. To date, conservation research has focused more on projecting climate impacts and identifying possible strategies, rather than understanding how governance enables or constrains adaptation actions. We outline an approach to futureoriented conservation that combines the capacities to anticipate future ecological change; to understand the implications of that change for social, political and ecological values; and the ability to engage with the governance (and politics) of adaptation. Our approach builds on the adaptive management and governance literature, however we explicitly address the (often contested) rules, knowledge and values that enable or constrain adaptation. We call for a broader focus that extends beyond technical approaches to acknowledge the sociopolitical challenges inherent to adaptation. More importantly, we suggest that conservation policy makers and practitioners can use this approach to facilitate learning and adaptation in the context of complexity, transformational change and uncertainty.

The five trademarks of agile organizations - Wouter Aghina; Karin Ahlbäck; Aaron De Smet; Clemens Fahrbach; Christopher Handscomb; Gerald Lackey; Michael Lurie; Monica Murarka; Olli Salo; Elizabeth Seem; Jannik Woxholth (McKinsey anc Company, 2017)
Our experience and research demonstrate that successful agile organizations consistently exhibit the five trademarks described in this article. The trademarks include a network of teams within a people-centered culture that operates in rapid learning and fast decision cycles which are enabled by technology, and a common purpose that co-creates value for all stakeholders. These trademarks complement the findings from The McKinsey Global Survey Results: How to create an agile organization.

Using beneficiary feedback to improve development programmes: findings from a multi-country pilot - World Vision (World Vision, 2016)
This briefing summarises the findings from Beneficiary Feedback Mechanisms pilots and is intended to inform organisations and their funders about the development and implementation of feedback mechanisms.

Forward Look - A vision for the World Bank Group in 2030 - World Bank (World Bank, 2016)

Learning and Results in World Bank Operations: Toward a New Learning Strategy - World Bank (IEG , The World Bank, 2015)
This report is the second in a program of evaluations that the Independent Evaluation Group (IEG) is conducting on the learning that takes place through World Bank projects. Learning and knowledge are treated as parts of a whole and are presumed to be mutually reinforcing.
Keywords: IMPORTANT

Strategic Framework for mainstreaming citizen engagemente in World Bank Group operations - World Bank (The World Bank, 2014)

World Development Report 2015: Mind, Society, and Behavior - World Bank (The World Bank, 2015)
Development economics and policy are due for a redesign. In the past few decades, research from across the natural and social sciences has provided stunning insight into the way people think and make decisions. Whereas the first generation of development policy was based on the assumption that humans make decisions deliberatively and independently, and on the basis of consistent and self-interested preferences, recent research shows that decision making rarely proceeds this way. People think automatically: when deciding, they usually draw on what comes to mind effortlessly. People also think socially: social norms guide much of behavior, and many people prefer to cooperate as long as others are doing their share. And people think with mental models: what they perceive and how they interpret it depend on concepts and worldviews drawn from their societies and from shared histories.The World Development Report 2015 offers a concrete look at how these insights apply to development policy. It shows how a richer view of human behavior can help achieve development goals in many areas, including early childhood development, household finance, productivity, health, and climate change. It also shows how a more subtle view of human behavior provides new tools for interventions. Making even minor adjustments to a decision-making context, designing interventions based on an understanding of social preferences, and exposing individuals to new experiences and ways of thinking may enable people to improve their lives.The Report opens exciting new avenues for development work. It shows that poverty is not simply a state of material deprivation, but also a “tax” on cognitive resources that affects the quality of decision making. It emphasizes that all humans, including experts and policy makers, are subject to psychological and social influences on thinking, and that development organizations could benefit from procedures to improve their own deliberations and decision making. It demonstrates the need for more discovery, learning, and adaptation in policy design and implementation. The new approach to development economics has immense promise. Its scope of application is vast. This Report introduces an important new agenda for the development community.

World Development Report 2017: Governance and the Law - World Bank (The World Bank, 2017)

A Practical Guide to Distributed Scrum - Woodward, Elizabeth; Surdek, Steffan; Ganis, Matthew (IBM Press, 2010)
Succeed with Scrum in Even the Largest, Most Complex Distributed Development Projects Forewords by Ken Schwaber, Scott Ambler, Roman Pichler, and Matthew Wang This is the first comprehensive, practical guide for Scrum practitioners working in large-scale distributed environments. Written by three of IBM’s leading Scrum practitioners--in close collaboration with the IBM QSE Scrum Community of more than 1000 members worldwide--this book offers specific, actionable guidance for everyone who wants to succeed with Scrum in the enterprise. Readers will follow a journey through the lifecycle of a distributed Scrum project, from envisioning products and setting up teams to preparing for Sprint planning and running retrospectives. Each chapter presents a baseline drawn from “conventional” Scrum, then discusses additional issues faced by distributed teams, and presents specific best-practice solutions, alternatives, and tips the authors have identified through hard, empirical experience. Using real-world examples, the book demonstrates how to apply key Scrum practices, such as look-ahead planning in geographically distributed environments. Readers will also gain valuable new insights into the agile management of complex problem and technical domains. Coverage includes•  Developing user stories and working with Product Owners as a distributed team•  Recognizing and fixing the flaws Scrum may reveal in existing processes•  Engaging in more efficient Release and Sprint planning•  Conducting intense, brief daily Scrum meetings in distributed environments•  Managing cultural and language differences•  Resolving dependencies, performing frequent integration, and maintaining transparency in geographically distributed environments•  Successfully running remote software reviews and demos•  Brainstorming what worked and what didn’t, to improve future Sprints This book will be an indispensable resource for every team leader, member, product owner, or manager working with Scrum or other agile methods in any distributed software development organization.

Scrambling after Moving Targets: Monitoring & Evaluation Applied to Adaptive Management Approaches in Peacebuilding - Woodrow, Peter; Jean, Isabella (New Directions in Peacebuilding Evaluation, 2019)
In this landmark collection, the voices of pathMakers and innovators in peacebuilding evaluation are assembled to provide new direction for the field.
Keywords: IMPORTANT

Agile Metrics: The Good, the Bad, and the Ugly - Wolpers, Stefan (dzone.com, 2017)
Suitable agile metrics reflect either a team’s progress in becoming agile or your organization’s progress in becoming a learning organization.

What is adaptive management? - Wilson, Gregory (ΔNTYLLES, 2016)
Recently there has been growing recognition that most development challenges are in actual fact ‘wicked’ problem that requires development actors to recognize that the optimal management approaches…

Test It and They Might Come: Improving the Uptake of Digital Tools in Transparency and Accountability Initiatives - Wilson, Christopher; de Lanerolle, Indra (IDS Bulletin, 2016)
Keywords: IMPORTANT

Outcome Harvesting - Wilson-Grau, Ricardo; Britt, Heather (Ford Foundation, 2012)
Outcome Harvesting was developed by Ricardo Wilson-Grau with colleagues Barbara Klugman, Claudia Fontes, David Wilson-Sánchez, Fe Briones Garcia, Gabriela Sánchez, Goele Scheers, Heather Britt, Jennifer Vincent, Julie Lafreniere, Juliette Majot, Marcie Mersky, Martha Nuñez, Mary Jane Real, Natalia Ortiz, and Wolfgang Richert. Over the past 8 years, Outcome Harvesting and has been used to monitor and evaluate the achievements of hundreds of networks, non-governmental organizations, research centers, think tanks, and communitybased organizations around the world. This brief is intended to introduce the concepts and approach used in Outcome Harvesting to grant makers, managers, and evaluators, with the hope that it may inspire them to learn more about the method and apply it to appropriate contexts. Thus, it is not a comprehensive guide to or explanation of the method, but an introduction to allow evaluators and decision makers to determine if the method is appropriate for their evaluation needs. Where possible, we have included examples to illustrate how Outcome Harvesting is applied to real situations. For each case story, organizations were asked to provide a description of the outcome and a summary of the role played by the organization. Sometimes they added other information such as the outcome’s significance. Some details and identifiers were redacted for confidentiality purposes. A draft of this brief was graciously commented on by Bob Williams, Fred Carden, Sarah Earl, Richard Hummelbrunner and Terry Smutylo. The final text is, of course, the sole responsibility of the authors and editor.

What is Outcome Harvesting? - Wilson-Grau, Ricardo (2014)
Ricardo Wilson-Grau, former Chair of the Board of Stewards of the Outcome Mapping Learning Community, introduces Outcome Harvesting, an approach for retrospective identification of outcomes based on the principles of Outcome Mapping. More details here: http://www.outcomemapping.ca/nuggets/outcome-harvesting

Outcome Harvesting - Wilson-Grau, R. (Better Evaluation, 2015)
Outcome Harvesting collects (“harvests”) evidence of what has changed (“outcomes”) and, then, working backwards, determines whether and how an intervention has contributed to these changes. Outcome Harvesting has proven to be especially useful in complex situations when it is not possible to define concretely most of what an intervention aims to achieve, or even, what specific actions will be taken over a multi-year period.

Guidelines and good practices for evidence-informed policy-making in a government department - Wills, Alf; Tshangela, Mapula; Shaxson, Louise; Datta, Ajoy; Matomela, Bongani (2016)

Change in challenging contexts - Williamson, Tim (ODI, 2015)
This report explores how genuine institutional change takes place in fragile and conflict-affected states reforms can be supported.

External validity and policy adaptation. From impact evaluation to policy design - Williams, Martin J. (BSG Working Paper Series, 2017)
With the growing number of rigorous impact evaluations worldwide, the question of how best to apply this evidence to policymaking processes has arguably become the main challenge for evidence-based policymaking. How can policymakers predict whether a policy will have the same impact in their context as it did elsewhere, and how should this influence the design and implementation of policy? This paper introduces a simple and flexible framework to address these questions of external validity and policy adaptation. I show that failures of external validity arise from an interaction between a policy’s theory of change and a dimension of the context in which it is being implemented, and develop a method of “mechanism mapping” that maps a policy’s theory of change against salient contextual assumptions to identify external validity problems and suggest appropriate policy adaptations. In deciding whether and how to adapt a policy in a new context, I show there is a fundamental informational trade-o↵ between the strength and relevance of evidence on the policy from other contexts and the policymaker’s knowledge of the local context. This trade-o↵ can guide policymakers’ judgments about whether policies should be copied exactly from elsewhere, adapted, or invented anew.

Adaptive Management: From More Talk to Real Action - Williams, Byron K.; Brown, Eleanor D. (Environmental Management, 2014)
The challenges currently facing resource managers are large-scale and complex, and demand new approaches to balance development and conservation goals. One approach that shows considerable promise for addressing these challenges is adaptive management, which by now is broadly seen as a natural, intuitive, and potentially effective way to address decision-making in the face of uncertainties. Yet the concept of adaptive management continues to evolve, and its record of success remains limited. In this article, we present an operational framework for adaptive decision-making, and describe the challenges and opportunities in applying it to real-world problems. We discuss the key elements required for adaptive decision-making, and their integration into an iterative process that highlights and distinguishes technical and social learning. We illustrate the elements and processes of the framework with some successful on-the-ground examples of natural resource management. Finally, we address some of the difficulties in applying learning-based management, and finish with a discussion of future directions and strategic challenges.
Keywords: IMPORTANT

Technical challenges in the application of adaptive management - Williams, Byron K.; Brown, Eleanor D. (Biological Conservation, 2016)
Adaptive management is an approach for simultaneously managing and learning about natural resources, by acknowledging uncertainty and seeking to reduce it through the process of management itself. Adaptive decision making can be applied to pressing issues in conservation biology such as species reintroduction, disease and invasive species control, and habitat restoration, as well as to management of natural resources in general. After briefly outlining a framework and process for adaptive management, we focus on an overview of the key technical issues related to problem framing and the ability of resource managers to learn from their experience. These technical issues include the treatment of uncertainty and its propagation over time; nonstationarity in long-term environmental trends; the applicability of adaptive management across scales; requirements for models and management alternatives that promote learning; the value of the information produced with adaptive management; the challenge to management of uncertainty and surprise; and institutional (social) learning. To accommodate these and other challenges that are now coming into focus, the learning-based approach of adaptive management will need to be adjusted and expanded in the future.
Keywords: Adaptive Management; Learning; Nonstationarity; Resilience; Uncertainty; Value of information

Adaptive management of natural resources—framework and issues - Williams, Byron K. (Journal of Environmental Management, 2011)
Adaptive management, an approach for simultaneously managing and learning about natural resources, has been around for several decades. Interest in adaptive decision making has grown steadily over that time, and by now many in natural resources conservation claim that adaptive management is the approach they use in meeting their resource management responsibilities. Yet there remains considerable ambiguity about what adaptive management actually is, and how it is to be implemented by practitioners. The objective of this paper is to present a framework and conditions for adaptive decision making, and discuss some important challenges in its application. Adaptive management is described as a two-phase process of deliberative and iterative phases, which are implemented sequentially over the timeframe of an application. Key elements, processes, and issues in adaptive decision making are highlighted in terms of this framework. Special emphasis is given to the question of geographic scale, the difﬁculties presented by non-stationarity, and organizational challenges in implementing adaptive management.

Passive and active adaptive management: Approaches and an example - Williams, Byron (Journal of Environmental Management, 2010)
Adaptive management is a framework for resource conservation that promotes iterative learning-based decision making. Yet there remains considerable confusion about what adaptive management entails, and how to actually make resource decisions adaptively. A key but somewhat ambiguous distinction in adaptive management is between active and passive forms of adaptive decision making. The objective of this paper is to illustrate some approaches to active and passive adaptive management with a simple example involving the drawdown of water impoundments on a wildlife refuge. The approaches are illustrated for the drawdown example, and contrasted in terms of objectives, costs, and potential learning rates. Some key challenges to the actual practice of AM are discussed, and tradeoffs between implementation costs and long-term benefits are highlighted.

Rewards and Risks Associated with Community Engagement in Anti-Poaching and Anti-Trafficking - Wilkie, David; Painter, Michael; Jacob, Anila (Measuring Impact, 2016)
This Biodiversity Technical Brief summarizes research on the roles communities do and should play in countering wildlife crime, motivations, and benefits for individuals and communities to engage in anti-poaching and anti-trafficking efforts, and risks and mitigation of risks associated with involvement. Peer-reviewed and grey literature, structured interviews, and case studies informed the research, with highlights from six case studies in Peru, Madagascar, Namibia, Philippines, Kenya, and Indonesia.

Building a global learning alliance on adaptive management - Wild, Leni; Ramalingam, Ben (ODI, 2018)

Putting theory into practice: how DFID is doing development differently - Wild, Leni; Booth, David; Valters, Craig (ODI, 2017)
Keywords: IMPORTANT

Adapting development: improving services to the poor - Wild, Leni; Booth, David; Cummings, Clare; Foresti, Marta; Wales, Joseph (ODI, 2015)
On current trends, it will take decades or longer to bring basic services to the world’s most disadvantaged people. Meeting this challenge means recognising the political conditions that enable or obstruct development progress - a radical departure from the approach of the Millennium Development Goals.
Keywords: Practice

Uncertainty, Precaution, and Adaptive Management in Wildlife Trade - Wiersema, Annecoos (Michigan Journal of International Law, 2015)

Wildlife laws monitoring as an adaptive management tool in protected area management in Ghana: a case of Kakum Conservation Area - Wiafe, Edward Debrah (SpringerPlus, 2016)
INTRODUCTION: The wildlife laws of Ghana alienated the rural communities from forests and material well-being depended upon for their livelihood and this manifests itself in the progressive conflict between the park patrol staff and poachers from the fringes of the protected areas. CASE DESCRIPTION: The main aim of this study was to determine the impact of quantification of patrol efforts on indicators of illegal hunting activities that occur in rainforest protected areas, as a result of monitoring patrol operations and modifying the original plan. The specific objectives were to determine the optimal patrol efforts necessary to reduce illegal wildlife use to minimal; and the influence of the rainfall and seasonal activities on illegal wildlife use. DISCUSSION AND EVALUATION: The results indicated that as the patrol efforts increased the encounter with illegal wildlife use also increased until a certain point that the encounter rates started decreasing. Neither rainfall nor seasonal activities influenced the illegal activities and the patrol efforts. The protection staff of rainforest protected areas would work effectively to bring down illegal wildlife off-take to the barest minimum if monitored, quantified and provide feed-back. CONCLUSIONS: Illegal wildlife off-take can also be reduced by the protection staff if the original plans are made flexible to be adjusted. Recommendations for further studies have been made.

How We Model Matters: A Manifesto for the Next Generation of Program Theorizing - Whynot, Jane; Lemire, Sebastian; Montague, Steve (Canadian Journal of Program Evaluation, 2019)
In this concluding article, grounded on the exemplary contributions contained in the preceding pages, the guest editors scale the proverbial soapbox and present a manifesto to guide the pursuit and advancement of the next generation of program theorizing. Formulating ten declarations for program theory development and examination, the modest hope of the authors is to motivate and inspire reflective evaluation practitioners to broaden their views, approaches, and techniques for future program theorizing.

A Guide to Digital Feedback Loops. An approach to strengthening program outcomes through data for decision making - Whittle, Dennis; Campbell, Megan (USAID, 2019)
Feedback is information about what happens as a result of what you do. Using that information to adapt what you do or how you do it creates what is called a feedback loop. A digital feedback loop uses digital technology at some stage of the feedback loop. Digital feedback loops help USAID missions improve the effectiveness and efficiency of their activities and can support partner countries on their journey to self-reliance through increased information sharing and improved government and civil society capacity. USAID missions and their partners have used digital feedback loops to improve HIV treatment targeting in Zimbabwe, engage three million young people in Nigeria in policy, and reduce field reporting times from one month to one day. Digital feedback loops provide access to information faster and more cheaply than ever before. As part of an adaptive management approach, digital feedback loops increase our ability to act on opportunities and respond to challenges. That in turn can improve outcomes and reduce the risk of waste and failure. This guide outlines the case for integrating digital feedback loops into your work, and provides tools, resources and guiding questions to support you as you get started. The guide includes examples of how USAID missions are using digital feedback loops to improve their programs in various sectors and provides worksheets to help you apply digital feedback loops to your own context.

Impact Evaluation of Development Interventions: A Practical Guide - White, Howard; Raitzer, David (Asian Development Bank, 2017)
This book offers guidance on the principles, methods, and practice of impact evaluation. It contains material for a range of audiences, from those who may use or manage impact evaluations to applied researchers.

A Governance Practitioner’s Notebook: Alternative Ideas and Approaches - Whaites, Alan; Gonzalez, Eduardo; Fyson, Sara; Teskey, Graham (OECD, 2015)
The Governance Practitioner’s Notebook takes an unusual approach for the OECD-DAC Network on Governance (GovNet). It brings together a collection of specially written notes aimed at those who work as governance practitioners within development agencies. It does so, however, without attempting to offer definitive guidance – instead aiming to stimulate thinking and debate. To aid this process the book is centred on a fictional Governance Adviser. The Notebook’s format provides space for experts to speak on today’s governance issues: politics, public sector reform and stakeholder engagement. It encourages debate, charts the evolution of donor thinking, and highlights future challenges in the age of the Sustainable Development Goals. Each section introduces both technical issues and major areas of debate, providing ideas for future development support to institutional reform.
Keywords: IMPORTANT

The Beginner’s Guide to Political Economy Analysis (PEA) - Whaites, Alan (National School of Government International, 2017)
Over the last two decades aid agencies and academics have been on a journey of lesson learning and adaptation in relation to `politics.’ This journey has been driven by a determination to improve impact in all areas of development, but for some time it was particularly associated with work on public sector reform. Now, however, there is an increasing expectation that Political Economy Analysis (PEA) should be part and parcel of designing and implementing any programme or activity (and a brief history of the meandering journey of development actors on PEA can be found in The Policy Practice’s Briefing Paper 11 – see below). DFID in the UK is fairly typical among large development organisations in running an excellent course on political economy analysis, complete with 200 pages of resources and various online videos and case studies (and this type of course is recommended for those who want to take their exploration of PEA further). Even so, PEA is not just for those who have `done the course and bought the T-shirt,’ it is something that can be absorbed and implemented quickly by everybody. Indeed, the growth of interest in PEA is a reminder that this can look like a complex and daunting field and so this guide aims to offer an entry-point for all those who want to use PEA in their own work. In doing so, this guide borrows from the best materials that are available while also adapting some approaches by incorporating wider ideas on politics and institutions. This guide affirms that there should never be an official `orthodoxy’ for PEA and so the emphasis here is on questions, prompts and ideas to help thinking and practice. There is also an attempt to clarify jargon wherever needed, while recognising that The Policy Practice (TPP) and the Overseas Development Institute (ODI) have produced a more complete glossary of PEA terminology. The note will instead focus on `the essentials’ of PEA as they relate to the following questions:  Why do we do political economy analysis, and what is it?  What kinds of issues and ingredients are often included in a PEA?  How do we make sense of the different varieties of PEA?  What tools are out there to help us conduct a PEA?  What is thinking and working politically?

Governance and Service Delivery: Practical Applications of Social Accountability Across Sectors - Wetterberg, Anna; Brinkerhoff, Derick W.; Hertz, Jana C. (RTI Press, 2016)
The six case studies in Governance and Service Delivery: Practical Applications of Social Accountability Across Sectors illustrate the multiple ways citizen participation in accountability – called social accountability – can lead to positive effects on governance, citizen empowerment, and service delivery. Drawing on their extensive experience implementing international donor-funded programs and projects, the authors examine six recent RTI International projects in Africa and Asia. The analysis focuses on both intended and actual effects, and it unpacks the influence of context on implementation and outcomes achieved, as well as on prospects for sustainability. Donors, academics, policy makers, practitioners and others interested in sustainable development and governance will find this systematic review invaluable.

Realist Impact Evaluation: An introduction - Westhorp, Gill (Methods Lab, 2014)
• Realist evaluation is a member of a family of theory-based evaluation approaches which begin by clarifying the ‘programme theory’: the mechanisms that are likely to operate, the contexts in which they might operate and the outcomes that will be observed if they operate as expected. • Realist approaches assume that nothing works everywhere for everyone: context makes a big difference to programme outcomes. A realist evaluation asks not ‘what works?’ but ‘how or why does this work, for whom, in what circumstances?’ • Realist impact evaluation is most appropriate for evaluating new initiatives or programmes that seem to work but where ‘how and for whom’ is not yet understood; programmes that have previously demonstrated mixed patterns of outcomes; and those that will be scaled up, to understand how to adapt the intervention to new contexts.

Testing the Waters: A Qualitative Comparative Analysis of the Factors Affecting Success in Rendering Water Services Sustainable Based on ICT Reporting - Welle, Katharina; Williams, Jennifer; Pearce, Joseph; Befani, Barbara (MAVC, 2015)
This research conducted by WaterAid, Itad and IRC aims to understand the factors that facilitate and inhibit the success of ICT-based reporting to improve rural water supply sustainability.

Timely evaluation in international development - Webster, Jayne; Exley, Josephine; Copestake, James; Davies, Rick; Hargreaves, James (Journal of Development Effectiveness, 2018)
Impact and process evaluations are increasingly used in international development; however they are generally retrospective in outlook. A more timely approach to evaluation aims to identify necessary, feasible and effective changes during a programme or intervention’s lifetime. This paper aims to identify, categorise, describe and critically appraise methods to support more timely evaluation in international development. Potential methods were identified through scoping seminar, public symposium, targeted review of the literature, and the authors’ own experiences and opinions. Findings from the different data sources were reviewed collectively by the author group and triangulated to develop an analytical framework. We identified four purposes of timely evaluation for international development, and critiqued the use of approaches against four dimensions of timeliness and flexibility. Whilst we found significant interest in more timely approaches to evaluation in international development, there was a dearth of published empirical evidence upon which to base strong recommendations. There is significant potential for timely evaluation to improve international development outcomes. New approaches to mixing and adapting existing methods, together with new technologies offer increased potential. Research is needed to provide an empirical evidence base upon which to further develop the application, across sectors and contexts, of timely evaluation in international development.
Keywords: Adaptive learning; Outcome evaluation; Programme improvement; impact evaluation

Principles for Monitoring, Evaluation, and Adaptive Management of Environmental Water Regimes - Webb, J. Angus; Watts, Robyn J.; Allan, Catherine; Warner, Andrew T. (Water for the Environment, 2017)
Environmental water is often a contentious investment in the environment that must be delivered under uncertainty regarding the ecological and social benefits they deliver. Adaptive management can be used to facilitate decision making under uncertainty, and use new knowledge and understanding to improve management decisions and outcomes over time. However, there is a perception that adaptive management has failed to deliver improvements in decision making and learning. Monitoring and evaluation are an essential feature of adaptive management. However, past monitoring for river protection and restoration has too often been of insufficient quality to facilitate adaptive learning. Moreover, environmental water represents a class of protection and restoration that is inherently difficult to monitor, and some of the learnings are not evident in part because fragmented assessment, documentation, and reporting of adaptive management can obscure successes. We outline a set of general principles for improving monitoring, evaluation, and adaptive management of environmental water regimes, and provide several examples from Australia and North America. Successful adaptive management depends upon the formation and maintenance of strong partnerships and an appreciation of the importance of individuals in teams. Through such partnerships, it is possible to coordinate monitoring programs over large scales, create programs of requisite simplicity, and use innovative approaches to evaluation. Finally, we note that although adaptive management has occurred in the past, too often it has been poorly documented and reported. The inclusion of reflectors in monitoring and evaluation teams will better capture the lessons learned by individual programs, improving adaptive management into the future.
Keywords: Environmental water management; Knowledge exchange; Legitimacy; implementation challenge

The Global Wildlife Program - Knowledge Platform - 2016-2018 - WB (The World Bank, 2018)

Policy-driven monitoring and evaluation: Does it support adaptive management of socio-ecological systems? - Waylen, Kerry A.; Blackstock, Kirsty L.; van Hulst, Freddy J.; Damian, Carmen; Horváth, Ferenc; Johnson, Richard K.; Kanka, Robert; Külvik, Mart; Macleod, Christopher J. A.; Meissner, Kristian; Oprina-Pavelescu, Mihaela M.; Pino, Joan; et al. (Science of The Total Environment, 2019)
Inadequate Monitoring and Evaluation (M&E) is often thought to hinder adaptive management of socio-ecological systems. A key influence on environmental management practices are environmental policies: however, their consequences for M&E practices have not been well-examined. We examine three policy areas - the Water Framework Directive, the Natura 2000 Directives, and the Agri-Environment Schemes of the Common Agricultural Policy - whose statutory requirements influence how the environment is managed and monitored across Europe. We use a comparative approach to examine what is monitored, how monitoring is carried out, and how results are used to update management, based on publicly available documentation across nine regional and national cases. The requirements and guidelines of these policies have provided significant impetus for monitoring: however, we find this policy-driven M&E usually does not match the ideals of what is needed to inform adaptive management. There is a tendency to focus on understanding state and trends rather than tracking the effect of interventions; a focus on specific biotic and abiotic indicators at the expense of understanding system functions and processes, especially social components; and limited attention to how context affects systems, though this is sometimes considered via secondary data. The resulting data are sometimes publicly-accessible, but it is rarely clear if and how these influence decisions at any level, whether this be in the original policy itself or at the level of measures such as site management plans. Adjustments to policy-driven M&E could better enable learning for adaptive management, by reconsidering what supports a balanced understanding of socio-ecological systems and decision-making. Useful strategies include making more use of secondary data, and more transparency in data-sharing and decision-making. Several countries and policy areas already offer useful examples. Such changes are essential given the influence of policy, and the urgency of enabling adaptive management to safeguard socio-ecological systems.
Keywords: Adaptive Management; Environmental governance; Monitoring and Evaluation; Policy making; Socio-ecological systems; Sustainability

From principle to practice: Implementing the Principles for Digital Development - Waugaman, Adele (2016)
The Principles for Digital Development (download PDF here) find their roots in the efforts of individuals, development organizations, and donors alike who have called for a more concerted effort by donors and implementing partners to institutionalize lessons learned in the use of information and communication technologies (ICTs) in development projects.
Keywords: IMPORTANT

VANUATU GOVERNANCE FOR GROWTH PROGRAM – REVIEW - Warner, Robert; Gouy, Jonathan; Samson, Anthony (2017)

Monitoring Humanitarian Innovation - Warner, Alexandra; Obrecht, Alice (HIF-ALNAP working paper, 2017)

Understanding ‘the users’ in Technology for Transparency and Accountability Initiatives - Wanjiku Kelbert, Alexandra; McGee, Rosemary; Carlitz, Ruth (2013)

Bridging & Bonding: Improving Links between Transparency & Accountability Actors - Wanjiku Kelbert, Alexandra (2014)

Using what we know: How to ensure tech projects meet the brief - Walker, Tom (Making All Voices Count, 2017)
Making tech effective - building on what we already know

Connecting the Dots: Systems Practice & Political Economy Analysis - Walker, Tjip; Jacobstein, David (Local Systems Community, 2017)
This slide deck, from a presentation to the Local Systems Community by Tjip Walker and David Jacobstein, shows various ways in which assessing the political economy of a context and understanding that context through the lens of systems thinking can reinforce each other. Effective systems practice should be grounded in the incentives and power dynamics of a particular local system; thinking and working politically requires understanding the systems dynamics of an issue or sector.

Designing Regenerative Cultures - Wahl, Daniel Christian (Triarchy Press Ltd, 2016)
This is a 'Whole Earth Catalog' for the 21st century: an impressive and wide-ranging analysis of what's wrong with our societies, organizations, ideologies, worldviews and cultures - and how to put them right. The book covers the finance system, agriculture, design, ecology, economy, sustainability, organizations and society at large. In this remarkable book, Daniel Wahl explores ways in which we can reframe and understand the crises that we currently face, and he explores how we can live our way into the future. Moving from patterns of thinking and believing to our practice of education, design and community living, he systematically shows how we can stop chasing the mirage of certainty and control in a complex and unpredictable world. The book asks how can we collaborate in the creation of diverse regenerative cultures adapted to the unique biocultural conditions of place? How can we create conditions conducive to life? *** "This book is a valuable contribution to the important discussion of the worldview and value system we need to redesign our businesses, economies, and technologies - in fact, our entire culture - so as to make them regenerative rather than destructive." --Fritjof Capra, author of The Web of Life, co-author of The Systems View of Life: A Unifying Vision *** "This is an excellent addition to the literature on ecological design and it will certainly form a keystone in the foundations of the new MA in Ecological Design Thinking at Schumacher College, Devon. It not only contains a wealth of ideas on what Dr Wahl has termed 'Designing Regenerative Cultures' but what is probably more important, it provides some stimulating new ways of looking at persistent problems in our contemporary culture and hence opens up new ways of thinking and acting in the future." -- Seaton Baxter OBE, Prof. in Ecological Design Thinking, Schumacher College, UK [Subject: Systems Thinking, Education, Social Anthropology, Environmentalism, Ecology, Regenerative Culture, Sociology]

MSP Guide - Wageningen University (MSP Guide, 2015)
The MSP Guide Designing and facilitating effective multi-stakeholder partnerships Get started Download now The MSP Guide(EN, FR, ES) Explore the rationale, principles and process of designing and facilitating effective MSPs Get it now The MSP Tool Guide Detailed descriptions of 60 tried-and-tested tools to facilitate multi-stakeholder partnerships Get it now Reflection Methods: Practical Guide Proven…

Valuing peace: delivering and demonstrating mediation results - Dilemmas & options for mediators - Wadley, Ian (Mediation Practice Series, 2017)
Essential points for practitioners and donors • Mediation offers a cost-effective and proven method for resolving armed conflict. Between 1985 and 2015, 75 per cent of armed conflicts in the world were resolved through agreement rather than by force. In most cases these processes will have involved third party facilitation or support. • Professional mediators understand the high stakes involved in their work to prevent, mitigate and resolve armed conflict. In addition, they and their financial supporters are increasingly required to demonstrate ‘value-for-money’ to ensure continued funding. • However, traditional monitoring and evaluation (M&E) methods are not well suited to this task, typically imposing artificially linear project models on a dynamic conflict situation, as well as compliance reporting that moves attention away from real value. • Traditional M&E methods tend to focus on documenting the past and generating vast amounts of data, rather than enabling timely adaptation of the project in the present. • Traditional M&E approaches rely heavily on external evaluation consultants. Even in the best of cases this may interfere with the mediation process and impose a heavy time burden on the project team, leading to low acceptance of traditional M&E approaches by mediation practitioners. • In contrast, an ideal M&E approach for mediation should deliver useful insights in even the most dynamic and sensitive mediation environments, impose a light reporting burden, and be readily accepted by mediation teams. It should protect discretion and trust, enable rapid adaptation, and also provide some assurance that donor funds are being well spent.

Developing an effective adaptive monitoring network to support integrated coastal management in a multiuser nature reserve - Vugteveen, Pim; van Katwijk, Marieke M.; Rouwette, Etiënne; Lenders, H. J. Rob; Hanssen, Lucien (Ecology and Society, 2015)
ABSTRACT. We elaborate the necessary conceptual and strategic elements for developing an effective adaptive monitoring network to support Integrated Coastal Management (ICM) in a multiuser nature reserve in the Dutch Wadden Sea Region. We discuss quality criteria and enabling actions essential to accomplish and sustain monitoring excellence to support ICM. The Wadden Sea Long-Term Ecosystem Research project (WaLTER) was initiated to develop an adaptive monitoring network and online data portal to better understand and support ICM in the Dutch Wadden Sea Region. Our comprehensive approach integrates ecological and socioeconomic data and links research-driven and policy-driven monitoring for system analysis using indicators of pressures, state, benefits, and responses. The approach and concepts we elaborated are transferable to other coastal regions to accomplish ICM in complex social-ecological systems in which scientists, multisectoral stakeholders, resource managers, and governmental representatives seek to balance long-term ecological, economic, and social objectives within natural limits.
Keywords: IMPORTANT

Adaptive development: great progress and some niggles - Vowles, Pete (Medium, 2016)
After 3 years in DFID headquarters, championing adaptive approaches to the delivery of aid and development programmes, I am back in an…

Adaptive programming - Vowles, Pete (DFID Bloggers, 2013)
Staff blogs from the UK Department for International Development. Get real-life perspectives from those on the ground to fight poverty and join in the debate.

What Are the Next Steps in Innovation for Good Governance? - von Sturmer, Lucy (Making All Voices Count, 2015)
What are the next steps in innovation for good governance? Lucy von Sturmer reflects on lessons learned at Buntwani 2015.

Appendix 3. ToC Examples - Vogel, Isabel; Stephenson, Zoe (DFID, 2012)

Innovation in development: Sharing learning, improving impact - Vogel, Isabel; Minkley, Gabrielle; Chowdhury, Sajid (Ideas to Impact / IMC Worldwide, 2017)

Innovating in Development Learning Event - Challenge brief - Vogel, Isabel (Ideas to Impact / iMC, 2017)

Review of the use of ‘Theory of Change’ in International development - Vogel, Isabel (DFID, 2012)
A new report on Theory of Change (ToC) and its use in International development has just been produced.

Impact Evaluation: Taking stock and looking ahead - Conference report - Visser, Irene; Guijt, Irene; Kusters, Cecile (Centre for Development Innovation, 2013)
This report summarises the presentations and discussions of the Conference ‘Impact evaluation. Taking stock and looking ahead’, which took place in Wageningen on March 25 and 26, 2013. The Conference was organised and funded by the Centre for

What exactly do we mean by systems? - Vexler, Dan (Stanford Social Innovation Review, 2017)
Everyone is talking about systems. Or at least, that's how it seems in my wonkish corner of the philanthropic world. You can't attend a conference or even have a meeting without hearing about systems, whether it's people trying to disrupt them, map them, learn from them, or catalyze them.

Re-Perceiving Results: Aid Programs and Change in Fragile Societies - van Veen, Erwin; Rijper, Alies (Policy Brief, 2017)
Aid programmes need to be able to adapt their objectives and operations to changes in their political environment, since development processes are subject to political contestation. Change takes time and is often a matter of seizing the opportunity.
Keywords: IMPORTANT

Understanding and governing learning in sustainability transitions: A review - van Mierlo, Barbara; Beers, Pieter J. (Environmental Innovation and Societal Transitions, 2018)
Many transitions scholars underscore the importance of learning in sustainability transitions, but the associated learning processes have hardly been conceptualised. The diverse, well-established research fields related to learning are broadly ignored or loosely applied. In this paper, we systematically explore four interesting learning traditions in terms of their value for gaining an in-depth understanding of learning in sustainability transitions and their relevance for fostering learning, by connecting them to key features of transitions. The selected learning traditions from different disciplinary backgrounds provide valuable insights. None of them sufficiently addresses the complexity of transitions. They include, however, a diversity of relevant learning contexts. We conclude that they have value for investigating new areas such as learning in socio-technological regimes and in later phases of a transition, while enlightening forms of learning that have not yet been fully recognised in transition studies, such as superficial learning, unlearning, and learning to resist change.
Keywords: Collaborative learning; Interactive learning; Organizational learning; Social learning; Sustainability transition

Balancing Inclusiveness, Rigour and Feasibility: Insights from Participatory Impact Evaluations in Ghana and Vietnam - van Hemelrijck, Adinda; Guijt, Irene (Practice Paper, 2016)
This paper by Adinda Van Hemelrijck and Irene Guijt explores how impact evaluation can live up to standards broader than statistical rigour in ways that address challenges of complexity and enable stakeholders to engage meaningfully. A Participatory Impact Assessment and Learning Approach (PIALA) was piloted to assess and debate the impacts on rural poverty of two government programmes in Vietnam and Ghana funded by the International Fund for Agricultural Development (IFAD). We discuss the trade-offs between rigour, inclusiveness and feasibility encountered in these two pilots. Trade-offs occur in every impact evaluation aiming for more than reductionist rigour, but the pilots suggest that they can be reduced by building sufficient research and learning capacity.

Theory of Change Thinking in Practice - van Es, Marjan; Guijt, Irene; Vogel, Isabel (2015)
Want to know better how your interventions can contribute to change? A Theory of Change (ToC) approach helps in deepening your understanding - and that of your partners - of how you collectively think change happens and what the effect will be of your intervention. Not only does it show what political, social, economic, and/or cultural factors are in play, it also clarifies your assumptions. Once a ToC has been developed, it can be used to continually reflect on it in ways that allow for adaptation and checking of assumptions of your intervention. This user friendly guideline helps you to use a Theory of Change approach. Theories of change are the ideas and beliefs people have – consciously or not – about why and how the world and people change. How people perceive and understand change and the world around them is infused by their underlying beliefs about life, human nature and society. They are deep drivers of people’s behaviour and of the choices they make. Social change processes are complex and characterised by non-linear feedback loops: our own actions interact with those of others and a myriad of influencing factors. This triggers reactions that cannot be foreseen and makes outcomes of change interventions unpredictable. Given these uncertainties, how can we plan strategically and sensibly? How can social change initiatives move forward in emerging change processes in a flexible way, while remaining focused on the goal? In this context of complexity, Hivos has found a theory of change (ToC) approach useful in guiding its strategic thinking and action, as well as its collaborative efforts with others. As it fosters critical questioning of all aspects of change interventions and supports adaptive planning and management in response to diverse and quickly changing contexts. It contributes to the quality and transparency of strategic thinking, and therefore to personal, organisational and social learning. This guide builds on the experiences of Hivos working with a ToC approach. It is a practical guide for Hivos staff in applying a Theory of Change approach, but is also very useful for others working on social change such as social entrepreneurs and innovators. This guide builds on the work of a ToC Learning Group initiated by Hivos and comprising of staff of the Centre for Development Innovation (CDI) of Wageningen University and Research Centre and of experts Iñigo Retolaza Eguren, Isabel Vogel and Irene Guijt. For current thinking and work on the use of Theory of Change thinking in complex change processes, see http://www.theoryofchange.nl

A conceptual map of political participation - van Deth, Jan W. (Acta Politica, 2014)
How would you recognize a mode of participation if you see one? Owing to the rapid expansion of political activities in the last decades this question has become increasingly difficult to answer. Neither the development of all-embracing nominal definitions, nor deductive analyses of existing modes of participation seem to be helpful. In addition, the spread of expressive modes of participation makes it hard to avoid purely subjective definitions. The aim of this discussion paper is to develop an operational definition of political participation, which allows us to cover distinct conceptualizations systematically, efficiently and consistently. This goal can only be arrived at if the conventional approach of presenting nominal definitions to solve conceptual problems is left behind. Instead, available definitions are included in a set of decision rules to distinguish three main variants of political participation. A fourth variant is distinguished for non-political activities used for political purposes. Together, the four variants of political participation cover the whole range of political participation systematically without excluding any mode of political participation unknown yet. At the same time, the endless expansion of the modes of political participation in modern democracies does not result in an endless conceptual expansion. Implications for research and various examples are discussed.

Making Sense of Complexity: Using SenseMaker as a Research Tool - Van der Merwe, Susara E.; Biggs, Reinette; Preiser, Rika; Cunningham, Charmaine; Snowden, David J.; O’Brien, Karen; Jenal, Marcus; Vosloo, Marietjie; Blignaut, Sonja; Goh, Zhen (Systems, 2019)
There is growing interest in studying processes of human sensemaking, as this strongly influences human and organizational behavior as well as complex system dynamics due to the diverse lenses people use to interpret and act in the world. The Cognitive Edge SenseMaker® tool is one method for capturing and making sense of people’s attitudes, perceptions, and experiences. It is used for monitoring and evaluation; mapping ideas, mind-sets, and attitudes; and detecting trends and weak signals. However, academic literature describing the tool-set and method is lacking. This introduction aims to guide researchers in choosing when to use SenseMaker and to facilitate understanding of its execution and limitations. SenseMaker can provide nuanced insight into system-level patterns of human sensemaking that can provide insight to nudge systems towards more desirable futures, and enable researchers to measure beyond what they know.
Keywords: Mixed methods; SenseMaker tool; complex systems; sensemaking; social complexity

Cherry-Picked Intelligence. The Weapons of Mass Destruction Dispositive as a Legitimation for National Security in the Post 9/11 Age - van der Heide, Liesbeth (Historical Social Research / Historische Sozialforschung, 2013)
»Geheimdienste mit Scheuklappen: Das Dispositiv der Massenvernichtungswaffen als Legitimation für Nationale Sicherheit nach 9/11«. The claim that Iraq possessed Weapons of Mass Destruction (WMD) led to the invasion of Iraq in 2003 by the US army. For the George W. Bush administration, the likely presence of WMD in Iraq was the major justification for going to war. However, Bush' opponents suspected he used the WMD-dispositive as a legitimation for an invasion that was already set in motion for different reasons. The Iraq invasion and the underlying ideas about the presence of WMD thus provide a tangible case for the analysis of theories of conspiracy and security. The development of the WMD-dispositive will be contextualized using the toolkit of securitization theory. The article explores the notions of security and conspiracy that were used to build the dispositive and shows how it ultimately failed and turned into a counter-narrative in which the Bush administration itself became the Great Conspirator.

The guiding logics and principles for designing emergent transdisciplinary research processes: learning experiences and reflections from a transdisciplinary urban case study in Enkanini informal settlement, South Africa - van Breda, John; Swilling, Mark (Sustainability Science, 2019)
Transdisciplinarity is not a new science per se, but a new methodology for doing science with society. A particular challenge in doing science with society is the engagement with non-academic actors to enable joint problem formulation, analysis and transformation. How this is achieved differs between contexts. The premise of this paper is that transdisciplinary research (TDR) methodologies designed for developed world contexts cannot merely be replicated and transferred to developing world contexts. Thus a new approach is needed for conducting TDR in contexts characterised by high levels of complexity, conflict and social fluidity. To that end, this paper introduces a new approach to TDR titled emergent transdisciplinary design research (ETDR). A core element of this approach is that the research process is designed as it unfolds, that is, it transforms as it emerges from and within the fluid context. The ETDR outlined in this paper emerged through a case study in the informal settlement (slum) of Enkanini in Stellenbosch, South Africa. This case study demonstrates the context from and within which the ETDR approach and identifies a set of guiding logics that can be used to guide ETDR approaches in other contexts. The study demonstrates that the new logics and guiding principles were not simply derived from the TDR literature, but rather emerged from constant interacting dynamics between theory and practice. Learning how to co-design the research process through co-producing transformative knowledge and then implementing strategic interventions to bring about incremental social change is key to theory development in ways that are informed by local contextual dynamics. There are, however, risks when undertaking such TDR processes such as under-valuing disciplinary knowledge, transferring risks onto a society, and suppressing ‘truth-to-power’.

Top Tips: How to design and manage adaptive programmes - Valters, Craig; Wild, Leni (Overseas Development Institute, 2019)
Within DFID, there is now a commitment to more flexible and adaptive programming. This recognises that: • DFID works in contexts that continuously evolve and change, sometimes in unpredictable ways. To respond to this, the agency needs to remain flexible – to expect change and have a good understanding of context, with resources that can be adjusted and scope to change direction if needed. All DFID programmes should be able to do this. • Some DFID programmes aim to support change in complex systems, behaviours and incentives. Efforts to address women’s empowerment, improve sanitation or build more sustainable health systems, for instance, all require engagement with the way in which complex systems operate and the people and behaviours within them. Trying to deliver reforms in these circumstances is challenging because the pathway to reform itself will be unclear: as a reform is rolled out, the system itself will react and respond. These types of programmes therefore need to build in from the start deliberate processes of learning and testing, to allow for adaptations as more information is gathered for what works over time. These top tips are concerned with programmes that aim to be flexible and adaptive – which work in dynamic contexts and are trying to address complex problems. While there is growing commitment to these approaches, feedback suggests staff still have questions about how to do this well. This document highlights some of the commonly reported issues related to adaptive programming and a set of tips, strategies and examples to help in addressing them. It is aimed at programme managers and advisors who may be Senior Responsible Owners (SROs) or those managing and supporting adaptive programming in a range of ways. We have collated these lessons from discussions with country offices and SROs, feedback from surveys and the wider evidence. We have looked specifically at the adaptive programmes we can find in the DFID portfolio, but this is not an exhaustive list. It should be noted that there is as yet no wide variety of case law to review, but there is a growing set of examples within DFID that can provide continuous learning for the organisation.

Putting learning at the centre: Adaptive development programming in practice - Valters, Craig; Cummings, Clare; Nixon, Hamish (ODI, 2016)
Adaptive programming suggests, at a minimum, that development actors react and respond to changes in the political and socio-economic operating environment. It emphasises learning and the development practitioner is encouraged to adjust their actions to find workable solutions to problems that they may face. Being prepared to react to change may seem like common sense – and indeed it is. However much development thinking and practice remains stuck in a linear planning model which discourages learning and adaptation, in part because projects are seen as ‘closed, controllable and unchanging systems’ (Mosse, 1998: 5). This paper critically engages with this problem and makes clear why and how learning needs to be at the centre of adaptive development programming. It begins by clarifying why and what kind of learning matters for adaptive programming. The paper then turns its focus to how strategies and approaches applied throughout a programme’s conception, design, management and M&E can enable it to continually learn and adapt.
Keywords: IMPORTANT

Building justice and peace from below? Supporting community dispute resolution in Asia - Valters, Craig (Working Politically in Practice Series: Case Study, 2016)

Learning and adaptation: 6 pitfalls to avoid - Valters, Craig (Devex, 2016)

Learning from adaptive programmes - 10 lessons and 10 case studies - Valters, Craig (Overseas Development Institute, 2018)
Internal DFID document from the DevAdapt Programme. Based on another previous document (also internal).

Theories of change in international development: Communication, learning, or accountability? - Valters, Craig (JSRP Paper 17, 2014)

Theories of Change: time for a radical approach to learning in development - Valters, Craig (ODI, 2015)
The Theory of Change approach demands a radical shift towards more and better learning in development thinking and practice, creating a productive and much-needed space for critical reflection.

Learning from Results-Based Management evaluations and reviews - Vähämäki, Janet; Verger, Chantal (Development Co-operation Working Papers, 2019)
What have we learned from implementing results-based management in development co-operation organisations? What progress and benefits can be seen? What are the main challenges and unintended consequences? Are there good practices to address these challenges? To respond to these questions this paper reviews and analyses the findings from various evaluations and reviews of results-based management systems conducted by members of the Development Assistance Committee (DAC), the OECD/DAC Results Community Secretariat and other bodies in the past four years (2015-2018). It also draws on emerging lessons from new methods for managing development co-operation results. This analytical work aims to: identify recent trends in results-based management, explore challenges faced by providers when developing their results approaches and systems, select good practices in responding to these challenges that can be useful for the OECD/DACResults Community, considering new approaches, new technologies and evolving contexts. This body of evidence will inform the development of a core set of generic guiding principles for results-based management in development co-operation.

Matrixing Aid: The Rise and Fall of 'Results Initiatives' in Swedish Development Aid - Vähämäki, Janet (Stockholm Business School, Stockholm University, 2017)

Using Systemic M&E Tools in Feed The Future Uganda: Sensemaker ® - Webinar - USAID Learning Lab (2015)
This webinar is part of a series organized by SEEP's Market Facilitation Initiative (MaFI), USAID's LEO project and the BEAM Exchange as a part of the "Learning with the Toolmakers" webinar series. As part of a new cycle of webinars focusing on inclusive market facilitation tools. In this series, Eric Derks and Leanne Rasmussen will share learning from this five-year, multi-million dollar USAID program, the objective of which is to increase Ugandan farmers’ use of good quality agro-inputs by fostering more inclusive systemic changes in the agro-inputs industry. Using Systemic M&E Tools in Feed The Future Uganda: Sensemaker ® This third webinar in the series, titled “,” will look at how the project team used this tool and method to monitor systemic change. Leanne and Eric will share their experiences with using the tool and give recommendations to other practitioners who are interested in applying it. What is Sensemaker ®? SenseMaker combines an innovative research methodology with patented software to collect and analyze large quantities of narratives in order to understand complex change. It brings together insights from complexity sciences, anthropology, and cognitive science. It uses participants’ narratives to uncover foundational attitudes and norms that inform and influence behavior. This webinar is organized by SEEP's Market Facilitation Initiative (MaFI), USAID's LEO project and the BEAM Exchange as a part of the "Learning with the Toolmakers" webinar series.

Course: Introduction to Collaborating, Learning and Adapting (CLA) in the Program Cycle - USAID LEARN (USAID Learning Lab, 2018)

Acquisition and Assistance Strategy - USAID (USAID, 2018)
The U.S. Agency for International Development (USAID) of tomorrow is one in which the Agency enables partner countries to plan, resource, and manage their own development through strengthened capacity and commitment — this is the essence of the Journey to Self-Reliance. In Fiscal Year (FY) 2018, the Agency obligated over 80 percent of its programmatic funding — a total of $17 billion — through acquisition and assistance (A&A) mechanisms. Partnering and procurement are central to how we do our work. Therefore, we must think holistically about with whom we work and how we work, if we are to achieve our ambitious goals for the USAID of tomorrow. The purpose of this document is to provide a transparent strategy that guides changes to Agency policy and practice for both our staff and implementing partners in how we approach our core A&A work. This strategy, which builds on previous and current reform efforts, outlines the shifts we will make to embrace a self-reliance model for A&A and move concretely toward the goal of ending the need for foreign assistance. GUIDING PRINCIPLES OF PARTNERING AT USAID USAID’s partnering approaches have evolved significantly over time as we have tested new and innovative ways of working. The principles outlined below support the Journey to Self-Reliance by empowering our staff and partners to produce results-driven solutions responsive to partner country needs and priorities — building capacity and commitment based on creative and entrepreneurial approaches that have already begun to develop. The Agency must move beyond our traditional approaches to embrace greater collaboration, co-design, and co-financing to improve upon our models of partnering.

ADS 201 Additional Help- Whole-of-Project Evaluation - USAID (USAID, 2017)

Biodiversity How-To Guide 1: Developing Situation Models in USAID Biodiversity Programming - USAID (USAID, 2016)
The Biodiversity How-To Guide 1: Developing Situation Models in USAID Biodiversity Programming is the first in a series of three guides that provide in-depth guidance on key tools and practices to support design teams as they design and manage biodiversity programs within the Program Cycle and in accordance with the USAID Biodiversity Policy. It focuses on how to develop situation models to map out the biodiversity conservation problem context to be addressed.

Biodiversity How-To Guide 2: Using Results Chains to Depict Theories of Change in USAID Biodiversity Programming - USAID (USAID, 2016)
The Biodiversity How-To Guide 2: Using Results Chains to Depict Theories of Change in USAID Biodiversity Programming is the second in a series of three guides that provide in-depth guidance on key tools and practices to support design teams as they design and manage biodiversity programs within the Program Cycle and in accordance with the USAID Biodiversity Policy. It builds off the situation model guide to help design teams clearly state the expected results and assumptions behind the proposed strategic approaches that make up the program’s theory of change. The situation model provides the foundation to identify necessary results to reduce threats; brainstorm and prioritize strategic approaches; and then develop results chains to clarify assumptions behind selected approaches.

Biodiversity How-To Guide 3: Defining Outcomes & Indicators for Monitoring, Evaluation, and Learning in USAID Biodiversity Programming - USAID (USAID, 2016)
The Biodiversity How-To Guide 3: Defining Outcomes and Indicators for Monitoring, Evaluation, and Learning in USAID Biodiversity Programming is the third in a series of three guides that provide in-depth guidance on key tools and practices to support design teams as they design and manage biodiversity programs within the Program Cycle and in accordance with the USAID Biodiversity Policy. It uses the results chains developed in the second guide and provides help identifying key results for developing outcome statements and indicators, as required by USAID’s Biodiversity Code, updated in the Biodiversity Policy.

Broad Agency Announcement for Locally Led Development Innovation - USAID (USAID, 2019)
This BAA allows USAID Operating Units (OUs) to co-create, co-design, co-invest, and collaborate in the research, development, piloting, testing, and scaling of innovative, practical, and cost-effective interventions to catalyze locally led development. The BAA aligns with a number of Agency priorities and policies, including the Journey to Self-Reliance, resilience, procurement innovation, and expanding and diversifying the partner base - as well as the New Partnerships Initiative and Acquisition and Assistance Strategy. E3/LS has put up the BAA’s first Addendum, "New Directions in Advancing Locally Led Development," which seeks Expressions of Interest on the following: - Engaging the Local Private Sector - Conflict, Post-Conflict, and Non-Permissive Environments - Effective Partnerships - The Changing Role of the Donor - Local Giving, Philanthropy, and Other Private Resources

CLA for More Effective Development Programs (video) - USAID (USAID LearningLab, 2014)
This presentation features USAID/PPL's Stacey Young discussing the history of learning at USAID; how collaborating, learning, and adapting (CLA) can enhance development outcomes, and the role of implementing partners in supporting this vision.

CLA Maturity Tool: Example Spectrum Cards - USAID (2016)

Collaborate Learn Adapt - Case Competition - USAID (USAID Learning Lab, 2015)

Collaborating, Learning and Adapting (CLA) - Maturity Matrix Overview - USAID (ADS 201 Additional Help, 2016)
Collaborating, Learning and Adapting (CLA) involves strategic collaboration, continuous learning, and adaptive management. CLA approaches to development include collaborating intentionally with stakeholders to share knowledge and reduce duplication of effort, learning systematically by drawing on evidence from a variety of sources and taking time to reflect on implementation, and applying learning by adapting intentionally. The purpose of the maturity matrix tool is to help USAID Missions think more deliberately about how to plan for and implement CLA approaches that fit the Mission’s context and needs. Through a set of easy-to-use cards, the CLA maturity matrix offers examples of what CLA looks like at different stages of maturity. USAID staff can use the decks of cards to both assess current practice and plan for the future. The maturity matrix consists of two decks of cards corresponding to the dimensions of CLA: ● CLA in the Program Cycle: By using the matrix cards to guide a conversation, teams can explore how well CLA is incorporated into the planning and implementation processes of the Program Cycle. ● Enabling Conditions: The cards encourage discussion of the conditions that can significantly influence how CLA and the Program Cycle are implemented at a Mission, including operating processes, organizational culture, and resourcing. Within these decks, the matrix covers 16 subcomponents of CLA. Each has one key concept card and five matrix cards that describe the component in practice, along a spectrum ranging from Not Yet Present to Institutionalized.

Collaborating, Learning, and Adapting Framework & Key Concepts - USAID (USAID, 2016)
Although collaborating, learning, and adapting (CLA) are not new to USAID, they often do not happen regularly or systematically and are not intentionally resourced. The CLA framework above identifies components and subcomponents to help you think more deliberately about what approach to CLA might be best tailored to your organizational or project context. The framework recognizes the diversity of what CLA can look like in various organizations and projects while also giving CLA structure, clarity, and coherence across two key dimensions: CLA in the Program Cycle: how CLA is incorporated throughout Program Cycle processes, including strategy, project, and activity design and implementation; and Enabling Conditions: how an organization’s culture, business processes, and resource allocation support CLA integration. Organizations need both integrated CLA practices appropriate for their context and conducive enabling conditions to become stronger learning organizations capable of managing adaptively. The framework stresses the holistic and integrated nature of the various components of CLA to reinforce the principle that CLA is not a separate workstream—it should be integrated into existing processes to strengthen the discipline of development and improve aid effectiveness.

Combating Wildlife Trafficking Case Study Compilation: Capacity Building for Enforcement and Prosecution - USAID (2018)

Developmental Evaluation in Practice: Tips, Tools, and Templates - USAID (USAID, 2017)

Discussion Note: Complexity-Aware Monitoring - USAID (Program Cycle, 2018)
This Discussion Note complements ADS 201 and outlines general principles and promising approaches for monitoring complex aspects of USAID development assistance. Complexity-aware monitoring is a type of complementary monitoring that is useful when results are difficult to predict due to dynamic contexts or unclear cause and-effect relationships. Key principles of the Program Cycle include applying analytic rigor, managing adaptively, and utilizing a range of approaches to achieve results. ADS 201.3.5.5 identifies three types of program monitoring – performance, context, and complementary. All USAID programming incorporates performance monitoring and should include context monitoring. Performance monitoring “is the ongoing and systematic collection of performance indicator data and other quantitative or qualitative information to reveal whether implementation is on track and whether expected results are being achieved.” Context monitoring is “[t]he systematic collection of information about conditions and external factors relevant to the implementation and performance of an operating units (OU’s) strategy, projects, and activities.” As stated in ADS 201.3.5.5, complementary monitoring may be used by missions and Washington OUs to complement performance and context monitoring in situations where results are difficult to predict due to dynamic contexts or unclear cause-andeffect relationships. This Discussion Note provides an explanation of when to use complementary monitoring approaches that are complexity-aware and summarizes the three principles of complexity-aware monitoring.

How-To Note: Conduct a Data Quality Assessment - USAID (2017)

How-To Note: Developing a Project Logic Model (and its Associated Theory of Change) - USAID (Program Cycle, 2017)
This How-To Note describes considerations for developing a project logic model, as well as steps for thinking through a more complete theory of change (TOC). A logic model is a graphic or visual depiction that summarizes key elements of a TOC, and it is often used as a facilitation tool during the design process. There are many types of logic models, including but not limited to logical frameworks (logframes), results chains, results frameworks, and local actor-oriented models, among others. The project logic model and its associated TOC are included in the Project Appraisal Document (PAD) that approves a project design (see ADS 201.3.3.13). While this How-To Note focuses on logic models at the project level, logic models are also used at the strategy level (specifically, results frameworks – see Box 1), and often at the activity level. The concepts and steps presented here are generally applicable to the process of developing logic models and TOCs throughout the Program Cycle.

Knowing When to Adapt - A Decision Tree - USAID (USAID LEARN, 2019)
This job aid will help you determine how best to resolve a challenge/issue in programming. It is intended for use by USAID, partners, and others working in international development.

Knowledge Retention and Transfer (KRT) - Model and Matsurity Matrix - USAID (CLA Toolkit, 2019)
The Maturity Matrix is not a standalone tool. It is one of the three major components of the KRT Model. The Maturity Matrix is meant to be used in conjunction with the KRT Toolkit and Implementation Plan.

Local Systems: a framework for supporting sustained development - USAID (USAID, 2014)

Local Works Guidance - Round 4 - USAID (USAID, 2019)

Managing staff transistions through CLA: preserving institutional memory as staff come and go - USAID (CLA Toolkit, 2019)
This document is relevant for any position or hiring mechanism. While this document does not explicitly address what happens when someone arrives into a newly-created position, which has its own set of challenges, many of the principles, actions, and resources can be applied in that context. Section 1 offers guidance for how to set up and implement systems at Mission/OU or office to ensure that all staff help preserve institutional memory and enable continuity of relationships. This section is for any staff in a Mission/OU working to build systems that improve handovers and knowledge capture and sharing across the Mission or OU. If a Mission or OU is just beginning to develop a system to manage staff transitions, you may want to start by developing a system within an office or team and then expand it out to other offices or to the Mission/OU writ large. Section 2 includes key principles and actions individuals could consider following when arriving or departing a position, regardless of hiring mechanism and position. This includes staff new to the Mission/OU and staff who are currently in the Mission/OU and are moving into a new position. Section 3 provides a select number of resources to help you take a systematic and comprehensive approach to manage staff transitions as effectively and efficiently as possible at the individual or organizational level.

Measuring Efforts to Combat Wildlife Crime - A toolkit for Improving Actiona and Accountability (v.1.3) - USAID (Measuring Impact, 2017)

Program Cycle - Discussion Note: Adaptive Management - USAID (USAID, 2018)
This Discussion Note complements ADS 201.3.1.2 Program Cycle Principles by elaborating on Principle 2: Manage Adaptively through Continuous Learning. This Discussion Note is intended for USAID staff interested in learning about recent and promising practices in adaptive management across the Program Cycle.

Program Cycle - Discussion Note: Designing Monitoring, Evaluation, and Learning Platforms - USAID (USAID, 2018)
This Discussion Note complements ADS 201.3.1.2 Program Cycle Principles by elaborating on Principle 2: Manage Adaptively through Continuous Learning. This Discussion Note is intended for USAID staff interested in learning about recent and promising practices in adaptive management across the Program Cycle.

Program Cycle - Discussion Note: Managing Monitoring, Evaluation, and Learning Platforms - USAID (USAID, 2018)
This Discussion Note complements ADS 201.3.1.2 Program Cycle Principles by elaborating on Principle 2: Manage Adaptively through Continuous Learning. This Discussion Note is intended for USAID staff interested in learning about recent and promising practices in adaptive management across the Program Cycle.

Program Cycle - How-To Note: Strategy-Level Portfolio Review - USAID (USAID PPL, 2017)

Program Cycle Road Map - USAID (2016)

RFI-521-17-000015 - Improving Governance in Haiti Program (IGHI) - USAID (USAID, 2017)

SPACES MERL: Systems and Complexity White Paper - USAID (2016)
The Strategic Program for Analyzing Complexity and Evaluating Systems (SPACES MERL) project is an activity funded by USAID’s Global Development Lab and the Bureau for Policy, Planning and Learning (PPL). This three-year activity aims to bring a variety of tools and methodologies that decision-makers can use (alone or in combination) to provide comprehensive systems analysis. The activity is being implemented from 2015 to 2018 by a consortium of organizations expert in systems and complexity, including the Global Obesity Prevention Center (GOPC) at Johns Hopkins University (Prime), Global Knowledge Initiative (GKI), LINC and ResilientAfrica Network (RAN). This Systems and Complexity White Paper is a collaborative effort of the SPACES MERL team, designed to frame the international development landscape, with particular reference to USAID-funded activities, for application of systems and complexity approaches to design, monitoring and evaluation. Customized to the systems and complexity layperson with in-depth knowledge of international development practice, the objectives of this white paper are three-fold:  Provide an overview of systems and complexity practice, its current state of application and relevance to international development practice;  Establish a taxonomy of systems and complexity tools, highlighting the fit of those offered by SPACES MERL within the wider landscape; and  Review and provide information on application of SPACES MERL tools, their purpose and construction, required data, and their applicability to specific contexts.

Stakeholder Engagement for Biodiversity Conservation Goals: Assessing the Status of the Evidence - USAID (Measuring Impact, 2016)
Learning how to communicate and work with different groups builds constituencies to support conservation aims. An analysis by USAID's research partner the American Museum of Natural History evaluated 148 references, selected through a rigorous systematic review process, to identify key lessons for stakeholder engagement. This briefer describes the analysis, which will soon be published in full.

The 5 Rs Framework in the program cycle - USAID (Program Cycle, 2016)
USAID’s Program Cycle Operational Policy (ADS 201) provides guidance to missions and other operating units on how to implement the Program Cycle. A key principle of the Program Cycle is to “Promote Sustainability through Local Ownership.” The purpose of this Technical Note is to describe the “5Rs Framework”, a practical methodology for supporting sustainability and local ownership in projects and activities through ongoing attention to local actors and local systems. This Note is rooted in USAID’s 2014 Local Systems Framework paper, which establishes that achieving sustained improvement in development results depends on the contributions of multiple and interconnected local actors. That document also states that USAID needs to improve its systems practice if it is to engage local actors and strengthen local systems more effectively and thus realize sustained results more consistently. The 5Rs Framework, also introduced in the Local Systems Framework, is intended as a simple and practical tool to promote good systems practice. The 5Rs Framework highlights five key dimensions of systems: Results, Roles, Relationships, Rules and Resources. Collectively these 5Rs can serve as a lens for assessing local systems and a guide for identifying and monitoring interventions designed to strengthen them. This Technical Note is divided in two parts. The first part provides an introduction to the 5Rs Framework and the systems practice from which it emerges. The second part demonstrates how systems practice can be embedded in the Program Cycle by continuously applying the 5Rs, especially to the design, implementation, and monitoring of USAID projects and their accompanying activities.

USAID ADS 201 - Program Cycle Operational Policy (Update 1/23/2017) - USAID (USAID, 2017)
The Program Cycle is USAID’s operational model for planning, delivering, assessing, and adapting development programming in a given region or country to advance U.S. foreign policy. It encompasses guidance and procedures for: 1) Making strategic decisions at the regional or country level about programmatic areas of focus and associated resources; 2) Designing projects and supportive activities to implement strategic plans; and 3) Learning from performance monitoring, evaluations, and other relevant sources of information to make course corrections as needed and inform future programming.

USAID ADS 201 - Program Cycle Operational Policy (Update 10/29/2018) - USAID (USAID, 2018)

USAID Risk Appetite Statement - USAID (USAID, 2018)

USAID’s Data Quality Standards & Conducting a DQA - USAID (2014)

Webimar - Adaptive Management at the Strategy Level: Portfolio Reviews and Mid Course Stocktaking - USAID (USAID, 2017)
On Wednesday, November 15, 2017 at 8:00 a.m. EST, the Bureau for Policy, Planning and Learning (PPL) held a one-hour webinar exploring Strategy-level Portfolio Reviews and Mid Course Stocktaking.

An Upside Down View of Governance - Unsworth, Sue (Institute of Development Studies, 2010)
Informal institutions and personalised relationships are usually seen as governance problems. However the research presented in this synthesis paper suggests that they can also be part of the solution...

It's the politics! Can donors rise to the challenge? - Unsworth, Sue (A Governance Practitioner’s Notebook: Alternative Ideas and Approaches, 2015)
The Governance Practitioner’s Notebook takes an unusual approach for the OECD-DAC Network on Governance (GovNet). It brings together a collection of specially written notes aimed at those who work as governance practitioners within development agencies. It does so, however, without attempting to offer definitive guidance – instead aiming to stimulate thinking and debate. To aid this process the book is centred on a fictional Governance Adviser. The Notebook’s format provides space for experts to speak on today’s governance issues: politics, public sector reform and stakeholder engagement. It encourages debate, charts the evolution of donor thinking, and highlights future challenges in the age of the Sustainable Development Goals. Each section introduces both technical issues and major areas of debate, providing ideas for future development support to institutional reform.
Keywords: IMPORTANT

Project Cycle Hacker's Toolkit - changing the conversation around your projects - UNDP (UNDP, 2017)
The Istanbul Regional Hub partnered with Nesta and 4 country offices (fYR Macedonia, Moldova, Georgia and Kyrgyzstan) to develop a program that can help us bring innovation closer to the center of the organization by embedding it in the key project management business processes - The Project Cycle Hackers Toolkit.

Scaling Up Development Programmes - UNDP (UNDP, 2013)
Many development organizations, national and local governments and civil society organizations are faced with the issue of scaling up development interventions — the main questions raised time and again are: a) what should be scaled up, and how it can be scaled up; b) is there a strong reason for a particular initiative to be scaled up; and c) what should be the value-added of the scaling up efforts, and how can practitioners ensure that technological and other innovations are being integrated for improved development effectiveness? Answers to these questions depend on a host of complex realities—the relative strengths and weaknesses in national and local systems, political and economic situations, including vulnerability of country systems to shocks, commitments from development partners, power dynamics between various groups and stakeholders in a given country, regional and global environments. For the United Nations Country Teams (UNCT) and UNDP offices, another factor to consider is how to maximize our respective comparative advantages. This guidance note summarizes the main conceptual thinking available from development institutions and academia, and presents a simplified conceptual framework and roadmap for scaling up processes. It also provides UNDP programme staff and UNCTs with practical actions and checklists to consider when designing and implementing programmes that support national scaling up initiatives, and proposes actions that can be undertaken at the regional and global levels. Although intended for internal audiences, the scaling up concept and recommendations can also be used by the public and private sector, civil society and social entrepreneurs. This note benefited from a wide consultative process held in 2011, including practical recommendations and proposals from colleagues at country offices and regional/global centres. Their insights have been instrumental in the distillation of main recommendations presented in this note, and the individuals who provided substantive contributions are gratefully noted in the Acknowledgements section.

Feasibility Study: Crowdsourcing High-frequency food price data in rural Indonesia - UN Global Pulse (2015)

A Practical Guide for Collective Action against Corruption - UN Global Compact (UN Global Compact, 2015)
All anti-corruption professionals looking to better understand the relationship between collective action and corruption should refer to these two comprehensive guides that the UN Global Compact published. The 2015 guide has modules that cover theoretical concepts, practical recommendations for undertaking CA initiatives, and multiple in-depth case studies of CA projects around the world.

A Framework for Freshwater Ecosystem Management - UN Enviornment (2018)

Critical systems heuristics - Ulrich, Werner; Reynolds, Martin (Systems Approaches to Manging Change: A Practical Guide, 2010)
This chapter provides a detailed introduction to critical systems heuristics and the use of its central tool boundary critique. What Is CSH? Two Studies in Applying CSH Using CSH as an Intervention Tool: Some Basic Concepts A Core Concept of CSH: Systematic Boundary Critique Boundary Critique Applied to NRUA-Botswana Boundary Critique Applied to ECOSENSUS-Guyana Boundary Critique and Personal Competence Recognising Boundary Judgements – and Keeping Them Fluid Towards a New Ethos of Professional Responsibility

Werner Ulrich's Homepage - Ulrich, Werne (2018)
This website provides a variety of resources from Werner Ulrich's work in a range of philosophical and research areas with a particular focus on his own work in critical systems thinking and practice or, Critical Systems Heuristics (CSH).

Case study - Lepra - Adaptive programming in “reaching the unreached” - UK Aid Direct (DFID, 2017)

Managing Facilities: a stock-take from the first 12 months - Tyrrel, Lavinia; Teskey, Graham; de Lacy, Jacqui (Governance Working Paper 3, 2017)

Dealing with uncertainty: Reflections on donor preferences for pre-planned project models - Tyrrel, Lavinia; Cole, William (Working Politically in Practice, 2016)
Keywords: IMPORTANT

Getting Past the Rhetoric #1: Tendering for ‘Thinking and Working Politically’ in Large Facilities - Tyrrel, Lavinia (Abt Associates - Governance Soapbox, 2018)

Getting Past the Rhetoric #2: Managing for ‘Thinking and Working Politically’ in Large Facilities - Tyrrel, Lavinia (Abt Associates - Governance Soapbox, 2018)

What's in a name? Unpacking “participatory” environmental monitoring - Turreira-García, Nerea; Lund, Jens; Domínguez, Pablo; Carrillo-Anglés, Elena; Brummer, Mathias; Duenn, Priya; Reyes-García, Victoria (Ecology and Society, 2018)
Turreira-García, N., J. F. Lund, P. Domínguez, E. Carrillo-Anglés, M. C. Brummer, P. Duenn, and V. Reyes-García. 2018. What's in a name? Unpacking “participatory” environmental monitoring. Ecology and Society 23(2):24. https://doi.org/10.5751/ES-10144-230224

What does ‘adaptive programming’ mean in the health sector? - Tulloch, Olivia (ODI, 2015)
• There is considerable interest in the concept of adaptive development and what it may look like in different sectors, including health. • Adaptive types of programming from the health sector are relatively advanced; as we work towards the Sustainable Development Goals (SDGs), experiences in health can provide useful lessons for other areas of development. • The international health community may not use the label ‘adaptive development’, but many are already conducting adaptive work. ‘Quality improvement’ is one such tried and tested approach. • Quality improvement is problem-driven, iterative and flexible. The methodology and principles can be used to identify, test and implement changes in any context or part of a health system. • Quality improvement is being used successfully, but there is still limited experience and evidence of how to apply its values and philosophy beyond the project level and embed it within national structures and systems. • Systems thinking and analysis of the political economy environment may help embed complex interventions like quality improvement and sustain their achievements

Exploring the prospects for adaptive governance in marine transboundary conservation in East Africa - Tuda, Arthur Omondi; Kark, Salit; Newton, Alice (Marine Policy, 2019)
This article explores the prospects for adaptive governance in a proposed marine transboundary conservation initiative in East Africa. Adaptive governance that involves interdependent state and non-state actors learning and taking action on joint environmental problems is suggested for effective transboundary resource governance. Using the concept of adaptive co-management, the current multi-stakeholder marine governance systems in southern Kenya and northern Tanzania are compared to illuminate opportunities and constraints for adaptive marine transboundary conservation governance between Kenya and Tanzania. The concept of networks and the formal method of social network analysis (SNA) are applied as the main methodological device. Using questionnaire and semi-structured interviews, social network data of 70 organizations (local resources users, government agencies and NGOs) was generated from Kenya (n = 33) and Tanzania (n = 37). Results show the existence of strong collaboration networks for marine resource governance in both Kenya and Tanzania. Social proximity is the common driver of network formation. Collaboration networks in Kenya and Tanzania have contributed to enhanced learning among marine resource managers. Conclusions point to the need to focus on common challenges relating to low levels of rule-compliance, limited access to information on the state of resources and poor integration of science into marine management decisions. Finally, differences in views regarding the state of marine ecosystems need to be addressed to improve prospects for joint problem-solving in marine transboundary conservation.
Keywords: Adaptive co-management; Adaptive governance; Collaboration; Marine transboundary conservation; Social network analysis

Monitoring and evaluation of policy influence and advocacy - Tsui, Josephine; Hearn, Simon; Young, John (Working Paper, 2014)
Policy influence and advocacy are increasingly regarded as a means of creating sustainable policy change in international development. It is often also seen as a difficult area to monitor and evaluate. Yet there is an increasingly rich strand of innovation in options to monitor, evaluate and learn from both the successes and failures of policy influence and advocacy interventions. This paper explores current trends in monitoring and evaluating policy influence and advocacy; discusses different theories of how policy influence happens; and presents a number of options to monitor and evaluate different aspects of advocacy interventions. Case studies describe how some organisations have used these options in practice to understand their impact and improve their advocacy strategies.

Monitoring, Evaluation and Learning approaches in an adaptive management context - Tsui, Josephine (Helpdesk Request, 2016)

Micropolitics in collective learning spaces for adaptive decision making - Tschakert, Petra; Das, Partha Jyoti; Shrestha Pradhan, Neera; Machado, Mario; Lamadrid, Armando; Buragohain, Mandira; Hazarika, Masfique Alam (Global Environmental Change, 2016)
Recent advances on power, politics, and pathways in climate change adaptation aim to re-frame decision-making processes from development-as-usual to openings for transformational adaptation. This paper offers empirical insights regarding decision-making politics in the context of collective learning through participatory scenario building and flexible flood management and planning in the Eastern Brahmaputra Basin of Assam, India. By foregrounding intergroup and intragroup power dynamics in such collective learning spaces and how they intersect with existing micropolitics of adaptation on the ground, we examine opportunities for and limitations to challenging entrenched authority and subjectivities. Our results suggest that emancipatory agency can indeed emerge but is likely to be fluid and multifaceted. Community actors who are best positioned to resist higher-level domination may well be imbricated in oppression at home. While participatory co-learning as embraced here might open some spaces for transformation, others close down or remain shut.
Keywords: Co-learning; Flood management; Participatory scenarios; Politics of adaptation; Power

Outcome mapping for health system integration - Tsasis, Peter; Evans, Jenna; Forrest, David; Jones, Richard Keith (Journal of Multidisciplinary Healthcare, 2013)
Health systems around the world are implementing integrated care strategies to improve quality, reduce or maintain costs, and improve the patient experience. Yet few practical tools exist to aid leaders and managers in building the prerequisites to integrated care, namely a shared vision, clear roles and responsibilities, and a common understanding of how the vision will be realized. Outcome mapping may facilitate stakeholder alignment on the vision, roles, and processes of integrated care delivery via participative and focused dialogue among diverse stakeholders on desired outcomes and enabling actions. In this paper, we describe an outcome-mapping exercise we conducted at a Local Health Integration Network in Ontario, Canada, using consensus development conferences. Our preliminary findings suggest that outcome mapping may help stakeholders make sense of a complex system and foster collaborative capital, a resource that can support information sharing, trust, and coordinated change toward integration across organizational and professional boundaries. Drawing from the theoretical perspectives of complex adaptive systems and collaborative capital, we also outline recommendations for future outcome-mapping exercises. In particular, we emphasize the potential for outcome mapping to be used as a tool not only for identifying and linking strategic outcomes and actions, but also for studying the boundaries, gaps, and ties that characterize social networks across the continuum of care.

A Rubric to Evaluate Citizen-Science Programs for Long-Term Ecological Monitoring - Tredick, Catherine A.; Lewison, Rebecca L.; Deutschman, Douglas H.; Hunt, Timothy ANN; Gordon, Karen L.; Von Hendy, Phoenix (BioScience, 2017)
Abstract. Citizen-science (CS) programs provide a cost-effective way to collect monitoring data over large temporal and spatial scales. Despite the recent prol

Integrating farmers’ adaptive knowledge into flood management and adaptation policies in the Vietnamese Mekong Delta: A social learning perspective - Tran, Thong Anh; Rodela, Romina (Global Environmental Change, 2019)
Flood management and adaptation are important elements in sustaining farming production in the Vietnamese Mekong Delta (VMD). While over the past decades hydraulic development introduced by the central government has substantially benefited the rural economy, it has simultaneously caused multiple barriers to rural adaptation. We investigate the relational practices (i.e., learning interactions) taking place within and across the flood management and adaptation boundaries from the perspective of social learning. We explore whether and how adaptive knowledge (i.e., experimental and experiential knowledge) derived from farmers’ everyday adaptation practices contributes to local flood management and adaptation policies in the selected areas. We collected data through nine focus groups with farmers and thirty-three interviews with government officials, environmental scientists, and farmers. Qualitative analysis suggests that such processes are largely shaped by the institutional context where the boundary is embedded. This study found that while the highly bureaucratic operation of flood management creates constraints for feedback, the more informal arrangements set in place at the local level provide flexible platforms conducive to open communication, collaborative learning, and exchange of knowledge among the different actors. This study highlights the pivotal role of shadow systems that provide space for establishing and maintaining informal interactions and relationships between social actors (e.g., interactions between farmers and extension officials) in stimulating and influencing, from the bottom-up, the emergence of adaptive knowledge about flood management and adaptation in a local context.
Keywords: Adaptation; Flood management; Knowledge brokers; Mekong Delta; Shadow systems; Social learning; Vietnamese

Triangulation, Respondent Validation, and Democratic Participation in Mixed Methods Research - Torrance, Harry (Journal of Mixed Methods Research, 2012)
Over the past 10 years or so the “Field” of “Mixed Methods Research” (MMR) has increasingly been exerting itself as something separate, novel, and significant, with some advocates claiming paradigmatic status. Triangulation is an important component of mixed methods designs. Triangulation has its origins in attempts to validate research findings by generating and comparing different sorts of data, and different respondents’ perspectives, on the topic under investigation. Respondent validation has sometimes been included in such processes, but it is an element that has not attracted significant attention from the MMR community. The article argues that attention to respondent validation is a significant issue for methodological debate and that it should be an important aspect of the development of democratic participation in MMR.

Designing Participatory Meetings and Brownbags: A TOPS Quick Guide to Linking Development Practitioners - TOPS (Technical and Operational Performance Support Program, USAID, 2013)
Visit this resource for ideas on designing meetings and brownbags that are engaging and build inopportunities for participant dialogue.

Nairobi Is Organizing- Grassroots Organizing &Public Participation for Social Change - TISA (2015)
The Institute for Social Accountability

Doing adaptive management at Sida - Tim Ruffer; Helen Bailey; Stefan Dahlgren; Patrick Spaven; Mark Winters (Evaluation Brief, 2019)
Lessons from the market systems development approach The evaluation focuses on Sida’s management of MSD projects. The projects are applying the MSD approach with an aim to: - contribute to improved MSD programming by Sida through better management practices across the project cycle - generate recommendations on how Sida can create conducive conditions for systems approaches and adaptive programming more generally. The brief assesses Sida’s organisational capacity for adaptive management in three dimensions: - leadership and culture - staff capacities - skills, and systems and procedures

A flowering of approaches to complexity and development? - Thorpe, Ian (KM on a dollar a day, 2015)
We are an important juncture in development at the moment with the Sustainable Development Goals due to be finalized later this year, and with discussion now turning full swing into what needs to h…

The Operational Guide - for the making markets work for the poor (M4P) approach (Second Edition) - The Springfield Centre (SDC & DFID, 2015)
In 2008, SDC and DFID published three documents aimed at improving the understanding and use of the Making Markets Work for the Poor (M4P) approach: the M4P Synthesis, M4P Perspectives and M4P Operational Guide. Since then the field has grown, diversified and, importantly, learned much more. A second edition was commissioned to capture that learning, maintain the momentum and realise the ambition that development can still 'do better'. The second edition provides an accessible resource to help practitioners put the market systems development approach into practice. It explains the key principles and frameworks which guide effective intervention in – and development of – market systems. It addresses common challenges with examples of good practice based on practitioner experience. Who is it for? The Operational Guide is for people whose job entails trying to make market systems work better for poor women and men. These people include: Individuals currently involved in funding or implementing the approach. Development agencies wishing to incorporate market systems thinking and practice in their work. National stakeholders that wish to play a more strategic and catalytic role within market systems. What is new? Application, application, application! Whilst the key principles and frameworks will be familiar, the advice on their operational application – from start to finish – has been significantly bolstered Enhanced guidance on facilitation. Greater emphasis on what constitutes good facilitation practice, building on a wealth of practitioner experience More real-life examples. The Operational Guide is laced with examples from programmes past and present, working in a diverse array of systems Peer learning focus. Direct insights from practitioners, highlighting 'bumps in the road' and how to avoid them. The Guide aims to provide an accessible operational resource to help practitioners put the market systems development approach into practice. It explains the key principles and frameworks which guide the process of effective intervention in – and development of – market systems, addressing common challenges with examples of good practice based on practitioner experience. HOW SHOULD IT BE USED? The Guide explores, sequentially, the key elements of the implementation process: strategy, diagnosis, vision, intervention, measurement and management. It is not intended to be read from cover to cover; readers can go directly to the chapter most relevant to their needs without having read preceding chapters. However each chapter does build upon the preceding one and may refer to other chapters. THE GUIDE IS STRUCTURED AS FOLLOWS: INTRODUCTION Overview of the objectives, structure and format of the Guide CONTEXT A reminder of what market systems development means 1. STRATEGY Core principles and framework for setting programme strategy 2. DIAGNOSIS Core principles and framework for diagnosing system constraints 3. VISION Core principles and frameworks for defining and planning intervention 4. INTERVENTION Core principles and framework to guide effective intervention 5. MEASUREMENT Core principles and framework for measuring results 6. MANAGEMENT Key considerations in managing market systems development programmes GLOSSARY Definition of key terms used in market systems development

Organisational Performance Index - The Kenya Institute of Management (2014)
The OPI Business Excellence Model exists to help organizations improve their performance and succeed in the competitive global marketplace. We are dedicated to improving African organizations regardless of sector, size or structure. The OPI was developed in response to feedback from organization participating in Company of the Year Award (COYA) and SME of the Year Award (SMOYA), who called on the Kenya Institute of Management (KIM) to refine the assessment methodology in order to emphasize the relationship between instilling smart business processes and generating strong business results. Whilst there are numerous management tools and techniques commonly used, the OPI Excellence Model is a practical, non-prescriptive framework which provides a holistic view of the organisation and it can be used to determine how these different methods fit together and complement each other. The Model can therefore be used in conjunction with any number of these tools, based on the needs and function of the organisation, as an overarching framework for developing sustainable excellence. We also administer the Annual Company of the Year Awards (COYA) and the SME of the Year Awards (SMOYA). Our key services are to identify and recognize role-model organizations, share best management practices, and help organizations achieve best-in-class performance levels. The OPI is an excellence model that generates a rating between 1 and 10, which sets a minimum score that an organisation must attain to remain competitive. The attainment of a minimum Organisation Performance Index ( OPI) demonstrates that organisations have applied an organisational strategy that drives effectiveness and competitiveness; failure to attain the minimum OPI demonstrates the organisation has not engaged the processes required to enable world class organisational performance.

Assessing the use of technological tools and strategies by Oxfam Novib partners in Angola, Burundi, Egypt, Niger, Pakistan, Rwanda and Uganda - The Engine Room (2014)
This report presents findings and insights from the Oxfam Novib pilot module of TechScape, which assessed how Oxfam Novib partners in seven countries related to the use of technology in their work. This report does not aim to draw conclusions about the nature of technology use by Oxfam Novib partners per se, or even the partners included in this assessment. The dramatic difference in organizational activities, contexts and objectives are too great for that. Detailed analysis of how partners are relating to technology in their work, and specific recommendations for greater efficiency and impact are presented in the TechScape Country Briefs. This report aims instead: • to describe the context in which the assessments took place, • to propose insights gained from the cumulative process about measurement, learning and capacity development, and • to identify opportunities for Oxfam Novib to pursue capacity development and knowledge sharing between countries and across the network, through mechanisms that minimize resource demands and directly target documented needs.

Primer: Technology to monitor and share information on rainforests and forest people's rights - The Engine Room (The Engine Room & Rainforest Foundation Norway, 2016)

The fashion for agile management is spreading - The Economist (The Economist, 2018)
Executives need to be a cross between Spider-Man and Simone Biles

Participation in ICT Development Interventions: Who and How? - Thapa, Devinder; Sæbø, Øystein (The Electronic Journal of Information Systems in Developing Countries, 2016)
The aim of participatory development (PD) in the context of using Information and Communication Technologies (ICT) for development (ICT4D) is to empower underprivileged communities and disadvantaged segments of the stakeholders. The literature on ICT4D is replete with empirical evidence showing that ICT interventions often fail since they are often externally initiated, with very limited involvement from the affected (Heeks, 2002). Clearly, the principles and concepts of PD are relevant to ICT4D. However, we should not consider PD a panacea but need to understand the caveats and processes by which PD happens. Questions to ask include: What are the various challenges in PD? Who are the relevant stakeholders? Why and how do actors enrol in the project? How do we create sustainable ICT4D projects through PD? To understand these research questions, we present a case analysis of a project in Nepal called the Nepal Wireless Networking Project (NWNP). Investigating the specific initiatives that they enabled, telemedicine, education and jobs, we propose that the key participants in the NWNP were activist actors and the affected and that activists drew upon existing Social Capital to enrol the affected through a process explained by Actor Network Theory (ANT). In the process, they built other forms of Social Capital, which in turn extended the benefits of PD to several mountain villages.

Towards characterizing the adaptive capacity of farmer-managed irrigation systems: learnings from Nepal - Thapa, Bhuwan; Scott, Christopher; Wester, Philippus; Varady, Robert (Environmental change assessments, 2016)
Small-scale irrigation systems managed by farmers are facing multiple challenges including competing water demand, climatic variability and change, and socioeconomic transformation. Though the relevant institutions for irrigation management have developed coping and adaptation mechanisms, the intensity and frequency of the changes have weakened their institutional adaptive capacity. Using case examples mostly from Nepal, this paper studies the interconnections between seven key dimensions of adaptive capacity: the five capitals (human, financial, natural, social, and physical), governance, and learning. Long-term adaptation requires harnessing the synergies and tradeoffs between generic adaptive capacity that fosters broader development goals and specific adaptive capacity that strengthens climate-risk management. Measuring and addressing the interrelations among the seven adaptive-capacity dimensions aids in strengthening the long term sustainability of farmer-managed irrigation systems.

Thinking and working politically in large, multi-sector Facilities: lessons to date - Teskey, Graham; Tyrrel, Lavinia (Governance Working Paper 2, 2017)

Adaptive management: why we find it so hard to operationalise - Teskey, Graham (Abt Associates - Governance Soapbox, 2018)

Implementing the new development agenda - Wrap up - Teskey, Graham (DDD 4 Conference, 2017)

Thinking and Working Politically – Are We Seeing the Emergence of a Second Orthodoxy? - Teskey, Graham (Governance Working Paper 1, 2017)
There now is a persuasive volume of evidence that demonstrates that capacity and technical knowledge alone are insufficient to change deeply entrenched political interests and bureaucratic norms. These critiques demonstrate that an understanding of power asymmetries is frequently the critical missing ingredient in project design and implementation. Many eminent thinkers have looked at the difference between success and failure in development, and all point to the primacy of domestic politics. This point has not been lost on development agencies and some have tried to provoke greater attention to the role that politics plays. However, this recognition is yet to pass into the mainstream of development practice. Despite the slow but sure accretion of this knowledge the international community seems to be wedded to doing development traditionally. The purpose of this paper is to consider the extent to which a ‘second orthodoxy’ is slowly emerging which can stand alongside, and in some cases may supplant, the ‘first orthodoxy’ of the traditional project framework. Care has to be taken in making this argument, as there is certainly no consensus within the development community on its importance, and even among advocates, there are slightly differing interpretations of what this second orthodoxy looks like. Further, it is not absolutely clear that the two orthodoxies can co-exist. The paper does not call for any ‘paradigm shift’ in how development practitioners conceptualise programs and projects, nor does it demand that the project framework be scrapped; the former would be impossible and the latter undesirable. Equally readers will find no claims that Doing Development Differently or ‘Thinking and Working Politically’ will always and everywhere guarantee better development outcomes. Rather, the paper seeks to summarise how the two orthodoxies differ, where the second orthodoxy now stands, and propose how it can be taken forward in practical terms.

2015 Rhode Island Wildlife Action Plan - Chapter 5 Monitoring and Adaptive Management - Terwilliger Consulting (State of Rhode Island, 2015)

Measuring Results & the DCED Standard - Tanburn, Jim (DCED Webinar, 2014)
This page gives an introduction to the DCED Standard, which is a framework that helps practitioners to measure results in Private Sector Development (PSD).

Evaluating Community Impact: Capturing and Making Sense of Community Outcomes - Tamarack Institute (2017)

Developmental Evaluation - Tamarack Community (2012)
This webpage from Tamarack Community provides links to audio files of an interview between Mark Cabaj and Michael Patton in which they discuss the topic of development evaluation. This is an "approach that has proven particularly useful and effective at addressing the unique challenges of evaluating the real nature of community change work. Learning Objectives: To deepen appreciation for the role of evaluation and evaluation thinking To explore the distinctions between various types of evaluation To understand more about developmental evaluation and its use To investigate concepts, tools and resources available to support working with developmental evaluation methods" (Tamarack Community)

Beyond Ballotocracy: Citizens' Voices and the Many Faces of Unruly Politics - Tadros, Mariz (IDS Bulletin, 2014)

Black Box Thinking: The Surprising Truth About Success - Syed, Matthew (Hachette UK, 2015)
The Sunday Times No.1 Bestseller From the Bestselling Author of BounceWhat links the Mercedes Formula One team with Google?What links Team Sky and the aviation industry?What connects James Dyson and David Beckham?They are all Black Box Thinkers.Black Box Thinking is a new approach to high performance, a means of finding an edge in a complex and fast-changing world. It is not just about sport, but has powerful implications for business and politics, as well as for parents and students. In other words, all of us.Drawing on a dizzying array of case studies and real-world examples, together with cutting-edge research on marginal gains, creativity and grit, Matthew Syed tells the inside story of how success really happens - and how we cannot grow unless we are prepared to learn from our mistakes.
Keywords: Psychology; Sports & Recreation / Sports Psychology; Strategic Planning

Tips on Learning from Context: Formal and Informal Approaches to Understanding the Local Political Economy - Swift, Sarah (USAID, 2018)
Successfully adapting your programmatic efforts and policy engagement to the context depends on maintaining your understanding of that context. Given this, continuous learning and feedback loops--not only about your programming, but also about the environment you are working within--are important components of USAID’s work. Since our environments are always changing, in ways big and small, this can be intimidating. One can imagine a scenario where learning consumes the limited time and budgets available, especially for small programs. The question becomes: How can we learn enough, at the right times, to limit missed opportunities and warning signs, while avoiding being consumed by data collection and analysis that never influences our work? This document capitalizes on the experiences of USAID staff as well as emerging learning from other donors and researchers to highlight a range of approaches--formal and informal, time-bound and continuous--that can support ongoing learning within the operational tempo of a busy Mission team or Operating Unit.

Portfolios of Agile Projects: A Complex Adaptive Systems’ Agent Perspective - Sweetman, Roger; Conboy, Kieran (Project Management Journal, 2018)
While agile approaches can be extremely effective at a project level, they can impose significant complexity and a need for adaptiveness at the project portfolio level. While this has proven to be highly problematic, there is little research on how to manage a set of agile projects at the project portfolio level. What limited research that does exist often assumes that portfolio-level agility can be achieved by simply scaling project level agile approaches such as Scrum. This study uses a complex adaptive systems lens, focusing specifically on the properties of projects as agents in a complex adaptive portfolio to critically appraise current thinking on portfolio management in an agile context. We then draw on a set of 30 expert interviews to develop 16 complex adaptive systems (CAS)-based propositions as to how portfolios of agile projects can be managed effectively. We also outline an agenda for future research and discuss the differences between a CAS-based approach to portfolio management and traditional approaches.

Integrating Food Security and Wild Caught Fisheries Management in USAID Programming. Illustrative situation Model and Results Chain - Swaminathan, Vinaya; Best, Barbara; Ajroud, Brittany (Measuring Impact, 2018)
Integrating Food Security and Wild Caught Fisheries Management in USAID Programming is an illustrative case example that demonstrates how two adaptive management programming tools—situation models and results chains—can help USAID staff and its partners to better design and implement activities that integrate food security, nutrition, and sustainable management of wild fisheries.

Scrum: The Art of Doing Twice the Work in Half the Time - Sutherland, Jeff (Crown Business, 2014)
We live in a world that is broken. For those who believe that there must be a more agile and efficient way for people to get things done, here from Scrum pioneer Jeff Sutherland is a brilliantly discursive, thought-provoking book about the leadership and management process that is changing the way we live. In the future, historians may look back on human progress and draw a sharp line designating "before Scrum" and "after Scrum." Scrum is that ground-breaking. It already drives most of the world's top technology companies. And now it's starting to spread to every domain where leaders wrestle with complex projects. If you've ever been startled by how fast the world is changing, Scrum is one of the reasons why. Productivity gains of as much as 1200% have been recorded, and there's no more lucid - or compelling - explainer of Scrum and its bright promise than Jeff Sutherland, the man who put together the first Scrum team more than twenty years ago. The thorny problem Jeff began tackling back then boils down to this: people are spectacularly bad at doing things with agility and efficiency. Best laid plans go up in smoke. Teams often work at cross purposes to each other. And when the pressure rises, unhappiness soars. Drawing on his experience as a West Point-educated fighter pilot, biometrics expert, early innovator of ATM technology, and V.P. of engineering or CTO at eleven different technology companies, Jeff began challenging those dysfunctional realities, looking for solutions that would have global impact. In this book you'll journey to Scrum's front lines where Jeff's system of deep accountability, team interaction, and constant iterative improvement is, among other feats, bringing the FBI into the 21st century, perfecting the design of an affordable 140 mile per hour/100 mile per gallon car, helping NPR report fast-moving action in the Middle East, changing the way pharmacists interact with patients, reducing poverty in the Third World, and even helping people plan their weddings and accomplish weekend chores. Woven with insights from martial arts, judicial decision making, advanced aerial combat, robotics, and many other disciplines, Scrum is consistently riveting. But the most important reason to read this book is that it may just help you achieve what others consider unachievable - whether it be inventing a trailblazing technology, devising a new system of education, pioneering a way to feed the hungry, or, closer to home, a building a foundation for your family to thrive and prosper.

Learning for social-ecological change: a qualitative review of outcomes across empirical literature in natural resource management - Suškevičs, Monika; Hahn, Thomas; Rodela, Romina; Macura, Biljana; Pahl-Wostl, Claudia (Journal of Environmental Planning and Management, 2018)

Process and Contextual Factors Supporting Action-Oriented Learning: A Thematic Synthesis of Empirical Literature in Natural Resource Management - Suškevičs, Monika; Hahn, Thomas; Rodela, Romina (Society & Natural Resources, 2019)
Despite a long-term focus on learning in natural resource management (NRM), it is still debated how learning supports sustainable real-world NRM practices. We offer a qualitative in-depth synthesis of selected scientific empirical literature (N = 53), which explores factors affecting action-oriented learning. We inductively identify eight key process-based and contextual factors discussed in this literature. Three patterns emerge from our results. First, the literature discusses both facilitated participation and self-organized collaboration as dialogical spaces, which bridge interests and support constructive conflict management. Second, the literature suggests practice-based dialogs as those best able to facilitate action and puts a strong emphasis on experimentation. Finally, not emphasized in existing reviews and syntheses, we found multiple evidence about certain contextual factors affecting learning, including social-ecological crises, complexity, and power structures. Our review also points at important knowledge gaps, which can be used to advance the current research agenda about learning and NRM.
Keywords: Ecosystem governance; Social learning; intermediaries; social-ecological systems; structural constraints

Systems Thinking For Social Change: A Practical Guide to Solving Complex Problems, Avoiding Unintended Consequences, and Achieving Lasting Results - Stroh, David Peter (Chelsea Green Publishing, 2015)
Donors, leaders of nonprofits, and public policy makers usually have the best of intentions to serve society and improve social conditions. But often their solutions fall far short of what they want to accomplish and what is truly needed. Moreover, the answers they propose and fund often produce the opposite of what they want over time. We end up with temporary shelters that increase homelessness, drug busts that increase drug-related crime, or food aid that increases starvation. How do these unintended consequences come about and how can we avoid them? By applying conventional thinking to complex social problems, we often perpetuate the very problems we try so hard to solve, but it is possible to think differently, and get different results. Systems Thinking for Social Change enables readers to contribute more effectively to society by helping them understand what systems thinking is and why it is so important in their work. It also gives concrete guidance on how to incorporate systems thinking in problem solving, decision making, and strategic planning without becoming a technical expert. Systems thinking leader David Stroh walks readers through techniques he has used to help people improve their efforts to end homelessness, improve public health, strengthen education, design a system for early childhood development, protect child welfare, develop rural economies, facilitate the reentry of formerly incarcerated people into society, resolve identity-based conflicts, and more.  The result is a highly readable, effective guide to understanding systems and using that knowledge to get the results you want.

Theory of Action: Creating Craddle to Career Proof Points - Strive Together (Strive Together, 2014)
StriveTogether’s Theory of Action provides a framework for improving educational outcomes and ensuring a community transforms how it serves children.

FOCEVAL – Promoting Evaluation Capacities in Costa Rica:: Smart(er) Implementation with Capacity WORKS? - Storm, Sabrina (Transformation, Politics and Implementation, 2017)
The National Monitoring and Evaluation System of Costa Rica and its corresponding laws were established during the 1990s. Since then, the country has endeavored to implement monitoring and evaluation (M&E) activities as part of its public policy framework. Nevertheless, hardly any systematic evaluations had been conducted, and monitoring activities had been reduced mainly to the institutional self-reporting of implementation compliance. Persisting regional disparities and growing levels of inequality among the population raised the level of pressure on the government to present reliable information on the effectiveness of public interventions. Hence, results-oriented evaluations were promoted by some Costa Rican departments as

Behind the scenes: International NGOs’ influence on reproductive health policy in Malawi and South Sudan - Storeng, Katerini T.; Palmer, Jennifer; Daire, Judith; Kloster, Maren O. (Global Public Health, 2019)
Global health donors increasingly embrace international nongovernmental organisations (INGOs) as partners, often relying on them to conduct political advocacy in recipient countries, especially in controversial policy domains like reproductive health. Although INGOs are the primary recipients of donor funding, they are expected to work through national affiliates or counterparts to enable ‘locally-led’ change. Using prospective policy analysis and ethnographic evidence, this paper examines how donor-funded INGOs have influenced the restrictive policy environments for safe abortion and family planning in South Sudan and Malawi. While external actors themselves emphasise the technical nature of their involvement, the paper analyses them as instrumental political actors who strategically broker alliances and resources to shape policy, often working ‘behind the scenes’ to manage the challenging circumstances they operate under. Consequently, their agency and power are hidden through various practices of effacement or concealment. These practices may be necessary to rationalise the tensions inherent in delivering a global programme with the goal of inducing locally-led change in a highly controversial policy domain, but they also risk inciting suspicion and foreign-national tensions.

Walking the Long Road Together - Stilger, Bob (Afternow: When We Cannot See the Future Where Do We Begin?, 2017)
On March 11, 2011, overwhelming and incomprehensible disaster struck the northeast coast of Japan. Life for those in the region would never be the same. This book is about the awakening that follows disaster. About the minutes and months and years that come after now. It is about what happens when we're smacked on the side of the head and open our eyes, startled out of the trance in which we have been living our days. It is about the opportunities always present, often invisible, to create the lives we want, now. AfterNow chronicles the author's journey with the Japanese people over 6 years -- his own story of awakening after plunging into this disaster and the stories from people who found where to take their first step, and the next. It offers the tools and processes and worldview people discovered to create what comes after now. It is built around two big ideas. The first is that after disaster, we find our way forward, together. We come awake, together. Disaster obliterates the past, plunges the present into chaos and cocoons the future. We need each other to see and build the new. The second idea is that we don't have to wait for the tragedy of disaster to make the communities and lives we want. We can engage each other with respect, curiosity and generosity and begin to co-create what we want, now. We live in a period of precipitous, unpredictable change. The book is for those who want to make this time more livable and less insane. In Japan and all over the world, we are living in the messy middle where old forms are falling apart and new possibilities are in early stages. The ground is pulled out from under us on a regular basis. Our work right now is to learn to coexist with the messiness. We need to keep trying things, to keep learning. We need to remain focused on our purpose and follow the braided strand of intention and surrender as we find our way forward. embracing radical uncertainty, showing up as fully as we can each moment, each breath.

An introduction to multi-stakeholder partnerships - Stibbe, Darian; Prescott, Dave (The Partnering Initiative, 2016)
This briefing document for the GPEDC High Level Meeting in November 2016 offers a definition of multi-stakeholder partnerships (MSPs) and shows how they are being used, where they have come from, and what the different sectors bring to the table. It provides an overview of the challenges the present, what they require from individuals and organisations, and how they get started. The report was written with the support of the PEP Initiative, and funded by the Netherlands Ministry of Foreign Affairs.

A Critique of the Claims About Mobile Phones and Kerala Fisherman. The Importance of the Context of Complex Social Systems - Steyn, Jacques (The Electronic Journal of Information Systems in Developing Countries, 2016)
This paper challenges some fundamental aspects of research and conclusions relating to the use of technology for community development. Views of technology, in this case the mobile phone, as a tool for increased economic welfare are often skewed due to extreme reductionism, ambiguous interview questions and poor data sources. Research of complex social systems or sub-systems give the wrong answers when reductionist methodologies are used. To demonstrate such shortcomings, the 2007 paper of Robert Jensen serves as an example. His conclusion that mobile phones enable Kerala fishermen to increase their economic welfare is the most cited paper on ICT4D topics, but there are fundamental methodological and logical problems with the claim, while other research came to contradictory conclusions. This critique is presented on many levels: ideological, paradigmatic, methodology, logical, statistical and semantic.

Using Information on Results in Program Management – The case of Samarth-NMDP in Nepal - Stewart, Tim; Joshi, Sanju; Miehlbradt, Alexandra (The Donor Committee for Enterprise Development, 2015)
Keywords: Case Report

The direction of evolution: The rise of cooperative organization - Stewart, John E. (Biosystems, 2014)
Two great trends are evident in the evolution of life on Earth: towards increasing diversification and towards increasing integration. Diversification has spread living processes across the planet, progressively increasing the range of environments and free energy sources exploited by life. Integration has proceeded through a stepwise process in which living entities at one level are integrated into cooperative groups that become larger-scale entities at the next level, and so on, producing cooperative organizations of increasing scale (for example, cooperative groups of simple cells gave rise to the more complex eukaryote cells, groups of these gave rise to multi-cellular organisms, and cooperative groups of these organisms produced animal societies). The trend towards increasing integration has continued during human evolution with the progressive increase in the scale of human groups and societies. The trends towards increasing diversification and integration are both driven by selection. An understanding of the trajectory and causal drivers of the trends suggests that they are likely to culminate in the emergence of a global entity. This entity would emerge from the integration of the living processes, matter, energy and technology of the planet into a global cooperative organization. Such an integration of the results of previous diversifications would enable the global entity to exploit the widest possible range of resources across the varied circumstances of the planet. This paper demonstrates that it's case for directionality meets the tests and criticisms that have proven fatal to previous claims for directionality in evolution.
Keywords: Direction of evolution; Evolution of a global entity; Evolution of cooperation; Evolutionary progress; Major evolutionary transitions

Broadening the range of designs and methods for impact evaluations - Stern, Elliot; Stame, Nicoletta; Mayne, John; Forss, Kim; Davies, Rick; Befani, Barbara (DFID, 2012)

Innovation, Sustainability, Development: A New Manifesto - STEPS Centre (STEPS Centre, 2010)
Our Manifesto project publication is available in print, on CD or to view online. Innovation, Sustainability, Development: A New Manifesto recommends new ways of linking science and innovation to development for a more sustainable, equitable and resilient future. The multimedia version, with added audio, video and background documents, is available on CD and online.

Prioritizing and Selecting Strategic Approaches in USAID Biodiversity Programming - Stem, Caroline; Swaminathan, Vinaya; Flores, Marco (Measuring Impact, 2018)
This guide supplements Biodiversity How-To Guide 2: Using Results Chains to Depict Theories of Change in USAID Biodiversity Programming. Step 4, Brainstorming Strategic Approaches, involves generating a suite of potential strategic approaches for a design team to consider. Step 5 introduces the practice of prioritizing and selecting among these draft strategic approaches but does not provide in-depth guidance on the process and criteria for doing so.

Virtuous cycles of learning: Using formative, embedded, and diagnostic developmental assessments in a large-scale leadership program - Stein, Z.; Dawson, Theo; Van Rossum, Zachary; Rothaizer, Joel; Hill, S. (Journal of Integral Theory and Practice, 2014)
This article presents preliminary results from a series of ongoing action-research projects involving the use of embedded diagnostic developmental assessments (called LectaTests™) in leadership education contexts. These findings are presented to support a particular metatheoretical approach to learning and education in which embedded assessments form a crucial part of ongoing virtuous cycles of action, feedback, support, and learning. We present two types of evidence. First, we compare developmental growth across eight program evaluations in which LectaTests were and were not embedded. Second, we examine how embedding LectaTests in a large-scale leadership development program affected the growth of managers and their direct reports. We review these findings with an eye toward detecting the benefits of using developmental assessment as embedded diagnostics alongside their use as research instruments. We begin by using Integral Theory to structure a discussion about the ideal function of developmental assessments in educational contexts.

Understanding ‘theory of change’ in international development: A review of existing knowledge - Stein, Danielle; Valters, Craig (LSE, 2012)
This is a review by Danielle Stein and Craig Valters of the concepts and debates within ‘Theory of Change’ (ToC) material, resulting from a search and detailed analysis of available donor, agency and expert guidance documents. The review was undertaken as part of a Justice and Security Research Program (JSRP) and The Asia Foundation (TAF) collaborative project, and focuses on the field of international development.

Appreciative Inquiry: Organization Development and the Strengths Revolution - Stavros, Jacqueline M.; Godwin, Lindsey N.; Cooperrider, David L. (Practicing Organization Development, 2015)
A ppreciative Inquiry (AI) is a theory and practice of inquiry-and-changethat shifts the perspective of organization development (OD) methodsby suggesting that the very act of asking generative questions has pro-found impact in organizational systems. Inquiry and change are not separatemoments. Our questions focus our attention on what is “there” to be noticed.Reflecting its social constructionist roots (Cooperrider, Barrett, and Srivastva1995; Gergen 1995), which suggest that words create worlds, AI offers a newchange imperative by suggesting that we be aware of the negativity bias thatpervades our investigations into organizational life and instead shift our focusto the good, the better, and the possibilities that often go undernoticed in oursystems. Building on Gergen (1995) and Cooperrider and Avital (2003), Cooper-rider and Godwin (2012) summarize, “AI posits that human systems move in thedirection of the questions they most frequently and authentically ask; knowl-edge and organizational destiny are intimately interwoven; what we know andhow we study it has a direct impact on where we end up” (740).Leveraging the power of generative questions, AI changes the focus of whatwe typically study in organizational life, questioning the prevailing mindset that“organizations are problems to be solved,” (Cooperrider and Srivastva 1987).Instead, AI suggests that “organizations are mysteries and miracles of humanrelatedness; they are living systems, alive and embedded in ever-wideningwebs of infinite strength and limitless human imagination. Organizations, ascenters of human connectivity and collaboration, are ‘universes of strengths,’” (Cooperrider and Godwin 2010, 10). AI invites change agents to look intotheir organizations with “appreciative eyes”—scanning the system for thingsfor which to be grateful, seeking out what is next and what is possible, andfocusing on valuing those things of value worth valuing. AI theorists posit thatsuch a shift in our approach to organizational change is needed if we are toinspire our imaginative capacities to their fullest potential.

Why Greatness Cannot Be Planned: The Myth of the Objective - Stanley, Kenneth O.; Lehman, Joel (Springer, 2015)
Why does modern life revolve around objectives? From how science is funded, to improving how children are educated -- and nearly everything in-between -- our society has become obsessed with a seductive illusion: that greatness results from doggedly measuring improvement in the relentless pursuit of an ambitious goal. In Why Greatness Cannot Be Planned, Stanley and Lehman begin with a surprising scientific discovery in artificial intelligence that leads ultimately to the conclusion that the objective obsession has gone too far. They make the case that great achievement can't be bottled up into mechanical metrics; that innovation is not driven by narrowly focused heroic effort; and that we would be wiser (and the outcomes better) if instead we whole-heartedly embraced serendipitous discovery and playful creativity.Controversial at its heart, yet refreshingly provocative, this book challenges readers to consider life without a destination and discovery without a compass.

Chaos Report 2015 - Standish Group (Standish Group, 2015)

Participation as assemblage: Introducing assemblage as a framework for analysing participatory processes and outcomes - Stage, Carsten; Ingerslev, Karen (Conjunctions. Transdisciplinary Journal of Cultural Participation, 2016)
The article presents a yet unexplored framework for analysing the multidimensionality and dis/connections of participatory processes and their outcomes by using the concept of the ‘assemblage’ (DeLanda, 2006). The case is an eight-month collaboration between a task force initiated by Central Denmark Region, the socio-economic company Sager der Samler, and citizens. The collaboration is aimed at bringing together and working across various institutional and user perspectives to act on a societal challenge. The analysis is theoretically based on a review of existing theories of participation and typologies for analysing and evaluating participation. In particu- lar, the analysis focuses on the assemblage approach as a way of acknowledging the institutional, affective, mate- rial and power-related complexity of participatory processes. The assemblage approach helps to analytically stress that the process under investigation should be evaluated both with a more traditional focus on decision-making or power allocation, as well as taking into account the social, personal-affective and material benefits produced, and the potential for change in the relationship between public administration and citizens.

Agile distributed software development in nine Central European teams: challenges, benefits and recommendations - Stadler, Manuel; Vallon, Raoul; Pazderka, Martin; Grechenig, Thomas (Information Technology, 2019)

Starting out on Social Return on Investment - SROI Network; Aitken, Hall (2014)
This guide, created by the SROI Network in collaboration with Hall Aitken, is aimed at providing guidance to those who have never used SROI on where to begin. The guide provides practical steps to beginning the process of SROI and includes links to tools aimed at supporting its implementation. Excerpt "Most public, private and third sector organisations have a pretty good idea of the costs of what they do. Annual accounts, management accounts, budget reports and a whole accountancy profession add up to a great deal of effort to make sure this is the case. Some organisations are quite good at counting what they do with these resources. They can track the number of users or contacts, or customers. Many can provide some evidence that these activities lead to some sort of change. But very few can explain clearly why all this matters. What would happen if they did not exist? What is the real value of what they do? Social Return on Investment sets out to redress the balance by looking at value not just cost." Contents Part one – why, what and how? Why does social value matter? What is SROI? How do I do SROI? Next steps Part two – progress tool Part three – practical next steps Steps to involve stakeholders Steps to understand what changes Steps to value the things that matter Steps to only include what is material Steps to avoid overclaiming Steps to be transparent Steps to verify the result

SROI Self-assessment tool - SROI Network (2016)
The online self assessment tool was created by the SROI Network in collaboration with Hall Aitken to help users judge how well their evaluation practices adhere to principles of best practice. The tool is comprised of a seven stage questionnaire, showing results as a spider chart illustrating areas of strength and areas for improvement. The questionnaire itself is structured around the seven principles of SROI. These principles include ‘involve stakeholders’, ‘be transparent’ and ‘do not overclaim’, and together make up the core framework around which SROI is based. Users receive a score for each principle, and an overall average, giving them an idea of to what extent they have successfully applied the principles. High scoring users can then use their score to guide them towards applying for assurance and accreditation. The tool provides guidance, support and more advice to people who want to improve the way in which their organisation measures their social value and assesses their service delivery but don’t know where to start.

Applying Systems Thinking via Systemigrams™ for Defining the Body of Knowledge and Curriculum to Advance Systems Engineering (BKCASE) Project - Squires, Alice; Pyster, Art; Sauser, Brian; Olwell, David; Enck, Stephanie; Gelosh, Don; Anthony, Jim (INCOSE International Symposium, 2010)
Systems thinking is commonly accepted as the backbone of a successful systems engineering approach. As such, the Body of Knowledge and Curriculum to Advance Systems Engineering (BKCASE) team chose to leverage a systems thinking based tool, called Systemitool, to describe our project to the vast audience that would potentially become involved directly or indirectly in the success of the project. This paper describes the process and steps used by the authors and the BKCASE team to develop the project's systemic diagram, or Systemigram™, and the story behind the project, the products, and the vision of the BKCASE project. The goal of the paper is to provide guidance so that readers can leverage the lessons learned from this effort to successfully develop their own project definitions and stories.

Thoughts on the use of hypotheses in adaptive management - Sparkman, Timothy (BEAM Exchange, 2015)
New insights, opinions and perspectives on market systems development, from experts and practitioners.