Politically informed, gender aware programming: Five lessons from practice - Derbyshire, Helen; Gibson, Sam; Hudson, David; Roche, Chris (DLP Program, 2018)

Politically smart approaches to donor investment climate programming. A Guidance Note - LASER (DFID-LASER Programme, 2016)
In order to help enhance the effectiveness of donors and development practitioners on the ground, LASER has produced a range of practical guidance and tools. These are primarily intended for the international development community engaged in designing and implementing investment climate programmes, though can also be used more widely by other stakeholders across sectors. General guidance and tools: Politically smart approaches to donor investment climate programming (and annexes) Revised February 2016 - sets out practical advice on how to adopt a politically smart (which requires being both ‘politically informed’ and ‘politically astute’) approach to programming. The annexes include a traffic light matrix for initial high level analysis; a problem diary template with examples; and an example of a flexible theory of change for adaptive, large scale programming
Keywords: Practice

Politically smart, locally led development - Booth, David; Unsworth, Sue (ODI, 2014)
Aid donors have found it hard to move from thinking politically to working differently, but there is evidence that they can do so and that this improves outcomes. This paper presents seven examples of where adopting a politically smart, locally led approach has led to better outcomes.
Keywords: Practice

Politically smart support to economic development: DFID experiences - Booth, David (ODI, 2016)

Politics matters, so what? Time for bigger bets (and more learning) on adaptive programming - Alan (www.globalintegrity.org, 2016)
By Alan Hudson, Executive Director, Global Integrity, July 26, 2016 Politics matters. Context too. And blueprints have limited value. Our strategy is based on these insights, so we’re totally on board. A World Development Report (WDR) that puts power and politics...

Politics, Political Change and International Development - Halloran, Brendan (Politics, Governance and Development, 2013)
As my inaugural post on my new blog, I thought I would re-post a short piece I wrote earlier this year about foreign aid (original here). Thomas Carothers and Diane de Garamont address this issue i…

Polycentric Systems of Governance: A Theoretical Model for the Commons - Carlisle, Keith; Gruby, Rebecca L. (Policy Studies Journal, 2019)
Polycentricity is a fundamental concept in commons scholarship that connotes a complex form of governance with multiple centers of semiautonomous decision making. If the decision-making centers take each other into account in competitive and cooperative relationships and have recourse to conflict resolution mechanisms, they may be regarded as a polycentric governance system. In the context of natural resource governance, commons scholars have ascribed a number of advantages to polycentric governance systems, most notably enhanced adaptive capacity, provision of good institutional fit for natural resource systems, and mitigation of risk on account of redundant governance actors and institutions. Despite the popularity of the concept, systematic development of polycentricity, including its posited advantages, is lacking in the commons literature. To build greater clarity and specificity around the concept, we develop a theoretical model of a polycentric governance system with a focus on the features necessary or conducive for achieving the functioning predicted by commons scholars. The model is comprised of attributes, which constitute the definitional elements, and enabling conditions, which specify additional institutional features for achieving functionality in the commons. The model we propose takes the concept a step further toward specificity without sacrificing the generality necessary for contextual application and further development.
_eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1111/psj.12212

Portfolios of Agile Projects: A Complex Adaptive Systems’ Agent Perspective - Sweetman, Roger; Conboy, Kieran (Project Management Journal, 2018)
While agile approaches can be extremely effective at a project level, they can impose significant complexity and a need for adaptiveness at the project portfolio level. While this has proven to be highly problematic, there is little research on how to manage a set of agile projects at the project portfolio level. What limited research that does exist often assumes that portfolio-level agility can be achieved by simply scaling project level agile approaches such as Scrum. This study uses a complex adaptive systems lens, focusing specifically on the properties of projects as agents in a complex adaptive portfolio to critically appraise current thinking on portfolio management in an agile context. We then draw on a set of 30 expert interviews to develop 16 complex adaptive systems (CAS)-based propositions as to how portfolios of agile projects can be managed effectively. We also outline an agenda for future research and discuss the differences between a CAS-based approach to portfolio management and traditional approaches.

Positive deviance, big data, and development: A systematic literature review - Albanna, Basma; Heeks, Richard (The Electronic Journal of Information Systems in Developing Countries, 2019)
Positive deviance is a growing approach in international development that identifies those within a population who are outperforming their peers in some way, eg, children in low-income families who are well nourished when those around them are not. Analysing and then disseminating the behaviours and other factors underpinning positive deviance are demonstrably effective in delivering development results. However, positive deviance faces a number of challenges that are restricting its diffusion. In this paper, using a systematic literature review, we analyse the current state of positive deviance and the potential for big data to address the challenges facing positive deviance. From this, we evaluate the promise of “big data-based positive deviance”: This would analyse typical sources of big data in developing countries—mobile phone records, social media, remote sensing data, etc—to identify both positive deviants and the factors underpinning their superior performance. While big data cannot solve all the challenges facing positive deviance as a development tool, they could reduce time, cost, and effort; identify positive deviants in new or better ways; and enable positive deviance to break out of its current preoccupation with public health into domains such as agriculture, education, and urban planning. In turn, positive deviance could provide a new and systematic basis for extracting real-world development impacts from big data.
_eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/isd2.12063
Keywords: big data; developing countries; machine learning; mobile data; positive deviance; systematic literature review

Positive Deviance Initiative (2016)

Positive Deviance Initiative - Positive Deviance Initiative (2018)

Positive Deviant - Dorsey, David (Fast Company, 2000)
Jerry Sternin’s job was to help save starving children in Vietnam. Faced with an impossible time frame, he adopted a radical approach to making change. His idea: Real change begins from the inside.

Poverty Stoplight - povertystoplight.org (2018)
What is the Poverty Stoplight? The Stoplight is a tool that seeks to activate the potential of families and communities to lift themselves out of poverty. Using a technology platform, it offers a self-assessment survey and intervention model that enables people to develop practical solutions to overcome their specific needs. We work with organizations from different sectors around the world and bring together a network of powerful actors with one clear mission: eliminate poverty worldwide. The Stoplight Community is comprised of government agencies, private companies, small and medium-sized enterprises, non-profits, cooperatives, microfinance organizations, academic institutions, and sports clubs, among others.

Poverty Unperceived: Traps, Biases and Agenda - Chambers, Robert (IDS, 2006)

Power Above and Below the Waterline: Bridging Political Economy and Power Analysis - Pettit, Jethro; Mejía Acosta, Andrés (IDS Bulletin, 2014)

Power Analysis: A Practical Guide - Pettit, Jethro (Sida, 2013)

Power, Empowerment and Social Change - McGee, Rosemary; Pettit, Jethro (2019)
This book uncovers how power operates around the world, and how it can be resisted or transformed through empowered collective action and social leadership. The stakes have never been higher. Recent years have seen a rapid escalation of inequalities, the rise of new global powers and corporate interests, increasing impunity of human rights violations, suppression of civil society, and a re-shaping of democratic processes by post-truth, populist and nationalist politics. Rather than looking at power through the lenses of agency or structure alone, this book views power and empowerment as complex and multidimensional societal processes, defined by pervasive social norms, conditions, constraints and opportunities. Bridging theory and practice, the book explores real-world applications using a selection of frameworks, tools, case studies, examples, resources and reflections from experience to support actors to analyse their positioning and align themselves with progressive social forces. Compiled with social change practitioners, students and scholars in mind, Power, Empowerment and Social Change is the perfect volume for anyone involved in politics, international development, sociology, human rights and environmental justice who is looking for fresh insights for transforming power in favour of relatively less powerful people.

Power, Violence, Citizenship and Agency - McGee, Rosemary (IDS Bulletin, 2014)

Practical Program Evaluation: Theory-Driven Evaluation and the Integrated Evaluation Perspective - Chen, Huey (SAGE Publications, Inc, 2014)
The Second Edition of Practical Program Evaluation shows readers how to systematically identify stakeholders’ needs in order to select the evaluation options best suited to meet those needs. Within his discussion of the various evaluation types, Huey T. Chen details a range of evaluation approaches suitable for use across a program’s life cycle. At the core of program evaluation is its body of concepts, theories, and methods. This revised edition provides an overview of these, and includes expanded coverage of both introductory and more cutting-edge techniques within six new chapters. Illustrated throughout with real-world examples that bring the material to life, the Second Edition provides many new tools to enrich the evaluator’s toolbox.

Practioners Guide to Assessing Systems Change - Gover, Dun; Nasution, Zulka; Okutu, David; Bolder, Meghan; Henao, Lina (USAID, 2023)

Practising change together – where nothing is clear, and everything keeps changing - Sharp, Cathy (Action Learning: Research and Practice, 2020)
This paper explores the thinking and practice of ‘action inquiry’ an embedded learning practice that can help navigate complexity when practising change together. The paper uses examples from social contexts where there are concerns about community wellbeing and health care. These are drawn from collaborative or collective leadership development programmes within public services that seek to bring new attention to the qualities of how people think, converse and interact, as part of their collective professional practice. This treats social action as a relational and dialogical practice, something that we do together as professionals by engaging in reflective inquiry and action. The paper suggests that action inquiry offers a prospect of rekindling the links between ‘action learning’ and collaborative leadership by developing a co-mission and a mutual commitment to a new type of learning partnership. Action inquiry can be wrapped around and enmeshed within initiatives and programmes that work with complexity, anywhere where effective social action will depend on the quality of relationships that can be developed. This research was funded by two separate Scottish Government commissions, where the author was a learning partner. The paper also draws on the further reflections of some of the practitioners most centrally involved.
Publisher: Routledge _eprint: https://doi.org/10.1080/14767333.2020.1712838

Practitioners Guidance to Assessing Systems Change: Co-Authors Preview - Gover, Dun; Nasution, Zulka; Okutu, David; Bolder, Meghan; Henao, Lina (USAID, 2023)
Check out this video to see what’s inside our new resource: Practitioners' Guidance to Assessing Systems Change, developed by MEL Managers for MEL Managers. (Check out the Guidance here https://bit.ly/MSPMELClinics.) Hear from the authors about which parts they love the most and how this guide challenges MEL managers to assess systems change as an ongoing aspect of implementation, generating feedback that teams need to better understand and catalyze change, for more impact.

Primer: Technology to monitor and share information on rainforests and forest people's rights - The Engine Room (The Engine Room & Rainforest Foundation Norway, 2016)

Principles-Focused Evaluation: The GUIDE - Patton, Michael Quinn (Guilford Press, 2017)
How can programs and organizations ensure they are adhering to core principles–and assess whether doing so is yielding desired results? From evaluation pioneer Michael Quinn Patton, this book introduces the principles-focused evaluation (P-FE) approach and demonstrates its relevance and application in a range of settings. Patton explains why principles matter for program development and evaluation and how they can serve as a rudder to navigate the uncertainties, turbulence, and emergent challenges of complex dynamic environments. In-depth exemplars illustrate how the unique GUIDE framework is used to determine whether principles provide meaningful guidance (G) and are useful (U), inspiring (I), developmentally adaptable (D), and evaluable (E). User-friendly features include rubrics, a P-FE checklist, firsthand reflections and examples from experienced P-FE practitioners, sidebars and summary tables, and end-of-chapter application exercises.

Principles for Digital Development - digitalprinciples.org (2018)

Principles for managing in complexity - Proud, Emma (LearnAdapt, 2020)
Written by Toby Lowe and Shaheen Warren (Centre for Public Impact) and Sam Sharp (Overseas Development Institute), with input from Jamie…

Principles for Monitoring, Evaluation, and Adaptive Management of Environmental Water Regimes - Webb, J. Angus; Watts, Robyn J.; Allan, Catherine; Warner, Andrew T. (Water for the Environment, 2017)
Environmental water is often a contentious investment in the environment that must be delivered under uncertainty regarding the ecological and social benefits they deliver. Adaptive management can be used to facilitate decision making under uncertainty, and use new knowledge and understanding to improve management decisions and outcomes over time. However, there is a perception that adaptive management has failed to deliver improvements in decision making and learning. Monitoring and evaluation are an essential feature of adaptive management. However, past monitoring for river protection and restoration has too often been of insufficient quality to facilitate adaptive learning. Moreover, environmental water represents a class of protection and restoration that is inherently difficult to monitor, and some of the learnings are not evident in part because fragmented assessment, documentation, and reporting of adaptive management can obscure successes. We outline a set of general principles for improving monitoring, evaluation, and adaptive management of environmental water regimes, and provide several examples from Australia and North America. Successful adaptive management depends upon the formation and maintenance of strong partnerships and an appreciation of the importance of individuals in teams. Through such partnerships, it is possible to coordinate monitoring programs over large scales, create programs of requisite simplicity, and use innovative approaches to evaluation. Finally, we note that although adaptive management has occurred in the past, too often it has been poorly documented and reported. The inclusion of reflectors in monitoring and evaluation teams will better capture the lessons learned by individual programs, improving adaptive management into the future.
Keywords: Environmental water management; Knowledge exchange; Legitimacy; implementation challenge

Prioritizing and Selecting Strategic Approaches in USAID Biodiversity Programming - Stem, Caroline; Swaminathan, Vinaya; Flores, Marco (USAID, 2018)
This guide supplements Biodiversity How-To Guide 2: Using Results Chains to Depict Theories of Change in USAID Biodiversity Programming. Step 4, Brainstorming Strategic Approaches, involves generating a suite of potential strategic approaches for a design team to consider. Step 5 introduces the practice of prioritizing and selecting among these draft strategic approaches but does not provide in-depth guidance on the process and criteria for doing so.

Probes, toolkits and prototypes: three approaches to making in codesigning - Sanders, Elizabeth B.-N.; Stappers, Pieter Jan (CoDesign, 2014)
The role of making in the design process has been growing, taking on new forms and involving new players over the past 10 years. Where we once primarily saw designers using making to give shape to the future, today we can see designers and non-designers working together, using making as a way to make sense of the future. In this paper, we describe the landscape of design research and practice at the end of 2013 with special attention to the role of making across these perspectives: approach (cultural probes, generative toolkits and design prototypes), mindset (designing for people and designing with people), focus in time (the world as it is, the near future and the speculative future) as well as variations in design intent (provoking, engaging and serving).

Problem-driven iterative approaches and wider governance reform - Rao, Sumedh (GSDRC, University of Birmingham, 2014)
Identify evidence which suggests that problem-driven, iterative approaches to public sector reform can deliver more substantial, wider, long-term governance reform.

Process and Contextual Factors Supporting Action-Oriented Learning: A Thematic Synthesis of Empirical Literature in Natural Resource Management - Suškevičs, Monika; Hahn, Thomas; Rodela, Romina (Society & Natural Resources, 2019)
Despite a long-term focus on learning in natural resource management (NRM), it is still debated how learning supports sustainable real-world NRM practices. We offer a qualitative in-depth synthesis of selected scientific empirical literature (N = 53), which explores factors affecting action-oriented learning. We inductively identify eight key process-based and contextual factors discussed in this literature. Three patterns emerge from our results. First, the literature discusses both facilitated participation and self-organized collaboration as dialogical spaces, which bridge interests and support constructive conflict management. Second, the literature suggests practice-based dialogs as those best able to facilitate action and puts a strong emphasis on experimentation. Finally, not emphasized in existing reviews and syntheses, we found multiple evidence about certain contextual factors affecting learning, including social-ecological crises, complexity, and power structures. Our review also points at important knowledge gaps, which can be used to advance the current research agenda about learning and NRM.
Keywords: Ecosystem governance; Social learning; intermediaries; social-ecological systems; structural constraints

Process Monitoring of Impacts: Towards a new approach to monitor the implementation of Structural Fund Programmes - Hummelbrunner, Richard; Huber, Wolf; Arbter, Roland (ÖAR Regionalberatung, 2005)

Process Tracing as a Practical Evaluation Method: Comparative Learning from Six Evaluations - Wadeson, Alix; Monzani, Bernardo; Aston, Tom (2020)

Process Tracing Innovations in Practice: Finding the Middle Path - Aston, Thomas; Wadeson, Alix (Institute of Development Studies, 2023)
Evaluation practitioners in the international development sector have given considerable attention in recent years to process tracing as a method for evaluating impact, including discussion of how to assess the relative importance of causal factors. Despite the increasing interest, there is a relative dearth of examples of practical learning and evidence of applying process tracing in practice. This CDI Practice Paper draws on comparative learning from applying three different types of process tracing in international development initiatives. It argues in favour of a ‘middle path’ of applying evidence tests and rubrics to structure evaluative judgements rather than formal Bayesian updating or looser forms of process tracing. It also calls attention to the potential added value of taking a participatory approach, offering practical recommendations for how to do this effectively.
Accepted: 2023-03-27T15:20:09Z Publisher: Institute of Development Studies

Procuring and Managing Adaptively: 5 Case Studies of Adaptive Mechanisms - Pryor, Tony (USAID Learning Lab, USAID, 2018)
Flexibility in program management is essential in all of the countries where USAID works. This is especially true in non-permissive environments (NPEs), where the ability to learn and adapt quickly to changing circumstances can help USAID staff members achieve their desired outcomes.

Producer-led value chain analysis: The missing link in value chain development - Ghore, Yogesh (Coady, 2015)
Introduction and rationale The concept of a value chain is increasingly being applied in the design and implementation of development programs aimed at poverty reduction. As an analytical tool, it provides a useful framework for understanding key activities, relationships, and mechanisms that allow producers, processors, buyers, sellers, and consumers—separated by time and space—to gradually add value to products and services as they pass from one link of the chain to another, making it a “value chain” (UNIDO, 2009). While it has been popular in the private sector ever since it was conceptualized by Michael Porter in the 1980s, more recently various donors and governments have shown interest in its use and have applied it to a range of development interventions, particularly in the area of sector development, livelihoods promotion, small and medium enterprise (SME) development, and rural and economic development. Academics and development organizations have designed numerous instruments for value chain analysis (VCA) and implementation. Beginning in the early 2000s, international organizations and donor agencies have sponsored the development of these tools, including the United States Agency for International Development (USAID) Deutsche Gesellschaft für Internationale Zusammenarbeit (GIZ), the World Bank, the International Finance Corporation (IFC), and the International Labour Organization (ILO). These guides and tools have been used in many development programs to address organizational, donor and local and regional priorities for development. While VCA guides and tools are important in understanding markets and relationships among key stakeholders, a recent comparative review of popularly used guides by Donovan et al. (2013) suggests that most of these guides are designed to be implemented independently of the local context and do not sufficiently focus on mutual learning, whether related to tool design or to the outcomes and impacts of the designed project activities. VCA is often conducted by external experts and the knowledge generated in the process is often confined to reports. Without the capacity building and effective participation of women and men producers—smallholder farmers who hold critical knowledge about the local context—an important link is missing in the entire process of VCA. The insufficient attention to the human, social, and other contextual factors undermines the full potential of the value chain systems approach, not only for economic outcomes, but for the long term sustainability of the intended benefits. So what are the ways to effectively engage producers in the community in the VCA? The producer-led process described here tries to address this basic question. It introduces simplified tools and an approach that ensures farmer participation in data collection, analysis, and identification of opportunities and constraints, and design of value chain interventions. This participation requires: a) an environment in which they feel comfortable to share their knowledge and insights, which is often not the case when extractive surveys and questionnaires are administered to collect information; and b) the use of simple and participatory tools that will allow them to provide inputs into the process of VCA and also help them to understand complex value chain systems and use this understanding for making livelihood decisions. The key steps and tools described are aimed at empowering the women and men farmers to make informed decisions about their own enterprises and how they relate to the value chain, thereby directly contributing to, and influencing, the overall process of value chain development. The process of VCA involving these steps and tools was developed at Coady Institute and first tested with Oxfam Canada and its local partners in Ethiopia in August 2012.

Profiling the international development mutants - Quaggiotto, Giulio (Development Impact and You, 2017)
As part of a new series, we talk to Giulio Quaggiotto about the development ‘mutants’ – innovators working at the edge of the field.

Program Cycle - Discussion Note: Adaptive Management - USAID (USAID, 2018)
This Discussion Note complements ADS 201.3.1.2 Program Cycle Principles by elaborating on Principle 2: Manage Adaptively through Continuous Learning. This Discussion Note is intended for USAID staff interested in learning about recent and promising practices in adaptive management across the Program Cycle.

Program Cycle - Discussion Note: Designing Monitoring, Evaluation, and Learning Platforms - USAID (USAID, 2018)
This Discussion Note complements ADS 201.3.1.2 Program Cycle Principles by elaborating on Principle 2: Manage Adaptively through Continuous Learning. This Discussion Note is intended for USAID staff interested in learning about recent and promising practices in adaptive management across the Program Cycle.

Program Cycle - Discussion Note: Managing Monitoring, Evaluation, and Learning Platforms - USAID (USAID, 2018)
This Discussion Note complements ADS 201.3.1.2 Program Cycle Principles by elaborating on Principle 2: Manage Adaptively through Continuous Learning. This Discussion Note is intended for USAID staff interested in learning about recent and promising practices in adaptive management across the Program Cycle.

Program Cycle - How-To Note: Strategy-Level Portfolio Review - USAID (USAID PPL, 2017)

Program Cycle Road Map - USAID (2016)

Program Logic Foundations: Putting the Logic Back into Program Logic - Hawkins, Andrew J. (Journal of MultiDisciplinary Evaluation, 2020)
Abstract Background: Program logic is one of the most used tools by the public policy evaluator. There is, however, little explanation in the evaluation literature about the logical foundations of program logic or discussion of how it may be determined if a program is logical. This paper was born on a long journey that started with program logic and ended with the logic of evaluation. Consistent throughout was the idea that the discipline of program evaluation is a pragmatic one, concerned with applied social science and effective action in complex, adaptive systems. It gradually became the central claim of this paper that evidence-based policy requires sound reasoning more urgently than further development and testing of scientific theory. This was difficult to reconcile with the observation that much evaluation was conducted within a scientific paradigm, concerned with the development and testing of various types of theory. Purpose: This paper demonstrates the benefits of considering the core essence of a program to be a proposition about the value of a course of action. This contrasts with a research-based paradigm in which programs are considered to be a type of theory, and in which experimental and theory-driven evaluations are conducted. Experimental approaches focus on internal validity of knowledge claims about programs and on discovering stable cause and effect relationships—or, colloquially, ‘what works?’. Theory-driven approaches tend to focus on external validity and in the case of the realist approach, the search for transfactual causal mechanisms—extending the ‘what works’ mantra to include ‘for whom and in what circumstances’. On both approaches, evaluation aspires to be a scientific pursuit for obtaining knowledge of general laws of phenomena, or in the case of realists, replicable context-mechanism-outcome configurations. This paper presents and seeks to justify an approach rooted in logic, and that supports anyone to engage in a reasonable and democratic deliberation about the value of a course of action. It is consistent with systems thinking, complexity and the associated limits to certainty for determining the value of a proposed, or actual, course of action in the social world. It suggests that evaluation should learn from the past and have an eye toward the future, but that it would be most beneficial if concerned with evaluating in the present, in addressing the question ‘is this a good idea here and now? Findings: In seeking foundations of program logic, this paper exposes roots that extend far deeper than the post-enlightenment, positivist and post-positivist social science search for stable cause and effect relationships. These roots lie in the 4th century BCE with Aristotle’s ‘enthymeme’. The exploration leads to conclusions about the need for a greater focus on logic and reasoning in the design and evaluation of programs and interventions for the public good. Science and research are shown to play a crucial role in providing reasons or warrants to support a claim about the value of a course of action; however, one subordinate to the alpha-discipline of logical evaluation and decision making that must consider what is feasible given the context, capability and capacity available, not to mention values and ethics. Program Design Logic (PDL) is presented as an accessible and incremental innovation that may be used to determine if a program makes sense ‘on paper’ in the design stage as well as ‘in reality’ during delivery. It is based on a configurationalist theory of causality and the concepts of ‘necessary’ and ‘sufficient’ conditions. It is intended to guide deliberation and decision making across the life cycle of any intervention intended for the public good.

Project Cycle Hacker's Toolkit - changing the conversation around your projects - UNDP (UNDP, 2017)
The Istanbul Regional Hub partnered with Nesta and 4 country offices (fYR Macedonia, Moldova, Georgia and Kyrgyzstan) to develop a program that can help us bring innovation closer to the center of the organization by embedding it in the key project management business processes - The Project Cycle Hackers Toolkit.

Propel - Strhive (2023)
Learn from experience. Together. In the complex landscape of international development, organisations need a way to learn from their experiences and build on what works. Propel is the software solution that revolutionises the way organisations capture, access, and reuse learnings to adapt, innovate, and create lasting change on a global scale. Let's stop reinventing the wheel and build on what works, together.

Purposeful Program Theory: Effective Use of Theories of Change and Logic Models - Funnell, Sue C.; Rogers, Patricia J. (Wiley, 2011)
Program Theory in Evaluation Practice is a ground-breaking reference that teaches how to develop an explicit causal model that links an intervention (project, program or policy) with its intended or observed impacts and using this to guide monitoring and evaluation. Peerless in its explanation of why and how to use and develop program theory, the book is rich with examples and alternative approaches. The book is an invaluable resource to faculty and students as well as professionals in professional development programs, education, social work, and counseling.

Purposeful Program Theory: Effective Use of Theories of Change and Logic Models - Funnell, Sue C.; Rogers, Patricia J. (2011)
Between good intentions and great results lies a program theory—not just a list of tasks but a vision of what needs to happen, and how. Now widely used in government and not-for-profit organizations, program theory provides a coherent picture of how change occurs and how to improve performance. Purposeful Program Theory shows how to develop, represent, and use program theory thoughtfully and strategically to suit your particular situation, drawing on the fifty-year history of program theory and the authors' experiences over more than twenty-five years."From needs assessment to intervention design, from implementation to outcomes evaluation, from policy formulation to policy execution and evaluation, program theory is paramount. But until now no book has examined these multiple uses of program theory in a comprehensive, understandable, and integrated way. This promises to be a breakthrough book, valuable to practitioners, program designers, evaluators, policy analysts, funders, and scholars who care about understanding why an intervention works or doesn't work." —Michael Quinn Patton, author, Utilization-Focused Evaluation"Finally, the definitive guide to evaluation using program theory! Far from the narrow 'one true way' approaches to program theory, this book provides numerous practical options for applying program theory to fulfill different purposes and constraints, and guides the reader through the sound critical thinking required to select from among the options. The tour de force of the history and use of program theory is a truly global view, with examples from around the world and across the full range of content domains. A must-have for any serious evaluator." —E. Jane Davidson, PhD, Real Evaluation Ltd.Companion Web site: josseybass.com/go/funnellrogers

Putting Gender into Political Economy Analysis: why it matters and how to do it - Brown, Emily; Haines, Rebecca; O’Neil, Tam (From Poverty to Power, 2018)
Gender specialists from Oxfam and Care introduce a new guide that covers both theory and practice of including gender in political economy analysis.
Keywords: Gender

Putting learning at the centre: Adaptive development programming in practice - Valters, Craig; Cummings, Clare; Nixon, Hamish (ODI, 2016)
Adaptive programming suggests, at a minimum, that development actors react and respond to changes in the political and socio-economic operating environment. It emphasises learning and the development practitioner is encouraged to adjust their actions to find workable solutions to problems that they may face. Being prepared to react to change may seem like common sense – and indeed it is. However much development thinking and practice remains stuck in a linear planning model which discourages learning and adaptation, in part because projects are seen as ‘closed, controllable and unchanging systems’ (Mosse, 1998: 5). This paper critically engages with this problem and makes clear why and how learning needs to be at the centre of adaptive development programming. It begins by clarifying why and what kind of learning matters for adaptive programming. The paper then turns its focus to how strategies and approaches applied throughout a programme’s conception, design, management and M&E can enable it to continually learn and adapt.
Keywords: IMPORTANT

Putting theory into practice: how DFID is doing development differently - Wild, Leni; Booth, David; Valters, Craig (ODI, 2017)
Keywords: IMPORTANT

Putting vulnerability to climate change on the map: a review of approaches, benefits, and risks - Preston, Benjamin L.; Yuen, Emma J.; Westaway, Richard M. (Sustainability Science; Dordrecht, 2011)
There is growing demand among stakeholders across public and private institutions for spatially-explicit information regarding vulnerability to climate change at the local scale. However, the challenges associated with mapping the geography of climate change vulnerability are non-trivial, both conceptually and technically, suggesting the need for more critical evaluation of this practice. Here, we review climate change vulnerability mapping in the context of four key questions that are fundamental to assessment design. First, what are the goals of the assessment? A review of published assessments yields a range of objective statements that emphasize problem orientation or decision-making about adaptation actions. Second, how is the assessment of vulnerability framed? Assessments vary with respect to what values are assessed (vulnerability of what) and the underlying determinants of vulnerability that are considered (vulnerability to what). The selected frame ultimately influences perceptions of the primary driving forces of vulnerability as well as preferences regarding management alternatives. Third, what are the technical methods by which an assessment is conducted? The integration of vulnerability determinants into a common map remains an emergent and subjective practice associated with a number of methodological challenges. Fourth, who participates in the assessment and how will it be used to facilitate change? Assessments are often conducted under the auspices of benefiting stakeholders, yet many lack direct engagement with stakeholders. Each of these questions is reviewed in turn by drawing on an illustrative set of 45 vulnerability mapping studies appearing in the literature. A number of pathways for placing vulnerability mapping on a more robust footing are also identified. [PUBLICATION ABSTRACT]
Keywords: Climate change; Mapping; Risk assessment; Sustainable development

Q&A: Complexity-Aware Planning for Stabilization Programming - Martins, Christy (DAI - Checkpoint, 2018)

Qualitative Comparative Analysis - A Rigorous Qualitative Method for Assessing Impact - Baptist, Carrie; Befani, Barbara (Coffey, 2015)

Qualitative comparative analysis: A valuable approach to add to the evaluator’s toolbox? Lessons from recent applications - Schatz, Florian; Welle, Katharina (IDS, 2016)

Quality Flaws: Issues and Challenges in Software Development - Mohan, P.; Shankar, A. Udaya; JayaSriDevi, K. (Computer Engineering and Intelligent Systems, 2012)
A statement “Prevention is better than cure” for illnesses in medical sciences also applies to the software development life cycle in terms of software defects. A defect is a deviation from actual functionality of the application in terms of the correctness and completeness of the specification of the customer requirements. Defective software fails to meet its customer requirements leading to the development of applications with poor quality. Quality is a top priority in every enterprise these days. Organizations struggle in a treadmill race to deliver quality software to stay ahead with new technology, deal with accumulated development backlogs, handle customer issues as software teams work as hard as they can make their organizations stay alive and competitive in the market place. Software companies face an immense pressure to virtually release a bug-free product or a software package. The culture of an organization is a critical success factor in the efforts of process improvement. The paper aims at assessing quality as a function for monitoring and measuring the strength of development processes and any successful application development enterprise requires an unambiguous understanding of customer expectation and maximizing participation of customers in the development activities thereby ensuring that people involved in development activities do the right thing and do the thing right for delivering high quality software . Keywords: Software development, process improvement, software defect, bug-free product, software package

Quality standards for development evaluation - OECD; Development Assistance Committee (OECD, 2010)
Based on a broad international consultative process, the DAC Quality Standards for Development Evaluation are a reference guide to good practice in development evaluation. With a view to improving the quality of evaluation processes and products, and facilitating collaboration, this reference guide lays out standards for each phase of a typical evaluation process: from defining purpose, to planning, designing, implementing, reporting, and learning from and using evaluation results.
OCLC: 631212078

QUIP: Understanding clients through in-depth interviews - IMP-ACT (Institute of Development Studies, 2004)
This Practice Note by Imp-Act gives a step-by-step guide to developing and conducting in-depth interviews using the QUIP approach, and analysing the information and making conclusions based on what you have learned.

RAND Program Evaluation Toolkit for Countering Violent Extremism - Helmus, Todd; Matthews, Miriam; Ramchand, Rajeev; Beaghley, Sina; Stebbins, David; Kadlec, Amanda; Brown, Michael; Kofner, Aaron; Acosta, Joie (RAND Corporation, 2017)

Rapid Action Learning and COVID-19 - Chambers, Robert (Sanitation Learning Hub, 2020)
A-ha! A moment etched in my memory: 20 or so researchers were...

Rapid Action Learning for Sanitation and Hygiene Programming - Chambers, Robert; Myers, Jamie; Vernon, Naomi (IDS, 2020)
There is a glaring gap and compelling need for approaches and methods that realign to new rigour through timeliness, cost-effectiveness, relevance and being actionable. Over the past few years, the Sanitation Learning Hub, in collaboration with the Government of India, Praxis, WSSCC and WaterAid India, have been developing Rapid Action Learning approaches. Multiple approaches have been trialled, with flexible formats, but the essential criteria is that learning is timely, relevant and actionable. These learning approaches are the focus of the latest edition of the Frontiers of Sanitation series. This Frontiers explains the advantages and disadvantages of the approaches trialled and sets out a challenge to those working in the water, sanitation and hygiene sector to: Reflect on what, for you, constitutes rigour. Adopt and adapt approaches to fit your context and needs. Develop your own approaches. Record your experiences and lessons learnt. Take the time to share your experiences with us

Rapid experiments with a purpose - Moses, Michael (BEAM Exchange, 2017)
New insights, opinions and perspectives on market systems development, from experts and practitioners.
Keywords: IMPORTANT

Rapid outcome mapping approach: a guide to policy engagement and influence - Young, John; Shaxson, Louise; Jones, harry; Hearn, Simon; Datta, Ajoy; Cassidy, Caroline (ODI, 2014)

Rapid Results!: How 100-Day Projects Build the Capacity for Large-Scale Change - Schaffer, Robert H.; Ashkenas, Ron (Jossey-Bass, 2005)
Rapid Results! shows how to make large-scale changes succeed by using 100-day results-producing projects to develop this vital implementation capability. Written by Robert H. Schaffer, Ronald N. Ashkenas, and their associates—leaders in the field of change management—Rapid Results! describes an approach that has been field-tested by real organizations of every size and description to improve performance and speed the pace of change. Rapid results projects produce results quickly, introduce new work patterns, and enable participants to learn a variety of lessons about managing change. Step by step, the book describes how the use of rapid-cycle, or 100-day, projects will multiply your organization’s power to succeed at large-scale change. Schaffer and Ashkenas specifically outline the concept behind 100-day projects and show you how to Set up the architecture to implement rapid results projects Improve operational performance and also attain hard results in the soft areas of management Build rapid results into major organizational change such as reorganization, acquisition integration, and international development Use rapid results to drive leadership development and culture change

Re-imagining Inclusive Urban Futures for Transformation - Friend, Richard M; Anwar, Nausheen H; Dixit, Ajaya; Hutanuwatr, Khanin; Jayaraman, Thiagarajan; McGregor, J Allister; Menon, Meena R; Moench, Marcus; Pelling, Mark; Roberts, Debra (Current Opinion in Environmental Sustainability, 2016)

Re-institute website - RE!NSTITUTE (Re!nstitute, 2023)
We are a dynamic non-profit organization with a unique approach to managing change and catalyzing innovation to support global systems transformation. We know that to achieve equal, just, and safe communities, we must collectively challenge and change the systems that people rely on — especially those most vulnerable. Together, we must RE!BUILD a system's resilience and capacity to take on our biggest generational challenges. Justice, housing, health, and other systems in every country are often struggling to come together, across institutions and organizations, to unite under a common vision for change, and implement those changes in effective and innovative ways. Our work and methodology — the 100-Day Challenge — are designed to support these systems to achieve extraordinary results. Our approach is rooted in the philosophy that frontline staff, supported by leadership, can unleash innovation and achieve incredible results by creating new relationships, experimenting with fresh ideas from across their system, and building authentic engagement with those with lived experience.

(Re)making the case for adaptive management - Aston, Thomas (Medium, 2022)
Great overview of what to read on adaptive management. It’s a long one, so I’ve split it into two – second installment tomorrow. Christian Aid Ireland’s recent publication The Difference Learning Makes by Stephen Gray and Andy Carl made a bit of a splash. The study found that Christian Aid Ireland’s application of adaptive programming contributed to better development outcomes and supported more flexible delivery. The much vaunted MUVA programme in Mozambique is also coming to a close and presenting its results from using and adaptive approach. So, it struck me that we might be at a critical juncture in the conversation on adaptive management. We’ve had the crashing to earth of inflated expectations in recent misanthropic reflections, [misanthropic, moi? – Duncan] alongside a fragile institutionalisation of adaptive management in donor agencies, NGOs, and private sector organisations. However, I’d argue that we’ve reached the point where adaptive management has passed the proof-of-concept stage.

Re-Perceiving Results: Aid Programs and Change in Fragile Societies - van Veen, Erwin; Rijper, Alies (Knowledge Platform Security & Rule of Law, 2017)
Aid programmes need to be able to adapt their objectives and operations to changes in their political environment, since development processes are subject to political contestation. Change takes time and is often a matter of seizing the opportunity.
Keywords: IMPORTANT

Reacting or adapting? Purposeful adaptation and response to contextual change. - Wood, Nik (Rebel with Causation, 2020)
Adaptive management is increasingly on the ticket for development programming, and has been crucial in the wake of covid-19. I’ve been working with adaptive programmes for most of my career, …

READ ME - HOW TO USE THIS AM LIBRARY - Prieto Martin, Pedro (Institute of Development Studies, 2019)

Reading the Local Context: A Causal Chain Approach to Social Accountability - Joshi, Anuradha (IDS Bulletin, 2014)
There is a general consensus that ‘context’ matters for development outcomes, yet we have little understanding of how exactly ‘context’ affects outcomes. This article focuses on the question of ‘context’ in social accountability (SA) initiatives by separating macro- and micro-contextual factors. On the macro side (country level), accountability processes need to take into account broad factors such as national histories of citizen–state engagement. On the micro side, local factors can drive the extent to which SA initiatives are successful, even within otherwise broadly similar national contexts. The article outlines the basic components of accountability and proposes a ‘causal chain'strategy to better understand the micro-context. This would allow existing evidence to be reorganised to assess the promise of existing and new initiatives by deconstructing the various mini-causal pathways (i.e. in the micro-context) and understanding the contextual conditions that make them work.
Keywords: IMPORTANT

“Real”​ process tracing: part 1 — context - Aston, Thomas (Medium, 2020)
When asserting the value of theory-based methods, you often here words like “black boxes” and “causal mechanisms.” These are commonly…

Real-Time Data for Adaptive Management at USAID - Doshi, Samir (2016)

Real Time Monitoring and the New Information Technologies - Lucas, Henry; Batchelor, Simon; Berdou, Evangelia (IDS Bulletin, 2013)
Debates as to the potential role of new Information and Communication Technologies (ICTs) in monitoring the wellbeing of vulnerable groups is often bedevilled by the failure of two principal actors – social researchers and technical experts – to address the other’s concerns or even to use language that is comprehensible to the other side. The aim here is to unpick some of the technical language relevant in this context and provide a brief introductory guide to some aspects of the current, rapidly changing and highly diverse ICT environment.

Real World SAFe – Leapfrogging a successful waterfall company into Scaled Agile - Skarin, Mattias (CRISP, 2017)

Realist Evaluation - Pawson, Ray; Tilley, Nick (2004)
Contents: Introduction 1. The nature of programmes and how they work 2. Basic concepts in the explanation and understanding of programmes 3. Strategies and methods of realist evaluation 4. Realism’s place in the policy cycle: formative, summative and synthetic approaches 5. The nature, presentation and use of findings from realist evaluation 6. Conclusion: strengths, limitations and relationships with other approaches Appendix I – ‘Thinking it through’: an exercise in realist hypothesis making. Appendix II – ‘Varieties of realist evaluation’: pocket illustrations of quantitative, qualitative, formative and synthetic applications. Appendix III – ‘Would it work here?’: a grid to help decide on the feasibility of mounting a programme ‘on your patch’.

Realist Impact Evaluation: An introduction - Westhorp, Gill (Methods Lab, 2014)
• Realist evaluation is a member of a family of theory-based evaluation approaches which begin by clarifying the ‘programme theory’: the mechanisms that are likely to operate, the contexts in which they might operate and the outcomes that will be observed if they operate as expected. • Realist approaches assume that nothing works everywhere for everyone: context makes a big difference to programme outcomes. A realist evaluation asks not ‘what works?’ but ‘how or why does this work, for whom, in what circumstances?’ • Realist impact evaluation is most appropriate for evaluating new initiatives or programmes that seem to work but where ‘how and for whom’ is not yet understood; programmes that have previously demonstrated mixed patterns of outcomes; and those that will be scaled up, to understand how to adapt the intervention to new contexts.

Recipes for Public Spheres: Eight Institutional Design Choices and Their Consequences - Fung, Archon (Journal of Political Philosophy, 2003)

Reciprocity in International Volunteer Cooperation - Lough, Benjamin J. (Fredskorpset Norway, 2016)

Redefining Rigor: Describing Quality Evaluation in Complex, Adaptive Settings - Preskill, Hallie; Lynn, Jewlya (FSG, 2016)
Traditionally, evaluation has focused on understanding whether a program is making progress against pre-determined indicators. In this context, the quality of the evaluation is often measured in part by the “rigor” of the methods and scientific inquiry.

Redefining rigour: using stories to evaluate systems change? - Lowther, Keira (Centre For Public Impact (CPI), 2022)
What might a different way of understanding rigour for work in complex adaptive systems look like?

Redesigning Field Papers’ User Interface - Jacks, Lindsey (Cadasta, 2016)
For the past three months, I've been working with Cadasta and Stamen on the atlas creation pages of the Field Papers map annotation tool. The end result is now live on the Field Papers website. We took the four step “wizard” process for creating an atlas, combined it all into a single-page, and...
Keywords: IMPORTANT

Rediscovery of Traditional Ecological Knowledge as Adaptive Management - Berkes, Fikret; Colding, Johan; Folke, Carl (Ecological Applications, 2000)
Indigenous groups offer alternative knowledge and perspectives based on their own locally developed practices of resource use. We surveyed the international literature to focus on the role of Traditional Ecological Knowledge in monitoring, responding to, and managing ecosystem processes and functions, with special attention to ecological resilience. Case studies revealed that there exists a diversity of local or traditional practices for ecosystem management. These include multiple species management, resource rotation, succession management, landscape patchiness management, and other ways of responding to and managing pulses and ecological surprises. Social mechanisms behind these traditional practices include a number of adaptations for the generation, accumulation, and transmission of knowledge; the use of local institutions to provide leaders/stewards and rules for social regulation; mechanisms for cultural internalization of traditional practices; and the development of appropriate world views and cultural values. Some traditional knowledge and management systems were characterized by the use of local ecological knowledge to interpret and respond to feedbacks from the environment to guide the direction of resource management. These traditional systems had certain similarities to adaptive management with its emphasis on feedback learning, and its treatment of uncertainty and unpredictability intrinsic to all ecosystems.
Keywords: Adaptive Management; Resource management; Social learning; Traditional Ecological Knowledge; human ecology; resilience

Refining advocacy assessment: reflections from practice - Buffardi, Anne; Hearn, Simon; Tilley, Helen (ODI, 2017)
• This paper revisits how existing advocacy evaluation frameworks classify people and activities, and define and assess outcomes. We discuss how assessments could be more specific and propose bounding the scope of inquiry in one of four ways: strategy specific, outcome oriented, actor-centric or system-wide. • In classifying activities, the same action or event may be situated at different phases of the change pathway – in some cases used as a tactic to influence a policy outcome, and in others an intended outcome itself. • Because advocacy is more relational than other types of more technical development interventions, there will be fewer sources of directly observable data, and the direction of potential bias may be unknown. • In terms of learning, advocacy initiatives are contextually dependent, therefore lessons may be less directly transferable to subsequent phases of an initiative or to other settings. Organisations have bounded repertoires and the transferability of skill sets is limited, so advocates adapt how and with whom they engage more than what they do

Reflect Action Methods - ActionAid (2009)
Reflect is an innovative approach to adult learning and social change, which fuses the theories of Brazilian educator Paulo Freire with participatory methodologies. It was developed in the 1990s through pilot projects in Bangladesh, Uganda and El Salvador and is now used by over 500 organisations in over 70 countries worldwide. Organisations working with Reflect won UNESCO literacy prizes in 2003, 2005, 2007, 2008 and 2010. This site is aimed at Reflect practitioners and others who want to know more about the approach. We want it to be truly interactive and the more stories, graphics and photos are submitted, the better the site will be. Please add your comments to tell us about the work you are doing with Reflect and join the discussion forum to share your ideas and experiences of working with the approach.

Reflection methods: Tools to make learning more meaningful - Gordijn, Femke; Eernstman, Natalia; Helder, Jan; Brouwer, Herman (Wageningen Centre for Development Innovation, 2018)
This handbook summarises methods that can be used to facilitate the process of reflection on the knowledge and experiences people acquire during a capacity development trajectory or training event. We believe that by explicitly integrating reflection in the learning process the learning will become clearer and better articulated and will contribute more strongly to meaningful change. Therefore we advise facilitators to deliberately include reflective learning sessions in their process design and implementation. This handbook can inspire you to do so and provides many methods which help to facilitate this.

Reflections from a Realist Evaluation in Progress: Scaling Ladders and Stitching Theory - Punton, Melanie; Vogel, Isabel; Lloyd, Rob (IDS, 2016)
Realist evaluation provides valuable insights into how and why programmes lead to change, and can generate transferable lessons to help practitioners roll out or scale up an intervention. However, as ...

Reflections on applying iterative and incremental software development methodologies to aid and development work in developing countries - Haikin, Matt (MattHaikin.com, 2013)

Reflections on if and how our partnership is working in Bangladesh - Paul, Sukanta; Snijder, Mieke; Apgar, Marina (CLARISSA, 2020)
Effective partnership working is crucial to producing quality results, especially when working with complex problems such as the worst forms...

Reflections on implementing politically informed, searching programs: lessons for aid practitioners and policy makers - Cole, William; Ladner, Debra; Koenig, Mark; Tyrrel, Lavinia (2016)

Reflections on Ten Years of USAID’s Experience with Political Economy Analysis and Thinking and Working Politically - Brinkerhoff, Derick; Cassidy, Marc (TWP CoP, 2023)
The global Thinking and Working Politically (TWP) Community of Practice (CoP), the Washington DC TWP CoP, and USAID organised a webinar on 5 December 2022 to take stock of how USAID and its partners have used PEA to inform programme strategy, design and implementation, and support TWP. This paper synthesises the key points arising from the webinar, including observations on the impacts, opportunities, challenges, and prospects for PEA/TWP to become more deeply adopted and sustained as a development methodology and approach across sectors. It starts by defining key concepts. It then highlights insights from the discussions of the impact of the application of PEA and TWP principles across sectors. The paper concludes by looking at progress achieved to date, as well as constraints and opportunities to increase the uptake of both thinking and working politically in USAID-sponsored programming.

Reflections on the Utilization-Focused Evaluation (UFE) Process - Lim, Yvonne; Mizumoto, Ann (Strengthening ICTD Research Capacity in Asia (SIRCA) Programme, 2010)
This presentation from the Strengthening ICTD Research Capacity in Asia (SIRCA) provides an overview of how UFE was used in their SIRCA programme. It was presented at the Evaluation Conclave 2010, New Delhi, India The key objectives of the program are to: Enhance research capacity in Asia through rigorous academic research Create a space for dialogue on ICT4D social science research issues in Asia Create linkages through a mentorship program Disseminate findings in publications and conferences Contents SIRCA Programme SIRCA Key Objectives SIRCA Evaluation UFE Learnings UFE Challenges Evaluation is over…but there’s a lasting outcome...

Reforming donors in fragile states: using public management theory more strategically - Gulrajani, Nilima; Honig, Dan (Overseas Development Institute, 2016)
This paper identifies ways in which donors can be more effective in fragile and conflict-affected states by exploiting theories and concepts drawn from public management.

Reforming solid waste management in Phnom Penh - Denney, Lisa (2016)
This paper tracks the efforts of an Asia Foundation team and local stakeholders as they worked to support improvements in the solid waste management sector in Phnom Penh, Cambodia. The team worked in a flexible way with a range of partners, and with particular focus on understanding the incentives and politics affecting service delivery. While reform of the sector remains in progress, steps have been taken to introduce more competition and better public sector management of solid waste collection in the city. This case study lays out the real-time decisions and processes which drove the strategy and implementation of this project, providing useful insights into how politically astute and flexible programs can be successfully implemented. This case has emerged from an action research process, which was led by a researcher from the Overseas Development Institute (ODI) and conducted over the course of almost two years. By capturing and analyzing the experiences of the program team in Phnom Penh, the paper intends to provide practical insights for others in the development community aiming to implement similar kinds of programming.

Reframing Complexity: A Four-Dimensional Approach to Organizational Diagnosis, Development and Change - Gallos, Joan V. (Organization Development: A Jossey-Bass Reader, 2006)
This is the third book in the Jossey–Bass Reader series, Organization Development: A Jossey–Bass Reader. This collection will introduce the key thinkers and contributors in organization development including Ed Lawler, Peter Senge, Chris Argyris, Richard Hackman, Jay Galbraith, Cooperrider, Rosabeth Moss Kanter, Bolman & Deal, Kouzes & Posner, and Ed Schein, among others. "Without reservations I recommend this volume to those students of organizational behavior who want an encyclopedia of OD to gain a perspective on the past, present, and future...." Jonathan D. Springer of the American Psychological Association.

Reframing, refining, and reconceptualising the worst forms of child labour through participatory adaptive programming - Apgar, Marina; Burns, Danny (Journal of modern slavery, 2021)
This article explores the potential of using participatory action research as an adaptive programming modality to drive learning and innovation to tackle the drivers of (and seek to eliminate) the Worst Forms of Child Labour. We draw on our experience from early phases of implementation of a large-scale action research programme, which despite the constraints covid-19 posed in moving to full implementation and participatory engagement with children and other stakeholders on the ground, is already generating rich learning about the opportunities and challenges of designing programmes that respond to the complex reality of WFCL. We share early learning about what it takes to be fully open to using the lived experience of programme development, and early findings from scoping and mapping of the dynamics of social norms, business practices and urban neighbourhoods and supply chains influencing WFCL in Bangladesh and Nepal, to frame and reframe the questions and response strategies and operationalise a participatory adaptive intent to work with hidden and complex dynamics that characterise the WFCL.

Regional Healthcare Ecosystem Analyst for Healthcare Associated Infections - Lee, Bruce Y. (Grantome, 2018)
Understanding and preventing the spread of both endemic and emerging healthcare-associated infectious diseases throughout hospitals and nursing homes is a national priority. Our work has shown that the many disparate inpatient healthcare facilities in a region can form a complex healthcare ecosystem connected by both direct and indirect patient sharing allowing pathogens in one health care facility to readily spread to other facilities. Our goal is to further develop RHEA (Regional Healthcare Ecosystem Analyst) into a user-friendly software tool that decision makers (e.g., policy makers, funders, product developers and manufacturers, healthcare administrators, infection prevention specialists, researchers, and educators) can readily use to help healthcare ecosystems prevent and control the spread of an endemic pathogen, methicillin- resistant Staphylococcus aureus (MRSA), and an emerging pathogen, carbapenem-resistant Enterobacteriaceae (CRE). This next generation of RHEA will bring multiple innovations by: 1) further elucidating the interconnectedness of the ecosystem and showcasing the value of cooperation among facilities versus the current individual facility approach to infectious disease control, 2) incorporating new healthcare ecosystem responses for endemic MRSA and emerging CRE, 3) continuing our work integrating economic and operational models into a framework of infectious disease epidemiological models, 4) imbuing virtual patients with characteristics linked to MRSA and CRE transmission and outcome risk, 5) building a comprehensive """"""""virtual laboratory"""""""" to help address many existing and future healthcare ecosystem infectious disease questions, and 6) building a user-friendly modeling tool that decision makers can use. The project will continue our team's longstanding modeling work and developing computational tools for decision makers via three specific aims. First, completing Specific Aim 1 will expand RHEA by adding the following capabilities: i) integrated clinical outcome and economic models, ii) more extensive and detailed patient characteristics linked to changes in infection risk and costs, iii) expanded HAI control measures, and iv) stochastic and adaptive disease parameters to represent emerging and evolving diseases. Next, Specific Aim 2 will use our newly expanded RHEA framework to model a sample endemic pathogen, MRSA, and a sample emerging pathogen, CRE to identify optimal control strategies even when pathogen characteristics are evolving. Finally, Specific Aim 3 will involve developing a user-friendly interface for RHEA and deploying it as a healthcare ecosystem computational modeling tool that various stakeholders (e.g., policy makers, healthcare administrators, infection control specialists, funders, and product manufacturers) can readily use to make decisions regarding the control of healthcare-associated infections. Public Health Relevance Understanding and preventing the spread of healthcare-associated infectious diseases throughout hospitals and nursing homes is a national priority. Simulation models can serve as virtual laboratories to help identify best practice solutions for containing common [such as methicillin-resistant Staphylococcus aureus (MRSA)] and emerging [e.g., carbapenem-resistant Enterobacteriaceae (CRE)] causes of healthcare associated infections (HAIs). Our goal is to develop our software RHEA (Regional Healthcare Ecosystem Analyst) into a computational modeling tool that can be used directly by decision makers to identify, develop, and evaluate strategies and interventions to reduce HAIs across a large geographic region.

Release the pressure on governance practitioners - de Weijer, Frauke; Hauck, Volker (A Governance Practitioner’s Notebook: Alternative Ideas and Approaches, 2015)
The Governance Practitioner’s Notebook takes an unusual approach for the OECD-DAC Network on Governance (GovNet). It brings together a collection of specially written notes aimed at those who work as governance practitioners within development agencies. It does so, however, without attempting to offer definitive guidance – instead aiming to stimulate thinking and debate. To aid this process the book is centred on a fictional Governance Adviser. The Notebook’s format provides space for experts to speak on today’s governance issues: politics, public sector reform and stakeholder engagement. It encourages debate, charts the evolution of donor thinking, and highlights future challenges in the age of the Sustainable Development Goals. Each section introduces both technical issues and major areas of debate, providing ideas for future development support to institutional reform.
Keywords: IMPORTANT

Report on outcomes and get everyone involved: The Participatory Performance Story Reporting Technique - Dart, J. (2008)
This paper outlines the background and philosophy of Collaborative Outcomes Reporting (COR) and Performance Story Reporting (PSR), providing an overview of these emerging techniques and showing how they can be used as a framework for reporting on contribution to long-term outcomes (or targets) using mixed methods and participatory process. The report serves as an introduction to these approaches in evaluation and discusses their bias, limitations and where they might best be applied.

Report template on integrating impact into an existing monitoring and evaluation system - Methods Lab (2015)
Many development programme staff will commission an impact evaluation towards the end of a project or programme, only to find that the monitoring system did not provide adequate data about implementation, context, baselines or interim results. This tool provides a template outline for a report making recommendations on how to integrate a focus on impact into a programme’s existing monitoring and evaluation system, as the programme moves into a new phase. This template was developed by Anne Buffardi and Tiina Pasanen for use in Methods Lab projects.

Report templates for evaluability assessment - Methods Lab (2015)
An evaluability assessment aims to assess the extent to which, and how best, a project can be evaluated in a reliable and credible fashion. These templates are intended to help anyone conducting an evaluability assessment to structure the final report. This tool was developed by Anne Buffardi and Bronwen McDonald for use in Methods Lab projects. It accompanies The Methods Lab publication ‘Evaluability assessment for impact evaluation: guidance, checklists and decision support’.

Representing theories of change: technical challenges with evaluation consequences - Davies, Rick (Journal of Development Effectiveness, 2018)
This paper looks at the technical issues associated with the representation of Theories of Change and the implications of design choices for the evaluability of those theories. The focus is on the description of connections between events rather than the events themselves, because this is seen as a widespread design weakness. Using examples and evidence from Internet sources six structural problems are described along with their consequences for evaluation. The paper then outlines a range of different ways of addressing these problems that could be used by programme designers, implementers and evaluators. The paper concludes with some caution speculating on why the design problems are so endemic but also pointing a way forward. Four strands of work are identified that CEDIL and DFID could invest in to develop solutions identified in the paper.
Keywords: Evaluation; evaluability; representation; theory of change

Resilience Thinking: Sustaining Ecosystems and People in a Changing World - Walker, Brian; Salt, David; Reid, Walter V. (Island Press, 2006)
Increasingly, cracks are appearing in the capacity of communities, ecosystems, and landscapes to provide the goods and services that sustain our planet's well-being. The response from most quarters has been for "more of the same" that created the situation in the first place: more control, more intensification, and greater efficiency. "Resilience thinking" offers a different way of understanding the world and a new approach to managing resources. It embraces human and natural systems as complex entities continually adapting through cycles of change and seeks to understand the qualities of a system that must be maintained or enhanced in order to achieve sustainability. It explains why greater efficiency by itself cannot solve resource problems and offers a constructive alternative that opens up options rather than closing them down. In "Resilience Thinking", scientist Brian Walker and science writer David Salt present an accessible introduction to the emerging paradigm of resilience. The book arose out of appeals from colleagues in science and industry for a plainly written account of what resilience is all about and how a resilience approach differs from current practices. Rather than complicated theory, the book offers a conceptual overview along with five case studies of resilience thinking in the real world. It is an engaging and important work for anyone interested in managing risk in a complex world.

Responding to change: Learning to adapt in development cooperation - Engel, Paul; Keijzer, Niels; Ørnemark, Charlotte (ECDPM, 2007)

Responding to complexity: A Case Study on the Use of “Developmental Evaluation for Managing Adaptively” - Boisvert, Kayla (University of Massachusetts, 2017)

Rethinking monitoring and evaluation in complex systems — when learning is a result in itself - Innovation, UNDP (Medium, 2022)
By Søren Vester Haldrup, UNDP’s Strategic Innovation Unit

Rethinking Participation and Re-enacting Its Dilemmas? Aarhus 2017 and “The Playful Society” - Eriksson, Birgit; Stephensen, Jan Løhmann (Conjunctions. Transdisciplinary Journal of Cultural Participation, 2016)
In 2012 the Danish city of Aarhus was appointed European Capital of Culture for 2017. The appointment was based on an ambitious programme that – under the headline Rethink – tried to set an agenda of societal transformation, mainly by seeking to increase the impact of art and culture, and to enhance civic participation at all levels of society. In this article we examine one of the first attempts of Aarhus 2017 to realize these grand ambitions: ‘The Playful Society’, a series of micro grants aimed at enabling young people to make their own art/culture projects and participate in the overall Rethink project. Informed by theoretical distinctions between different forms of participation, and the diverse interests invested in participatory processes, we investigate how the young cultural entrepreneurs and the artistic administrators of Aarhus 2017 separately, in conjunction, and sometimes even in opposition to each other, translated these overall ambitions into practice. We argue that they illuminate some of the dilemmas of contemporary cultural participation, including the importance of question- ing who participates in what, how they do it, and in what context.
Keywords: Cultural Entrepreneurship; Participation; youth

Rethinking Rigor - Increasing Credibility and Use - Lynn, Jewlya; Preskill, Hallie (Spark Policy Institute & FSG, 2016)
Evaluations of complex systems change strategies or adaptive, innovative programs cannot use the traditional “rigor” yardstick to measure quality. This paper proposes a new definition of rigor, one that applies in any setting, but particularly in complex, adaptive ones. Top Takeaways: 4 criteria for the new definition of rigor: - Quality of thinking - Credible and legitimate claims - Cultural context and responsiveness - Quality and value of the learning process Regardless of its other positive attributes, an evaluation of a complex, adaptive program that fails to take into account systems thinking will not be responsive to the needs of that program.

Rethinking systemic change: economic evolution and institutions - Cunningham, Shawn; Jenal, Marcus (BEAM Exchange, 2016)
Resources that contain evidence of market systems interventions. Recently updated.

Rethinking systemic change: economic evolution and institutions. Discussion paper - Cunningham, Shawn; Jenal, Marcus (BEAM Exchange, 2016)
The primary aim of this research project was to find a conceptually sound definition of systemic change. To do so, it was essential to gain a better understanding of how economies change. The central part of the research work, therefore, was an extended literature review on three bodies of knowledge: evolutionary economics new institutional economics complexity theory There is a growing interest in these bodies of knowledge, combined often called New Economic Thinking, and how they affect economic development. Hence, while rethinking systemic change, this work also contributes to answering the broader question of how market systems approaches can contribute to inclusive economic development. The answer, in short, is to shift the focus away from improving transactions at the micro level towards enabling actors to continuously shape an institutional landscape that supports inclusive economic evolution. This discussion paper briefly presents the key messages from the literature review and seven principles drawing from this literature. The principles can be used by market development practitioners, including technical advisers in donor organisations, programme designers and team leaders, to shape programmes and become more in line with how change happens in the economy. A list of selected references is presented at the end. A technical paper contains a much more detailed discussion of the findings and the principles and an extensive list of references. A case study offers a practitioner perspective through the lens of one market systems development programme: DFID-funded Northern Uganda: Transforming the Economy through Climate Smart Agribusiness – Market Development (NUTEC-MD).

Rethinking systemic change: economic evolution and institutions. Technical Paper - Cunningham, Shawn; Jenal, Marcus (BEAM Exchange, 2016)
The primary aim of this research project was to find a conceptually sound definition of systemic change. To do so, it was essential to gain a better understanding of how economies change. The central part of the research work, therefore, was an extended literature review on three bodies of knowledge: evolutionary economics, new institutional economics and complexity theory. There is a growing interest in these bodies of knowledge, combined often called New Economic Thinking, and how they affect economic development. Hence, while rethinking systemic change, this work also contributes to answering the broader question of how market systems approaches can contribute to inclusive economic development. The answer, in short, is to shift the focus away from improving transactions at the micro level towards enabling actors to continuously shape an institutional landscape that supports inclusive economic evolution. This technical paper provides an in-depth review of the fields of evolutionary economics, new institutional economics and complexity and social change. It is argued that economic development is a complex, non-linear and continuous evolutionary process. Both market and non-market institutions matter greatly in shaping economic performance. The paper then explores the consequences of this understanding for market development practice. It discusses how market development practitioners can engage in and shape an intentional change processes. To translate the theory into practice, seven principles are suggested that can be applied to market systems development practice. The paper concludes with a reframed look at systemic change in market systems development. A discussion paper presents the key messages from the literature review and seven principles drawing from this literature, and a case study offers a practitioner perspective through the lens of one market systems development programme: DFID-funded Northern Uganda: Transforming the Economy through Climate Smart Agribusiness – Market Development (NUTEC-MD).

Rethinking systemic change in practice - perspectives from NUTEC-MD in northern Uganda - Koleros, Andrew (BEAM Exchange, 2016)
Document description This document is currently being finalised and will be published shortly. Please try again soon. Recent research by The BEAM Exchange seeks to understand theoretical perspectives on how market systems approaches can contribute to inclusive economic development through systemic change. It produced three main insights. Economies are evolving systems, building on the mechanisms of variety creation, selection and amplification. Current economic performance, including aspects like the inclusiveness of growth and economic evolution, are shaped by the ability of a society to explore different options for institutional arrangements and adjust them over time. This process of evolution is complex. While some aspects can be designed and managed, others need to be explored through a process of learning and adjustment. This paper responds to these insights by providing a practitioner perspective through the lens of one programme: “Northern Uganda: Transforming the Economy through Climate Smart Agribusiness – Market Development (NUTEC-MD)”, implemented by Palladium Group. It begins with a brief introduction to the programme and key aspects of its design phase. It then provides a summary of the three main research insights, with reflections on their applicability for programme design based on the NUTEC-MD experience. Finally, it provides some conclusions for the wider practitioner community based on this case.

Rethinking value for money for adaptive, politically smart programmes - Lessons from Institutions for Inclusive Development in Tanzania - Laws, Ed (ODI, 2020)
- This short paper draws out lessons for working effectively with and through partners, based on the experience of the Institutions for Inclusive Development (I4ID) programme – an adaptive, politically smart governance programme in Tanzania. • Cultivating effective partnerships can be a key part of delivering locally legitimate projects that have the potential to create sustainable change. Adaptive and politically informed ways of working create specific opportunities and challenges for doing this well. • Flexible and adaptive programmes are deliberately designed to experiment and to make small investments in different areas, to see what will work. While this is often important for making headway on complex challenges, it can also leave partners exposed and can undermine trust. • It can also be challenging to balance the need to meet accountability commitments to donors while allowing local partners to take the lead in pursuing their own objectives. • Co-creating plans, priorities and activities with partners has the potential to resolve some of these tensions. But the time and patience required to do this successfully should not be underestimated, and can be difficult to maintain in the face of pressure from donors to see results within a confined timeframe.

Retrospective ‘Outcome Harvesting’: Generating robust insights about a global voluntary environmental network - Rassmann, Kornelia; Smith, Richard; Mauremootoo, John; Wilson-Grau, Ricardo (Better Evaluation, 2013)

Revealing the Relational Mechanisms of Research for Development Through Social Network Analysis - Apgar, Marina; Fournie, Guillaume; Haesler, Barbara; Higdon, Grace Lyn; Kenny, Leah; Oppel, Annalena; Pauls, Evelyn; Smith, Matthew; Snijder, Mieke; Vink, Daan; Hossain, Mazeda (The European Journal of Development Research, 2023)
Achieving impact through research for development programmes (R4D) requires engagement with diverse stakeholders across the research, development and policy divides. Understanding how such programmes support the emergence of outcomes, therefore, requires a focus on the relational aspects of engagement and collaboration. Increasingly, evaluation of large research collaborations is employing social network analysis (SNA), making use of its relational view of causation. In this paper, we use three applications of SNA within similar large R4D programmes, through our work within evaluation of three Interidsiplinary Hubs of the Global Challenges Research Fund, to explore its potential as an evaluation method. Our comparative analysis shows that SNA can uncover the structural dimensions of interactions within R4D programmes and enable learning about how networks evolve through time. We reflect on common challenges across the cases including navigating different forms of bias that result from incomplete network data, multiple interpretations across scales, and the challenges of making causal inference and related ethical dilemmas. We conclude with lessons on the methodological and operational dimensions of using SNA within monitoring, evaluation and learning (MEL) systems that aim to support both learning and accountability.

Review of Selected DFAT Facilities: Independent Consultant Report to DFAT, Key Findings - Pieper, Lynn (DFAT, 2018)
For the purposes of this report, a facility is defined as an aid delivery mechanism that provides flexible (adaptive and responsive) services managed in an integrated way. Objectives (or endof-facility outcomes) are specified, but the pathways to deliver them are left unspecified. The facility is a highly relevant model for delivering Australian aid effectively. Achievement of the Sustainable Development Goals depends on flexible approaches that work across sectors and that integrate significant cross-cutting themes such as gender equality and social inclusion. Efficient DFAT management of a $4 billion aid program requires a shift to fewer and larger initiatives, to make best use of limited internal management resources while still enabling policy and program choices that can have real impact. Facilities and other flexible delivery mechanisms offer significant potential for better development results. They can: enable collaborative and responsive partnership approaches to gain traction; allow activities to experiment and adapt based on progress, demand and contextual changes; and provide the opportunity for outcome-focused coherence across sectors, enabling the whole to be more than the sum of the parts. Facilities are not new, but they are different today. Facilities have existed since at least the mid-1990s. What is new is that some facilities today are very large; and the flexibility they enable is increasingly and consciously being used to strengthen links between the technical and the political, for more effective development results. This is a positive trend, but it adds enormously to their complexity and visibility, creates new risks, and has resulted in role confusion (especially in early years of implementation) between DFAT and its contractors.

Review of the use of report cards for monitoring ecosystem and waterway health - Connolly, Rod; Bunn, Stuart; Campbell, Marnie; Escher, Beate; Hunter, Jane; Maxwell, Paul; Richmond, Sarah; Rissik, David; Roiko, Anne; Smart, Jim; Teasdale, Peter; Harbour, Sunrise Over Gladstone (Gladstone Healthy Harbour Partnership, 2013)

Review of the use of ‘Theory of Change’ in International development - Vogel, Isabel (DFID, 2012)
A new report on Theory of Change (ToC) and its use in International development has just been produced.

Revisiting the Foundational Assumptions of Fiscal Transparency and Accountability Work - Carothers, Thomas; Brechenmacher, Saskia (International Budget Partnership, 2018)
The Fiscal Futures team recently updated the foundational assumptions of fiscal transparency and accountability work to fit today’s world. Learn more.

Rewards and Risks Associated with Community Engagement in Anti-Poaching and Anti-Trafficking - Wilkie, David; Painter, Michael; Jacob, Anila (USAID, 2016)
This Biodiversity Technical Brief summarizes research on the roles communities do and should play in countering wildlife crime, motivations, and benefits for individuals and communities to engage in anti-poaching and anti-trafficking efforts, and risks and mitigation of risks associated with involvement. Peer-reviewed and grey literature, structured interviews, and case studies informed the research, with highlights from six case studies in Peru, Madagascar, Namibia, Philippines, Kenya, and Indonesia.

RFI-521-17-000015 - Improving Governance in Haiti Program (IGHI) - USAID (USAID, 2017)

Rigorous Impact Evaluation in GIZ Governance Programmes - von Schiller, Armin (Bonn, 2020)
Why should I integrate an impact assessment in my programme? How will the programme benefit from it? Are the benefits worth the effort and expenses? How do I design and implement it in detail? Who is addressable for support? What should I pay attention to in order to get the most out of it? This note is meant to answer these questions. It addresses leaders and project staff of governance programmes who are interested in using this tool within their specific governance programme or project. This note provides a guideline and good practice recommendations on how to design and conduct an impact assessment and on how to fully utilise the benefits of the results for the programme and for communication with commissioners, partners and other donors. Additionally, this note will point to indirect benefits that can arise and that should not be ignored. Results of impact assessments are highly relevant for the GIZ as an institution. However, in this note we stress the benefits for the programme or project itself. In particular this note addresses the following aspects: • What are rigorous impact assessments and why should GIZ Governance programmes conduct them more often within their programmes? • Which phases does an impact assessment include? How do I set one up and which aspects deserve special attention in each phase to maximise the benefits for my programme? • What are the benefits I can expect from implementing and impact assessment? • Whom to ask at headquarters in case I need support? This note complements the policy brief “Strategic use of Rigorous Impact Evaluation” and the corporate strategic review on “Rigorous Impact Evaluation” written by the GIZ evaluation unit which focuses on the strategic use of rigorous impact evaluations (RIE) at GIZ. Based on the review findings, the policy brief presents recommendations for strategic planning and implementation of purpose-sensitive RIE using a number of key levers. By adopting central coordination and needs-based support mechanisms, the evaluation unit intends to promote the strategic use of RIE for evidence-based learning and decision-making within the organisation.

Risk navigation for Thinking and Working Politically: The work and disappearance of Sombath Somphone - Sims, Kearrin (Development Policy Review, 2020)
Abstract Motivation On December 15, 2012 Sombath Somphone was abducted at a police checkpoint in his home city of Vientiane, the capital of Laos; his whereabouts remain unknown. This article considers his work and disappearance through the lens of Thinking and Working Politically (TWP) approaches to development. The article is supportive of TWP, but emphasizes the significant risks of politicized programming in authoritarian contexts. Purpose By examining the case of Sombath Somphone, the article seeks to offer insights for safer, and more effective, TWP programming. It considers how specific events in authoritarian contexts can suddenly reposition development workers and/or organizations as political dissidents. Approaches and Methods The argument draws on analysis of grey literature; conversational and observational knowledge accrued during 18 months of fieldwork in Laos between 2011 and 2018; on‐going formal and informal interviews with members of Laos’ civil society sector; and extensive dialogue with Sombath Somphone’s wife, Ng Shui Meng. Findings The article identifies four key factors that contributed to the enforced disappearance of Sombath Somphone: international exposure; timing; particular elites; and strategies of oppression. It highlights the need for further consideration of how to anticipate and mitigate the dangers of politically oriented development work, as well as the different forms of risk experienced by local and international development actors working in authoritarian contexts. Policy Implications TWP has much to offer to development practice, but its contributions should not threaten the safety of local development actors. More attention must be given to preventing and mitigating such risks.

Routledge international handbook of participatory design - Simonsen, Jesper; Robertson, Toni (Routledge, 2013)
"Participatory Design is about the direct involvement of people in the co-design of the technologies they use. Its central concern is how collaborative design processes can be driven by the participation of the people affected by the technology designed. Embracing a diverse collection of principles and practices aimed at making technologies, tools, environments, businesses, and social institutions more responsive to human needs, the International Handbook of Participatory Design is a state-of-the-art reference handbook for the subject. The Handbook brings together a multidisciplinary and international group of highly recognized and experienced experts to present an authoritative overview of the field and its history and discuss contributions and challenges of the pivotal issues in Participatory Design, including heritage, ethics, ethnography, methods, tools and techniques and community involvement. The book also highlights three large-scale case studies which show how Participatory Design has been used to bring about outstanding changes in different organisations. The book shows why Participatory Design is an important, highly relevant and rewarding area for research and practice. It will be an invaluable resource for students, researchers, scholars and professionals in Participatory Design"–
OCLC: 754734489

Rubrics as a harness for complexity - Aston, Thomas (Medium, 2020)
In this final blog in the series, I want to look at the potential value of rubrics. While evaluability assessments can help us to…

Rules of Thumb – good idea or double-edged sword? - Green, Duncan (From Poverty to Power, 2020)
A recent conversation with a good governance programme in Myanmar tried to identify its underlying rules of thumb. Was that a good idea?

Rwanda Multi-Donor Civil Society Support Programme (2015-2021) - DFID (Development Tracker, 2018)
Project data for the Rwanda Multi-Donor Civil Society Support Programme (2015-2021). Strengthened civil society engagement on critical social cohesion, reconciliation and governance issues in Rwanda. DFID will provide funding and technical support to Rwandan civil society organisations to support the design and implementation of governance and reconciliation focused initiatives, and to support more effective engagement (influencing) with government on these issues.

Salt River Ecosystem Restoration Project - Adaptive Management Plan - Harvey, H.T. (Humboldt County Resource Conservation District, 2011)

Sample agendas for an evaluability assessment stakeholder workshop - Methods Lab (2015)
An evaluability assessment aims to assess the extent to which, and how best, an intervention can be evaluated in a reliable and credible fashion. These sample agendas are intended for people convening key stakeholders (such as project implementation staff and managers, donors and government officials) to discuss the purpose and scope of an impact evaluation and to identify key evaluation questions. This tool was developed by Bronwen McDonald, Anne Buffardi and Irene Guijt for use in Methods Lab projects. It accompanies the Methods Lab publication ‘Evaluability assessment for impact evaluation: guidance, checklists and decision support’.

Sample criteria to select case studies for evaluation - Methods Lab (2018)
Time and budget constraints often mean that organisations are unable to evaluate all of their programmes, and large programmes, operating in multiple locations, are unable to evaluate all project sites. This tool introduces two sets of criteria to support evaluators and programme managers to select case studies or programmes for evaluation: i) information about how relevant or feasible evaluation is for individual programmes, and ii) across the overall portfolio, strategic thinking around what types of cases are most important to understand. This tool was developed by Anne Buffardi, Irene Guijt, Simon Hearn and Tiina Pasanen for use in The Methods Lab projects.

Sample interview questions for evaluability assessment - Methods Lab (2015)

Sara Earl Outcome Mapping pt 1, 2, and 3 - Earl, Sara (2008)
These three videos from Sarah Earl provide an introduction to the concepts of Outcome Mapping

SAVI Approach Paper 1: Core Values - SAVI (London, 2015)
Governance reform is about government and citizens working together in more responsive, inclusive and accountable ways for the benefit of citizens. More responsive, inclusive and accountable attitudes and behaviour on the part of government and non-government stakeholders are the critical factors which lead to meaningful reform processes, and replicate and sustain reforms beyond the lifetime...

SAVI Approach Paper 10: Engaging State Governments - SAVI (DFID, 2015)
SAVI as a programme does not directly work with state governments – but we work in close conjunction with sister programmes who are supporting state governments on governance and sector reforms. SAVI supports non-government and SHoA partners to play their part in promoting more responsive, inclusive and accountable state governance delivering better services for citizens....

SAVI Approach Paper 11: Managing and Staffing an Adaptive Citizen Engagement Programme - SAVI (DFID, 2016)
SAVI, a DFID funded programme implemented by Palladium, is an adaptive programme putting learning and adaptation at the centre of all decision-making. In relation to management and staffing SAVI has established the following approaches to facilitate this: – An adaptive approach to programme management: Full time strategic technical leadership, that works closely with and complements...

SAVI Approach Paper 12: Managing Programme Finances to Support Adaptive, Locally-led Processes of Citizen Engagement in Governance - SAVI (DFID, 2016)
SAVI, is seeking to support processes of citizen engagement in governance in ways that are effective in influencing reform, and that are able to take on a life of their own without continuing donor support. SAVI is also an adaptive programme, putting learning and adaptation at the centre of all decision-making. Money is used and...

SAVI Approach Paper 13: Measuring Value for Money and using Value for Money Analysis - SAVI (DFID, 2016)
SAVI has established its own framework for assessing Value for Money in annual performance – in relation to expenditure, economy, efficiency, effectiveness and equity. Routine tracking and analysis of expenditure and economy ensure that inputs are supplied and services delivered to partners in line with SAVI’s core values, whilst also meeting DFID requirements and competing...

SAVI Approach Paper 14: Learning, Adaptation and Communications - SAVI (DFID, 2016)
SAVI, a DFID funded programme implemented by Palladium, is an adaptive programme, aiming to put learning and adaptation at the centre of all decision-making. Learning and adaptation takes place in SAVI at three levels: the work of partners; the work of SAVI delivery teams; and the enabling environment of the programme as a whole. Achieving...

SAVI Approach Paper 15: Introduction to PERL: the SAVI Successor Programme - SAVI (DFID, 2016)
In May 2016, SAVI transitioned into a successor programme – the ‘Engaged Citizens Pillar’ (ECP) of a wider DFID-funded governance reform programme ‘The Partnership to Engage, Reform and Learn’ (PERL). ECP is managed by the same service provider, Palladium, and the same core management team as SAVI, and many of the SAVI front line staff...

SAVI Approach Paper 2: Programme Design - SAVI (DFID, 2015)
SAVI supports citizen engagement in governance through a facilitated partnership approach, in contrast to the usual approach of grants to civil society organisations (CSOs). The overall aim is to facilitate and support working relationships and processes of reform that are home-grown, self-sustaining and, after initial engagement, not dependent on external support. Our way of working...

SAVI Approach Paper 3: Theory of Change - SAVI (DFID, 2015)
SAVI’s theory of change is a simple, practical guide that staff and partners use to plan and to monitor change – as well as to reflect on and enhance their own effectiveness. It sets out broad stages of attitude and behaviour change over time to facilitate effective citizen engagement in governance processes, systems and structures....

SAVI Approach Paper 4: Thinking and Working Politically - Supporting partners and staff through a participatory apporach to political economy analysis - SAVI (DFID, 2015)
Thinking and acting politically is central to the SAVI programme. We support staff and partners to analyse the power relations that shape change in their state, and to use this knowledge to inform their decision-making. This includes decisions made by SAVI state teams relating to the issues and partners they engage with and support, and...

SAVI Approach Paper 5: Defining and Measuring Results - SAVI (DFID, 2015)
SAVI aims to facilitate replicable and sustainable processes of citizen engagement in governance. The programme in each state is locally defined, flexible and adaptive, and results are not predictable in advance. Standardised monitoring tools are not applicable, and consequently we have evolved our tools and frameworks during the programme through processes of learning by doing....

SAVI Approach Paper 6: Engaging Civil Society - SAVI (DFID, 2015)
SAVI state teams provide support to CS groups to become more effective agents of citizens’ voice and public accountability, through a variety of mutually reinforcing interventions. These include: hands-on support to demonstration civil society Advocacy Partnerships (APs) facilitating working partnerships between civil society APs, SHoAs, and the media brokering working relationships between all of these...

SAVI Approach Paper 7: Promoting Gender Equality and Social Inclusion - SAVI (DFID, 2015)
We promote attention to gender equality and social inclusion in all of our engagement with CS groups, the media and SHoAs, and in all of the issues and processes they work on. In all the states we work in, we also support partners to focus on some issues and form some partnerships and networks which...

SAVI Approach Paper 8: Engaging the Media - SAVI (DFID, 2015)
The overall aim of SAVI engagement with the media is for media representation of citizens’ interests to become normal, and play its part in helping state governments to be more responsive, inclusive and accountable to their citizens. Media partners – individual media personnel and selected media houses – are supported to be more effective agents...

SAVI Approach Paper 9: Engaging State Houses of Assembly - SAVI (DFID, 2015)
The overall aim of SAVI engagement with SHoAs is to promote lasting reforms that are not dependent on external funding and which promote an increasingly more responsive and accountable relationship between Nigerian state governments and their citizens. SHoAs are supported to be more effective agents of citizen voice and public accountability, demanding better performance from...

Scale Up Sourcebook - Cooley, Larry; Howard, Julie (Purdue University, 2019)
The Scale Up Sourcebook is informed and inspired by the September 2018 conference, Innovations in Agriculture: Scaling Up to Reach Millions, organized by Purdue University, in partnership with the African Development Bank. The Sourcebook consolidates, extends, and disseminates some of the scaling insights presented at the Purdue conference. It is intended as an easy-to-use guidebook targeted to a broad and diverse audience of stakeholders associated with scaling agricultural technologies and innovations to meet the needs of the world’s poor. The Sourcebook has nine chapters: designing with scale in mind; assessing scalability; using commercial markets to drive scaling; financing the transition to scale; creating an enabling environment for scale; tailoring metrics, monitoring, and evaluation to support sustainable outcomes at scale; and the critical role of intermediary and donor organizations. The Sourcebook provides guidance, tips, and examples, along with links and references to additional resources on scale up.

Scale Up Sourcebook - Cooley, Larry; Howard, Julie (Scale Up Conference, 2019)
The Scale Up Sourcebook is informed and inspired by the September 2018 conference, Innovations in Agriculture: Scaling Up to Reach Millions, organized by Purdue University, in partnership with the African Development Bank. The Sourcebook consolidates, extends, and disseminates some of the scaling insights presented at the Purdue conference. It is intended as an easy-to-use guidebook targeted to a broad and diverse audience of stakeholders associated with scaling agricultural technologies and innovations to meet the needs of the world’s poor. The Sourcebook has nine chapters: designing with scale in mind; assessing scalability; using commercial markets to drive scaling; financing the transition to scale; creating an enabling environment for scale; tailoring metrics, monitoring, and evaluation to support sustainable outcomes at scale; and the critical role of intermediary and donor organizations. The Sourcebook provides guidance, tips, and examples, along with links and references to additional resources on scale up.

Scaled Agile Framework – SAFe for Lean Software and System Engineering 4.5 - Scaled Agile (2017)

Scaling accountability through vertically integrated civil society policy monitoring and advocacy - Fox, Jonathan (IDS, 2016)
This working paper argues that the growing field of transparency, participation and accountability (TPA) needs a conceptual reboot, to address the limited traction gained so far on the path to accountability. To inform more strategic approaches and to identify the drivers of more sustainable institutional change, fresh analytical work is needed. This paper makes the case for one among several possible strategic approaches by distinguishing between “scaling up” and “taking scale into account”. This proposition grounds an explanation of the vertical integration strategy, which involves multi-level coordination by civil society organisations of policy monitoring and advocacy, grounded in broad pro-accountability constituencies. To spell out how this strategy can empower pro-accountability actors, the paper contrasts varied terms of engagement between state and society, proposing a focus on collaborative coalitions as an alternative to the conventional dichotomy between confrontation and constructive engagement. The paper grounds this discussion by reviewing the rich empirical terrain of existing multi-level approaches, summarizing nine cases – three each in three countries – to demonstrate what can be revealed when TPA initiatives are seen through the lens of scale. It concludes with a set of broad analytical questions for discussion, followed by testable hypotheses proposed to inform future research agendas

Scaling Agile @ LEGO and Spotify – my talk at EA träff - Kniberg, Henrik (Crisp, 2017)

Scaling Agile @ Spotify with Tribes, Squads, Chapters & Guilds - Kniberg, Henrik; Ivarsson, Anders (Spotify, 2012)

Scaling Assessment Map: An Evolving Tool Supporting Innovation Scale Up - McClure, Dan; Gray, Ian (ThoughtWorks, 2016)
Nearly three years ago we wrote about the “Missing Middle” in the innovation lifecycle[i], a gap that kept successful pilot programs from reaching the goal of replication and optimization in multiple contexts. Since then, scaling humanitarian innovation has received a great deal of attention from the sector, with a number of new initiatives specifically focused on the scaling challenge.

Scaling Impact: Innovation for the Public Good - McLean, Robert; Gargani, John (Routledge, 2019)
Scaling Impact introduces a new and practical approach to scaling the positive impacts of research and innovation. Inspired by leading scientific and entrepreneurial innovators from across Africa, Asia, the Caribbean, Latin America, and the Middle East, this book presents a synthesis of unrivalled diversity and grounded ingenuity. The result is a different perspective on how to achieve impact that matters, and an important challenge to the predominant more-is-better paradigm of scaling. For organisations and individuals working to change the world for the better, scaling impact is a common goal and a well-founded aim. The world is changing rapidly, and seemingly intractable problems like environmental degradation or accelerating inequality press us to do better for each other and our environment as a global community. Challenges like these appear to demand a significant scale of action, and here the authors argue that a more creative and critical approach to scaling is both possible and essential. To encourage uptake and co-development, the authors present actionable principles that can help organisations and innovators design, manage, and evaluate scaling strategies. Scaling Impact is essential reading for development and innovation practitioners and professionals, but also for researchers, students, evaluators, and policymakers with a desire to spark meaningful change.
Google-Books-ID: 9X6YDwAAQBAJ
Keywords: Developing & Emerging Countries

Scaling: Innovations Missing Middle - McClure, Dan; Gray, Ian (ThoughtWorks, 2015)

Scaling Science - Gargani, John; McLean, Robert (Stanford Social Innovation Review, 2017)

Scaling the impact of sustainability initiatives: a typology of amplification processes - Lam, David P. M.; Martín-López, Berta; Wiek, Arnim; Bennett, Elena M.; Frantzeskaki, Niki; Horcea-Milcu, Andra I.; Lang, Daniel J. (Urban Transformations, 2020)
Amplifying the impact of sustainability initiatives to foster transformations in urban and rural contexts, has received increasing attention in resilience, social innovation, and sustainability transitions research. We review the literature on amplification frameworks and propose an integrative typology of eight processes, which aim to increase the impact of such initiatives. The eight amplification processes are: stabilizing, speeding up, growing, replicating, transferring, spreading, scaling up, and scaling deep. We aggregated these processes into three categories: amplifying within, amplifying out, and amplifying beyond. This integrative typology aims to stimulate the debate on impact amplification from urban and rural sustainability initiatives across research areas to support sustainability transformations. We propose going beyond an understanding of amplification, which focuses only on the increase of numbers of sustainability initiatives, by considering how these initiatives create transformative change.
Keywords: City; Rural; Scaling; Transformation; Transition; Transition initiative; Urban

Scaling up co-design - Dearden, Andrew; Light, Ann; Zamenopoulos, Theodore; Graham, Paula; Plouviez, Emma; de Sousa, Sophia (PDC 2014 : Reflecting connectedness : proceedings of the 13th Participatory Design Conference, 2014)
In this paper we reflect on our experiences in a project where academic researchers and social change organizations are working together to explore how participatory and co-design practices can be disseminated and spread within the 'third sector'. The research project is itself co-designed and co-produced, but within various constraints arising from research funding models. We explore both our immediate outputs and our learning about successful co-research models for this challenge.

Scaling Up Development Impact - Guerrero, Isabel; Gokhale, Siddhant; Fahsbender, Jossie (Bowker, 2023)
Today, nearly one billion people lack electricity, over three billion lack clean water, and 750 million lack basic literacy skills. Many of these challenges could be solved with existing solutions, and technology enables us to reach the last mile like never before. Yet, few solutions attain the necessary scale to match the size of these challenges. Scaling Up Development Impact offers an analytical framework, a set of practical tools, and adaptive evaluation techniques to accompany the scaling process. It presents rich organizational experiences that showcase real-world journeys toward increased impact. From the people from IMAGOgg.org

Scaling Up Development Programmes - UNDP (UNDP, 2013)
Many development organizations, national and local governments and civil society organizations are faced with the issue of scaling up development interventions — the main questions raised time and again are: a) what should be scaled up, and how it can be scaled up; b) is there a strong reason for a particular initiative to be scaled up; and c) what should be the value-added of the scaling up efforts, and how can practitioners ensure that technological and other innovations are being integrated for improved development effectiveness? Answers to these questions depend on a host of complex realities—the relative strengths and weaknesses in national and local systems, political and economic situations, including vulnerability of country systems to shocks, commitments from development partners, power dynamics between various groups and stakeholders in a given country, regional and global environments. For the United Nations Country Teams (UNCT) and UNDP offices, another factor to consider is how to maximize our respective comparative advantages. This guidance note summarizes the main conceptual thinking available from development institutions and academia, and presents a simplified conceptual framework and roadmap for scaling up processes. It also provides UNDP programme staff and UNCTs with practical actions and checklists to consider when designing and implementing programmes that support national scaling up initiatives, and proposes actions that can be undertaken at the regional and global levels. Although intended for internal audiences, the scaling up concept and recommendations can also be used by the public and private sector, civil society and social entrepreneurs. This note benefited from a wide consultative process held in 2011, including practical recommendations and proposals from colleagues at country offices and regional/global centres. Their insights have been instrumental in the distillation of main recommendations presented in this note, and the individuals who provided substantive contributions are gratefully noted in the Acknowledgements section.

Scaling up - From Vision to Large-Scale Change - A Management Framework for Practitioners - Cooley, Larry; Kohl, Richard; Ved, Rajani R. (MSI, 2016)
This document was originally published in 2006 and re-issued in a substantially revised Second Edition in 2012.

Scaling Up Inclusive Approaches for Marginalised and Vulnerable People - Carter, Becky; Joshi, Anu; Remme, Michelle (2018)
This rapid review summarises the evidence on how to scale up inclusive approaches to complex social change. It looks at how to design scalable inclusive change interventions, as well as how to plan and manage the scale-up process. Focusing on interventions with the aim of reaching the most marginalised and transform social norms, it covers programmes aiming to deliver inclusive outcomes for women and girls (with a particular focus on preventing violence against women and girls) and persons with disabilities. To date, many interventions seeking to change harmful gender and disability norms have been implemented as small-scale projects. There are limited experiences of scale-up and fewer evaluations of these experiences. However, there are some documented case studies as well as emerging analysis that draw out lessons learned. From this evidence base, this rapid desk review identifies eight critical issues commonly highlighted as important considerations when scaling up inclusive change interventions: 1. Opportunities for systemic approach, including integrating political and community-level scale-up, and coordinating across multiple sectors and stakeholders 2. Political support for scale-up 3. Strategic choices: balancing reach, speed, cost, quality, equity, and sustainability 4. Catalysing change: tipping points, diffusion effects, and local champions 5. Locally grounded, participatory, and adaptive approaches 6. Long-term approaches with funding models to match 7. Cost-effective and financially feasible scale-up strategies 8. Measuring impact and sustainability.

Scaling up Social Accountability in Complex Governance Systems: A Relational Approach for Evidencing Sustainability - Guerzovich, Florencia; Wadeson, Alix (World Bank, 2024)
When social accountability interventions scale up and their sustainability depends on the interactions of many agents and system components, related results are rarely observable at the end of an intervention. The 2019 OECD Development Assistance Committee’s (OECD DAC) revamped evaluations criteria for assessing sustainability acknowledges that such results are often emergent, and should be monitored and evaluated with this in mind. It therefore emphasizes a turn towards assessing complex processes prospectively. It also asks evaluations to consider how likely it is that these results are evident at the time they are monitored or evaluated. However,the social accountability field continues to have gaps regarding doing this effectively in practice. This paper presents and provides evidence from testing an innovative operational approach that has promising potential to support this aim - a sequential, relational rubric. This approach can support practitioners to monitor, evaluate and learn about the causal processes of scale up of social accountability interventions with an eye towards sustainability i.e., considering prospective sustainability. It is grounded in systems thinking, co-production and social learning theory, as well as links with collective governance and social contract theory for development. Evidence yielded from the authors’ testing of this approach on a sample of diverse projects from the Global Partnership for Social Accountability (GPSA) program revealed that the alleged ‘absence of evidence’ dilemma of social accountability scale up is due to ill-fitting concepts and methods for assessment. It challenges existing assumptions and findings that claim that social accountabilityprocesses do not scale and are unsustainable. The authors propose that by using fit-for-purpose concepts and methods with a focus on social learning and compromise – also called a ‘resonance pathway to scale’ which this paper discusses in detail – it is possible to observe loosely coordinated scale up processes at work in many (but not all) social accountability interventions and identify tangible evidence of prospective sustainability. An important caveat is that these processes, the outcomes they generate, and the corresponding evidence often look qualitatively different than the original intervention design and predictions for scale-up at that point in time. This is because the process of deliberation and compromise inherent to social accountability work in dynamic local systems introduces changes and new conditions for uptake by diverse actors in the public sector, civil society, and donor institutions. The paper concludes that even relatively small-scale localized projects of three to five years with budgets of less than one million USD, across different contexts and sectors can produce processes and outcomes which contribute to many forms of sustainability, including via scaleup.Furthermore, the cross-fertilization of learning and aggregation of results for scale-up across projects within and beyond the GPSA (and other programs) can help monitoring evaluation and learning (MEL) and social accountability practitioners alike to deliver on a program’s mandate. Doing so can also create new knowledge for the wider social accountability field that siloed interventions, lacking suitable concepts and methods for assessing scale-up and prospective sustainability, often fail to produce. The paper ends with recommendations for taking forward this approach and the associated benefits, implications and required investments.

Scenario-based strategizing: Advancing the applicability in strategists' teams - Lehr, Thomas; Lorenz, Ullrich; Willert, Markus; Rohrbeck, René (Technological Forecasting and Social Change, 2017)
For over 40years, scenarios have been promoted as a key technique for forming strategies in uncertain environments. However, many challenges remain. In this article, we discuss a novel approach designed to increase the applicability of scenario-based strategizing in top management teams. Drawing on behavioural strategy as a theoretical lens, we design a yardstick to study the impact of scenario-based strategizing. We then describe our approach, which includes developing scenarios and alternative strategies separately and supporting the strategy selection through an integrated assessment of the goal-based efficacy and robustness. To facilitate the collaborative strategizing in teams, we propose a matrix with robustness and efficacy as the two axes, which we call the Parmenides Matrix. We assess the impact of the novel approach by applying it in two cases, at a governmental agency (German Environmental Ministry) and a firm affected by disruptive change (Bosch, leading global supplier of technology and solutions).
Keywords: Behavioural strategy; Scenario-based strategizing; Scenarios; Strategic foresight; Uncertainty

Scenarios: An Explorer's Guide - Shell International (Shell International BV, 2008)
Exploring the Future The future is ‘terra incognita’: although we may be able to guess the outcome of events that lie close to us, as we project beyond this we enter an unmapped zone full of uncertainty. Paradoxically, the range of options this reveals can seem paralysing. No one can definitively map the future, but we can explore the possibilities in ways that are specifically intended to support decision-making. At Shell we use scenario building to help us wrestle with the developments and behaviours that shape what the future may hold and prepare ourselves more effectively. We also believe it can inspire individuals and organisations to play a more active role in shaping a better future - for themselves, or even on a global scale. In this book, we use a metaphor of exploration and map-making to describe how we think about building scenarios. Like a set of maps describing different aspects of a landscape, scenarios provide us with a range of perspectives on what might happen, helping us to navigate more successfully. Exploration - of a territory or the future - involves both analytical thinking rooted in whatever facts are clear, and also informed intuition. This book describes the approach used to develop a set of global scenarios, ‘People and Connections’ several years ago under the guidance of Ged Davis. Since then, scenarios guided by Albert Bressand have been published, and more recently Shell has published a summary of its Energy Scenarios, ‘Scramble’ and ‘Blueprints’, developed under the guidance of the current leadership. These have built on, and extended, our approach. Indeed, Shell has been working with scenarios for almost 40 years, and we are still learning. Since the environment we live and work in is constantly changing, building scenarios demands continual innovation and creativity.

Science, Technology, and Innovation in Uganda: Recommendations for Policy and Action - Brar, Sukdeep; Farley, Sara E.; Hawkins, Robert; Wagner, Caroline S. (World Bank, 2011)

Scrambling after Moving Targets: Monitoring & Evaluation Applied to Adaptive Management Approaches in Peacebuilding - Woodrow, Peter; Jean, Isabella (New Directions in Peacebuilding Evaluation, 2019)
In this landmark collection, the voices of pathMakers and innovators in peacebuilding evaluation are assembled to provide new direction for the field.
Keywords: IMPORTANT

Scrum For Dummies - Layton, Mark C. (John Wiley & Sons, 2015)
Practice an agile form of management to stop wasting time and money Scrum For Dummies is an easy to use guide to managing the tricky transition from a traditional project management methodology to the new and most popular agile framework. As the most efficient, successful methodology for team project management, Scrum relies on transparency, flexibility, and fluidity to deliver a final product that fulfills the needs of all stakeholders. Written in easy–to–read Dummies style, this book walks you through the core principles of Scrum and provides a roadmap for tangible implementation. The vast majority of projects go over budget, and billions of dollars are wasted every year on overruns. Put a stop to this wasteful leakage by switching to a management style that keeps all participants informed, up–to–date, and accountable. Authored by a Certified Scrum Trainer, Mark Layton, Scrum For Dummies covers the key ideas and processes behind Scrum methodologies, and presents the inner workings of the plan in an engaging and accessible format. Topics include: The Scrum values, roles, artifacts, and activities that make up the principle of this methodology When and how best to use Scrum The differences between Scrum and other agile methodologies Using Scrum for IT, finance, construction, health care, and more The book also delves into the everyday use of Scrum, and how it can help you achieve your own personal goals outside of work. There′s a reason why scrum is quickly becoming the standard approach to project management it works! If you want to stop wasting time and start producing more effectively, Scrum For Dummies is the guide that will get you there.

Scrum: The Art of Doing Twice the Work in Half the Time - Sutherland, Jeff (Crown Business, 2014)
We live in a world that is broken. For those who believe that there must be a more agile and efficient way for people to get things done, here from Scrum pioneer Jeff Sutherland is a brilliantly discursive, thought-provoking book about the leadership and management process that is changing the way we live. In the future, historians may look back on human progress and draw a sharp line designating "before Scrum" and "after Scrum." Scrum is that ground-breaking. It already drives most of the world's top technology companies. And now it's starting to spread to every domain where leaders wrestle with complex projects. If you've ever been startled by how fast the world is changing, Scrum is one of the reasons why. Productivity gains of as much as 1200% have been recorded, and there's no more lucid - or compelling - explainer of Scrum and its bright promise than Jeff Sutherland, the man who put together the first Scrum team more than twenty years ago. The thorny problem Jeff began tackling back then boils down to this: people are spectacularly bad at doing things with agility and efficiency. Best laid plans go up in smoke. Teams often work at cross purposes to each other. And when the pressure rises, unhappiness soars. Drawing on his experience as a West Point-educated fighter pilot, biometrics expert, early innovator of ATM technology, and V.P. of engineering or CTO at eleven different technology companies, Jeff began challenging those dysfunctional realities, looking for solutions that would have global impact. In this book you'll journey to Scrum's front lines where Jeff's system of deep accountability, team interaction, and constant iterative improvement is, among other feats, bringing the FBI into the 21st century, perfecting the design of an affordable 140 mile per hour/100 mile per gallon car, helping NPR report fast-moving action in the Middle East, changing the way pharmacists interact with patients, reducing poverty in the Third World, and even helping people plan their weddings and accomplish weekend chores. Woven with insights from martial arts, judicial decision making, advanced aerial combat, robotics, and many other disciplines, Scrum is consistently riveting. But the most important reason to read this book is that it may just help you achieve what others consider unachievable - whether it be inventing a trailblazing technology, devising a new system of education, pioneering a way to feed the hungry, or, closer to home, a building a foundation for your family to thrive and prosper.

Second (and Third) Thoughts on Adaptive Management and Thinking and Working Politically - Green, Duncan (From Poverty to Power, 2022)
Self-Critical reflections on AM and TWP. Linking it with The Hype Cycle - "it feels like we are heading downward to the ‘trough of disillusionment’ form the initial peak of ‘inflated expectations’, but we will bounce back to something more sustained, that becomes a permanent feature of the aid landscape".

Seeing (from) Digital Peripheries: Technology and Transparency in Kenya’s Silicon Savannah - Poggiali, Lisa (Cultural Anthropology, 2016)

Seeing the Combined Effects of Aid Programmes - Burge, Richard; Nadelman, Rachel; McGee, Rosie; Fox, Jonathan; Anderson, Colin (IDS, 2022)
Multiple aid agencies often try to support change in the same places, at the same time, and with similar actors. Surprisingly, their interactions and combined effects are rarely explored. This Policy Briefing describes findings from research conducted on recent aid programmes that overlapped in Mozambique, Nigeria, and Pakistan, and from a webinar with UK Foreign, Commonwealth & Development Office (FCDO) advisors and practitioners. The research found three distinct categories of ‘interaction effects’: synergy, parallel play, and disconnect. We explore how using an ‘interaction effects’ lens in practice could inform aid agency strategies and programming.
Accepted: 2022-05-10T09:42:35Z Publisher: Institute of Development Studies

Seeking balanced ownership in changing development cooperation relationships - Keijzer, Niels; Klingebiel, Stephan; Örnemark, Charlotte; Scholtes, Fabian (Expert Group for Aid Studies, 2018)
According to the Paris Declaration and the 2030 Agenda, ownership is a prerequisite for effective development cooperation. How can the principle of ownership be promoted in today’s complex development cooperation, in which the numbers of actors have increased? This is the subject of the Expert Group for Aid Studies report Seeking balanced ownership in changing development cooperation relationships. The report contains two country case studies – on Liberia and Rwanda – as well as interviews with the Swedish International Development Cooperation Agency (Sida) and the Ministry for Foreign Affairs, and studies on documents concerning ownership in a Swedish development cooperation context. The authors note that ownership remains relevant as a guiding principle in international development cooperation. The trend from country-to-country cooperation to various forms of support through UN bodies and specialised global funds has created new conditions and competing interests for ownership. An understanding of ownership and how it can be promoted in the complex reality of today needs to be thoroughly re-examined. The study recommends the following: 1. Starting a discussion within the OECD-DAC on effective development cooperation that has global ownership right up to the end of the process. 2. Establishing an international code of conduct in accordance with agreed ownership principles concerning development cooperation funding to and via UN bodies and global funds. 3. Sweden should formulate an explicit policy and approach for how to promote ownership in development cooperation that includes numerous partners.

Self Sabotage: Why Doing the Right Thing Results in Failure - Newell, Peter (War on the Rocks, 2020)
In January 2010 improvised explosive device (IED) attacks against dismounted infantry squads in Afghanistan numbered in the single digits — with only two

Sense and Respond: How Successful Organizations Listen to Customers and Create New Products Continuously - Gothelf, Jeff; Seiden, Josh (Harvard Business Review Press, 2017)
The End of Assembly Line ManagementWe’re in the midst of a revolution. Quantum leaps in technology are enabling organizations to observe and measure people’s behavior in real time, communicate internally at extraordinary speed, and innovate continuously. These new, software-driven technologies are transforming the way companies interact with their customers, employees, and other stakeholders.This is no mere tech issue. The transformation requires a complete rethinking of the way we organize and manage work. And, as software becomes ever more integrated into every product and service, making this big shift is quickly becoming the key operational challenge for businesses of all kinds. We need a management model that doesn’t merely account for, but actually embraces, continuous change. Yet the truth is, most organizations continue to rely on outmoded, industrial-era operational models. They structure their teams, manage their people, and evolve their organizational cultures the way they always have.Now, organizations are emerging, and thriving, based on their capacity to sense and respond instantly to customer and employee behaviors. In Sense and Respond, Jeff Gothelf and Josh Seiden, leading tech experts and founders of the global Lean UX movement, vividly show how these companies operate, highlighting the new mindset and skills needed to lead and manage them—and to continuously innovate within them.In illuminating and instructive business examples, you’ll see organizations with distinctively new operating principles: shifting from managing outputs to what the authors call “outcome-focused management”; forming self-guided teams that can read and react to a fast-changing environment; creating a learning-all-the-time culture that can understand and respond to new customer behaviors and the data they generate; and finally, developing in everyone at the company the new universal skills of customer listening, assessment, and response.This engaging and practical book provides the crucial new operational and management model to help you and your organization win in a world of continuous change.

Sense-making with stakeholders and rubrics - King, Julian (Evaluation and Value for Investment, 2023)
Principles and processes

Sensemaking Workshop Preparation Guide and Facilitator Guide and Sensemaking Training - UNDP (UNDP, 2022)
Based on experience from running Sensemaking workshops for UNDP offices and government partners, the Asia-Pacific Regional Innovation Centre developed the Sensemaking Preparation Guide and Facilitator Guide to share its knowledge with teams and organization that are interested in using the Sensemaking process.

Sensing and Cyberinfrastructure for Smarter Water Management: The Promise and Challenge of Ubiquity - Hill David; Kerkez Branko; Rasekh Amin; Ostfeld Avi; Minsker Barbara; Banks M. Katherine (Journal of Water Resources Planning and Management, 2014)

Set-theoretic methods for the social sciences: a guide to qualitative comparative analysis - Schneider, Carsten Q.; Wagemann, Claudius (Cambridge Univ. Press, 2012)
"Qualitative Comparative Analysis (QCA) and other set-theoretic methods distinguish themselves from other approaches to the study of social phenomena by using sets and the search for set relations. In virtually all social science fields, statements about social phenomena can be framed in terms of set relations, and using set-theoretic methods to investigate these statements is therefore highly valuable. This book guides readers through the basic principles of set theory and then on to the applied practices of QCA. It provides a thorough understanding of basic and advanced issues in set-theoretic methods together with tricks of the trade, software handling and exercises. Most arguments are introduced using examples from existing research. The use of QCA is increasing rapidly and the application of set-theory is both fruitful and still widely misunderstood in current empirical comparative social research. This book provides an invaluable guide to these methods for researchers across the social sciences"–
Keywords: Comparative method; Mathematical models; Qualitative Methode; Set theory; Social science; Vergleichende Forschung

Setting new standards for better MEL. Lessons for grantees & funders - Colnar, Megan; Azevedo, Andrea; Tolmie, Courtney; Caddick, Hannah (Better Evaluation, 2023)
How can donors and grantees work together to create effective monitoring, evaluation, and learning (MEL) practices that drive field-wide transformation? The Open Society Foundation’s Fiscal Governance Program found success by focusing on six key approaches, including empowering grantees and relinquishing power. In 2021, an external close-out evaluation by Intention to Impact of the program (which ran for 7 years and gave over $150 million in grants) revealed something pretty remarkable—the program’s deliberate focus on strengthening field-wide monitoring, evaluation, and learning practices was a success. Substantial capacity increases were observed across key institutions and grantees, new complexity-sensitive practices and methods were being actively championed and deployed, and a growing community of better-connected practitioners were exchanging tips and tricks on how to apply smart, context-specific MEL across fiscal governance issues. What’s more, in this evaluation, most grantees gave high praise to these efforts. So, how did this come about? We detail the six different approaches we used in our new publication Setting new standards for better MEL: Lessons for funders and grantees. The approaches range from checking power dynamics to growing skills for evaluative thinking and seeding peer learning and field-wide research. The publication is paired with a toolkit and showcases resources we used and iterated on across the various approaches.

“Shared learning” for building urban climate resilience – experiences from Asian cities - Orleans Reed, Sarah; Friend, Richard; Toan, Vu Canh; Thinphanga, Pakamas; Sutarto, Ratri; Singh, Dilip (Environment and Urbanization, 2013)
This paper considers how resilience thinking and, in particular, its emphasis on learning has been applied in 10 cities in Vietnam, India, Thailand and Indonesia. Applying a “shared learning” approach in the Asian Cities Climate Change Resilience Network (ACCCRN) has helped to create or strengthen networks, build appreciation for complexity and uncertainty among stakeholders, provide a space for deliberating concepts such as vulnerability and resilience, and build knowledge and capacities for stakeholders to engage and represent their own interests. Shared learning approaches face considerable challenges navigating politicized urban environments, in which the nature and value of existing systems − and therefore the value of building resilience − are contested. This article suggests that deliberate, strategic intervention by facilitators may contribute to more transformative change on behalf of equitable, socially just outcomes – and thus cautions against seeing urban climate vulnerability as a technical challenge, or shared learning as a “toolkit” for building resilience.

Shifting Power? Assessing the Impact of Transparency and Accountability Initiatives - McGee, Rosie; Gaventa, John (IDS, 2011)
This paper arises from a review of the impact and effectiveness of transparency and accountability initiatives which gathered and analysed existing evidence, discussed how it could be improved, and ev...

Short Course - Adaptive Management, an overview - Bazaz Smith, Komal (American University, 2019)

Should development agencies have official views? - Ellerman, David (Development in Practice, 2002)

Should the Principles of Digital Development be Agile? - ICTworks (ICT Works, 2016)
Recently, Abt Associates endorsed the “Principles of Digital Development.” These nine principles have been widely adopted by international development funders and practitioners to absorb and disseminate technology best practices in the field of international development. More than 50 organizations ranging from various offices in the United Nations and the U.S. Agency for International Development (USAID) down to niche technology providers have endorsed the principles. The principles are aimed at moving the field away from a disconnected series of technology pilots, each of which are largely ad hoc and duplicate many of the same lessons, and toward scalability and sustainability. Ann Mei Chang, the Executive Director of the U.S. Global Development Lab at USAID in her foreword to the recent report “From Principle to Practice: Implementing the Principles for Digital Development”, characterized the problem that these principles are trying to address as follows: “Pilots have failed to move

Shoulder to Shoulder - Hymowitz, Dan (Tony Blair Africa Governance Initiative, 2016)

Si Guides on System Innovation - Colchester, Joss; Si Network (Si Network, 2023)
So you have just hear about systems thinking and systems innovation and are keen to know more, Ok sparky let's get started.We have structured all the content into four main areas that we think you ...

Signal Left, Turn Right: Central Rhetoric and Local Reform in China - Huang, Haifeng (Political Research Quarterly, 2013)
How have local governments in China been able to break through central policy restrictions in a unitary and authoritarian political system? Why is China's official discourse in the reform era often so conservative and unfavorable to reform? The author argues the two issues are components of a signaling game between China's central government and local officials, in which local officials know that the center may be reformist, but the reformist center imitates the rhetoric of a conservative center to control the pace of local liberalization. The result is a gradualist reform of "signaling left, turning right," with glaring incongruity of speech and actions in the process.

Simple Habits for Complex Times: Powerful Practices for Leaders - Berger, Jennifer Garvey; Johnston, Keith (Stanford University Press, 2016)

Simplicity, Accountability and Relationships: Three ways to ensure MEL supports Adaptive Management - Roche, Chris (From Poverty to Power, 2018)
Based on a recent discussion in Manila, Chris Roche reflects on how Monitoring, Evaluation and Learning can better support 'adaptive programming'.

Six Simple Rules: How to Manage Complexity without Getting Complicated - Morieux, Yves; Tollman, Peter (Harvard Business Review Press, 2014)
New tools for managing complexityDoes your organization manage complexity by making things more complicated? If so, you are not alone.According to The Boston Consulting Group’s fascinating Complexity Index, business complexity has increased sixfold during the past sixty years. And, all the while, organizational complicatedness—that is, the number of structures, processes, committees, decision-making forums, and systems—has increased by a whopping factor of thirty-five. In their attempt to respond to the increasingly complex performance requirements they face, company leaders have created an organizational labyrinth that makes it more and more difficult to improve productivity and to pursue innovation. It also disengages and demotivates the workforce.Clearly it’s time for leaders to stop trying to manage complexity with their traditional tools and instead better leverage employees' intelligence. This book shows you how and explains the implications for designing and leading organizations.The way to manage complexity, the authors argue, is neither with the hard solutions of another era nor with the soft solutions—such as team building and feel-good “people initiatives”—that often follow in their wake. Based on social sciences (notably economics, game theory, and organizational sociology) and The Boston Consulting Group’s work with more than five hundred companies in more than forty countries and in various industries, authors Yves Morieux and Peter Tollman recommend six simple rules to manage complexity without getting complicated.Showing why the rules work and how to put them into practice, Morieux and Tollman give managers a much-needed tool to reinvigorate people in the face of seemingly endless complexity. Included are detailed examples from companies that have achieved a multiplicative effect on performance by using them.It’s time to manage complexity better. Employ these six simple rules to foster autonomy and cooperation and to effectively handle business complexity. As a result, you will improve productivity, innovate more, reengage your workforce, and seize opportunities to create competitive advantage.
Keywords: Complexity; Design Thinking

Six things that help grant-makers learn and adapt - Murray, Aoife (Itad, 2017)
There’s an emerging body of literature identifying key strategies that can both improve learning and enable adaptive management amongst grant-makers. We recently reviewed a host of publications from eight grant-making organisations. Those organisations have diverse aims and approaches but we’ve identified six common themes that stand out: Strong leadership and facilitation enables successful learning and …

Skills, atitudes and behaviours that fuel public innovation - a guide to getting the most from Nesta's Competency Framework for Experimenting and Public Problem Solving - Nesta (Nesta, 2018)

Small Foundation Network Partner Evaluation Toolkit: Network Evaluation for Network Coordinators - Small Foundation (2021)
This Toolkit This Toolkit presents an approach to network evaluation that is designed for network coordinators. This Toolkit provides guidance for network coordinators on how to: • More effectively use information they are already collecting as part of their routine coordination duties; • Collect other useful data that would support their network’s health and development; • Integrate network evaluation tasks into network activities, like convenings, to streamline the process; • Use data to effectively coordinate, grow, and sustain their networks. The Toolkit also provides examples of surveys, questionnaires, and dashboards, as well as tips for easy implementation.

Small Foundation Network Partner Evaluation Toolkit Network Evaluation for Network Coordinators Frequently Asked Questions - Small Foundation (Small Foundation, 2021)
This Frequently Asked Questions (FAQ) document is written for Small Foundation network partners. It accompanies Network Partner Evaluation Toolkit, which outlines four evaluation tools that Small Foundation is encouraging, and supporting, its network partners to use to improve their operations and, ultimately, increase their impact. This FAQ document answers typical questions about these evaluation tools and provides additional detailed recommendations for how network coordinators can effectively implement them. This document has five sections: 1) A brief introduction to network theory and the value of evaluation for network coordinators. 2) An overview of the four evaluation tools and answers general questions about incorporating evaluation into network coordination duties. 3) Recommendations regarding the Network Coordinator Administrative Information (tool #1). 4) Information about Social Network Analysis (tool #2). 5) Recommendations regarding the Network Participant Survey (tool #3). 6) Information about the Collaborative Activity Dashboard (tool #4).

Small-scale farmers in a 1.5°C future: The importance of local social dynamics as an enabling factor for implementation and scaling of climate-smart agriculture - Martinez-Baron, Deissy; Orjuela, Guillermo; Renzoni, Giampiero; Loboguerrero Rodríguez, Ana María; Prager, Steven D (Sustainability governance and transformation 2018, 2018)
Climate-smart agriculture (CSA) has the potential to help farmers implement both adaptation and mitigation practices. The mitigation aspect of CSA is often not considered by farmers due to a high discount rate and, as such, adaptation is usually the priority concern. This review article offers perspective on this issue and highlights two key gaps in the literature: (i) understanding of factors related to the uptake of adaptation practices with co-benefits for mitigation and, (ii) the role of social networks to better enable rapid, widespread implementation of CSA, the latter being critical to bringing CSA to scale. The systematic review treated literature on synergies between adaptation, mitigation and social networks in the rural sector, as well as case studies illustrating the importance of social networks in climate change interventions when addressing synergies in adaptation and mitigation. We find that additional research is required that explicitly focuses on how social networks and social capital may be harnessed to hasten the adoption and uptake of highly synergistic CSA practices. This will facilitate both adaptation in the near term and contribute to mitigation at scale, allowing small-scale farmers to both benefit from and contribute to a 1.5°C future.

Smart Environmental Monitoring Using Wireless Sensor Networks - El-Bendary, Nashwa; Fouad, Mohamed; Ramadan, Rabie; Banerjee, Soumya; Hassanien, Aboul (Wireless Sensor Networks, 2013)

Smart Implementation of complex change processes - Beier, Christoph; Kirsch, Renate (Global Solutions Journal, 2020)
Cooperation management facilitates the recoupling of progress toward sustainable development

Smart Risks: How small grants are helping to solve some of the world's biggest problems - Lentfer, Jennifer; Cothran, Tanya (Practical Action Publishing, 2017)
As never before, international aid is in the hands of ordinary people. Concerned citizens in wealthy countries are starting philanthropy groups, joining giving circles, and travelling internationally to lend support. Yet, they are torn between the feelings that 'something' must be done about global poverty and that foreign assistance is creating dependency and fueling corruption overseas.A growing community of international small grant-makers know how to find and fund effective grassroots initiatives. Compared to donor-controlled, large-scale, project-based international aid funding, small grant-makers use the concept of 'smart risks' to build upon existing human and social capital and to make a lasting changes in people's lives. Smart Risks brings together the wisdom of experts with wide-ranging experience within the development sector. Their contributions focus on five guiding question, such as 'who is a smart risk?' and 'what is your role in smart risks?' They include case studies, personal stories of lessons learned over time, provocative insights on power and privilege, and practical frameworks for choosing, investing in, and measuring the impact of grassroots organizations and movements. This book is essential reading for all those who wonder how their donations and work can make a difference in developing countries - from aid agency staff and policy makers, to globally engaged individuals.

Snapshot of Adaptive Management in Peacebuilding Programs - Queen, Emily Forsyth; Baumgardner-Zuzik, Jessica; Hume, Elizabeth; Greenberg, Melanie (Alliance for Peacebuilding, 2018)
The Alliance for Peacebuilding developed the report Snapshot of Adaptive Management in Peacebuilding Programs with support from Humanity United. This report examines how existing organizational programs are designing and learning from adaptive management in a conflict effected and fragile states. It further provides practical recommendations for applying adaptive management to peacebuilding programs based on synthesis … Continue reading "Snapshot of Adaptive Management in Peacebuilding Programs"
Keywords: KEY