Evaluation of the market systems development approach: Lessons for expanded use and adaptive management at Sida Volume II: Case studies - Ruffer, Tim; Bailey, Helen; Dahlgren, Stefan; Spaven, Patrick; Winters, Mark (Sida, 2018)
This report presents the findings of an evaluation of Sida’s management of the market systems development (MSD) approach. It aims to inform thinking on how Sida can best manage its growing portfolio of MSD programs. Beyond this, it provides insights relevant to Sida’s wider support to complex and adaptive programs. The evaluation identified several factors that affect Sida’s ability to ensure that conducive conditions are in place for effective MSD programs and good development programming more generally. Sida’s relatively flexible framework of rules, guidelines and systems for project management provide the space needed for staff to innovate and manage adaptively. But for this to happen consistently and effectively, Sida needs to invest more deliberately in building the capacity of its staff in relevant areas. In addition, leadership and incentives are key to shaping a culture of active experimentation and learning. This needs to be supported with clearer guidance for those involved in the design and appraisal of MSD projects; and strengthened oversight of project performance, including through adjustments to Sida’s contracts and funding agreements.

Parliament and the people - Rumbul, Rebecca; Moulder, Gemma; Parsons, Alex (2018)
How digital technologies are shaping democratic information flow in Sub-Saharan Africa

An Introduction to Adaptive Management for Threatened and Endangered Species - Runge, Michael C. (Journal of Fish and Wildlife Management, 2011)
Management of threatened and endangered species would seem to be a perfect context for adaptive management. Many of the decisions are recurrent and plagued by uncertainty, exactly the conditions that warrant an adaptive approach. But although the potential of adaptive management in these settings has been extolled, there are limited applications in practice. The impediments to practical implementation are manifold and include semantic confusion, institutional inertia, misperceptions about the suitability and utility, and a lack of guiding examples. In this special section of the Journal of Fish and Wildlife Management, we hope to reinvigorate the appropriate application of adaptive management for threatened and endangered species by framing such management in a decision-analytical context, clarifying misperceptions, classifying the types of decisions that might be amenable to an adaptive approach, and providing three fully developed case studies. In this overview paper, I define terms, review the past application of adaptive management, challenge perceived hurdles, and set the stage for the case studies which follow.

Doing the Transparent State: open government data as performance indicators - Ruppert, Evelyn; others (A World of Indicators: The production of knowledge and justice in an interconnected world, 2013)

Causal Loop Diagrams: Little Known Analytical Tool | iSixSigma - Rushing, William (2010)
The causal loop diagram is an analytical tool that is seldom used in Six Sigma but nonetheless is still very valuable. It is a foundational tool used in system dynamics, a method of analysis used to develop an understanding of complex systems.

Towards ‘Targeted Systems Change’ - Rye, Sam (Fieldnotes by Sam Rye, 2019)
Modelling and communicating how to shift systems

Volume 3: Participatory Monitoring, Evaluation, and Learning in Complex Adaptive Environments - SACE (SACE Program, 2018)
This volume is the last in a series of papers about systems approaches in complex environments, which includes the use of the collective impact model to address large-scale social problems, and the application of participant-driven MEL techniques across 17 networks of civil society organizations. It is based on the experiences of Root Change and Chemonics, two development partners working on a USAID civic engagement project in Nigeria (2013-2018), as well as hundreds of civil society organization partners. This is the final paper in the series and aims to highlight how the adaptation of participatory monitoring, evaluation, and learning techniques (e.g., most significant change, outcome mapping, and outcome harvesting) evolved and ultimately empowered cluster members. The first paper in the series presented a brief introduction to systems approaches in advocacy settings, the SACE theory of change, and the scope of Root Change’s work as technical lead on capacity building and measurement. The second volume aims to address the innovative use of the advocacy strategy matrix, adapted from work by the Center for Evaluation Innovation, for collective impact and the Collective Impact Model, an approach that engages multiple players in working together to solve complex social problems.

Doing things differently: Rethinking monitoring and evaluation to understand change - Saferworld (Saferworld, 2016)
Doing things differently: Rethinking monitoring and evaluation to understand change Learning paper Over the past four years, Saferworld has put in place a way of monitoring, evaluating and learning from our work focused on behaviour and relationship change. This paper outlines the process we have gone through to adapt, embed, and embrace an approach inspired by Outcome Mapping and Outcome Harvesting (OH). Key benefits of our monitoring, evaluation and learning approach are: It is simple, but promotes complex discussion and analysis. It allows conflict- and gender-sensitivity to be built into programmes; it promotes analysis of and adaptation to context. Bringing front-line staff and partners into wider conversations with others substantially increases cross-organisational learning.

Defining and using evidence in conservation practice - Salafsky, Nick; Boshoven, Judith; Burivalova, Zuzana; Dubois, Natalie S.; Gomez, Andres; Johnson, Arlyne; Lee, Aileen; Margoluis, Richard; Morrison, John; Muir, Matthew; Pratt, Stephen C.; Pullin, Andrew S.; et al. (Conservation Science and Practice, 2019)
There is growing interest in evidence-based conservation, yet there are no widely accepted standard definitions of evidence, let alone guidance on how to use it in the context of conservation and natural resource management practice. In this paper, we first draw on insights of evidence-based practice from different disciplines to define evidence as being the “relevant information used to assess one or more hypotheses related to a question of interest.” We then construct a typology of different kinds of information, hypotheses, and evidence and show how these different types can be used in different steps of conservation practice. In particular, we distinguish between specific evidence used to assess project hypotheses and generic evidence used to assess generic hypotheses. We next build on this typology to develop a decision tree to support practitioners in how to appropriately use available specific and generic evidence in a given conservation situation. Finally, we conclude with a discussion of how to better promote and enable evidence-based conservation in both projects and across the discipline of conservation. Our hope is that by understanding and using evidence better, conservation can both become more effective and attract increased support from society.
Keywords: Adaptive Management; Evidence-based conservation; Evidence-based practice; Natural resource management; Project management; biodiversity; environmental evidence

Defining the burden of proof in conservation - Salafsky, Nick; Redford, Kent H. (Biological Conservation, 2013)
Conservationists often must take action in the face of uncertainty about the costs and benefits of different options. Although this uncertainty can be paralyzing when the stakes are high, there is obviously a cost to inaction as well as action, and decision makers need to be encouraged to act when appropriate. Many other fields of human endeavor such as law, medicine, and public safety have formally developed the “burden and standards of proof” that decision makers have to meet in choosing to take action. In this paper, we review the standards developed in these other fields to help define a similar framework for conservation. Specifically we propose that a conservation decision maker must assume the burden of proof when there is a decision to act that substantially affects others, in which the decision maker has professional standing, where there is not immediate urgency, and where there is some, but not complete certainty about the outcomes of acting versus not acting. Once these initial tests have been met, in situations in which the decision maker is more worried about the consequences of not acting, then a relatively low standard of proof is required for taking action. If the decision maker is concerned with the consequences of acting in error, but the action is relatively reversible, then a medium standard of proof is required. And finally, if there are concerns about the consequences of acting in error, but the action is relatively irreversible, then a high standard of proof is required.
Keywords: Biodiversity; Burden of proof; Decision theory; Standard of proof; Uncertainty

From analysis to action: operationalising learning and adaptation in Savings at the Frontier - Salehi, Yusef (2016)
Keywords: IMPORTANT

The Internet and Democracy Building in Lusophone African Countries - Salgado, Dr Susana (Ashgate Publishing, Ltd., 2014)
This timely book fills an important gap in the literature on the influence of the Internet and new media in Portuguese speaking African countries. Based on extensive field work throughout the region the author examines the influence of the Internet in the transition to democracy in Africa, and asks whether there are new possibilities for popular activism to emerge from evolving communication environments and media systems.The book analyses the different forms of democracy, the concept of development, and addresses the debate about the relationship between democracy and development and explores the influence of the media in the democratization process, the promises that digital media bring to this process and to development and the implications of the African digital divide. In certain countries in this region democracy and independent news media are in their infancy but are starting to take hold, giving an excellent opportunity to observe the dynamics of civil society and the influence of increased freedom, new voting powers and new media in particular. The book offers important insights into the roles and functions that the media in general, and the Internet in particular, can perform in the creation of a more democratic society, as well as in empowering and educating citizens in democratic values.
Google-Books-ID: WC3jBAAAQBAJ
Keywords: Business & Economics / Industries / Computers & Information Technology; History / Africa / General; Political Science / Political Ideologies / Democracy

Help! I’m hiring new staff and I want them to work adaptively. A guide to hiring adaptive employees. - Salib, Monalisa (USAID LEARN, 2019)
If you are involved in hiring, this tool can help you increase your chances of selecting staff members skilled in adaptive management. It will help answer the questions: Which competencies should I recruit for in order to hire more adaptive employees? Which desired qualifications should I incorporate into position descriptions to attract adaptive employees? Which interview questions should I ask to screen for adaptive employee competencies? You should use this tool when you decide to hire a new individual - whether that be a direct hire, contractor, or consultant - or when you are changing an individual’s current position description or scope of work. Specifically, this tool will help you determine which qualifications are most important for the position and offers interview questions you can use with candidates. — You’re in luck! We just released a new guide for hiring adaptive employees. This visual and user-friendly tool will help increase your chances of selecting staff skilled in adaptive management. Here are the details: What do you mean by “work adaptively” or an “adaptive employee”? An adaptive employee is an individual who, in collaboration with relevant stakeholders, systematically acquires and uses knowledge to make decisions and adjustments in their work in order to achieve greater impact. Why focus on adaptive employees? Why does it matter? With industries, technologies, and organizations in a near constant state of flux, leaders are recognizing the importance of adaptability as a critical capacity. Because of this, it’s not surprising that a recent LinkedIn report found that adaptability was the most important soft skill hiring managers were screening for. In addition, evidence shows that teams that apply more data-driven and adaptive leadership practices perform better than those that focus less on these practices. It makes sense, then, that managers want to recruit more team members who are skilled in adaptive management - it helps achieve results. Who should use this tool? Anyone involved in hiring, responsible for developing or approving position descriptions, participating in interviews, and/or approving new hires. When should I use this tool? Use it as soon as you decide to hire a new staff person or when you’re adjusting existing position descriptions. What does the tool help me do? It will help you think through: Which competencies should I recruit for in order to hire more adaptive employees? Which desired qualifications should I incorporate into position descriptions to attract adaptive employees? (You can even copy and paste qualification language from the tool into scopes of work!) Which interview questions should I ask to screen for adaptive employee competencies? (You can copy and paste interview questions into your screening, interview, and reference check protocols!) Has the tool been tested? Yes, staff within USAID’s Global Development Lab and on the USAID LEARN contract tested the tool, providing feedback on the minimum viable product and subsequent versions. Testers confirmed finding the tool useful, and gave it a 9/10 score when asked if they would recommend it to colleagues. Some specific feedback from testers included: "The tool prompts deeper thought on what you might need and want in a job candidate" and "All [of the interview questions I used from the tool] worked well." What about the existing staff? How can they gain greater skills in adaptive management? Existing USAID staff and implementing partners can access online training in collaborating, learning, and adapting (CLA) and find resources in the CLA Toolkit. USAID staff also have access to an internal CLA community of practice and five-day, in-person CLA training.

“There’s no money for that.” Three Ways to Resource Collaborating, Learning, and Adapting - Salib, Monalisa (USAID Learning Lab, 2016)
This blog is the third in an ongoing series exploring the components of USAID's CLA Framework. Here is the first blog on organizational culture and the second on effective learning.

How to create an agile organization - survey - Salo, Olli; Ahlbäck, Karin; Fahrbach, Clemens; Murarka, Monica (McKinsey & Co., 2017)
Eighteen practices for organizational agility The survey asked respondents about a series of specific actions that underlie each of the 18 practices (9 of them stable, and 9 dynamic) of organizational agility; all of the practices are summarized in the table below. To rate respondents’ organizations, we asked how frequently their performance units engaged in each action that supports a given practice.

Has Kenya’s ICT revolution triggered more citizen participation? - Salome, Nyambura (Institute of Development Studies, 2016)
Lessons from policy in Ghana, Kenya, South Africa and Tanzania
Keywords: IMPORTANT

Miradi Measures Dashboard Demo - Salzer, D (2013)
Live demonstration (view in HD) of a new online measures dashboard site (http://miradi.sitkatech.com) that allows users of the Miradi Adaptive Management software (http://miradi.org) to share the progress they are making towards achieving their desired results

PDIA Course: Alumni are already practicing what they learned - Samji, Salimah (Building State Capability, 2017)
written by Salimah Samji We offered 4 free PDIA online courses between November 2015 and June 2016. They were well received and 365 people, living in 56 countries, successfully completed the course…

PDIA Notes 2: Learning to Learn - Samji, Salimah (Building State Capability, 2016)
written by Peter Harrington After over two years of working with the government of Albania, and as we embark on a new project to work with the government of Sri Lanka, we at the Building State Capa…

Caja de Herramientas PDIA - Un enfoque “hazlo tú mismo” para resolver problemas complejos - Samji, Salimah; Andrews, Matt; Pritchett, Lant; Woolcock, MIchael (Center for International Development at Harvard University, 2018)
(Spanish version of he PDIA toolkit) The PDIAtoolkit is designed to guide you through the process of solving complex problems which requires working in teams. We call it a Do-it-Yourself (DIY) kit, where the ‘you’ is a committed team of 4-6 people mobilized to work together to solve a complex problem that cannot be solved by one person.

PDIA Toolkit - A DIY Approach to Solving Complex Problems - Samji, Salimah; Andrews, Matt; Pritchett, Lant; Woolcock, MIchael (Center for International Development at Harvard University, 2018)
The PDIAtoolkit is designed to guide you through the process of solving complex problems which requires working in teams. We call it a Do-it-Yourself (DIY) kit, where the ‘you’ is a committed team of 4-6 people mobilized to work together to solve a complex problem that cannot be solved by one person.

Perspectives on Participation in Design - Sanders, Elizabeth (Wer gestaltet die Gestaltung? Praxis, Theorie und Geschichte des partizipatorischen Designs, 2013)
OCLC: 930782596
Keywords: Design

Probes, toolkits and prototypes: three approaches to making in codesigning - Sanders, Elizabeth B.-N.; Stappers, Pieter Jan (CoDesign, 2014)
The role of making in the design process has been growing, taking on new forms and involving new players over the past 10 years. Where we once primarily saw designers using making to give shape to the future, today we can see designers and non-designers working together, using making as a way to make sense of the future. In this paper, we describe the landscape of design research and practice at the end of 2013 with special attention to the role of making across these perspectives: approach (cultural probes, generative toolkits and design prototypes), mindset (designing for people and designing with people), focus in time (the world as it is, the near future and the speculative future) as well as variations in design intent (provoking, engaging and serving).

Using Systemigrams in Problem Definition: A Case Study in Maritime Resilience for Homeland Security - Sauser, Brian; Mansouri, Mo; Omer, Mayada (Journal of Homeland Security and Emergency Management, 2011)
The concept of resilience has been used among a diversity of fields with a myriad of definitions. A systems approach to discovering the essence of resilience could aid in understanding its concept and provide opportunities to distinguish its systemic characteristics that can be identified, planned, or analyzed regardless of the field in which it is considered. In order to begin executing such an approach, a comprehensive study of the literature on the topic and circumstances in which resilience has been used or referred to in several fields of studies is necessary. In this paper, the conceptual common denominator of resilience is identified based on the results of a literature survey and according to the way it has been used in different contexts. This basis leads to the objective of this effort, and that is to recognize the systemic characteristics of resilience and demonstrate the defining of a universally accepted definition. Using a soft systems methodology and a supporting systemic diagramming technique entitled Systemigrams, we present the formulation of defining resilience in maritime homeland security. In this effort, many stakeholders contributed their thoughts and concerns on the meaning and operational use of resilience through a repetitive process to formulate a definition of the term. The result of this methodic approach is a general definition of resilience that has been refined in a collaborative environment via the application the Boardman Soft Systems Methodology.

“Cash Plus” programmes for children - Save the Children (Save the Children, 2017)
This paper provides a resource on “Cash Plus” interventions for children. These interventions combine household cash transfers with complementary, context-relevant interventionsn in order to address the multiple drivers of childhood deprivations and generate more powerful impacts for children across Save the Children’s Breakthroughs, in both development and humanitarian contexts.

Introduction to SAVI's way of working - State Accountability and Voice Initiative (SAVI) - SAVI (DFID, 2015)
We are piloting a new approach to identifying and supporting our partners. This breaks with convention in many ways in order to improve impact. SAVI Approach Papers summarise key aspects of SAVI’s way of working. They explain what we do, and why – and link to relevant tools and frameworks. Our approach is summarized in...
Keywords: Practice

Nigeria Public Sector Accountability and Governance Programme - Business Case - SAVI (DFID, 2016)
In May 2016, SAVI transitioned into a successor programme – the ‘Engaged Citizens Pillar’ (ECP) of a wider DFID-funded governance reform programme ‘The Partnership to Engage, Reform and Learn’ (PERL). ECP is managed by the same service provider, Palladium, and the same core management team as SAVI, and many of the SAVI front line staff...

SAVI Approach Paper 1: Core Values - SAVI (London, 2015)
Governance reform is about government and citizens working together in more responsive, inclusive and accountable ways for the benefit of citizens. More responsive, inclusive and accountable attitudes and behaviour on the part of government and non-government stakeholders are the critical factors which lead to meaningful reform processes, and replicate and sustain reforms beyond the lifetime...

SAVI Approach Paper 10: Engaging State Governments - SAVI (DFID, 2015)
SAVI as a programme does not directly work with state governments – but we work in close conjunction with sister programmes who are supporting state governments on governance and sector reforms. SAVI supports non-government and SHoA partners to play their part in promoting more responsive, inclusive and accountable state governance delivering better services for citizens....

SAVI Approach Paper 11: Managing and Staffing an Adaptive Citizen Engagement Programme - SAVI (DFID, 2016)
SAVI, a DFID funded programme implemented by Palladium, is an adaptive programme putting learning and adaptation at the centre of all decision-making. In relation to management and staffing SAVI has established the following approaches to facilitate this: – An adaptive approach to programme management: Full time strategic technical leadership, that works closely with and complements...

SAVI Approach Paper 12: Managing Programme Finances to Support Adaptive, Locally-led Processes of Citizen Engagement in Governance - SAVI (DFID, 2016)
SAVI, is seeking to support processes of citizen engagement in governance in ways that are effective in influencing reform, and that are able to take on a life of their own without continuing donor support. SAVI is also an adaptive programme, putting learning and adaptation at the centre of all decision-making. Money is used and...

SAVI Approach Paper 13: Measuring Value for Money and using Value for Money Analysis - SAVI (DFID, 2016)
SAVI has established its own framework for assessing Value for Money in annual performance – in relation to expenditure, economy, efficiency, effectiveness and equity. Routine tracking and analysis of expenditure and economy ensure that inputs are supplied and services delivered to partners in line with SAVI’s core values, whilst also meeting DFID requirements and competing...

SAVI Approach Paper 14: Learning, Adaptation and Communications - SAVI (DFID, 2016)
SAVI, a DFID funded programme implemented by Palladium, is an adaptive programme, aiming to put learning and adaptation at the centre of all decision-making. Learning and adaptation takes place in SAVI at three levels: the work of partners; the work of SAVI delivery teams; and the enabling environment of the programme as a whole. Achieving...

SAVI Approach Paper 15: Introduction to PERL: the SAVI Successor Programme - SAVI (DFID, 2016)
In May 2016, SAVI transitioned into a successor programme – the ‘Engaged Citizens Pillar’ (ECP) of a wider DFID-funded governance reform programme ‘The Partnership to Engage, Reform and Learn’ (PERL). ECP is managed by the same service provider, Palladium, and the same core management team as SAVI, and many of the SAVI front line staff...

SAVI Approach Paper 2: Programme Design - SAVI (DFID, 2015)
SAVI supports citizen engagement in governance through a facilitated partnership approach, in contrast to the usual approach of grants to civil society organisations (CSOs). The overall aim is to facilitate and support working relationships and processes of reform that are home-grown, self-sustaining and, after initial engagement, not dependent on external support. Our way of working...

SAVI Approach Paper 3: Theory of Change - SAVI (DFID, 2015)
SAVI’s theory of change is a simple, practical guide that staff and partners use to plan and to monitor change – as well as to reflect on and enhance their own effectiveness. It sets out broad stages of attitude and behaviour change over time to facilitate effective citizen engagement in governance processes, systems and structures....

SAVI Approach Paper 4: Thinking and Working Politically - Supporting partners and staff through a participatory apporach to political economy analysis - SAVI (DFID, 2015)
Thinking and acting politically is central to the SAVI programme. We support staff and partners to analyse the power relations that shape change in their state, and to use this knowledge to inform their decision-making. This includes decisions made by SAVI state teams relating to the issues and partners they engage with and support, and...

SAVI Approach Paper 5: Defining and Measuring Results - SAVI (DFID, 2015)
SAVI aims to facilitate replicable and sustainable processes of citizen engagement in governance. The programme in each state is locally defined, flexible and adaptive, and results are not predictable in advance. Standardised monitoring tools are not applicable, and consequently we have evolved our tools and frameworks during the programme through processes of learning by doing....

SAVI Approach Paper 6: Engaging Civil Society - SAVI (DFID, 2015)
SAVI state teams provide support to CS groups to become more effective agents of citizens’ voice and public accountability, through a variety of mutually reinforcing interventions. These include: hands-on support to demonstration civil society Advocacy Partnerships (APs) facilitating working partnerships between civil society APs, SHoAs, and the media brokering working relationships between all of these...

SAVI Approach Paper 7: Promoting Gender Equality and Social Inclusion - SAVI (DFID, 2015)
We promote attention to gender equality and social inclusion in all of our engagement with CS groups, the media and SHoAs, and in all of the issues and processes they work on. In all the states we work in, we also support partners to focus on some issues and form some partnerships and networks which...

SAVI Approach Paper 8: Engaging the Media - SAVI (DFID, 2015)
The overall aim of SAVI engagement with the media is for media representation of citizens’ interests to become normal, and play its part in helping state governments to be more responsive, inclusive and accountable to their citizens. Media partners – individual media personnel and selected media houses – are supported to be more effective agents...

SAVI Approach Paper 9: Engaging State Houses of Assembly - SAVI (DFID, 2015)
The overall aim of SAVI engagement with SHoAs is to promote lasting reforms that are not dependent on external funding and which promote an increasingly more responsive and accountable relationship between Nigerian state governments and their citizens. SHoAs are supported to be more effective agents of citizen voice and public accountability, demanding better performance from...

State Accountability and Voice Initiative (SAVI) - Approach Paper Series - SAVI (DFID, 2016)
We are piloting a new approach to identifying and supporting our partners. This breaks with convention in many ways in order to improve impact. Our approach is summarized in the Introduction to SAVI’s way of working. We have broken our approach down into key components – depicted in the form of our ‘knowledge tree’ –...
Keywords: IMPORTANT

Scaled Agile Framework – SAFe for Lean Software and System Engineering 4.5 - Scaled Agile (2017)

Qualitative comparative analysis: A valuable approach to add to the evaluator’s toolbox? Lessons from recent applications - Schatz, Florian; Welle, Katharina (IDS, 2016)

ING’s agile transformation - Schlatmann, Bart (McKinsey Quarterly, 2017)
Two senior executives from the global bank describe their recent journey.

(Draft) Managing to Adapt - Analysing Adaptive Management for Planning, Monitoring, Evaluation, and Learning (draft) - Schlingheider, Annika; Pellfolk, Erica; Maneo, Gabriele; Desai, Harsh (Oxfam, 2017)
Adaptive management is at the heart of ‘doing development differently’ (Wild et al., 2016). Whether it is here to stay depends on how much it is mainstreamed into existing development programming by donors and implementers alike, especially in planning, monitoring, evaluation, and learning (PMEL) cycles. In this report, we find that mainstreaming adaptive management in PMEL involves three strategies: 1. planning for flexibility; 2. developing locally owned monitoring and evaluation (M&E); and 3. creating an enabling environment for learning. Adopting these strategies contributes to virtuous cycles of PMEL

Independent Evaluation of SDC’s Results-Based Management System with a Focus on Poverty Reduction - Schmidt, Martin; Palenberg, Markus; Vähämäki, Janet (SDC, 2017)
The SDC's results-based management system ensures that the processes and instruments used for the design and implementation of programs and projects contribute to achieving the desired results (outputs, outcomes and impact). The independent evaluation examines the extent to which these processes and tools have fostered the results culture within the organization, and improved competencies for results-based management decisions, learning and communication. In addition to the findings, conclusions and recommendations, the evaluation report includes the management response of SDC’s Directorate.

Set-theoretic methods for the social sciences: a guide to qualitative comparative analysis - Schneider, Carsten Q.; Wagemann, Claudius (Cambridge Univ. Press, 2012)
"Qualitative Comparative Analysis (QCA) and other set-theoretic methods distinguish themselves from other approaches to the study of social phenomena by using sets and the search for set relations. In virtually all social science fields, statements about social phenomena can be framed in terms of set relations, and using set-theoretic methods to investigate these statements is therefore highly valuable. This book guides readers through the basic principles of set theory and then on to the applied practices of QCA. It provides a thorough understanding of basic and advanced issues in set-theoretic methods together with tricks of the trade, software handling and exercises. Most arguments are introduced using examples from existing research. The use of QCA is increasing rapidly and the application of set-theory is both fruitful and still widely misunderstood in current empirical comparative social research. This book provides an invaluable guide to these methods for researchers across the social sciences"–
Keywords: Comparative method; Mathematical models; Qualitative Methode; Set theory; Social science; Vergleichende Forschung

Making design core to the agile process: a look into how we built Salesforce's Lightning Experience - Schoen, Ian (Medium, 2016)
A look into how we built Salesforce’s Lightning Experience

The Scrum Guide - Schwaber, Ken; Sutherland, Jeff (scrum.org, 2016)

What is Uncertainty and Why Does it Matter? - Scoones, Ian (STEPS centre, 2019)
Uncertainty defines our times. Whether it is in relation to climate change, disease outbreaks, financial volatility, natural disasters or political settlements, every media headline seems to assert that things are uncertain, and increasingly so. Uncertainty, where we do not know the probabilities of either likelihoods or outcomes, is different to risk, the implications of which are explored in this paper through five different ways of thinking about uncertainty, derived from highly diverse literatures encompassing societal, political, cultural, practice and individual perspectives. The paper continues by examining how these perspectives relate to four domains: finance and banking; critical infrastructures; disease outbreaks and climate change; natural hazards and disasters. Reflecting on these experiences, the paper argues that embracing uncertainty raises some fundamental challenges. It means questioning simple, linear perspectives on modernity and progress. It means rethinking expertise and including diverse knowledges in deliberations about the future. It means understanding how uncertainties emerge in social, political and economic contexts, and how uncertainties affect different people, depending on class, gender, race, age and other dimensions of social difference. And, if uncertainty is not reducible to probabilistic risk, it means a radically different approach to governance; one that rejects control-oriented, technocratic approaches in favour of more tentative, adaptive, hopeful and caring responses. The paper concludes by asking whether we can learn from those who live with and from uncertainty – including pastoralists in marginal settings – as part of a wider conversation about embracing uncertainties to meet the challenges of our turbulent world.

Strategy Deployment and Spotify Rhythm - Scotl, Karl (AvailAgility, 2016)
Last month, Henrik Kniberg posted slides from a talk he gave at Agile Sverige on something called Spotify Rhythm - "Spotify’s current approach to getting aligned as a company". While looking through the material, it struck me that what he was describing was a form of Strategy Deployment. This interpretation is based purely on those slides - I haven't had a chance yet to explore this more deeply with Henrik or anyone else from Spotify. I hope I will do some day, but given that caveat, here's how I currently understand the approach in terms of the X-Matrix Model.

The 2015 State of Scrum Report: How the world is applying the most popular Agile approach to projects - Scrum Alliance (Scrum Alliance, 2015)

Dispatch on Switzerland's International Cooperation 2017–2020: Key points in brief - SDC (Federal Department of Foreign Affairs FDFA, 2016)
The “Dispatch on Switzerland’s International Cooperation, 2017–2020”, is a report to the Swiss Parliament outlining the strategic priorities proposed by the Federal Council in this area. It includes framework credits for each of the five policy instruments used by Switzerland to implement its international cooperation strategy. These are implemented by the Swiss Agency for Development and Cooperation (SDC) of the Federal Department of Foreign Affairs (FDFA), the Human Security Division (HSD) of the FDFA’s Directorate of Political Affairs, and the State Secretariat for Economic Affairs (SECO) of the Federal Department of Economic Affairs, Education and Research (EAER).

Guidelines for the Monitoring System for Development-Related Changes (MERV) - SDC (SDC, 2013)

Peacebuilding and Statebuilding Strategy for SDC’s work in fragile and conflict contexts - SDC (Swiss Agency for Development and Cooperation SDC, 2015)

Swiss Cooperation Strategy Pakistan, 2017-2019 - SDC (2016)

Was bedeutet “Staying Engaged” im Kontext der aktuellen Krise in Nicaragua? Überlegungen und Strategien der ALAK (Internal memo) - SDC (SDC, 2018)
«Mitigation» (im Sinne von Notlinderung) und «Transformation» sind die zwei Schlagworte, an welchen sich die Neuausrichtung des Portfolios in Nicaragua über die nächsten Monate orientieren wird. Ziel ist es, dass die Schweiz ihr über die letzten Jahrzehnte akquiriertes politisches Kapital und ihre Expertise nutzt, um zu einer Linderung der Auswirkung der Krise für die Bevölkerung beizutragen und mithilft die Grundlagen für eine Transformation der politischen Kultur und eine langfristig angelegte Demokratisierung zu schaffen.

Adaptive Programming: The “Space of Possibility” - Seavey, Sara Mizuta (USAID Learning Lab, 2016)
Sara Mizuta Seavey, M.A., is a Senior Program Officer at FHI360 for the Mobile Solutions Technical Assistance and Research (mSTAR) project, where she works with USAID’s Digital Development Team to conceive, design, and test how real-time data systems can enable a more adaptive and participatory approach to development. She is passionate about systems thinking and participatory approaches to international development. What does space travel have to do with international development?

Managing and Adapting a development program: Lessons from PRISMA - Seely, Kevin (PRISMA, 2019)
This case study is part of the AIP-Rural Learning Series. Funders and implementers of international development programs largely agree that adaptive management is industry best practice. Most development experts also broadly agree on what ‘adaptive management’ means. In this case study, we use a common definition of ‘adaptive management’, including the following features: Flexibility. Implementers create, modify and drop interventions when circumstances change or new information emerges, in order to tailor strategies to context and maximise impact. Purposeful experimentation. Implementers test different activities at the same time, monitoring them to learn what will achieve the desired impact. Since 2015, the number of publications calling for and praising adaptive management in development programs has grown fast. These publications give us an idea of the state of adaptive management in development programs. They reveal progress in some areas, such as tailoring interventions to local context and using evidence for decision-making. Yet they also reveal multiple, ongoing, real-world constraints to adaptive management. This case study explores how one development program, PRISMA, has avoided and overcome some of these constraints, whilst continuing to battle others. Four major constraints revealed in the adaptive management literature are discussed in this case study: Programs are designed in ways that make it hard to adapt interventions, target regions or sectors based on new learning or changing circumstances. Programs struggle to create an organisational culture that encourages learning and adapting. When staffing programs, recruiters prioritise sectoral expertise and length of experience over adaptive managerial competence. Program managers face pressures to spend their budgets predictably and before their program ends. Learning and testing take time and cost little, so managers feel pressure to deprioritise them. The first of these constraints is explored in the next section, ‘Design’, which looks at how the selection of target sectors and performance targets affects PRISMA implementers’ ability to manage adaptively. The third section, ‘Organisational Culture’, shares lessons on encouraging staff to test and improve interventions. Section 4, ‘Staffing’, looks at hiring adaptive managers, and freeing up their time to improve interventions. The final section summarises this case study’s key lessons. Throughout this paper, findings are based on 16 in-depth interviews with PRISMA’s junior, mid-level and senior staff, and its funders. To contextualise these findings, the authors reviewed the ‘adaptive management’ literature, and drew on their experience with development programs worldwide.

Evaluation for equitable development results - Segone, M (UNICEF, 2011)
This document is made up of a range of Evaluation Working Papers (EWP) focused on evaluation for equitable development. Put together by evaluation specialists they present strategic evaluation findings, lessons learned and innovative approaches and methodologies. Part 1:Evaluation and equity Evaluation to accelerate progress towards equity, social justice and human rights 2 Human rights and gender equality in evaluation 13 When human rights is the starting point for evaluation 25 Strengthening Equity- focused evaluations through insights from feminist theory and approaches 39 Decolonizing evaluation in a developing world. Implications and cautions for Equity-focused evaluations 59 Part 2: Methodological implications for Equity-focused evaluations Methodological issues to design and implement equity-focused evaluations 86 Developmental evaluation for Equity-focused evaluations 102 Systems thinking and Equity-focused evaluations 115 Methodological challenges in using programme theory to evaluate pro-poor and equity-focused programmes by Patricia Rogers, Royal Melbourne Institute of Technology University and Richard Hummelbrunner, Independent consultant 142 Case Study and equity in Evaluationby Saville Kushner, University of the West of Englan 172 Values-Engaged Evaluationsby Jennifer Greene, University of Illinois at Urbana-Champaign 192 Part 3: Examples of Equity-focused evaluations Evaluating the contribution of UNDP to equity-focused public policies in Brazil and China 210 Using a human rights approach to evaluate ILO’s discrimination strategy 222 CONEVAL experience in evaluating interventions for Indigenous populations in Mexico 244 UNICEF supported evaluations with elements of equity-focused evaluations 258

What We Do: Getting Beyond Statistics - Sense Guide (Sensemaker narrative monitoring, 2018)
Our approach Understanding daily life reality with micro-narratives Narratives and more specifically micro-narratives are a fundamental and ancient way by which humans interpret their experience and make decisions. SenseMaker® provides the ability to capture and understand those narratives. Through the web or app environment the software allows the capture of pictures, recordings and writing in various combinations to reflect how the respondents are making sense of the world. Reducing cognitive bias with self signification In a patented method, the respondent then interprets their own story into a series of abstract constructs (‘signifiers’) that feel more like a game than a survey, but allow profound meaning to emerge. This interpretation adds layers of meaning rather than simply interpreting the story and provides quantitative data to detect visual patterns among stories. The patterns are linked back to the original material enabling a deeper dive into individual stories. If the researcher first look for patterns in the metadata using statistical or visual tools, he or she is less likely to be biased by content and prematurely converge on an interpretation. Evidence based insights that enables action The output of SenseMaker® is statistical data backed up by explanatory narrative. This means that advocacy is an integral part of the system. Numbers on their own appear objective but are not persuasive; anecdotes on their own may be persuasive but are not objective. SenseMaker® puts the two together and provides a powerful means of persuasion. It also enables action. Instead of saying “How do we create a culture of X?” we say “How do we create more stories like this and fewer stories like that?” Then, as actions are initiated, we see the impact in real time.

Glossary of Knowledge Management - Serrat, Olivier (Knowledge Solutions: Tools, Methods, and Approaches to Drive Organizational Performance, 2017)
The knowledge management discipline can be cryptic. These Knowledge Solutions define its most common concepts in simple terms.
Keywords: Definitions; Knowledge management; Taxonomy; Terminology

Exploring new territories for evaluation - Sharp, Cathy (Collective Leadership for Scotland, 2018)
Drawing on action research, this paper recasts evaluation as ‘action inquiry’, an embedded evaluative learning practice that can help navigate complexity when enacting collective leadership. It is offered as an invitation to inquiry amongst a reasonably well-informed audience of policy makers and practitioners who work in and for public services. It will particularly interest those who provide research, evaluation and facilitation support, and those seeking to develop a more relational approach to research and evaluation. Action inquiry is a model of practising change together in environments where ‘nothing is clear, and everything keeps changing’ that significantly challenges the prevailing discourse on evaluation. Action inquiry can be wrapped around and enmeshed within initiatives and programmes that work with complexity - anywhere where success will depend on the quality of relationships that can be developed. The paper reviews some important interrelated concepts that underpin the ideals of collective leadership and public service reform and which confront deeply embedded traditional notions of leadership, expertise and participation. These offer important challenges to ideas about how change happens and recognise that relationships are at the heart of practising change. This warrants a re-examination of the high expectations of evidence-based or informed practice. Collective leadership makes new demands of evidence as it rests on help to determine ‘wise actions’ in real-life situations. This confronts the practical reality of how to work together in conditions often expressed as ‘dynamic’ or ‘turbulent’ and the added human complexities of power, emotions and relationships; too often these elements are denied or avoided aspects of a change process. Facilitated action inquiry makes these elements part of the conversations, in the midst of ‘work-as-we-are-doing-it’, to increase areas of choice for individuals and a group as a whole. Within public policy, there is an overwhelming amount of evidence about ‘what works’ yet change seems to be stubborn and slow. The paper explores some of the deep-rooted vestiges of a ‘hierarchy of evidence’ and assumptions about standardisation and generalisability that act as a ‘barrier to transformation’. These include the narrow framing of what counts as evidence and consequent relegation of community perspectives, lived experience and practice-based evidence. The paper acknowledges the clear appetite for different approaches to evaluation, especially those that better reflect deeply held values and avoid creating a culture of ‘gaming’, rooted in fear of failure and loss of funding, at the expense of learning. The need for new forms of developmental evaluative thinking, collaborative inquiry and action research to create embedded learning is well overdue. Action inquiry is a desirable and necessary response to the complex situations and challenges of human services and recognises the essentialness of knowledge co-production. It is a model of co-creation at every stage and endorses the idea that people learn from participation in evaluation and by testing theories of change through action. Action inquiry builds on the idea of inquiry, or a moment-to-moment awareness and quality of attention and draws from several elements of action research practice. It sees inquiry as an intervention in itself, one that furthermore, explicitly seeks to enhance the probability of the success of a programme, focus on learning, the collaborative development of practice-based knowledge and positive relationships. The paper highlights the importance of building inquiry into living systems, the role of facilitation, systemic inquiry, and evaluative thinking. It proposes an expansion of ideas of appreciation as a relational and collaborative practice that is a driver of emergence. Social recognition that acknowledges someone’s social value to the community and implies mutual moral obligations to cooperation and participation is particularly crucial in a work context that requires successful coordination and multiple contributions to achieve results across hierarchies of position, professional rank and sectors. Hence, appreciation goes beyond the idea of positivity to include social recognition, valuing more explicit forms of inquiry, building participants’ aspirations to design new social systems and acting in new ways to embed change. In developing this discussion, the paper contributes to emerging dialogues about the need for a model of ‘5th generation evaluation’. Such a model would be based on the idea that appreciative and challenging inquiry that is contextual, relational and open-minded will create better opportunities for change and development. The paper sets out some ‘provocative propositions’ that can help us to navigate this terrain, perhaps of a fledgling ‘5th generation approach’ to inquiry. Facilitated action inquiry can hold the key to developing both new knowledge and an adaptive, collaborative and improvisational skill-set, able to respond in new ways to systemic and complex issues on the ground. It’s common to hear the expression ‘it’s all about relationships’ and it is clearly time to shift our focus to relationships; not relationships as ‘things’, but as co-created and dynamic relational processes in which we are embedded. In this way we can bring new qualities to our talking to each other about our various and shared visions of a better future.

Exploring new territories for evaluation - Provocative propositions - Sharp, Cathy (2018)

USAID/Colombia Introduces Political Economy Analysis to Better Adapt Programming to Local Contexts - Sharp, Preston (USAID, 2015)

How DFID can better manage complexity in development programming - Sharp, Samuel; Valters, Craig; Whitty, Brendan (ODI, 2019)
The United Kingdom’s (UK) Department for International Development (DFID) is an ambitious government department that is committed to reducing poverty and conflict overseas. Many of the issues on which DFID works are complex; whether focused on climate change, gender equality, health or other priorities, simple solutions rarely exist. And to tackle these complex challenges, DFID staff must interact with unpredictable systems of political, organisational and individual behaviours and incentives. There is a risk that complex problems spur more complicated programmes; that the complexity of development challenges is addressed through designing programmes with too many projects and implementers. While there may be valid reasons for this, too many of these complicated programmes will overburden staff. This briefing note is the outcome of an ongoing process within DFID to confront these issues and answer the question: how can DFID design and manage programmes to address complex development challenges without creating too much staff workload? Key messages DFID deals with complex problems, which require flexible systems to support testing, learning and adaptation. • Complex problems do not necessarily require workload-heavy delivery structures, but simpler approaches depend on delivery partners’ experience and competence. • However, programmes that tackle complex problems do require more hands-on engagement and face more workload from inflexible compliance requirements. We suggest that DFID and similar agencies: • Pay closer attention to delivery options in programme design, making use of existing options where possible and, where not, fostering local organisations through long-term investments. • Encourage programme designers to articulate how ambition matches resources and consider ‘good enough’ design. • Reduce the burden of compliance by cultivating partner autonomy, reassessing results and valuefor-money requirements and promoting more flexible contracting and procurement. • Plan and prioritise management resources across a portfolio of programmes to make sure they can be focused in the right areas, where the complexity of the problem requires greater engagement.

Conflict Aid Goes “Lean” - Shinkle, Whitney (Stanford Social Innovation Review, 2017)
Iterative design methods are essential to development work—even (or especially) in regions marked by war and violence.

Towards an Alternative Development Management Paradigm? - Shutt, Cathy (Expertgruppen för biståndsanalys (EBA), 2016)
Demonstrating results has been a concern in international development cooperation ever since it was started and in recent years there has been an increased focus on achieving and reporting on “results”. Despite the fact that everyone involved in development cooperation wants to make a difference there has been a growing criticism from practitioners about the “results agenda” based on a concern that the approaches used are not fit for purpose. In the EBA-report, Cathy Shutt, at the University of Sussex, scrutinizes the recent critical debate about results based management, and the main arguments and motives behind the criticism. She shows that the debate is not only a matter of obsessive measurement and reporting of meaningless numbers for political accountability, but also a matter of problematic assumptions and how we think about development, evidence and learning. In the report, Shutt also explores what could be learned from those who are not just critiquing results based management approaches but also proposing alternatives. Are these new alternatives an answer to the criticism?
Keywords: IMPORTANT

Improving the Evaluability of INGO Empowerment and Accountability Programmes - Shutt, Cathy; McGee, Rosemary (Centre for Development Impact, 2013)

Achieving reforms in oligarchical democracies: the role of leadership and coalitions in the Philippines - Sidel, John T. (Developmental Leadership Program, 2014)
This paper examines the role of developmental leadership in two major reforms introduced in the Philippines in 2012: the passage into law in December of excise tax reform which significantly raised taxes on cigarettes and alcohol – generally referred to as the Sin Tax Reform – and, in July, the re-registration of voters in the Autonomous Region of Muslim Mindanao (ARMM). These reforms have a) strengthened government finances and healthcare; and b) improved the quality of elections and promoted good governance and conflict resolution in the southern Philippines. Key points: These reforms were not achieved exclusively through the executive leadership of Philippine President Benigno Aquino III, this paper argues. A broader form of developmental leadership was critical to their passage into legislation and their subsequent implementation, made up of reform coalitions that incorporated elements of government, the legislature, and civil society. While these coalitions were diverse and flexible in their form and composition, their core strength came from established advocacy groups and experienced activists. These groups and activists used highly labour-intensive, specialized and complex forms of mobilization. The success of these reform coalitions, it is argued, has implications for economic and governance reform in the developing world, particularly in systems characterised by oligarchical democracy, where competition for elected office is closely linked to the entrenched interests of business and industry.

Amateur hour: CfC's 'surprising' success in addressing school congestion in the philippines - Sidel, John T. (Asia Foundation, 2017)
The international development community has increasingly embraced the idea that finding durable solutions to complex development problems requires new ways of working that move beyond industry norms. This paper makes an important contribution to the current debate by outlining an innovative monitoring system called Strategy Testing (ST). This is the third paper in the Working Politically in Practice paper series, launched together with the Australian Department of Foreign Affairs and Trade.
Keywords: IMPORTANT

Learning to ADAPT: monitoring and evaluation approaches in climate change adaptation and disaster risk reduction – challenges, gaps and ways forward - Silva Villanueva, Paula (IDS, 2011)
This working paper is a methodological contribution to the emerging debate on monitoring and evaluation (M&E) in the context of climate change adaptationand disaster risk reduction. Effectively managing disaster risk is critical for adapting to the impacts of climate change, however disasters risk reduction M&E practice may be limited in capturing progress towards adaptation. The unique nature of adaptation to climate change calls for experience-based learning M&E processes for discovering the key insights into adaptive capacity and its links to adaptation processes, and to risk and vulnerability reduction at large. The ADAPT guiding principles and indicators set the foundations towards this end.

Beyond Logframes - Simister, Nigel (Intrac, 2017)
The logical framework, otherwise known as a logframe, is a commonly used planning tool. Initially designed for use within simple projects, it is increasingly being applied to complex programmes and organisations. In these cases the logical framework has limitations. There are several options that can help overcome these limitations. These include expanding the logframe, and using multiple logframes.

How Adaptive Management is challenging the monitoring and evaluation of complex programmes - Simister, Nigel (INTRAC, 2018)
By Nigel Simister Adaptive management is a broad approach designed to support development or humanitarian programmes in complex or uncertain …

In pursuit of the deep and sustained shifts necessary for adaptive management - Simister, Nigel (INTRAC, 2018)
The final blog in Nigel Simister's series on adaptive management and the M&E of complex projects and programmes.

Summarising portfolio change: results frameworks at organisational level - Simister, Nigel (Intrac, 2016)

Digital Democracy: The Tools Transforming Political Engagement - Simon, Julie; Bass, Theo; Boelman, Victoria; Mulgan, Geoff (NESTA, 2017)
This paper shares lessons from Nesta’s research into some of the pioneering innovations in digital democracy which are taking place across Europe and beyond

Routledge international handbook of participatory design - Simonsen, Jesper; Robertson, Toni (Routledge, 2013)
"Participatory Design is about the direct involvement of people in the co-design of the technologies they use. Its central concern is how collaborative design processes can be driven by the participation of the people affected by the technology designed. Embracing a diverse collection of principles and practices aimed at making technologies, tools, environments, businesses, and social institutions more responsive to human needs, the International Handbook of Participatory Design is a state-of-the-art reference handbook for the subject. The Handbook brings together a multidisciplinary and international group of highly recognized and experienced experts to present an authoritative overview of the field and its history and discuss contributions and challenges of the pivotal issues in Participatory Design, including heritage, ethics, ethnography, methods, tools and techniques and community involvement. The book also highlights three large-scale case studies which show how Participatory Design has been used to bring about outstanding changes in different organisations. The book shows why Participatory Design is an important, highly relevant and rewarding area for research and practice. It will be an invaluable resource for students, researchers, scholars and professionals in Participatory Design"–
OCLC: 754734489

Top-down vs. Bottom-up Hierarchy: Or, How to Design a Self-Managed Organization - Sisney, Lex (Organizational Physics - Systems thinking for breakthrough business performance, 2016)
Top-down vs. Bottom-up Hierarchy: Or, How to Design a Self-Managed Organization

Real World SAFe – Leapfrogging a successful waterfall company into Scaled Agile - Skarin, Mattias (CRISP, 2017)

Built to improve: Leveraging realtime M&E for adaptive youth employment programming - Skelton, John (Mercy Corps, 2016)
Recognising that aid and development programming takes place in complex contexts, Mercy Corps is increasingly seeking to understand how best to manage programs which iterate, adapt and respond to the consistently evolving settings in which we work. This brief Practice Paper provides some examples of what adaptive management looks like in practice on the Prospects youth employment program in Liberia. It does not seek to function as a manual or set of guidelines, but simply provides some practical examples and insights into how a youth employment program governed by principles of adaptive management operates.

I know what I know (but how do I know what I don’t?) - Smit, Debbie; de Lanerolle, Indra; Braam, Tamara; Byrne, Deborah; Legong, Gontse (MAVC, 2017)
An important support function of Making All Voices Count South Africa is to design, plan and facilitate community of practice gatherings for sustained learning and sharing across Making All Voices Count grantees. This report aims to capture the content of a one-day Making All Voices Count South African Community of Practice (CoP) Meeting held in November 2016. The South African MAVC CoP has been running for three years and has met between two and four times a year. It is a space for MAVC grantees and others working to foster innovation in the fields of transparency and accountability, to share experiences and knowledge, and collaborate in learning and improving work.

40 Agile Methods in 40 Minutes - Smith, Craig (2014)
My presentation from Scrum Australia 2014 called “40 Agile Methods in 40 Minutes” is available on Slideshare. With 73% of the world using Scrum as their predominant Agile method, this session will …

40 Agile Methods in 40 Minutes - Smith, Craig (2015)

Chris Argyris: theories of action, double-loop learning and organizational learning - Smith, Mark K. (The encyclopedia of pedagogy and informal education, 2013)
Chris Argyris: theories of action, double-loop learning and organizational learning. The work of Chris Argyris (1923-2013) has influenced thinking about the relationship of people and organizations…

10 years of Outcome Mapping - Smith, R; Mauremootoo, John; Ambrose, K.; Hearn, Simon (2012)
This webinar from the Outcome Mapping Learning Community (OMLC) presents the key findings from research conducted into the extent of Outcome Mapping use and the support required for its implementation.

Ten years of Outcome Mapping adaptations and support - Smith, Richard; Mauremootoo, John; Rassmann, Kornelia (Outcome Mapping Learning Community, 2012)
An analysis of how and where Outcome Mapping has been applied, how users have experienced OM and the support options available and required for its use. This research was commissioned by the OMLC Stewards.

External Review of the Building Effective and Accessible Markets (BEAM) programme - Snedden, Ewan; Freer, Gordon; Moffatt, Michelle (WYG International, 2016)

Naturalizing sensemaking - Snowden, Dave (Informed by Knowledge: Expert Performance in Complex Situations, 2010)
The focus of this book is on how experts adapt to complexity, synthesize and interpret information in context, and transform or "fuse" disparate items of information into coherent knowledge. The chapters examine these processes across experts (e.g. global leaders, individuals in extreme environments, managers, police officers, pilots, commanders, doctors, inventors), across contexts (e.g. space and space analogs, corporate organizations, command and control, crisis and crowd management, air traffic control, the operating room, product development), and for both individual and team performance. Successful information integration is a key factor in the success of diverse endeavors, including team attempts to climb Mt. Everest, crowd control in the Middle East, and remote drilling operations. This volume is divided into four sections, each with a specific focus on an area of expert performance, resulting in a text that covers a wide range of useful information. These sections present well-researched discussions, such as: the management of complex situations in various fields and decision contexts; technological and training approaches to facilitate knowledge management by individual experts and expert teams; new or neglected perspectives in expert decision making; and the importance of ‘modeling’ expert performance through techniques and frameworks such as Cognitive Task Analysis, computational architectures based on the notion of causal belief mapping such as ‘Convince Me,’ or the data/frame model of sensemaking. The volume provides essential reading for researchers and practitioners of Naturalistic Decision Making and those who study Expertise; Organizational and Cognitive Psychologists; and researchers and students in Business and Engineering.

Thoughts on the use of hypotheses in adaptive management - Sparkman, Timothy (BEAM Exchange, 2015)
New insights, opinions and perspectives on market systems development, from experts and practitioners.

Applying Systems Thinking via Systemigrams™ for Defining the Body of Knowledge and Curriculum to Advance Systems Engineering (BKCASE) Project - Squires, Alice; Pyster, Art; Sauser, Brian; Olwell, David; Enck, Stephanie; Gelosh, Don; Anthony, Jim (INCOSE International Symposium, 2010)
Systems thinking is commonly accepted as the backbone of a successful systems engineering approach. As such, the Body of Knowledge and Curriculum to Advance Systems Engineering (BKCASE) team chose to leverage a systems thinking based tool, called Systemitool, to describe our project to the vast audience that would potentially become involved directly or indirectly in the success of the project. This paper describes the process and steps used by the authors and the BKCASE team to develop the project's systemic diagram, or Systemigram™, and the story behind the project, the products, and the vision of the BKCASE project. The goal of the paper is to provide guidance so that readers can leverage the lessons learned from this effort to successfully develop their own project definitions and stories.

SROI Self-assessment tool - SROI Network (2016)
The online self assessment tool was created by the SROI Network in collaboration with Hall Aitken to help users judge how well their evaluation practices adhere to principles of best practice. The tool is comprised of a seven stage questionnaire, showing results as a spider chart illustrating areas of strength and areas for improvement. The questionnaire itself is structured around the seven principles of SROI. These principles include ‘involve stakeholders’, ‘be transparent’ and ‘do not overclaim’, and together make up the core framework around which SROI is based. Users receive a score for each principle, and an overall average, giving them an idea of to what extent they have successfully applied the principles. High scoring users can then use their score to guide them towards applying for assurance and accreditation. The tool provides guidance, support and more advice to people who want to improve the way in which their organisation measures their social value and assesses their service delivery but don’t know where to start.

Starting out on Social Return on Investment - SROI Network; Aitken, Hall (2014)
This guide, created by the SROI Network in collaboration with Hall Aitken, is aimed at providing guidance to those who have never used SROI on where to begin. The guide provides practical steps to beginning the process of SROI and includes links to tools aimed at supporting its implementation. Excerpt "Most public, private and third sector organisations have a pretty good idea of the costs of what they do. Annual accounts, management accounts, budget reports and a whole accountancy profession add up to a great deal of effort to make sure this is the case. Some organisations are quite good at counting what they do with these resources. They can track the number of users or contacts, or customers. Many can provide some evidence that these activities lead to some sort of change. But very few can explain clearly why all this matters. What would happen if they did not exist? What is the real value of what they do? Social Return on Investment sets out to redress the balance by looking at value not just cost." Contents Part one – why, what and how? Why does social value matter? What is SROI? How do I do SROI? Next steps Part two – progress tool Part three – practical next steps Steps to involve stakeholders Steps to understand what changes Steps to value the things that matter Steps to only include what is material Steps to avoid overclaiming Steps to be transparent Steps to verify the result

Agile distributed software development in nine Central European teams: challenges, benefits and recommendations - Stadler, Manuel; Vallon, Raoul; Pazderka, Martin; Grechenig, Thomas (Information Technology, 2019)

Participation as assemblage: Introducing assemblage as a framework for analysing participatory processes and outcomes - Stage, Carsten; Ingerslev, Karen (Conjunctions. Transdisciplinary Journal of Cultural Participation, 2016)
The article presents a yet unexplored framework for analysing the multidimensionality and dis/connections of participatory processes and their outcomes by using the concept of the ‘assemblage’ (DeLanda, 2006). The case is an eight-month collaboration between a task force initiated by Central Denmark Region, the socio-economic company Sager der Samler, and citizens. The collaboration is aimed at bringing together and working across various institutional and user perspectives to act on a societal challenge. The analysis is theoretically based on a review of existing theories of participation and typologies for analysing and evaluating participation. In particu- lar, the analysis focuses on the assemblage approach as a way of acknowledging the institutional, affective, mate- rial and power-related complexity of participatory processes. The assemblage approach helps to analytically stress that the process under investigation should be evaluated both with a more traditional focus on decision-making or power allocation, as well as taking into account the social, personal-affective and material benefits produced, and the potential for change in the relationship between public administration and citizens.

Chaos Report 2015 - Standish Group (Standish Group, 2015)

Why Greatness Cannot Be Planned: The Myth of the Objective - Stanley, Kenneth O.; Lehman, Joel (Springer, 2015)
Why does modern life revolve around objectives? From how science is funded, to improving how children are educated – and nearly everything in-between – our society has become obsessed with a seductive illusion: that greatness results from doggedly measuring improvement in the relentless pursuit of an ambitious goal. In Why Greatness Cannot Be Planned, Stanley and Lehman begin with a surprising scientific discovery in artificial intelligence that leads ultimately to the conclusion that the objective obsession has gone too far. They make the case that great achievement can't be bottled up into mechanical metrics; that innovation is not driven by narrowly focused heroic effort; and that we would be wiser (and the outcomes better) if instead we whole-heartedly embraced serendipitous discovery and playful creativity.Controversial at its heart, yet refreshingly provocative, this book challenges readers to consider life without a destination and discovery without a compass.

Appreciative Inquiry: Organization Development and the Strengths Revolution - Stavros, Jacqueline M.; Godwin, Lindsey N.; Cooperrider, David L. (Practicing Organization Development, 2015)
A ppreciative Inquiry (AI) is a theory and practice of inquiry-and-changethat shifts the perspective of organization development (OD) methodsby suggesting that the very act of asking generative questions has pro-found impact in organizational systems. Inquiry and change are not separatemoments. Our questions focus our attention on what is “there” to be noticed.Reflecting its social constructionist roots (Cooperrider, Barrett, and Srivastva1995; Gergen 1995), which suggest that words create worlds, AI offers a newchange imperative by suggesting that we be aware of the negativity bias thatpervades our investigations into organizational life and instead shift our focusto the good, the better, and the possibilities that often go undernoticed in oursystems. Building on Gergen (1995) and Cooperrider and Avital (2003), Cooper-rider and Godwin (2012) summarize, “AI posits that human systems move in thedirection of the questions they most frequently and authentically ask; knowl-edge and organizational destiny are intimately interwoven; what we know andhow we study it has a direct impact on where we end up” (740).Leveraging the power of generative questions, AI changes the focus of whatwe typically study in organizational life, questioning the prevailing mindset that“organizations are problems to be solved,” (Cooperrider and Srivastva 1987).Instead, AI suggests that “organizations are mysteries and miracles of humanrelatedness; they are living systems, alive and embedded in ever-wideningwebs of infinite strength and limitless human imagination. Organizations, ascenters of human connectivity and collaboration, are ‘universes of strengths,’” (Cooperrider and Godwin 2010, 10). AI invites change agents to look intotheir organizations with “appreciative eyes”—scanning the system for thingsfor which to be grateful, seeking out what is next and what is possible, andfocusing on valuing those things of value worth valuing. AI theorists posit thatsuch a shift in our approach to organizational change is needed if we are toinspire our imaginative capacities to their fullest potential.

Understanding ‘theory of change’ in international development: A review of existing knowledge - Stein, Danielle; Valters, Craig (LSE, 2012)
This is a review by Danielle Stein and Craig Valters of the concepts and debates within ‘Theory of Change’ (ToC) material, resulting from a search and detailed analysis of available donor, agency and expert guidance documents. The review was undertaken as part of a Justice and Security Research Program (JSRP) and The Asia Foundation (TAF) collaborative project, and focuses on the field of international development.

Virtuous cycles of learning: Using formative, embedded, and diagnostic developmental assessments in a large-scale leadership program - Stein, Z.; Dawson, Theo; Van Rossum, Zachary; Rothaizer, Joel; Hill, S. (Journal of Integral Theory and Practice, 2014)
This article presents preliminary results from a series of ongoing action-research projects involving the use of embedded diagnostic developmental assessments (called LectaTests™) in leadership education contexts. These findings are presented to support a particular metatheoretical approach to learning and education in which embedded assessments form a crucial part of ongoing virtuous cycles of action, feedback, support, and learning. We present two types of evidence. First, we compare developmental growth across eight program evaluations in which LectaTests were and were not embedded. Second, we examine how embedding LectaTests in a large-scale leadership development program affected the growth of managers and their direct reports. We review these findings with an eye toward detecting the benefits of using developmental assessment as embedded diagnostics alongside their use as research instruments. We begin by using Integral Theory to structure a discussion about the ideal function of developmental assessments in educational contexts.

Prioritizing and Selecting Strategic Approaches in USAID Biodiversity Programming - Stem, Caroline; Swaminathan, Vinaya; Flores, Marco (USAID, 2018)
This guide supplements Biodiversity How-To Guide 2: Using Results Chains to Depict Theories of Change in USAID Biodiversity Programming. Step 4, Brainstorming Strategic Approaches, involves generating a suite of potential strategic approaches for a design team to consider. Step 5 introduces the practice of prioritizing and selecting among these draft strategic approaches but does not provide in-depth guidance on the process and criteria for doing so.

Innovation, Sustainability, Development: A New Manifesto - STEPS Centre (STEPS Centre, 2010)
Our Manifesto project publication is available in print, on CD or to view online. Innovation, Sustainability, Development: A New Manifesto recommends new ways of linking science and innovation to development for a more sustainable, equitable and resilient future. The multimedia version, with added audio, video and background documents, is available on CD and online.

Broadening the range of designs and methods for impact evaluations - Stern, Elliot; Stame, Nicoletta; Mayne, John; Forss, Kim; Davies, Rick; Befani, Barbara (DFID, 2012)

The direction of evolution: The rise of cooperative organization - Stewart, John E. (Biosystems, 2014)
Two great trends are evident in the evolution of life on Earth: towards increasing diversification and towards increasing integration. Diversification has spread living processes across the planet, progressively increasing the range of environments and free energy sources exploited by life. Integration has proceeded through a stepwise process in which living entities at one level are integrated into cooperative groups that become larger-scale entities at the next level, and so on, producing cooperative organizations of increasing scale (for example, cooperative groups of simple cells gave rise to the more complex eukaryote cells, groups of these gave rise to multi-cellular organisms, and cooperative groups of these organisms produced animal societies). The trend towards increasing integration has continued during human evolution with the progressive increase in the scale of human groups and societies. The trends towards increasing diversification and integration are both driven by selection. An understanding of the trajectory and causal drivers of the trends suggests that they are likely to culminate in the emergence of a global entity. This entity would emerge from the integration of the living processes, matter, energy and technology of the planet into a global cooperative organization. Such an integration of the results of previous diversifications would enable the global entity to exploit the widest possible range of resources across the varied circumstances of the planet. This paper demonstrates that it's case for directionality meets the tests and criticisms that have proven fatal to previous claims for directionality in evolution.
Keywords: Direction of evolution; Evolution of a global entity; Evolution of cooperation; Evolutionary progress; Major evolutionary transitions

Using Information on Results in Program Management – The case of Samarth-NMDP in Nepal - Stewart, Tim; Joshi, Sanju; Miehlbradt, Alexandra (The Donor Committee for Enterprise Development, 2015)
Keywords: Case Report

A Critique of the Claims About Mobile Phones and Kerala Fisherman. The Importance of the Context of Complex Social Systems - Steyn, Jacques (The Electronic Journal of Information Systems in Developing Countries, 2016)
This paper challenges some fundamental aspects of research and conclusions relating to the use of technology for community development. Views of technology, in this case the mobile phone, as a tool for increased economic welfare are often skewed due to extreme reductionism, ambiguous interview questions and poor data sources. Research of complex social systems or sub-systems give the wrong answers when reductionist methodologies are used. To demonstrate such shortcomings, the 2007 paper of Robert Jensen serves as an example. His conclusion that mobile phones enable Kerala fishermen to increase their economic welfare is the most cited paper on ICT4D topics, but there are fundamental methodological and logical problems with the claim, while other research came to contradictory conclusions. This critique is presented on many levels: ideological, paradigmatic, methodology, logical, statistical and semantic.

An introduction to multi-stakeholder partnerships - Stibbe, Darian; Prescott, Dave (The Partnering Initiative, 2016)
This briefing document for the GPEDC High Level Meeting in November 2016 offers a definition of multi-stakeholder partnerships (MSPs) and shows how they are being used, where they have come from, and what the different sectors bring to the table. It provides an overview of the challenges the present, what they require from individuals and organisations, and how they get started. The report was written with the support of the PEP Initiative, and funded by the Netherlands Ministry of Foreign Affairs.

Walking the Long Road Together - Stilger, Bob (Afternow: When We Cannot See the Future Where Do We Begin?, 2017)
On March 11, 2011, overwhelming and incomprehensible disaster struck the northeast coast of Japan. Life for those in the region would never be the same. This book is about the awakening that follows disaster. About the minutes and months and years that come after now. It is about what happens when we're smacked on the side of the head and open our eyes, startled out of the trance in which we have been living our days. It is about the opportunities always present, often invisible, to create the lives we want, now. AfterNow chronicles the author's journey with the Japanese people over 6 years – his own story of awakening after plunging into this disaster and the stories from people who found where to take their first step, and the next. It offers the tools and processes and worldview people discovered to create what comes after now. It is built around two big ideas. The first is that after disaster, we find our way forward, together. We come awake, together. Disaster obliterates the past, plunges the present into chaos and cocoons the future. We need each other to see and build the new. The second idea is that we don't have to wait for the tragedy of disaster to make the communities and lives we want. We can engage each other with respect, curiosity and generosity and begin to co-create what we want, now. We live in a period of precipitous, unpredictable change. The book is for those who want to make this time more livable and less insane. In Japan and all over the world, we are living in the messy middle where old forms are falling apart and new possibilities are in early stages. The ground is pulled out from under us on a regular basis. Our work right now is to learn to coexist with the messiness. We need to keep trying things, to keep learning. We need to remain focused on our purpose and follow the braided strand of intention and surrender as we find our way forward. embracing radical uncertainty, showing up as fully as we can each moment, each breath.

Behind the scenes: International NGOs’ influence on reproductive health policy in Malawi and South Sudan - Storeng, Katerini T.; Palmer, Jennifer; Daire, Judith; Kloster, Maren O. (Global Public Health, 2019)
Global health donors increasingly embrace international nongovernmental organisations (INGOs) as partners, often relying on them to conduct political advocacy in recipient countries, especially in controversial policy domains like reproductive health. Although INGOs are the primary recipients of donor funding, they are expected to work through national affiliates or counterparts to enable ‘locally-led’ change. Using prospective policy analysis and ethnographic evidence, this paper examines how donor-funded INGOs have influenced the restrictive policy environments for safe abortion and family planning in South Sudan and Malawi. While external actors themselves emphasise the technical nature of their involvement, the paper analyses them as instrumental political actors who strategically broker alliances and resources to shape policy, often working ‘behind the scenes’ to manage the challenging circumstances they operate under. Consequently, their agency and power are hidden through various practices of effacement or concealment. These practices may be necessary to rationalise the tensions inherent in delivering a global programme with the goal of inducing locally-led change in a highly controversial policy domain, but they also risk inciting suspicion and foreign-national tensions.

FOCEVAL – Promoting Evaluation Capacities in Costa Rica:: Smart(er) Implementation with Capacity WORKS? - Storm, Sabrina (Transformation, Politics and Implementation, 2017)
The National Monitoring and Evaluation System of Costa Rica and its corresponding laws were established during the 1990s. Since then, the country has endeavored to implement monitoring and evaluation (M&E) activities as part of its public policy framework. Nevertheless, hardly any systematic evaluations had been conducted, and monitoring activities had been reduced mainly to the institutional self-reporting of implementation compliance. Persisting regional disparities and growing levels of inequality among the population raised the level of pressure on the government to present reliable information on the effectiveness of public interventions. Hence, results-oriented evaluations were promoted by some Costa Rican departments as

Theory of Action: Creating Craddle to Career Proof Points - Strive Together (Strive Together, 2014)
StriveTogether’s Theory of Action provides a framework for improving educational outcomes and ensuring a community transforms how it serves children.

Systems Thinking For Social Change: A Practical Guide to Solving Complex Problems, Avoiding Unintended Consequences, and Achieving Lasting Results - Stroh, David Peter (Chelsea Green Publishing, 2015)
Donors, leaders of nonprofits, and public policy makers usually have the best of intentions to serve society and improve social conditions. But often their solutions fall far short of what they want to accomplish and what is truly needed. Moreover, the answers they propose and fund often produce the opposite of what they want over time. We end up with temporary shelters that increase homelessness, drug busts that increase drug-related crime, or food aid that increases starvation. How do these unintended consequences come about and how can we avoid them? By applying conventional thinking to complex social problems, we often perpetuate the very problems we try so hard to solve, but it is possible to think differently, and get different results. Systems Thinking for Social Change enables readers to contribute more effectively to society by helping them understand what systems thinking is and why it is so important in their work. It also gives concrete guidance on how to incorporate systems thinking in problem solving, decision making, and strategic planning without becoming a technical expert. Systems thinking leader David Stroh walks readers through techniques he has used to help people improve their efforts to end homelessness, improve public health, strengthen education, design a system for early childhood development, protect child welfare, develop rural economies, facilitate the reentry of formerly incarcerated people into society, resolve identity-based conflicts, and more. The result is a highly readable, effective guide to understanding systems and using that knowledge to get the results you want.

Process and Contextual Factors Supporting Action-Oriented Learning: A Thematic Synthesis of Empirical Literature in Natural Resource Management - Suškevičs, Monika; Hahn, Thomas; Rodela, Romina (Society & Natural Resources, 2019)
Despite a long-term focus on learning in natural resource management (NRM), it is still debated how learning supports sustainable real-world NRM practices. We offer a qualitative in-depth synthesis of selected scientific empirical literature (N = 53), which explores factors affecting action-oriented learning. We inductively identify eight key process-based and contextual factors discussed in this literature. Three patterns emerge from our results. First, the literature discusses both facilitated participation and self-organized collaboration as dialogical spaces, which bridge interests and support constructive conflict management. Second, the literature suggests practice-based dialogs as those best able to facilitate action and puts a strong emphasis on experimentation. Finally, not emphasized in existing reviews and syntheses, we found multiple evidence about certain contextual factors affecting learning, including social-ecological crises, complexity, and power structures. Our review also points at important knowledge gaps, which can be used to advance the current research agenda about learning and NRM.
Keywords: Ecosystem governance; Social learning; intermediaries; social-ecological systems; structural constraints

Learning for social-ecological change: a qualitative review of outcomes across empirical literature in natural resource management - Suškevičs, Monika; Hahn, Thomas; Rodela, Romina; Macura, Biljana; Pahl-Wostl, Claudia (Journal of Environmental Planning and Management, 2018)

Scrum: The Art of Doing Twice the Work in Half the Time - Sutherland, Jeff (Crown Business, 2014)
We live in a world that is broken. For those who believe that there must be a more agile and efficient way for people to get things done, here from Scrum pioneer Jeff Sutherland is a brilliantly discursive, thought-provoking book about the leadership and management process that is changing the way we live. In the future, historians may look back on human progress and draw a sharp line designating "before Scrum" and "after Scrum." Scrum is that ground-breaking. It already drives most of the world's top technology companies. And now it's starting to spread to every domain where leaders wrestle with complex projects. If you've ever been startled by how fast the world is changing, Scrum is one of the reasons why. Productivity gains of as much as 1200% have been recorded, and there's no more lucid - or compelling - explainer of Scrum and its bright promise than Jeff Sutherland, the man who put together the first Scrum team more than twenty years ago. The thorny problem Jeff began tackling back then boils down to this: people are spectacularly bad at doing things with agility and efficiency. Best laid plans go up in smoke. Teams often work at cross purposes to each other. And when the pressure rises, unhappiness soars. Drawing on his experience as a West Point-educated fighter pilot, biometrics expert, early innovator of ATM technology, and V.P. of engineering or CTO at eleven different technology companies, Jeff began challenging those dysfunctional realities, looking for solutions that would have global impact. In this book you'll journey to Scrum's front lines where Jeff's system of deep accountability, team interaction, and constant iterative improvement is, among other feats, bringing the FBI into the 21st century, perfecting the design of an affordable 140 mile per hour/100 mile per gallon car, helping NPR report fast-moving action in the Middle East, changing the way pharmacists interact with patients, reducing poverty in the Third World, and even helping people plan their weddings and accomplish weekend chores. Woven with insights from martial arts, judicial decision making, advanced aerial combat, robotics, and many other disciplines, Scrum is consistently riveting. But the most important reason to read this book is that it may just help you achieve what others consider unachievable - whether it be inventing a trailblazing technology, devising a new system of education, pioneering a way to feed the hungry, or, closer to home, a building a foundation for your family to thrive and prosper.

Integrating Food Security and Wild Caught Fisheries Management in USAID Programming. Illustrative situation Model and Results Chain - Swaminathan, Vinaya; Best, Barbara; Ajroud, Brittany (USAID, 2018)
Integrating Food Security and Wild Caught Fisheries Management in USAID Programming is an illustrative case example that demonstrates how two adaptive management programming tools—situation models and results chains—can help USAID staff and its partners to better design and implement activities that integrate food security, nutrition, and sustainable management of wild fisheries.

Portfolios of Agile Projects: A Complex Adaptive Systems’ Agent Perspective - Sweetman, Roger; Conboy, Kieran (Project Management Journal, 2018)
While agile approaches can be extremely effective at a project level, they can impose significant complexity and a need for adaptiveness at the project portfolio level. While this has proven to be highly problematic, there is little research on how to manage a set of agile projects at the project portfolio level. What limited research that does exist often assumes that portfolio-level agility can be achieved by simply scaling project level agile approaches such as Scrum. This study uses a complex adaptive systems lens, focusing specifically on the properties of projects as agents in a complex adaptive portfolio to critically appraise current thinking on portfolio management in an agile context. We then draw on a set of 30 expert interviews to develop 16 complex adaptive systems (CAS)-based propositions as to how portfolios of agile projects can be managed effectively. We also outline an agenda for future research and discuss the differences between a CAS-based approach to portfolio management and traditional approaches.

Tips on Learning from Context: Formal and Informal Approaches to Understanding the Local Political Economy - Swift, Sarah (USAID, 2018)
Successfully adapting your programmatic efforts and policy engagement to the context depends on maintaining your understanding of that context. Given this, continuous learning and feedback loops–not only about your programming, but also about the environment you are working within–are important components of USAID’s work. Since our environments are always changing, in ways big and small, this can be intimidating. One can imagine a scenario where learning consumes the limited time and budgets available, especially for small programs. The question becomes: How can we learn enough, at the right times, to limit missed opportunities and warning signs, while avoiding being consumed by data collection and analysis that never influences our work? This document capitalizes on the experiences of USAID staff as well as emerging learning from other donors and researchers to highlight a range of approaches–formal and informal, time-bound and continuous–that can support ongoing learning within the operational tempo of a busy Mission team or Operating Unit.

Black Box Thinking: The Surprising Truth About Success - Syed, Matthew (Hachette UK, 2015)
The Sunday Times No.1 Bestseller From the Bestselling Author of BounceWhat links the Mercedes Formula One team with Google?What links Team Sky and the aviation industry?What connects James Dyson and David Beckham?They are all Black Box Thinkers.Black Box Thinking is a new approach to high performance, a means of finding an edge in a complex and fast-changing world. It is not just about sport, but has powerful implications for business and politics, as well as for parents and students. In other words, all of us.Drawing on a dizzying array of case studies and real-world examples, together with cutting-edge research on marginal gains, creativity and grit, Matthew Syed tells the inside story of how success really happens - and how we cannot grow unless we are prepared to learn from our mistakes.
Google-Books-ID: f1eNBQAAQBAJ
Keywords: Psychology; Sports & Recreation / Sports Psychology; Strategic Planning

Beyond Ballotocracy: Citizens' Voices and the Many Faces of Unruly Politics - Tadros, Mariz (IDS Bulletin, 2014)

Developmental Evaluation - Tamarack Community (2012)
This webpage from Tamarack Community provides links to audio files of an interview between Mark Cabaj and Michael Patton in which they discuss the topic of development evaluation. This is an "approach that has proven particularly useful and effective at addressing the unique challenges of evaluating the real nature of community change work. Learning Objectives: To deepen appreciation for the role of evaluation and evaluation thinking To explore the distinctions between various types of evaluation To understand more about developmental evaluation and its use To investigate concepts, tools and resources available to support working with developmental evaluation methods" (Tamarack Community)

Evaluating Community Impact: Capturing and Making Sense of Community Outcomes - Tamarack Institute (2017)

Measuring Results & the DCED Standard - Tanburn, Jim (2014)
This page gives an introduction to the DCED Standard, which is a framework that helps practitioners to measure results in Private Sector Development (PSD).

2015 Rhode Island Wildlife Action Plan - Chapter 5 Monitoring and Adaptive Management - Terwilliger Consulting (State of Rhode Island, 2015)

Adaptive management: why we find it so hard to operationalise - Teskey, Graham (Abt Associates - Governance Soapbox, 2018)

Implementing the new development agenda - Wrap up - Teskey, Graham (2017)

Thinking and Working Politically – Are We Seeing the Emergence of a Second Orthodoxy? - Teskey, Graham (Abt Associates, 2017)
There now is a persuasive volume of evidence that demonstrates that capacity and technical knowledge alone are insufficient to change deeply entrenched political interests and bureaucratic norms. These critiques demonstrate that an understanding of power asymmetries is frequently the critical missing ingredient in project design and implementation. Many eminent thinkers have looked at the difference between success and failure in development, and all point to the primacy of domestic politics. This point has not been lost on development agencies and some have tried to provoke greater attention to the role that politics plays. However, this recognition is yet to pass into the mainstream of development practice. Despite the slow but sure accretion of this knowledge the international community seems to be wedded to doing development traditionally. The purpose of this paper is to consider the extent to which a ‘second orthodoxy’ is slowly emerging which can stand alongside, and in some cases may supplant, the ‘first orthodoxy’ of the traditional project framework. Care has to be taken in making this argument, as there is certainly no consensus within the development community on its importance, and even among advocates, there are slightly differing interpretations of what this second orthodoxy looks like. Further, it is not absolutely clear that the two orthodoxies can co-exist. The paper does not call for any ‘paradigm shift’ in how development practitioners conceptualise programs and projects, nor does it demand that the project framework be scrapped; the former would be impossible and the latter undesirable. Equally readers will find no claims that Doing Development Differently or ‘Thinking and Working Politically’ will always and everywhere guarantee better development outcomes. Rather, the paper seeks to summarise how the two orthodoxies differ, where the second orthodoxy now stands, and propose how it can be taken forward in practical terms.

Thinking and working politically in large, multi-sector Facilities: lessons to date - Teskey, Graham; Tyrrel, Lavinia (Abt Associates, 2017)

Towards characterizing the adaptive capacity of farmer-managed irrigation systems: learnings from Nepal - Thapa, Bhuwan; Scott, Christopher; Wester, Philippus; Varady, Robert (Environmental change assessments, 2016)
Small-scale irrigation systems managed by farmers are facing multiple challenges including competing water demand, climatic variability and change, and socioeconomic transformation. Though the relevant institutions for irrigation management have developed coping and adaptation mechanisms, the intensity and frequency of the changes have weakened their institutional adaptive capacity. Using case examples mostly from Nepal, this paper studies the interconnections between seven key dimensions of adaptive capacity: the five capitals (human, financial, natural, social, and physical), governance, and learning. Long-term adaptation requires harnessing the synergies and tradeoffs between generic adaptive capacity that fosters broader development goals and specific adaptive capacity that strengthens climate-risk management. Measuring and addressing the interrelations among the seven adaptive-capacity dimensions aids in strengthening the long term sustainability of farmer-managed irrigation systems.

Participation in ICT Development Interventions: Who and How? - Thapa, Devinder; Sæbø, Øystein (The Electronic Journal of Information Systems in Developing Countries, 2016)
The aim of participatory development (PD) in the context of using Information and Communication Technologies (ICT) for development (ICT4D) is to empower underprivileged communities and disadvantaged segments of the stakeholders. The literature on ICT4D is replete with empirical evidence showing that ICT interventions often fail since they are often externally initiated, with very limited involvement from the affected (Heeks, 2002). Clearly, the principles and concepts of PD are relevant to ICT4D. However, we should not consider PD a panacea but need to understand the caveats and processes by which PD happens. Questions to ask include: What are the various challenges in PD? Who are the relevant stakeholders? Why and how do actors enrol in the project? How do we create sustainable ICT4D projects through PD? To understand these research questions, we present a case analysis of a project in Nepal called the Nepal Wireless Networking Project (NWNP). Investigating the specific initiatives that they enabled, telemedicine, education and jobs, we propose that the key participants in the NWNP were activist actors and the affected and that activists drew upon existing Social Capital to enrol the affected through a process explained by Actor Network Theory (ANT). In the process, they built other forms of Social Capital, which in turn extended the benefits of PD to several mountain villages.

The fashion for agile management is spreading - The Economist (The Economist, 2018)
Executives need to be a cross between Spider-Man and Simone Biles

Assessing the use of technological tools and strategies by Oxfam Novib partners in Angola, Burundi, Egypt, Niger, Pakistan, Rwanda and Uganda - The Engine Room (2014)
This report presents findings and insights from the Oxfam Novib pilot module of TechScape, which assessed how Oxfam Novib partners in seven countries related to the use of technology in their work. This report does not aim to draw conclusions about the nature of technology use by Oxfam Novib partners per se, or even the partners included in this assessment. The dramatic difference in organizational activities, contexts and objectives are too great for that. Detailed analysis of how partners are relating to technology in their work, and specific recommendations for greater efficiency and impact are presented in the TechScape Country Briefs. This report aims instead: • to describe the context in which the assessments took place, • to propose insights gained from the cumulative process about measurement, learning and capacity development, and • to identify opportunities for Oxfam Novib to pursue capacity development and knowledge sharing between countries and across the network, through mechanisms that minimize resource demands and directly target documented needs.

Primer: Technology to monitor and share information on rainforests and forest people's rights - The Engine Room (The Engine Room & Rainforest Foundation Norway, 2016)

Organisational Performance Index - The Kenya Institute of Management (2014)
The OPI Business Excellence Model exists to help organizations improve their performance and succeed in the competitive global marketplace. We are dedicated to improving African organizations regardless of sector, size or structure. The OPI was developed in response to feedback from organization participating in Company of the Year Award (COYA) and SME of the Year Award (SMOYA), who called on the Kenya Institute of Management (KIM) to refine the assessment methodology in order to emphasize the relationship between instilling smart business processes and generating strong business results. Whilst there are numerous management tools and techniques commonly used, the OPI Excellence Model is a practical, non-prescriptive framework which provides a holistic view of the organisation and it can be used to determine how these different methods fit together and complement each other. The Model can therefore be used in conjunction with any number of these tools, based on the needs and function of the organisation, as an overarching framework for developing sustainable excellence. We also administer the Annual Company of the Year Awards (COYA) and the SME of the Year Awards (SMOYA). Our key services are to identify and recognize role-model organizations, share best management practices, and help organizations achieve best-in-class performance levels. The OPI is an excellence model that generates a rating between 1 and 10, which sets a minimum score that an organisation must attain to remain competitive. The attainment of a minimum Organisation Performance Index ( OPI) demonstrates that organisations have applied an organisational strategy that drives effectiveness and competitiveness; failure to attain the minimum OPI demonstrates the organisation has not engaged the processes required to enable world class organisational performance.

The Operational Guide - for the making markets work for the poor (M4P) approach (Second Edition) - The Springfield Centre (SDC & DFID, 2015)
In 2008, SDC and DFID published three documents aimed at improving the understanding and use of the Making Markets Work for the Poor (M4P) approach: the M4P Synthesis, M4P Perspectives and M4P Operational Guide. Since then the field has grown, diversified and, importantly, learned much more. A second edition was commissioned to capture that learning, maintain the momentum and realise the ambition that development can still 'do better'. The second edition provides an accessible resource to help practitioners put the market systems development approach into practice. It explains the key principles and frameworks which guide effective intervention in – and development of – market systems. It addresses common challenges with examples of good practice based on practitioner experience. Who is it for? The Operational Guide is for people whose job entails trying to make market systems work better for poor women and men. These people include: Individuals currently involved in funding or implementing the approach. Development agencies wishing to incorporate market systems thinking and practice in their work. National stakeholders that wish to play a more strategic and catalytic role within market systems. What is new? Application, application, application! Whilst the key principles and frameworks will be familiar, the advice on their operational application – from start to finish – has been significantly bolstered Enhanced guidance on facilitation. Greater emphasis on what constitutes good facilitation practice, building on a wealth of practitioner experience More real-life examples. The Operational Guide is laced with examples from programmes past and present, working in a diverse array of systems Peer learning focus. Direct insights from practitioners, highlighting 'bumps in the road' and how to avoid them. The Guide aims to provide an accessible operational resource to help practitioners put the market systems development approach into practice. It explains the key principles and frameworks which guide the process of effective intervention in – and development of – market systems, addressing common challenges with examples of good practice based on practitioner experience. HOW SHOULD IT BE USED? The Guide explores, sequentially, the key elements of the implementation process: strategy, diagnosis, vision, intervention, measurement and management. It is not intended to be read from cover to cover; readers can go directly to the chapter most relevant to their needs without having read preceding chapters. However each chapter does build upon the preceding one and may refer to other chapters. THE GUIDE IS STRUCTURED AS FOLLOWS: INTRODUCTION Overview of the objectives, structure and format of the Guide CONTEXT A reminder of what market systems development means 1. STRATEGY Core principles and framework for setting programme strategy 2. DIAGNOSIS Core principles and framework for diagnosing system constraints 3. VISION Core principles and frameworks for defining and planning intervention 4. INTERVENTION Core principles and framework to guide effective intervention 5. MEASUREMENT Core principles and framework for measuring results 6. MANAGEMENT Key considerations in managing market systems development programmes GLOSSARY Definition of key terms used in market systems development

A flowering of approaches to complexity and development? - Thorpe, Ian (KM on a dollar a day, 2015)
We are an important juncture in development at the moment with the Sustainable Development Goals due to be finalized later this year, and with discussion now turning full swing into what needs to h…

Doing adaptive management at Sida - Tim Ruffer; Helen Bailey; Stefan Dahlgren; Patrick Spaven; Mark Winters (SIDA, 2019)
Lessons from the market systems development approach The evaluation focuses on Sida’s management of MSD projects. The projects are applying the MSD approach with an aim to: - contribute to improved MSD programming by Sida through better management practices across the project cycle - generate recommendations on how Sida can create conducive conditions for systems approaches and adaptive programming more generally. The brief assesses Sida’s organisational capacity for adaptive management in three dimensions: - leadership and culture - staff capacities - skills, and systems and procedures

Nairobi Is Organizing- Grassroots Organizing &Public Participation for Social Change - TISA (2015)
The Institute for Social Accountability

Designing Participatory Meetings and Brownbags: A TOPS Quick Guide to Linking Development Practitioners - TOPS (Technical and Operational Performance Support Program, USAID, 2013)
Visit this resource for ideas on designing meetings and brownbags that are engaging and build inopportunities for participant dialogue.

Triangulation, Respondent Validation, and Democratic Participation in Mixed Methods Research - Torrance, Harry (Journal of Mixed Methods Research, 2012)
Over the past 10 years or so the “Field” of “Mixed Methods Research” (MMR) has increasingly been exerting itself as something separate, novel, and significant, with some advocates claiming paradigmatic status. Triangulation is an important component of mixed methods designs. Triangulation has its origins in attempts to validate research findings by generating and comparing different sorts of data, and different respondents’ perspectives, on the topic under investigation. Respondent validation has sometimes been included in such processes, but it is an element that has not attracted significant attention from the MMR community. The article argues that attention to respondent validation is a significant issue for methodological debate and that it should be an important aspect of the development of democratic participation in MMR.

Integrating farmers’ adaptive knowledge into flood management and adaptation policies in the Vietnamese Mekong Delta: A social learning perspective - Tran, Thong Anh; Rodela, Romina (Global Environmental Change, 2019)
Flood management and adaptation are important elements in sustaining farming production in the Vietnamese Mekong Delta (VMD). While over the past decades hydraulic development introduced by the central government has substantially benefited the rural economy, it has simultaneously caused multiple barriers to rural adaptation. We investigate the relational practices (i.e., learning interactions) taking place within and across the flood management and adaptation boundaries from the perspective of social learning. We explore whether and how adaptive knowledge (i.e., experimental and experiential knowledge) derived from farmers’ everyday adaptation practices contributes to local flood management and adaptation policies in the selected areas. We collected data through nine focus groups with farmers and thirty-three interviews with government officials, environmental scientists, and farmers. Qualitative analysis suggests that such processes are largely shaped by the institutional context where the boundary is embedded. This study found that while the highly bureaucratic operation of flood management creates constraints for feedback, the more informal arrangements set in place at the local level provide flexible platforms conducive to open communication, collaborative learning, and exchange of knowledge among the different actors. This study highlights the pivotal role of shadow systems that provide space for establishing and maintaining informal interactions and relationships between social actors (e.g., interactions between farmers and extension officials) in stimulating and influencing, from the bottom-up, the emergence of adaptive knowledge about flood management and adaptation in a local context.
Keywords: Adaptation; Flood management; Knowledge brokers; Mekong Delta; Shadow systems; Social learning; Vietnamese

A Rubric to Evaluate Citizen-Science Programs for Long-Term Ecological Monitoring - Tredick, Catherine A.; Lewison, Rebecca L.; Deutschman, Douglas H.; Hunt, Timothy ANN; Gordon, Karen L.; Von Hendy, Phoenix (BioScience, 2017)
Abstract. Citizen-science (CS) programs provide a cost-effective way to collect monitoring data over large temporal and spatial scales. Despite the recent prol

Outcome mapping for health system integration - Tsasis, Peter; Evans, Jenna; Forrest, David; Jones, Richard Keith (Journal of Multidisciplinary Healthcare, 2013)
Health systems around the world are implementing integrated care strategies to improve quality, reduce or maintain costs, and improve the patient experience. Yet few practical tools exist to aid leaders and managers in building the prerequisites to integrated care, namely a shared vision, clear roles and responsibilities, and a common understanding of how the vision will be realized. Outcome mapping may facilitate stakeholder alignment on the vision, roles, and processes of integrated care delivery via participative and focused dialogue among diverse stakeholders on desired outcomes and enabling actions. In this paper, we describe an outcome-mapping exercise we conducted at a Local Health Integration Network in Ontario, Canada, using consensus development conferences. Our preliminary findings suggest that outcome mapping may help stakeholders make sense of a complex system and foster collaborative capital, a resource that can support information sharing, trust, and coordinated change toward integration across organizational and professional boundaries. Drawing from the theoretical perspectives of complex adaptive systems and collaborative capital, we also outline recommendations for future outcome-mapping exercises. In particular, we emphasize the potential for outcome mapping to be used as a tool not only for identifying and linking strategic outcomes and actions, but also for studying the boundaries, gaps, and ties that characterize social networks across the continuum of care.

Micropolitics in collective learning spaces for adaptive decision making - Tschakert, Petra; Das, Partha Jyoti; Shrestha Pradhan, Neera; Machado, Mario; Lamadrid, Armando; Buragohain, Mandira; Hazarika, Masfique Alam (Global Environmental Change, 2016)
Recent advances on power, politics, and pathways in climate change adaptation aim to re-frame decision-making processes from development-as-usual to openings for transformational adaptation. This paper offers empirical insights regarding decision-making politics in the context of collective learning through participatory scenario building and flexible flood management and planning in the Eastern Brahmaputra Basin of Assam, India. By foregrounding intergroup and intragroup power dynamics in such collective learning spaces and how they intersect with existing micropolitics of adaptation on the ground, we examine opportunities for and limitations to challenging entrenched authority and subjectivities. Our results suggest that emancipatory agency can indeed emerge but is likely to be fluid and multifaceted. Community actors who are best positioned to resist higher-level domination may well be imbricated in oppression at home. While participatory co-learning as embraced here might open some spaces for transformation, others close down or remain shut.
Keywords: Co-learning; Flood management; Participatory scenarios; Politics of adaptation; Power

Monitoring, Evaluation and Learning approaches in an adaptive management context - Tsui, Josephine (EPS PEAKS, ODI, 2016)

Monitoring and evaluation of policy influence and advocacy - Tsui, Josephine; Hearn, Simon; Young, John (ODI, 2014)
Policy influence and advocacy are increasingly regarded as a means of creating sustainable policy change in international development. It is often also seen as a difficult area to monitor and evaluate. Yet there is an increasingly rich strand of innovation in options to monitor, evaluate and learn from both the successes and failures of policy influence and advocacy interventions. This paper explores current trends in monitoring and evaluating policy influence and advocacy; discusses different theories of how policy influence happens; and presents a number of options to monitor and evaluate different aspects of advocacy interventions. Case studies describe how some organisations have used these options in practice to understand their impact and improve their advocacy strategies.

Exploring the prospects for adaptive governance in marine transboundary conservation in East Africa - Tuda, Arthur Omondi; Kark, Salit; Newton, Alice (Marine Policy, 2019)
This article explores the prospects for adaptive governance in a proposed marine transboundary conservation initiative in East Africa. Adaptive governance that involves interdependent state and non-state actors learning and taking action on joint environmental problems is suggested for effective transboundary resource governance. Using the concept of adaptive co-management, the current multi-stakeholder marine governance systems in southern Kenya and northern Tanzania are compared to illuminate opportunities and constraints for adaptive marine transboundary conservation governance between Kenya and Tanzania. The concept of networks and the formal method of social network analysis (SNA) are applied as the main methodological device. Using questionnaire and semi-structured interviews, social network data of 70 organizations (local resources users, government agencies and NGOs) was generated from Kenya (n = 33) and Tanzania (n = 37). Results show the existence of strong collaboration networks for marine resource governance in both Kenya and Tanzania. Social proximity is the common driver of network formation. Collaboration networks in Kenya and Tanzania have contributed to enhanced learning among marine resource managers. Conclusions point to the need to focus on common challenges relating to low levels of rule-compliance, limited access to information on the state of resources and poor integration of science into marine management decisions. Finally, differences in views regarding the state of marine ecosystems need to be addressed to improve prospects for joint problem-solving in marine transboundary conservation.
Keywords: Adaptive co-management; Adaptive governance; Collaboration; Marine transboundary conservation; Social network analysis

What does ‘adaptive programming’ mean in the health sector? - Tulloch, Olivia (ODI, 2015)
• There is considerable interest in the concept of adaptive development and what it may look like in different sectors, including health. • Adaptive types of programming from the health sector are relatively advanced; as we work towards the Sustainable Development Goals (SDGs), experiences in health can provide useful lessons for other areas of development. • The international health community may not use the label ‘adaptive development’, but many are already conducting adaptive work. ‘Quality improvement’ is one such tried and tested approach. • Quality improvement is problem-driven, iterative and flexible. The methodology and principles can be used to identify, test and implement changes in any context or part of a health system. • Quality improvement is being used successfully, but there is still limited experience and evidence of how to apply its values and philosophy beyond the project level and embed it within national structures and systems. • Systems thinking and analysis of the political economy environment may help embed complex interventions like quality improvement and sustain their achievements

What's in a name? Unpacking “participatory” environmental monitoring - Turreira-García, Nerea; Lund, Jens; Domínguez, Pablo; Carrillo-Anglés, Elena; Brummer, Mathias; Duenn, Priya; Reyes-García, Victoria (Ecology and Society, 2018)
Turreira-García, N., J. F. Lund, P. Domínguez, E. Carrillo-Anglés, M. C. Brummer, P. Duenn, and V. Reyes-García. 2018. What's in a name? Unpacking “participatory” environmental monitoring. Ecology and Society 23(2):24. https://doi.org/10.5751/ES-10144-230224

Getting Past the Rhetoric #1: Tendering for ‘Thinking and Working Politically’ in Large Facilities - Tyrrel, Lavinia (Abt Associates - Governance Soapbox, 2018)

Getting Past the Rhetoric #2: Managing for ‘Thinking and Working Politically’ in Large Facilities - Tyrrel, Lavinia (Abt Associates - Governance Soapbox, 2018)

Dealing with uncertainty: Reflections on donor preferences for pre-planned project models - Tyrrel, Lavinia; Cole, William (2016)
Keywords: IMPORTANT

Managing Facilities: a stock-take from the first 12 months - Tyrrel, Lavinia; Teskey, Graham; de Lacy, Jacqui (Abt Associates, 2017)

Case study - Lepra - Adaptive programming in “reaching the unreached” - UK Aid Direct (DFID, 2017)

Werner Ulrich's Homepage - Ulrich, Werne (2018)
This website provides a variety of resources from Werner Ulrich's work in a range of philosophical and research areas with a particular focus on his own work in critical systems thinking and practice or, Critical Systems Heuristics (CSH).

Critical systems heuristics - Ulrich, Werner; Reynolds, Martin (Systems Approaches to Manging Change: A Practical Guide, 2010)
This chapter provides a detailed introduction to critical systems heuristics and the use of its central tool boundary critique. What Is CSH? Two Studies in Applying CSH Using CSH as an Intervention Tool: Some Basic Concepts A Core Concept of CSH: Systematic Boundary Critique Boundary Critique Applied to NRUA-Botswana Boundary Critique Applied to ECOSENSUS-Guyana Boundary Critique and Personal Competence Recognising Boundary Judgements – and Keeping Them Fluid Towards a New Ethos of Professional Responsibility

A Framework for Freshwater Ecosystem Management - UN Enviornment (2018)

A Practical Guide for Collective Action against Corruption - UN Global Compact (UN Global Compact, 2015)
All anti-corruption professionals looking to better understand the relationship between collective action and corruption should refer to these two comprehensive guides that the UN Global Compact published. The 2015 guide has modules that cover theoretical concepts, practical recommendations for undertaking CA initiatives, and multiple in-depth case studies of CA projects around the world.

Feasibility Study: Crowdsourcing High-frequency food price data in rural Indonesia - UN Global Pulse (2015)

Project Cycle Hacker's Toolkit - changing the conversation around your projects - UNDP (UNDP, 2017)
The Istanbul Regional Hub partnered with Nesta and 4 country offices (fYR Macedonia, Moldova, Georgia and Kyrgyzstan) to develop a program that can help us bring innovation closer to the center of the organization by embedding it in the key project management business processes - The Project Cycle Hackers Toolkit.

Scaling Up Development Programmes - UNDP (UNDP, 2013)
Many development organizations, national and local governments and civil society organizations are faced with the issue of scaling up development interventions — the main questions raised time and again are: a) what should be scaled up, and how it can be scaled up; b) is there a strong reason for a particular initiative to be scaled up; and c) what should be the value-added of the scaling up efforts, and how can practitioners ensure that technological and other innovations are being integrated for improved development effectiveness? Answers to these questions depend on a host of complex realities—the relative strengths and weaknesses in national and local systems, political and economic situations, including vulnerability of country systems to shocks, commitments from development partners, power dynamics between various groups and stakeholders in a given country, regional and global environments. For the United Nations Country Teams (UNCT) and UNDP offices, another factor to consider is how to maximize our respective comparative advantages. This guidance note summarizes the main conceptual thinking available from development institutions and academia, and presents a simplified conceptual framework and roadmap for scaling up processes. It also provides UNDP programme staff and UNCTs with practical actions and checklists to consider when designing and implementing programmes that support national scaling up initiatives, and proposes actions that can be undertaken at the regional and global levels. Although intended for internal audiences, the scaling up concept and recommendations can also be used by the public and private sector, civil society and social entrepreneurs. This note benefited from a wide consultative process held in 2011, including practical recommendations and proposals from colleagues at country offices and regional/global centres. Their insights have been instrumental in the distillation of main recommendations presented in this note, and the individuals who provided substantive contributions are gratefully noted in the Acknowledgements section.

An Upside Down View of Governance - Unsworth, Sue (Institute of Development Studies, 2010)
Informal institutions and personalised relationships are usually seen as governance problems. However the research presented in this synthesis paper suggests that they can also be part of the solution...

It's the politics! Can donors rise to the challenge? - Unsworth, Sue (A Governance Practitioner’s Notebook: Alternative Ideas and Approaches, 2015)
The Governance Practitioner’s Notebook takes an unusual approach for the OECD-DAC Network on Governance (GovNet). It brings together a collection of specially written notes aimed at those who work as governance practitioners within development agencies. It does so, however, without attempting to offer definitive guidance – instead aiming to stimulate thinking and debate. To aid this process the book is centred on a fictional Governance Adviser. The Notebook’s format provides space for experts to speak on today’s governance issues: politics, public sector reform and stakeholder engagement. It encourages debate, charts the evolution of donor thinking, and highlights future challenges in the age of the Sustainable Development Goals. Each section introduces both technical issues and major areas of debate, providing ideas for future development support to institutional reform.
Keywords: IMPORTANT

Acquisition and Assistance Strategy - USAID (USAID, 2018)
The U.S. Agency for International Development (USAID) of tomorrow is one in which the Agency enables partner countries to plan, resource, and manage their own development through strengthened capacity and commitment — this is the essence of the Journey to Self-Reliance. In Fiscal Year (FY) 2018, the Agency obligated over 80 percent of its programmatic funding — a total of $17 billion — through acquisition and assistance (A&A) mechanisms. Partnering and procurement are central to how we do our work. Therefore, we must think holistically about with whom we work and how we work, if we are to achieve our ambitious goals for the USAID of tomorrow. The purpose of this document is to provide a transparent strategy that guides changes to Agency policy and practice for both our staff and implementing partners in how we approach our core A&A work. This strategy, which builds on previous and current reform efforts, outlines the shifts we will make to embrace a self-reliance model for A&A and move concretely toward the goal of ending the need for foreign assistance. GUIDING PRINCIPLES OF PARTNERING AT USAID USAID’s partnering approaches have evolved significantly over time as we have tested new and innovative ways of working. The principles outlined below support the Journey to Self-Reliance by empowering our staff and partners to produce results-driven solutions responsive to partner country needs and priorities — building capacity and commitment based on creative and entrepreneurial approaches that have already begun to develop. The Agency must move beyond our traditional approaches to embrace greater collaboration, co-design, and co-financing to improve upon our models of partnering.

ADS 201 Additional Help- Whole-of-Project Evaluation - USAID (USAID, 2017)

Biodiversity How-To Guide 1: Developing Situation Models in USAID Biodiversity Programming - USAID (USAID, 2016)
The Biodiversity How-To Guide 1: Developing Situation Models in USAID Biodiversity Programming is the first in a series of three guides that provide in-depth guidance on key tools and practices to support design teams as they design and manage biodiversity programs within the Program Cycle and in accordance with the USAID Biodiversity Policy. It focuses on how to develop situation models to map out the biodiversity conservation problem context to be addressed.

Biodiversity How-To Guide 2: Using Results Chains to Depict Theories of Change in USAID Biodiversity Programming - USAID (USAID, 2016)
The Biodiversity How-To Guide 2: Using Results Chains to Depict Theories of Change in USAID Biodiversity Programming is the second in a series of three guides that provide in-depth guidance on key tools and practices to support design teams as they design and manage biodiversity programs within the Program Cycle and in accordance with the USAID Biodiversity Policy. It builds off the situation model guide to help design teams clearly state the expected results and assumptions behind the proposed strategic approaches that make up the program’s theory of change. The situation model provides the foundation to identify necessary results to reduce threats; brainstorm and prioritize strategic approaches; and then develop results chains to clarify assumptions behind selected approaches.

Biodiversity How-To Guide 3: Defining Outcomes & Indicators for Monitoring, Evaluation, and Learning in USAID Biodiversity Programming - USAID (USAID, 2016)
The Biodiversity How-To Guide 3: Defining Outcomes and Indicators for Monitoring, Evaluation, and Learning in USAID Biodiversity Programming is the third in a series of three guides that provide in-depth guidance on key tools and practices to support design teams as they design and manage biodiversity programs within the Program Cycle and in accordance with the USAID Biodiversity Policy. It uses the results chains developed in the second guide and provides help identifying key results for developing outcome statements and indicators, as required by USAID’s Biodiversity Code, updated in the Biodiversity Policy.

Broad Agency Announcement for Locally Led Development Innovation - USAID (USAID, 2019)
This BAA allows USAID Operating Units (OUs) to co-create, co-design, co-invest, and collaborate in the research, development, piloting, testing, and scaling of innovative, practical, and cost-effective interventions to catalyze locally led development. The BAA aligns with a number of Agency priorities and policies, including the Journey to Self-Reliance, resilience, procurement innovation, and expanding and diversifying the partner base - as well as the New Partnerships Initiative and Acquisition and Assistance Strategy. E3/LS has put up the BAA’s first Addendum, "New Directions in Advancing Locally Led Development," which seeks Expressions of Interest on the following: - Engaging the Local Private Sector - Conflict, Post-Conflict, and Non-Permissive Environments - Effective Partnerships - The Changing Role of the Donor - Local Giving, Philanthropy, and Other Private Resources

CLA for More Effective Development Programs (video) - USAID (USAID LearningLab, 2014)
This presentation features USAID/PPL's Stacey Young discussing the history of learning at USAID; how collaborating, learning, and adapting (CLA) can enhance development outcomes, and the role of implementing partners in supporting this vision.

CLA Maturity Tool: Example Spectrum Cards - USAID (2016)

Collaborate Learn Adapt - Case Competition - USAID (USAID Learning Lab, 2015)

Collaborating, Learning and Adapting (CLA) - Maturity Matrix Overview - USAID (Policy, Planning and Learning, 2016)
Collaborating, Learning and Adapting (CLA) involves strategic collaboration, continuous learning, and adaptive management. CLA approaches to development include collaborating intentionally with stakeholders to share knowledge and reduce duplication of effort, learning systematically by drawing on evidence from a variety of sources and taking time to reflect on implementation, and applying learning by adapting intentionally. The purpose of the maturity matrix tool is to help USAID Missions think more deliberately about how to plan for and implement CLA approaches that fit the Mission’s context and needs. Through a set of easy-to-use cards, the CLA maturity matrix offers examples of what CLA looks like at different stages of maturity. USAID staff can use the decks of cards to both assess current practice and plan for the future. The maturity matrix consists of two decks of cards corresponding to the dimensions of CLA: ● CLA in the Program Cycle: By using the matrix cards to guide a conversation, teams can explore how well CLA is incorporated into the planning and implementation processes of the Program Cycle. ● Enabling Conditions: The cards encourage discussion of the conditions that can significantly influence how CLA and the Program Cycle are implemented at a Mission, including operating processes, organizational culture, and resourcing. Within these decks, the matrix covers 16 subcomponents of CLA. Each has one key concept card and five matrix cards that describe the component in practice, along a spectrum ranging from Not Yet Present to Institutionalized.

Collaborating, Learning, and Adapting Framework & Key Concepts - USAID (USAID, 2016)
Although collaborating, learning, and adapting (CLA) are not new to USAID, they often do not happen regularly or systematically and are not intentionally resourced. The CLA framework above identifies components and subcomponents to help you think more deliberately about what approach to CLA might be best tailored to your organizational or project context. The framework recognizes the diversity of what CLA can look like in various organizations and projects while also giving CLA structure, clarity, and coherence across two key dimensions: CLA in the Program Cycle: how CLA is incorporated throughout Program Cycle processes, including strategy, project, and activity design and implementation; and Enabling Conditions: how an organization’s culture, business processes, and resource allocation support CLA integration. Organizations need both integrated CLA practices appropriate for their context and conducive enabling conditions to become stronger learning organizations capable of managing adaptively. The framework stresses the holistic and integrated nature of the various components of CLA to reinforce the principle that CLA is not a separate workstream—it should be integrated into existing processes to strengthen the discipline of development and improve aid effectiveness.

Combating Wildlife Trafficking Case Study Compilation: Capacity Building for Enforcement and Prosecution - USAID (2018)

Developmental Evaluation in Practice: Tips, Tools, and Templates - USAID (USAID, 2017)

Discussion Note: Complexity-Aware Monitoring - USAID (USAID, 2018)
This Discussion Note complements ADS 201 and outlines general principles and promising approaches for monitoring complex aspects of USAID development assistance. Complexity-aware monitoring is a type of complementary monitoring that is useful when results are difficult to predict due to dynamic contexts or unclear cause and-effect relationships. Key principles of the Program Cycle include applying analytic rigor, managing adaptively, and utilizing a range of approaches to achieve results. ADS 201.3.5.5 identifies three types of program monitoring – performance, context, and complementary. All USAID programming incorporates performance monitoring and should include context monitoring. Performance monitoring “is the ongoing and systematic collection of performance indicator data and other quantitative or qualitative information to reveal whether implementation is on track and whether expected results are being achieved.” Context monitoring is “[t]he systematic collection of information about conditions and external factors relevant to the implementation and performance of an operating units (OU’s) strategy, projects, and activities.” As stated in ADS 201.3.5.5, complementary monitoring may be used by missions and Washington OUs to complement performance and context monitoring in situations where results are difficult to predict due to dynamic contexts or unclear cause-andeffect relationships. This Discussion Note provides an explanation of when to use complementary monitoring approaches that are complexity-aware and summarizes the three principles of complexity-aware monitoring.

How-To Note: Conduct a Data Quality Assessment - USAID (2017)

How-To Note: Developing a Project Logic Model (and its Associated Theory of Change) - USAID (2017)
This How-To Note describes considerations for developing a project logic model, as well as steps for thinking through a more complete theory of change (TOC). A logic model is a graphic or visual depiction that summarizes key elements of a TOC, and it is often used as a facilitation tool during the design process. There are many types of logic models, including but not limited to logical frameworks (logframes), results chains, results frameworks, and local actor-oriented models, among others. The project logic model and its associated TOC are included in the Project Appraisal Document (PAD) that approves a project design (see ADS 201.3.3.13). While this How-To Note focuses on logic models at the project level, logic models are also used at the strategy level (specifically, results frameworks – see Box 1), and often at the activity level. The concepts and steps presented here are generally applicable to the process of developing logic models and TOCs throughout the Program Cycle.

Knowing When to Adapt - A Decision Tree - USAID (USAID LEARN, 2019)
This job aid will help you determine how best to resolve a challenge/issue in programming. It is intended for use by USAID, partners, and others working in international development.

Knowledge Retention and Transfer (KRT) - Model and Matsurity Matrix - USAID (USAID LEARN, 2019)
The Maturity Matrix is not a standalone tool. It is one of the three major components of the KRT Model. The Maturity Matrix is meant to be used in conjunction with the KRT Toolkit and Implementation Plan.

Local Systems: a framework for supporting sustained development - USAID (USAID, 2014)

Local Works Guidance - Round 4 - USAID (USAID, 2019)

Managing staff transistions through CLA: preserving institutional memory as staff come and go - USAID (USAID LEARN, 2019)
This document is relevant for any position or hiring mechanism. While this document does not explicitly address what happens when someone arrives into a newly-created position, which has its own set of challenges, many of the principles, actions, and resources can be applied in that context. Section 1 offers guidance for how to set up and implement systems at Mission/OU or office to ensure that all staff help preserve institutional memory and enable continuity of relationships. This section is for any staff in a Mission/OU working to build systems that improve handovers and knowledge capture and sharing across the Mission or OU. If a Mission or OU is just beginning to develop a system to manage staff transitions, you may want to start by developing a system within an office or team and then expand it out to other offices or to the Mission/OU writ large. Section 2 includes key principles and actions individuals could consider following when arriving or departing a position, regardless of hiring mechanism and position. This includes staff new to the Mission/OU and staff who are currently in the Mission/OU and are moving into a new position. Section 3 provides a select number of resources to help you take a systematic and comprehensive approach to manage staff transitions as effectively and efficiently as possible at the individual or organizational level.

Measuring Efforts to Combat Wildlife Crime - A toolkit for Improving Actiona and Accountability (v.1.3) - USAID (USAID, 2017)

Program Cycle - Discussion Note: Adaptive Management - USAID (USAID, 2018)
This Discussion Note complements ADS 201.3.1.2 Program Cycle Principles by elaborating on Principle 2: Manage Adaptively through Continuous Learning. This Discussion Note is intended for USAID staff interested in learning about recent and promising practices in adaptive management across the Program Cycle.

Program Cycle - Discussion Note: Designing Monitoring, Evaluation, and Learning Platforms - USAID (USAID, 2018)
This Discussion Note complements ADS 201.3.1.2 Program Cycle Principles by elaborating on Principle 2: Manage Adaptively through Continuous Learning. This Discussion Note is intended for USAID staff interested in learning about recent and promising practices in adaptive management across the Program Cycle.

Program Cycle - Discussion Note: Managing Monitoring, Evaluation, and Learning Platforms - USAID (USAID, 2018)
This Discussion Note complements ADS 201.3.1.2 Program Cycle Principles by elaborating on Principle 2: Manage Adaptively through Continuous Learning. This Discussion Note is intended for USAID staff interested in learning about recent and promising practices in adaptive management across the Program Cycle.

Program Cycle - How-To Note: Strategy-Level Portfolio Review - USAID (USAID PPL, 2017)

Program Cycle Road Map - USAID (2016)

RFI-521-17-000015 - Improving Governance in Haiti Program (IGHI) - USAID (USAID, 2017)

SPACES MERL: Systems and Complexity White Paper - USAID (2016)
The Strategic Program for Analyzing Complexity and Evaluating Systems (SPACES MERL) project is an activity funded by USAID’s Global Development Lab and the Bureau for Policy, Planning and Learning (PPL). This three-year activity aims to bring a variety of tools and methodologies that decision-makers can use (alone or in combination) to provide comprehensive systems analysis. The activity is being implemented from 2015 to 2018 by a consortium of organizations expert in systems and complexity, including the Global Obesity Prevention Center (GOPC) at Johns Hopkins University (Prime), Global Knowledge Initiative (GKI), LINC and ResilientAfrica Network (RAN). This Systems and Complexity White Paper is a collaborative effort of the SPACES MERL team, designed to frame the international development landscape, with particular reference to USAID-funded activities, for application of systems and complexity approaches to design, monitoring and evaluation. Customized to the systems and complexity layperson with in-depth knowledge of international development practice, the objectives of this white paper are three-fold:  Provide an overview of systems and complexity practice, its current state of application and relevance to international development practice;  Establish a taxonomy of systems and complexity tools, highlighting the fit of those offered by SPACES MERL within the wider landscape; and  Review and provide information on application of SPACES MERL tools, their purpose and construction, required data, and their applicability to specific contexts.

Stakeholder Engagement for Biodiversity Conservation Goals: Assessing the Status of the Evidence - USAID (USAID, 2016)
Learning how to communicate and work with different groups builds constituencies to support conservation aims. An analysis by USAID's research partner the American Museum of Natural History evaluated 148 references, selected through a rigorous systematic review process, to identify key lessons for stakeholder engagement. This briefer describes the analysis, which will soon be published in full.

The 5 Rs Framework in the program cycle - USAID (2016)
USAID’s Program Cycle Operational Policy (ADS 201) provides guidance to missions and other operating units on how to implement the Program Cycle. A key principle of the Program Cycle is to “Promote Sustainability through Local Ownership.” The purpose of this Technical Note is to describe the “5Rs Framework”, a practical methodology for supporting sustainability and local ownership in projects and activities through ongoing attention to local actors and local systems. This Note is rooted in USAID’s 2014 Local Systems Framework paper, which establishes that achieving sustained improvement in development results depends on the contributions of multiple and interconnected local actors. That document also states that USAID needs to improve its systems practice if it is to engage local actors and strengthen local systems more effectively and thus realize sustained results more consistently. The 5Rs Framework, also introduced in the Local Systems Framework, is intended as a simple and practical tool to promote good systems practice. The 5Rs Framework highlights five key dimensions of systems: Results, Roles, Relationships, Rules and Resources. Collectively these 5Rs can serve as a lens for assessing local systems and a guide for identifying and monitoring interventions designed to strengthen them. This Technical Note is divided in two parts. The first part provides an introduction to the 5Rs Framework and the systems practice from which it emerges. The second part demonstrates how systems practice can be embedded in the Program Cycle by continuously applying the 5Rs, especially to the design, implementation, and monitoring of USAID projects and their accompanying activities.

USAID ADS 201 - Program Cycle Operational Policy (Update 1/23/2017) - USAID (USAID, 2017)
The Program Cycle is USAID’s operational model for planning, delivering, assessing, and adapting development programming in a given region or country to advance U.S. foreign policy. It encompasses guidance and procedures for: 1) Making strategic decisions at the regional or country level about programmatic areas of focus and associated resources; 2) Designing projects and supportive activities to implement strategic plans; and 3) Learning from performance monitoring, evaluations, and other relevant sources of information to make course corrections as needed and inform future programming.

USAID ADS 201 - Program Cycle Operational Policy (Update 10/29/2018) - USAID (USAID, 2018)

USAID Risk Appetite Statement - USAID (USAID, 2018)

USAID’s Data Quality Standards & Conducting a DQA - USAID (2014)