A Low-resource Aware Framework for ICT Service Development in Rural Africa - Bon, Anna; Gordijn, Jaap; Akkermans, Hans (28th International Conference on Advanced Information Systems Engineering, 2016)
Technological innovation and information & communication technologies (ICTs) are considered enabling factors for social and economic development, even in very poor parts of the world. However,...

Why the Problem with Learning Is Unlearning - Bonchek, Mark (Harvard Business Review, 2016)
Don’t get stuck in your current ways of thinking.

Aiding Institutional Reform in Developing Countries: Lessons from the Philippines on what works, what doesn't and why - Booth, David (Working Politically in Practice Series: Case Study, 2014)

Incubating policy for economic transformation: Lessons from Nepal - Booth, David (ODI, 2018)

Politically smart support to economic development: DFID experiences - Booth, David (ODI, 2016)

Still watering white elephants? The blueprint versus process debate thirty years on - Booth, David (Perspectives on politics, production and public administration in Africa: essays in honour of Ole Therkildsen, 2015)

Thinking and Working Politically: Professional Development Reading Pack - Booth, David (GSDRC Applied Knowledge services, 2015)

Learning to make a difference: Christian Aid Ireland’s adaptive programme management in governance, gender, peace building and human rights - Booth, David; Balfe, Karol; Gallagher, Róisín; Kilcullen, Gráinne; O'Boyle, Sarah; Tiernan, Alix (ODI, 2018)
This paper assesses the relevance of adaptive or trial-and-error approaches to the field of governance, peace building and human rights. Tackling the problems of poverty, vulnerability and exclusion that persist in parts of the world that continue to be affected by violence or political insecurity is difficult for several reasons. For one, because of the complexity of the prevailing social, economic and political systems, solutions to chronic problems are far from obvious. One response to this aspect of the challenge is adaptive programme design and management. This paper is the product of a multi-year collaboration between ODI and the core team of Christian Aid Ireland to assess the relevance of adaptive or trial-and-error approaches to the field of governance, peace building and human rights. It explains the basis on which Christian Aid Ireland’s current five-year programme has become committed to an adaptive approach. It then describes and seeks to draw lessons from the programme’s first year of experience, considering the possible implications for implementation over the coming years. The authors find that to get full benefits from the move to adaptive management, the new ways of working and their underlying principles will need to become more embedded in organisational practices and cultures.

The SAVI programme in Nigeria: Towards politically smart, locally led devlopment - Booth, David; Chambers, Victoria (ODI, 2014)
 More examples are needed of aid programming that works by being responsive to country realities: politically smart, problem-driven and locally led  DFID’s SAVI programme has revealed a hitherto untapped potential for change leading to better development results at state level in Nigeria  SAVI provides low-profile support to state-level organisations and partnerships, building their capacity to engage constructively with government  It avoid the pitfalls of a donor-driven approach by ‘taking the money off the table’  This illustrates the power of facilitated multi-stakeholder engagement and the disadvantages of seeing this in terms of ‘supply side’ and ‘demand side’ governance  The set-up of the DFID suite of state-level programmes, with separately managed sector support and ‘governance’ initiatives, has limited realisation of the potential  Key enabling conditions were that DFID provided space for an experience-based design process and permitted tangible results to be judged retrospectively, not pre-programmed

From political economy analysis to doing development differently: a learning experience - Booth, David; Harris, Daniel; Wild, Leni (ODI, 2016)
A study of how development efforts can be strengthened by an awareness of political economy, reflecting on the experiences of PoGo policy researchers.
Keywords: IMPORTANT

Politically smart, locally led development - Booth, David; Unsworth, Sue (Discussion Paper, 2014)
Aid donors have found it hard to move from thinking politically to working differently, but there is evidence that they can do so and that this improves outcomes. This paper presents seven examples of where adopting a politically smart, locally led approach has led to better outcomes.
Keywords: Practice

Conservation Enterprises: Using A Theory of Change Approach to Synthesize Lessons from USAID Biodiversity Projects - Boshoven, Judy (Measuring Impact, 2017)
In an effort to increase the understanding of conservation enterprises’ activities and outcomes and to improve the effectiveness of biodiversity programming, this brief synthesizes lessons from past USAID-funded efforts to support conservation enterprises

Lessons Learned from the Forest, Climate and Communities Alliance - Boshoven, Judy (Measuring Impact, 2014)
The Forest, Climate, and Communities Alliance (FCCA) was an initiative funded by USAID’s Bureau for Economic Growth, Education, and the Environment/Office of Forestry and Biodiversity (E3/FAB) under the USAID Global Development Alliance (GDA)1 between 2009 and 2013. FCCA was one of the first USAID-funded projects for reducing emissions from deforestation and degradation (REDD+). The Rainforest Alliance (RA) implemented FCCA in Ghana and Honduras. Operating in two different contexts allowed FCCA to generate important lessons learned that may be useful as countries around the world search for approaches to prepare for and implement successful REDD+ mechanisms. In 2013, as FCCA was coming to an end, USAID tasked the Measuring Impact (MI) initiative with an independent review to generate lessons learned from FCCA. In capturing and disseminating lessons from the FCCA project, the Agency intends to contribute to the understanding of what may be effective, and under what conditions, when promoting REDD+ in conjunction with forest and agricultural product certification. MI is a five-year USAID project executed by the E3/FAB Office designed to improve the Agency’s practice of conservation by building USAID’s capacity to better design, manage, evaluate, and learn from biodiversity conservation initiatives. As such, MI was tasked with carrying out this review of lessons learned from FCCA while using RA’s general hypothesis as the basis to describe the project and its lessons.

Human-Centered, Systems-Minded Design - Both, Thomas (Stanford Social Innovation Review, 2018)
Both human-centered and systems-thinking methods fit within an effective design approach, and can work in conjunction to address social challenges.

Embracing Complexity: Strategic Perspectives for an Age of Turbulence - Boulton, Jean G.; Allen, Peter M.; Bowman, Cliff (Oxford University Press, 2015)
The book describes what it means to say the world is complex and explores what that means for managers, policy makers and individuals. The first part of the book is about the theory and ideas of complexity. This is explained in a way that is thorough but not mathematical. It compares differing approaches, and also provides a historical perspective, showing how such thinking has been around since the beginning of civilisation. It emphasises the difference between a complexity worldview and the dominant mechanical worldview that underpins much of current management practice. It defines the complexity worldview as recognising the world is interconnected, shaped by history and the particularities of context. The comparison of the differing approaches to modelling complexity is unique in its depth and accessibility. The second part of the book uses this lens of complexity to explore issues in the fields of management, strategy, economics, and international development. It also explores how to facilitate others to recognise the implications of adopting a complex rather than a mechanical worldview and suggests methods of research to explore systemic, path-dependent emergent aspects of situations. The authors of this book span both science and management, academia and practice, thus the explanations of science are authoritative and yet the examples of changing how you live and work in the world are real and accessible. The aim of the book is to bring alive what complexity is all about and to illustrate the importance of loosening the grip of a modernist worldview with its hope for prediction, certainty and control.

The Answer is 42. On Data, Information and Knowledge - Bours, Dennis (Earth-Eval, 2015)
A recent discussion with some colleagues on the differences between data, knowledge and information made me realize that there still is a lot of confusion when it comes to the use of terms; confusion that goes well beyond my earlier blog post on indicators, measures and metrics.

Systems Thinking: An introduction for Oxfam programme staff - Bowman, Kimberly; Chettleborough, John; Jeans, Helen; Whitehead, James; Rowlands, Jo (Policy & Practice, 2015)
Development organizations frequently face and overcome challenges in programme delivery. But what happens when the proposed solutions fail? How can organizations adapt to changing conditions and ensure the benefits of programmes are shared as widely as possible?

Science, Technology, and Innovation in Uganda: Recommendations for Policy and Action - Brar, Sukdeep; Farley, Sara E.; Hawkins, Robert; Wagner, Caroline S. (A World Bank Study, 2011)

Using Research Evidence - A practice guide - Breckon, Jonathan (Alliance for Useful Evidence, 2016)

Using Evidence - What works? - Breckon, Jonathan; Dodson, Jane (Alliance for Useful Evidence, 2016)

Participation and accountability in development management - Brett, E. A. (The Journal of Development Studies, 2003)
This article critically reviews the role of participatory theory in managing development projects and programmes in poor countries. Participation has emerged in response to global demands for greater individual and social control over the activities of state and private agencies, and especially to the manifest failures of traditional ‘top-down’ management systems in LDCs. Claims made on behalf of these participatory methodologies are critically reviewed and a distinction is drawn between strong and weak versions of the theory. Empirical evidence is then considered to evaluate the effectiveness of these methodologies, using long-standing insights of social science theory to show that participation can succeed for specific kinds of projects and programmes in favourable circumstances, but is unsuitable for many others. It commonly fails in contexts where local conditions make co-operative and collective action very difficult, or where it is manipulated by implementing agencies to justify their own actions or poor performance.

Digital Technologies for Democratic Governance in Latin America: Opportunities and Risks - Breuer, Anita; Welp, Yanina (Routledge, 2016)
This book is the first to comprehensively analyse the political and societal impacts of new Information and Communication Technologies (ICT) in a region of the Global South. It evaluates under what conditions some Latin American governments and people have succeeded in taking up the opportunities related to the spread of ICTs, while others are confronted with the pessimist scenario of increased, digitally induced social and democratic cleavages. Specifically, the book examines if and how far the spread and use of new ICT affected central aims of democratic governance such as reducing socio-economic and gender inequality; strengthening citizen participation in political decision making; increasing the transparency of legislative processes; improving administrative processes; providing free access to government data and information; and expanding independent spaces of citizen communication. The country case and cross-country explore a range of bottom-up driven initiatives to reinforce democracy in the region. The book offers researchers and students an interdisciplinary approach to these issues by linking it to established theories of media and politics, political communication, political participation, and governance. Giving voice to researchers native to the region and with direct experience of the region, it uniquely brings together contributions from political scientists, researchers in communication studies and area studies specialists who have a solid record in political activism and international development co-operation.

Implementing Adaptive Approaches in Real World Scenarios: A Nigeria Case Study, with Lessons for Theory and Practice - Bridges, Kate; Woolcock, Michael (The World Bank, 2019)
How does adaptive implementation work in practice? Drawing on extensive interviews and observations, this paper contrasts the ways in which an adaptive component of a major health care project was implemented in three program and three matched comparison states in Nigeria. The paper examines the bases on which claims and counterclaims about the effectiveness of these approaches were made by different actors, concluding that resolution requires any such claims to be grounded in a fit-for-purpose theory of change and evaluation strategy. The principles of adaptive development may be gaining broad acceptance, but a complex array of skills, expectations, political support, empirical measures, and administrative structures needs to be deftly integrated if demonstrably positive operational results are to be obtained, especially when undertaken within institutional systems, administrative logics, and political imperatives that are predisposed to serve rather different purposes.

Unpacking the concept of political will to confront corruption - Brinkerhoff, Derek W. (U4 Brief, No. 1, 2010)
Quite often, "lack of political will" is identified as the culprit for poorly performing anti-corruption programmes. Yet despite the frequency with which it is used to explain unsatisfactory reform outcomes, political will remains under-defined and poorly understood. Further, assessments are often conducted retrospectively, looking back at failed programmes. By applying a model of political will that specifies a set of action-based components that are observable and measurable, and amenable to external reinforcement and support, more clarity regarding the degree of political will can be achieved.

Adapting to Learn and Learning to Adapt: Practical Insights from International Development Projects - Brinkerhoff, Derick W.; Frazer, Sarah; McGregor, Lisa (RTI Press, 2018)
Adaptive programming and management principles focused on learning, experimentation, and evidence-based decision making are gaining traction with donor agencies and implementing partners in international development. Adaptation calls for using learning to inform adjustments during project implementation. This requires information gathering methods that promote reflection, learning, and adaption, beyond reporting on pre-specified data. A focus on adaptation changes traditional thinking about program cycle. It both erases the boundaries between design, implementation, and evaluation and reframes thinking to consider the complexity of development problems and nonlinear change pathways.Supportive management structures and processes are crucial for fostering adaptive management. Implementers and donors are experimenting with how procurement, contracting, work planning, and reporting can be modified to foster adaptive programming. Well-designed monitoring, evaluation, and learning systems can go beyond meeting accountability and reporting requirements to produce data and learning for evidence-based decision making and adaptive management. It is important to continue experimenting and learning to integrate adaptive programming and management into the operational policies and practices of donor agencies, country partners, and implementers. We need to devote ongoing effort to build the evidence base for the contributions of adaptive management to achieving international development results.

Reflections on Ten Years of USAID’s Experience with Political Economy Analysis and Thinking and Working Politically - Brinkerhoff, Derick; Cassidy, Marc (TWP CoP, 2023)
The global Thinking and Working Politically (TWP) Community of Practice (CoP), the Washington DC TWP CoP, and USAID organised a webinar on 5 December 2022 to take stock of how USAID and its partners have used PEA to inform programme strategy, design and implementation, and support TWP. This paper synthesises the key points arising from the webinar, including observations on the impacts, opportunities, challenges, and prospects for PEA/TWP to become more deeply adopted and sustained as a development methodology and approach across sectors. It starts by defining key concepts. It then highlights insights from the discussions of the impact of the application of PEA and TWP principles across sectors. The paper concludes by looking at progress achieved to date, as well as constraints and opportunities to increase the uptake of both thinking and working politically in USAID-sponsored programming.

Adapting to learn and learning to adapt: Practical insights from international development projects - Brinkerhoff, Derick; Frazer, Sarah (RTI, 2018)
Adaptive programming and management principles focused on learning, experimentation, and evidence-based decision making are gaining traction with donor agencies and implementing partners in international development. Adaptation calls for using learning to inform adjustments during project implementation. This requires information gathering methods that promote reflection, learning and adaption, beyond reporting on pre-specified data. A focus on adaptation changes traditional thinking about program cycle.

Thinking and Working Politically (Yangon, October 2016) - British Council (British Council Myanmar, 2017)
On 3-4 October 2016, British Council, Pyoe Pin, The Asia Foundation and UK DFID co-hosted a two day conference on ‘Thinking and Working Politically’ (TWP) for more effective and sustainable development assistance. The success or failure of development programmes is, in many – if not most – cases, determined by domestic politics within countries, rather than by the technical elegance of programme design by external donors. The event brought together international donors, implementing agencies and local partners. Participants compared experiences on what has worked, where and why – both in Myanmar, and across the world including case studies from Sudan, Zambia and the Philippines. Throughout the conference, participants familiarised themselves with politically smart development approaches and what it means to think and work politically in Myanmar. This has laid foundations for greater collaboration on TWP to help meet Myanmar’s critical development challenges.

Iterative Design and Monitoring for Adaptive Management: How Causal Link Monitoring can help - Britt, Heather; Hummelbrunner, Richard; Green, Jackie (Better Evaluation, 2018)
Development actors are embracing the concept and practice of adaptive management, using evidence to inform ongoing revisions throughout implementation. In this guest blog, Heather Britt, Richard Hummelbrunner and Jackie Greene discuss a practical approach that donors and partners can use to agree on what’s most important to monitor as a project continues to evolve.

Causal Link Monitoring - Britt, Heather; Hummelbrunner, Richard; Greene, Jacqueline (2017)
Causal Link Monitoring (CLM) 1 integrates design and monitoring to support adaptive management of projects. CLM helps project planners and managers identify the processes that are required to achieve desired results, and then to observe whether those processes take place, and how. Result-producing processes specify the causal links between results in a logic model or results framework—in other words, the processes between results.2 CLM focuses on how specific individuals or organizations use results to achieve other results. In CLM, planners start by creating a logic model to help document predictable, agreed-upon elements of the project. Next, they refine the causal links by describing the processes that will transform results at one point in the causal chain to the next. Planners are often less certain about these resultproducing processes. Finally, the CLM logic model is enhanced with information about two important sources of uncertainty, contextual factors that may influence the project and diverse perspectives on the problem and its solution.

Complexity-Aware Monitoring - Britt, Heather; Patsalides, Melissa (Briefing on USAID's Discussion Note, 2013)

Organisational Learning in NGOs: Creating the motive, means and opportunity - Britton, Bruce (Intrac, 2005)

More accountable and responsive governance: How do technologies help make it happen? - Brock, Karen; McGee, Rosemary (2017)
The change Making All Voices Count wants to see is more responsive, accountable governance. The programme has contributed to this change by supporting tech-enabled initiatives which amplify citizen voice and nurture government responsiveness, and by building understanding of when and how the technologies help create and support change. In March 2017, partners from 34 of the programme's projects met with Making All Voices Count staff and associates in South Africa in order to share their stories of change. The learning event participants analysed their experiences using a framework that describes seven streams of tech-enabled change: the information stream; the feedback stream; the naming-and-shaming stream; the conducive innovation system stream; the connecting citizens stream; the infomediation stream and the intermediation stream.

Learning for change in accountable governance programming - Brock, Karen; Shutt, Cathy; Ashlin, Alison (MAVC Learning Review, 2016)
Keywords: IMPORTANT

Assessing the Evidence: The Effectiveness and Impact of Public Governance-Oriented Multi-Stakeholder Initiatives - Brockmyer, Brandon; Fox, Jonathan A. (Transparency & Accountability Initiative, 2015)
Transnational multi-stakeholder initiatives (MSIs) – voluntary partnerships between governments, civil society, and the private sector – are an increasingly prevalent strategy for promoting government responsiveness and accountability to citizens. While most transnational MSIs involve using voluntary standards to encourage socially and environmentally responsible private sector behavior, a handful of these initiatives – the Extractive Industries Transparency Initiative (EITI), the Construction Sector Transparency Initiative (CoST), the Open Government Partnership (OGP), the Global Initiative on Fiscal Transparency (GIFT) and the Open Contracting Partnership (OCP) – focus on information disclosure and participation in the public sector. Unlike private sector MSIs, which attempt to supplement weak government capacity to enforce basic social and environmental standards through partnerships between businesses and civil society, public sector MSIs ultimately seek to bolster public governance. But how exactly are these MSIs supposed to work? And how much has actually been achieved?The purpose of this study is to identify and consolidate the current state of the evidence for public governance-oriented MSI effectiveness and impact. Researchers collected over 300 documents and interviewed more than two-dozen MSI stakeholders about their experiences with five public governance oriented multi-stakeholder initiatives.This report provides a ‘snapshot’ of the evidence related to these five MSIs, and suggests that the process of leveraging transparency and participation through these initiatives for broader accountability gains remains uncertain. The report highlights the ongoing process of defining MSI success and impact, and how these initiatives intersect with other accountability actors and processes in complex ways. The study closes with key recommendations for MSI stakeholders.
Keywords: Accountability; Participation; Program evaluation; Transparency; global governance; multi-stakeholder

This startup uses machine learning and satellite imagery to predict crop yields - Brokaw, Alex (The Verge, 2016)
Mark Johnson wants to beat the United States Department of Agriculture at its own game: predicting yields of America's crops. The USDA puts boots on the ground, deploying hundreds of workers to...

The MSP Tool Guide: Sixty tools to facilitate Multi-Stakeholder Partnerships - Brouwer, Herman; Brouwers, Jan (CDI, Wageningen University and Research, 2016)
What is ‘The MSP Tool Guide’ all about? This compilation of 60 tools is an companion to The MSP Guide, the Wageningen University & Research CDI resource on how to design and facilitate effective multi-stakeholder partnerships. At the request of many readers we have compiled them into one document to enable easy storing and sharing. These tools are available in summarized version in the MSP Guide in Chapter 6. The detailed versions on how to use the tool, and when to use it, are available on the portal www.mspguide.org/tools-and-methods. The content of this portal is compiled in this Tool Guide.

The MSP Guide: How to Design and Facilitate Multi-Stakeholder Partnerships - Brouwer, Herman; Woodhill, Jim; Hemmati, Minu; Verhoosel, Karèn; van Vugt, Simone (Practical Action Publishing, 2016)
In recent years, multi-stakeholder partnerships (MSPs) have become popular for tackling the complex challenges of sustainable development. This guide provides a practical framework for the design and facilitation of these collaborative processes that work across the boundaries of business, government, civil society and science. The guide links the underlying rationale for multistakeholder partnerships, with a clear four phase process model, a set of seven core principles, key ideas for facilitation and 60 participatory tools for analysis, planning and decision making. The guide has been written for those directly involved in MSPs – as a stakeholder, leader, facilitator or funder – to provide both the conceptual foundations and practical tools that underpin successful partnerships. What’s inside draws on the direct experience of staff from the Wageningen Centre of Development Innovation (WCDI), at Wageningen University & Research, in supporting MSP processes in many countries around the world. The guide also compiles the ideas and materials behind WCDI’s annual three week international course on facilitating MSPs and social learning. This work has been inspired by the motivation and passion that comes when people dare to “walk in each other’s shoes” to find new paths toward shared ambitions for the future.

Putting Gender into Political Economy Analysis: why it matters and how to do it - Brown, Emily; Haines, Rebecca; O’Neil, Tam (From Poverty to Power, 2018)
Gender specialists from Oxfam and Care introduce a new guide that covers both theory and practice of including gender in political economy analysis.
Keywords: Gender

Change by Design: How Design Thinking Transforms Organizations and Inspires Innovation - Brown, Tim (HarperBusiness, 2009)
The myth of innovation is that brilliant ideas leap fully formed from the minds of geniuses. The reality is that most innovations come from a process of rigorous examination through which great ideas are identified and developed before being realized as new offerings and capabilities. This book introduces the idea of design thinking‚ the collaborative process by which the designer′s sensibilities and methods are employed to match people′s needs not only with what is technically feasible and a viable business strategy. In short‚ design thinking converts need into demand. It′s a human−centered approach to problem solving that helps people and organizations become more innovative and more creative. Design thinking is not just applicable to so−called creative industries or people who work in the design field. It′s a methodology that has been used by organizations such as Kaiser Permanente to increase the quality of patient care by re−examining the ways that their nurses manage shift change‚ or Kraft to rethink supply chain management. This is not a book by designers for designers; this is a book for creative leaders seeking to infuse design thinking into every level of an organization‚ product‚ or service to drive new alternatives for business and society.
Keywords: IMPORTANT

Design Thinking for Social Innovation - Brown, Tim; Wyatt, Jocelyn (Stanford Social Innovation Review, 2010)
Designers have traditionally focused on enhancing the look and functionality of products. Recently, they have begun using design techniques to tackle more complex problems, such as finding ways to provide low-cost healthcare throughout the world. Businesses were the first to embrace this new approach—called design thinking—and nonprofits are beginning to adopt it too.

Emerging Technologies and Approaches in Monitoring, Evaluation, Research, and Learning for International Development Programs - Bruce, Kerry; Gandhi, Valentine J; Vandelanotte, Joris (MERL Tech, 2020)
Emerging technology is making monitoring, evaluation, research and learning (MERL) more precise and enriching data. However, this evolution is so rapid that it can be difficult to stay informed about the field overall. This paper presents examples of emerging technology that are most often used in MERL for development programs, describes the pros and cons of their use, and discusses technology and ethics concerns that practitioners should keep in mind. The paper covers new types of data sources (application data, sensor data, and drones), new ways to store data (distributed ledger technology and the cloud), and new ways to analyze data (text analytics and supervised and unsupervised learning).

Contracts for adaptive programming - Bryan, Kevin; Carter, Paddy (ODI, 2016)
Adaptive programming is an approach to development that encourages experimentation, learning & adaptation. This report examines the contractual underpinnings of this approach.

Getting good at disruption in an uncertain world: Insights from Southern NGO leaders - Buckley, Lila; Ward, Halina (International Institute for Environment and Development, 2016)
Keywords: IMPORTANT

Linking constituent engagement and adaptive management - Buell, Stephanie; Campbell, Megan; Pett, Jamie (Overseas Development Institute, 2020)
Constituent engagement is the two-way process of involving constituents in the design, delivery, monitoring and evaluation of programmes. Constituent engagement and adaptive management together can be a powerful combination; high-quality constituent engagement can reinforce effective adaptive management, and vice versa. By highlighting stories from leading practitioners and their organisations, this paper explores how programmes ensure that constituent engagement informs meaningful adaptation. Key messages Constituent engagement and adaptive management are both important tools for implementing responsive and effective development programmes. Together, they can be a powerful combination: input from constituent engagement can be a key source of information and evidence that meaningfully informs programme design and adaptation, and closing the feedback loop in this way increases the quality of future engagement. Both adaptive management and community engagement principles recognise that, for a programme to be effective, it must be responsive to the people meant to ultimately benefit from it. Beyond providing a key source of information for potential programme adaptations, constituent engagement efforts also help build trust with stakeholders, align expectations and promote accountability. This paper explores five key elements for ensuring that constituent engagement and adaptive management are effectively linked within a programme: strong internal systems and external channels; skilled staff that value engagement and adaptation; decision-maker champions; clear points for reflection and action; and a meaningful role for constituents.

Outcome mapping: learning brief - Buell, Stephanie; Malallah, Haneen; Mason, Paige (Briefing Paper, 2020)
Adaptive programmes recognise that certain changes, particularly in behaviours, are complex, non-linear and difficult to measure. This briefing note explores the use of outcome mapping (OM) as a monitoring, evaluation and learning (MEL) approach to track behavioural change and inform adaptation for two programmes: the Pathways to Resilience in Semi-arid Economies (PRISE) research consortium and the Accountability in Tanzania programme (AcT I and AcT II). It discusses the implementation of OM, the ways in which it has enabled adaptation and enabling contexts in order to identify key considerations for MEL specialists and programme managers as they determine whether OM may be the right fit, and how best to use the approach. Key messages OM has a number of different benefits as a MEL approach, including unpacking different uses of information at different levels of programme implementation; helping to develop a common language around progress markers; and going beyond monitoring to inform adaptation throughout implementation. These benefits are important aspects of monitoring, evaluation and learning for adaptive management (MEL4AM), as they provide richer evidence for decision-making at a frequency that could mean real-time learning and change. OM works best when it is embedded throughout the organisation, and as part of programme and organisational culture, rather than tasked to a MEL unit or individual.

When theory meets reality: assumptions, feasibility and implications of a complexity-informed approach - Buffardi, Anne (Methods Lab, 2016)
Over the last half century, repeated calls for adaptive learning in development suggests two things: many practitioners are working in complex situations that may benefit from flexible approaches, and such approaches can be difficult to apply in practice. • Complexity thinking can offer useful recommendations on how to take advantage of distributed capacities, joint interpretation of problems and learning through experimentation in complex development programmes. • However, these recommendations rely on underlying assumptions about relationships, power and flexibility that may not hold true in practice, particularly for programmes operating in a risk averse, results-driven environment. • This paper poses guiding questions to assess the fit and feasibility of integrating complexity informed practices into development programmes.

Monitoring and learning for country-level portfolio decision-making and adaptation - Buffardi, Anne L; Mason, Paige; Hutchings, Claire; Sharp, Samuel (Briefing Note, 2019)
Most measurement and adaptive management approaches were developed for and from individual projects. This briefing aims to guide measurement and management of country-level portfolios of work. It identifies potential purposes portfolio-level analyses can fulfil, types of adaptation, and the relative role of monitoring, learning and evaluation (MEL). Drawing on reviews of practice from the United States Agency for International Development (USAID) and the United Kingdom Department for International Development (DFID), guidance notes, and experiences of members of the Global Learning for Adaptive Management (GLAM) initiative, it offers recommendations and considerations that are particularly relevant for this level of analysis and management. Key messages - Portfolio-level analyses can serve eight potential purposes, each of which answers different questions, involves adaptation at different times and levels, and requires different types of evidence. Identifying the purpose(s) and how the component parts relate to each other should guide the development of monitoring and learning systems. - Portfolios are oriented more towards breadth than depth, involve more people with different perspectives, and draw on multiple sources of evidence with potentially greater variation in quality. - In practice, four activities appear to be applied most frequently at a portfolio level: alignment of indicators and aggregation of monitoring data; synthesis of multiple sources and types of information to provide a summary of outputs, outcomes, common observations and trends; periodic review and reflection sessions; and strategic planning, design or refresh of the portfolio strategy. - The extent to which evidence-informed portfolio management is facilitating learning and adaptation has not been well documented to date, and we suggest potential indicators to do so.

Multi-project programmes functions, forms and implications for evaluation and learning - Buffardi, Anne; Hearn, Simon (Methods Lab, 2015)
Multi-project programmes can serve different purposes. For instance, they may coordinate multiple implementing entities; standardise management and technical support; compare intervention approaches across different contexts; enhance leverage through joint action; or foster sustainability by building relationships among organisations. • At the same time, multi-project programmes are costly, potentially duplicate other mechanisms that fulfil similar functions, and can dilute focus and create confusion. • To guide decisions on what coordination, evaluation and learning mechanisms are needed, it is helpful to articulate the intended purpose of using a programme model. Identifying the purpose(s) can help staff determine what types of knowledge sharing strategies may be most useful to the programme, and how project and programme theories of change can be sequenced

10 Things to Know About Evaluation - Buffardi, Anne; Hearn, Simon; Pasanen, Tiina; Price, clare; Ball, Louise (RAPID, 2015)
Evaluation is essential to good development. But there are still many myths and misconceptions about what it is - and how it should be used. ODI's Research and Policy in Development Programme (RAPID) has many years' experience supporting evaluation in complex development contexts. In support of the International Year of Evaluation 2015, we've put together our essential 'things to know' about evaluation in 10 infographics. Available in English and French.

Refining advocacy assessment: reflections from practice - Buffardi, Anne; Hearn, Simon; Tilley, Helen (Working Paper, 2017)
• This paper revisits how existing advocacy evaluation frameworks classify people and activities, and define and assess outcomes. We discuss how assessments could be more specific and propose bounding the scope of inquiry in one of four ways: strategy specific, outcome oriented, actor-centric or system-wide. • In classifying activities, the same action or event may be situated at different phases of the change pathway – in some cases used as a tactic to influence a policy outcome, and in others an intended outcome itself. • Because advocacy is more relational than other types of more technical development interventions, there will be fewer sources of directly observable data, and the direction of potential bias may be unknown. • In terms of learning, advocacy initiatives are contextually dependent, therefore lessons may be less directly transferable to subsequent phases of an initiative or to other settings. Organisations have bounded repertoires and the transferability of skill sets is limited, so advocates adapt how and with whom they engage more than what they do

Beyond 'Technology for Development' and 'Sustainability' towards Systemic and Holistic Rural Innovation: Success Factors from the Southern African Experience over 20 years - Buisson, Uys Du; Cronje, Braam; Marais, Mario; Haruperi, Emmanuel; Rensburg, Johann (2014 International Conference of the UNESCO Chair in Technologies for Development, 2014)
Abstract: This paper describes essential, real-world activities and processes needed to develop and deploy people-centred networks enabled with innovative technologies that in turn produce "...

Aiming at the Wrong Targets: The Domestic Consequences of International Efforts to Build Institutions - Buntaine, Mark T.; Parks, Bradley C.; Buch, Benjamin P. (International Studies Quarterly, 2017)
We explain why international development organizations have had so little success building and reforming public sector institutions in developing countries. They often fail despite their apparently strong commitment to achieving measurable results and extraordinary amounts of time, money, and effort. We demonstrate that, when donors and lenders make access to financing contingent upon achievement of performance targets, recipient countries tend to choose easy and shallow institutional targets. These targets measure the organization of public sector institutions, rather than their effectiveness at addressing public problems. Such targets provide countries with low-cost opportunities to signal commitment to institution-building to international development organizations. We demonstrate the explanatory and predictive power of our argument in the context of a sector of World Bank lending—environment and natural resource management—that focuses heavily on improving public sector institutions.

Seeing the Combined Effects of Aid Programmes - Burge, Richard; Nadelman, Rachel; McGee, Rosie; Fox, Jonathan; Anderson, Colin (IDS Policy Briefing, 2022)
Multiple aid agencies often try to support change in the same places, at the same time, and with similar actors. Surprisingly, their interactions and combined effects are rarely explored. This Policy Briefing describes findings from research conducted on recent aid programmes that overlapped in Mozambique, Nigeria, and Pakistan, and from a webinar with UK Foreign, Commonwealth & Development Office (FCDO) advisors and practitioners. The research found three distinct categories of ‘interaction effects’: synergy, parallel play, and disconnect. We explore how using an ‘interaction effects’ lens in practice could inform aid agency strategies and programming.

Tale of the converted: how complex social problems have made me question the use of data in driving impact - Burgoyne, John (Impact of Social Sciences, 2019)
15 Shares In practice the way in which research impacts and influences policy and society is often thought to be a rational, ordered and linear process. Whilst this might represent a ‘common sense’ understanding of research impact, in this cross-post John Burgoyne reflects on how upending the primacy of data and embracing complexity can lead to a more nuanced and effective understanding of research impact.

Challenge-led Innovation Workbook. Organising for Systems Innovation at Scale - Burkett, Ingrid (Griffith Centre for Systems Innovation, 2023)
Organising for Systems Innovation at Scale Our team at Griffith Centre for Systems Innovation have been experimenting with and evolving a Challenge-led Innovation Approach (based on Mission-oriented approaches developed by Mariana Mazzucato at UCL IIPP and others internationally). We are using this approach to guide the way we work internally and engage with our systems innovation partners. We’ve facilitated intensive Re:Treats, worked with government bodies, businesses and civic organisations, and engaged deeply with others exploring this work. We have a bias for developing and testing HOW such approaches could be applied to respond to both local and global challenges rather than getting too caught up in the what and why of such approaches. We decided to openly share our learnings and thinking to date in this workbook, to spark conversations and innovation in both practice and thinking amongst those exploring how we work, and to learn together to address complex systems and challenges. We see this booklet as a first step in a longer learning journey. In it we share an overview of: the principles and processes that sparked our evolution to a Challenge-led Innovation framework (from Mission-oriented). examples of our learnings from other system innovators who are experimenting. an adaptable process to help guide the learning journey. learning tools and canvases to catalyse thinking, practice, and further adaptations. Part One sets out some foundations we’ve identified as important to Challenge-led Innovation. If you want to jump straight into the mapping process, we suggest you skip to Part Two. The final section, Part Three, focuses on what we have learnt about the conditions needed and how to get started on a Challenge-led initiative.

Assessing Impact in Dynamic and Complex Environments: Systemic Action Research and Participatory Systemic Inquiry - Burns, Danny (CDI Practice Paper, 2014)
This CDI Practice Paper is about the uses of Systemic Action Research (SAR) and Participatory Systemic Inquiry (PSI) for impact assessment (Burns 2006, 2007, 2011, 2012, 2013; Wadsworth 2001, 2010).

Participatory Systemic Inquiry - Burns, Danny (2012)
This article explores Participatory Systemic Inquiry processes through two examples of practise. The first is about embedding public engagement in UK higher education, the second is about water infrastructure development and local capacity development in small towns situated around Lake Victoria. These examples illustrate why it is necessary to understand the wider systemic dynamics within which issues are situated, and how this helps to identify workable and sustainable solutions to problems. It describes the learning architectures which were constructed to hold the local and thematic inquiries and then to extend them. It also demonstrates the methods which operationalised these processes and explores some of the methodological differences between this approach and other approaches to qualitative and participatory research.

Systemic action research: Changing system dynamics to support sustainable change - Burns, Danny (Action Research, 2014)
This article explores the characteristics of systemic action research. It looks at the conceptual underpinnings of systemic action research and explores some of the ways in which it differs from (builds on) other forms of action research. It then explores some of the issues and dilemmas faced by systemic action researchers.

Designing a Participatory Programme at Scale: Phases 1 and 2 of the CLARISSA Programme on Worst Forms of Child Labour - Burns, Danny; Apgar, Marina; Raw, Anna (CLARISSA Working Paper, 2021)
CLARISSA (Child Labour: Action-Research-Innovation in South and South-Eastern Asia) is a large-scale Participatory Action Research programme which aims to identify, evidence, and promote effective multi-stakeholder action to tackle the drivers of the worst forms of child labour in selected supply chains in Bangladesh, Nepal, and Myanmar. CLARISSA places a particular focus on participants’ own ‘agency’. In other words, participants’ ability to understand the situation they face, and to develop and take actions in response to them. Most of CLARISSA’s participants are children. This document shares the design and overarching methodology of the CLARISSA programme, which was co-developed with all consortium partners during and since the co-generation phase of the programme (September 2018–June 2020). The immediate audience is the CLARISSA programme implementation teams, plus the Foreign, Commonwealth & Development Office (FCDO). This design document is also a useful reference point for other programmes trying to build large-scale participatory processes. It provides a clear overview of the CLARISSA programmatic approach, the design, and how it is being operationalised in context.

Navigating Complexity in International Development: Facilitating Sustainable Change at Scale - Burns, Danny; Worsley, Stuart (Practical Action Publishing, 2015)
Governments and organizations invest huge sums of money in development interventions to explicitly address poverty and its root causes. However, a high proportion of these do not work. This is because interventions are grounded in flawed assumptions about how change happens -- change is rarely linear, yet development interventions are almost entirely based on linear planning models. Change is also characterized by unintended consequences, which are not predictable by planners and by power dynamics, which drive outcomes towards vested interests rather than real need. Development processes need to engage effectively with these sorts of complex system dynamics. This book provides a conceptual framework for this thinking, offers detail case studies of interventions which have been built on this philosophy and which demonstrate key facets of it. It articulates some clear methodological underpinnings for this work, and draws out the implications both for development, practice and practitioners.
Keywords: IMPORTANT

Thinking and Working Politically in the Land Sector in Mekong Region - Burns, Tony; Ingalls, Micah; Rickersey, Kate (FIG Congress 2022, 2022)
In recent decades, the World Bank and many bilateral development partners have provided funding to support land administration reform. Traditional land administration reform projects focus on the economic and technical design of interventions based on a library of best practice, commonly avoiding the “messy politics” typically involved in land governance. Experience and lessons from land administration reform initiatives have been documented and a recurrent theme is that many projects fail to create effective, transformative change and gain the critical mass, and the community participation, necessary to ensure the sustainability of land administration reform. Over the last decade there have been concerted efforts to develop more politically informed ways of thinking and working using a range of methodologies referred to, variously, as Thinking and Working Politicallyi (TWP), Problem Driven Iterative Adaptation (PDIA) and Doing Development Differently (DDD). There is little evidence that these different approaches have been applied in the land sector.

Who Owns Poverty? - Burt, Martin (Red Press Ltd, 2019)
This is the story of the one question about global poverty we never thought to ask: who owns it? It's a question with an unexpected answer, one that challenges everything that we thought we knew about what poverty is, and what we can do about it. This is a story of a powerful data-driven methodology being used in a dozen countries across 5 continents. It's a new approach that puts poor families in charge of defining and diagnosing their own unique, multidimensional povertywho by owning the problem, own the solution. This book is for all the governments, development NGOs, charities, dreamers, thinkers, doers and leaders who are frustrated with limiting their aspirations to reducing poverty, or alleviating its effectsand the lack of progress we face in doing either. This is a book about unleashing trapped energy within poor families to do the unthinkable: eliminate global poverty once and for all.

Dialogic Organization Development: The Theory and Practice of Transformational Change - Bushe, Gervase R. (EDS Publications Ltd., 2015)
Dialogic Organization Development is a compelling alternative to the classical action research approach to planned change. Organizations are seen as fluid,socially constructed realities that are continuously created through conversations and images change happens when those conversations and images change. Leaders and consultants can help foster, support, or accelerate the emergence of transformational possibilities by encouraging disruptions to taken-for-granted ways of thinking and acting and the use of generative images to stimulate new organizational conversations and narratives. Dialogic OD is a different mindset, but it s also the previously unrecognized underpinning of such diverse change methods as Appreciative Inquiry, the Art of Convening, Future Search, and many more.

Integrating Top-Down and Bottom-Up Adaptation Planning to Build Adaptive Capacity: A Structured Learning Approach - Butler, J. R. A.; Wise, R. M.; Skewes, T. D.; Bohensky, E. L.; Peterson, N.; Suadnya, W.; Yanuartati, Y.; Handayani, T.; Habibi, P.; Puspadi, K.; Bou, N.; Vaghelo, D.; et al. (Coastal Management, 2015)
Climate adaptation planning provides an opportunity to enhance the adaptive capacity of stakeholders across multiple levels. However, reviews of standard top-down and bottom-up approaches indicate that the value of multistakeholder involvement is not fully recognized or incorporated into guidelines. Focusing on provinces in Indonesia and Papua New Guinea within the Coral Triangle region, we present a novel integrated top-down and bottom-up planning approach. Based on Participatory Systemic Inquiry the process involves three stages of workshops intentionally designed to promote social learning, knowledge exchange, empowerment and social networks among multilevel stakeholders. Stage 1 workshops engage government, nongovernment and science stakeholders at the provincial level to analyze sub-districts' vulnerability and design appropriate adaptation strategies. Stage 2 engages local government, non-government and community stakeholders within vulnerable sub-districts identified in Stage 1. Stage 3 combines Stage 1 and 2 stakeholders to refine adaptation strategies and design action plans for sub-districts. Evaluation demonstrated that different stakeholder groups' perceptions of community adaptation needs varied significantly, justifying the approach. In terms of adaptive capacity, the primary outcome for all stakeholder groups was innovative ideas, suggesting that social learning and knowledge exchange had occurred. Empowerment was a secondary outcome. We discuss how the approach could be further refined.
Keywords: Climate change; Coral Triangle; Evaluation; Social learning; knowledge cultures

Citizen science in hydrology and water resources: opportunities for knowledge generation, ecosystem service management, and sustainable development - Buytaert, Wouter; Zulkafli, Zed; Grainger, Sam; Acosta, Luis; Alemie, Tilashwork C.; Bastiaensen, Johan; De Bièvre, Bert; Bhusal, Jagat; Clark, Julian; Dewulf, Art; Foggin, Marc; Hannah, David M.; et al. (Frontiers in Earth Science, 2014)
The participation of the general public in the research design, data collection and interpretation process together with scientists is often referred to as citizen science. While citizen science itself has existed since the start of scientific practice, developments in sensing technology, data processing and visualisation, and communication of ideas and results, are creating a wide range of new opportunities for public participation in scientific research. This paper reviews the state of citizen science in a hydrological context and explores the potential of citizen science to complement more traditional ways of scientific data collection and knowledge generation for hydrological sciences and water resources management. Although hydrological data collection often involves advanced technology, the advent of robust, cheap and low-maintenance sensing equipment provides unprecedented opportunities for data collection in a citizen science context. These data have a significant potential to create new hydrological knowledge, especially in relation to the characterisation of process heterogeneity, remote regions, and human impacts on the water cycle. However, the nature and quality of data collected in citizen science experiments is potentially very different from those of traditional monitoring networks. This poses challenges in terms of their processing, interpretation, and use, especially with regard to assimilation of traditional knowledge, the quantification of uncertainties, and their role in decision support. It also requires care in designing citizen science projects such that the generated data complement optimally other available knowledge. Lastly, we reflect on the challenges and opportunities in the integration of hydrologically-oriented citizen science in water resources management, the role of scientific knowledge in the decision-making process, and the potential contestation to established community institutions posed by co-generation of new knowledge.
Keywords: Citizen science; Co-generation of knowledge; Water Resources Management; hydrological sensing; poly-centric governance

Impact assessment and the quest for the Holy Grail - Bymolt, Roger (KIT Working papers, 2015)

Adaptive management: A practical guide to mitigating uncertainty and advancing evidence-based programming - Byom, K.; Ingram, M.; Oakley, A.; Serpe, L. (PACT, 2020)
Pact’s Adaptive Management Guide provides practical guidance to development practitioners globally on the mindsets, behaviors, resources, and processes that underpin an effective adaptive management system. It presents an approach to managing adaptively that is rooted in complexity analysis and program theory. It draws on Pact’s global experiences and work on topics as diverse as health, livelihoods, markets, governance, capacity development, women and youth, and more. This document begins with an introduction to adaptive management, then walks through successive steps to determine how much adaptation a project requires and how to design an appropriate system. The second half of this guidebook contains a toolkit of examples and templates that projects can tailor to their needs.

The road to adaptive management: knowledge, leadership, culture and rules - Byrne, Karri Goeldner; Sparkman, Timothy; Fowler, Ben (The BEAM Exchange, 2016)
Keywords: IMPORTANT; Practice

Evaluating Systems Change Results: an inquiry framework - Cabaj, Mark (Tamarack Institute, 2018)

Learning, monitoring and evaluating: achieving and measuring change in adaptive programmes - Callaghan, Sarah; Plank, Georgia (Synthesis Paper, 5, 2017)

USAID Applied Political Economy Analysis - Field Guide - Cammack, Diana (USAID, 2016)
Political Economy Analysis (PEA) is a field-research methodology used to explore not simply how things happen in an aid-recipient country, but why things happen. It results in a written assessment with recommendations for a mission's County Development Cooperation Strategy (CDCS), project or activity design, or course correction during implementation.USAID's Applied PEA is a problem-focused method specially intended to be used by Mission staff to inform the design of aid interventions at any phase of the USAID program cycle and at any level of effort.

Barrio Mio and Katye: PCI’s neighbourhood approach in cities - Campbell, Leah (AKNAP case study, 2019)

What's missing? Adding context to the urban response toolbox - Campbell, Leah (ALNAP Study, 2018)

Global governance and local peace: accountability and performance in international peacebuilding - Campbell, Susanna (Cambridge University Press, 2018)
Local peacebuilding and global accountability -- The country context--Burundi from 1999 to 2014 -- Ingos in peacebuilding--globally unaccountable, locally adaptive -- International organizations in peacebuilding--globally accountable, locally constrained -- Bilateral development donors--accountable for global targets, not local change

Doing Development Differently in the Global South - Workshop Report - CARE (CARE and British Council, 2018)

Learning From Failure 2020 - What CARE’s evaluations tell us about how to improve our work - CARE (CARE, 2020)
“Ever failed. No matter. Try again. Fail again. Fail better.” --Samuel Beckett Here’s my favorite part of that quote: the ultimate goal is not a lack of failure; it’s better failures. That’s good news for CARE, because we just published round two of our Learning From Failure initiative, and…I know this will surprise everyone…we haven’t stopped failures yet. We do have some hopeful signs that we’re failing better; or at least, that we’re improving on some concrete weaknesses we identified in the first round. It’s an interesting process to launch the second phase of learning from failure. The first round, we didn’t know what we were going to find. We spent as much time talking about how it was the first-ever report of its kind as we did about the actual failures. Our case study admitted, “It's still very early to see specific development impacts.” Round two isn’t quite the same. It’s not new anymore, so there’s less excitement at having invented something. We’re not discovering data and themes for the first time. In a lot of ways, the stakes are higher. Round two of learning from failure becomes an exercise in continuous performance improvement, rather than a journey of discovery. If we don’t see improvements, we don’t have the excuse that it’s too early to tell. It also takes a sustained commitment. Launching an exploratory exercise at a small scale is easy, especially when no one quite knows what the answers will be. Pulling together a few pieces of content over a few months is pretty straightforward. It takes some staying power—and real support from leadership—to keep up the work over time, especially in the middle of a pandemic. That’s even more true once we’ve seen one round of results and had a chance to understand the work that it takes to improve.

Listen carefully. Tread lightly. Adapt quickly. Approaching Adaptive Management: Examples from our Somalia Education Programming - CARE (CARE Learning, 2020)
Adaptive management approaches potentially offer us opportunities to deliver high quality results in circumstances where change is complex, including in fragile, unstable or conflict affected places. However, building adaptive programming continues to be a challenge for the sector. For CARE, our Department for International Development -UK Aid funded Girls’ Education Challenge (GEC) programming has provided useful learning on how to operationalise adaptive approaches. In this paper we expand on our learning from this project and offer some recommendations for how to create more opportunities for truly adaptive programming in the future. In particular: • Projects that are designed to adapt need budget structures, results frameworks and governance that enable the process of adaptation. In our GEC projects the approaches employed by DFID, including the introduction of Review and Adaptation meetings have served to support meaningful adaptation. • Adaptive projects require both strong participatory elements and flexible governance and accountability structures. Whilst rigorous and comprehensive Monitoring, Evaluation and Learning (MEL) systems are important without these other elements appropriate adaptation can be hindered. • Adaptive Management requires resources. Where the expected change is complex, adaptation is frequently necessary to ensure we are responding to context and evidence. This should be adequately resourced if we are to expect results. In an environment where many INGOs work consistently within complex environments, the sector also needs more opportunities to trial these approaches and could benefit from more funding streams available which include the kinds of approaches used by DFID in current GEC programming

Agile, is it just a delivery mechanism? - Carignan, Louis-Philippe (Scrum.org Community Blog, 2014)
As a Agile coach, I refer to a few tools to help me think about where my Scrum teams should go next on their path to Agility. One of these tools is the Agile subway map, a list of Agile practices grouped in different categories. It helps me think how a specific practice could help …

Polycentric Systems of Governance: A Theoretical Model for the Commons - Carlisle, Keith; Gruby, Rebecca L. (Policy Studies Journal, 2019)
Polycentricity is a fundamental concept in commons scholarship that connotes a complex form of governance with multiple centers of semiautonomous decision making. If the decision-making centers take each other into account in competitive and cooperative relationships and have recourse to conflict resolution mechanisms, they may be regarded as a polycentric governance system. In the context of natural resource governance, commons scholars have ascribed a number of advantages to polycentric governance systems, most notably enhanced adaptive capacity, provision of good institutional fit for natural resource systems, and mitigation of risk on account of redundant governance actors and institutions. Despite the popularity of the concept, systematic development of polycentricity, including its posited advantages, is lacking in the commons literature. To build greater clarity and specificity around the concept, we develop a theoretical model of a polycentric governance system with a focus on the features necessary or conducive for achieving the functioning predicted by commons scholars. The model is comprised of attributes, which constitute the definitional elements, and enabling conditions, which specify additional institutional features for achieving functionality in the commons. The model we propose takes the concept a step further toward specificity without sacrificing the generality necessary for contextual application and further development.

Learning in Development Co-operation - Carlsson, Jerker; Wohlgemuth, Lennart (Almqvist & Wiksell International, 2000)

Accountability, transparency, Participation, and Inclusion. A New Development Consensus? - Carothers, Thomas; Brechenmacher, Saskia (Carnegie Endowment for International Peace, 2014)
The wide-reaching consensus around the normative and instrumental value of accountability, transparency, participation, and inclusion remains less solid than enthusiasts of these concepts might wish.

Revisiting the Foundational Assumptions of Fiscal Transparency and Accountability Work - Carothers, Thomas; Brechenmacher, Saskia (International Budget Partnership, 2018)
The Fiscal Futures team recently updated the foundational assumptions of fiscal transparency and accountability work to fit today’s world. Learn more.

Development Aid Confronts Politics: The Almost Revolution - Carothers, Thomas; de Gramont, Diane (EDS Publications Ltd., 2013)
A new lens on development is changing the world of international aid. The overdue recognition that development in all sectors is an inherently political process is driving aid providers to try to learn how to think and act politically. Major donors are pursuing explicitly political goals alongside their traditional socioeconomic aims and introducing more politically informed methods throughout their work. Yet these changes face an array of external and internal obstacles, from heightened sensitivity on the part of many aid-receiving governments about foreign political interventionism to inflexible aid delivery mechanisms and entrenched technocratic preferences within many aid organizations. This pathbreaking book assesses the progress and pitfalls of the attempted politics revolution in development aid and charts a constructive way forward.

Scaling Up Inclusive Approaches for Marginalised and Vulnerable People - Carter, Becky; Joshi, Anu; Remme, Michelle (2018)
This rapid review summarises the evidence on how to scale up inclusive approaches to complex social change. It looks at how to design scalable inclusive change interventions, as well as how to plan and manage the scale-up process. Focusing on interventions with the aim of reaching the most marginalised and transform social norms, it covers programmes aiming to deliver inclusive outcomes for women and girls (with a particular focus on preventing violence against women and girls) and persons with disabilities. To date, many interventions seeking to change harmful gender and disability norms have been implemented as small-scale projects. There are limited experiences of scale-up and fewer evaluations of these experiences. However, there are some documented case studies as well as emerging analysis that draw out lessons learned. From this evidence base, this rapid desk review identifies eight critical issues commonly highlighted as important considerations when scaling up inclusive change interventions: 1. Opportunities for systemic approach, including integrating political and community-level scale-up, and coordinating across multiple sectors and stakeholders 2. Political support for scale-up 3. Strategic choices: balancing reach, speed, cost, quality, equity, and sustainability 4. Catalysing change: tipping points, diffusion effects, and local champions 5. Locally grounded, participatory, and adaptive approaches 6. Long-term approaches with funding models to match 7. Cost-effective and financially feasible scale-up strategies 8. Measuring impact and sustainability.

An inventory and review of countering violent extremism and insurgency monitoring systems - Carter, Lynn; Phyllis, Dinino (USAID, 2012)

Where next for development effectiveness? Implementing development effectiveness: a reality check - Carter, Paddy (2016 CAPE Conference, 2016)

Using middle-level theory to improve programme and evaluation design - Cartwright, N (CEDIL, 2020)
What can middle-level theory do? Middle-level theory (MLT) has several uses in development planning and evaluation. It helps predict whether a programme can be expected to work in a new setting. It offers insights into what design features are needed for success. It provides invaluable information for monitoring to see if the programme is on track and to fix problems that arise. It reveals the causal processes and related assumptions to be tested in an evaluation and helps identify evaluation questions. It helps in interpreting evaluation findings, assessing their relevance and locating a description of them that is useful for programme design and evaluation in other settings

2018 Map of the Complexity Sciences - Castellani, Brian (Durham University, 2018)
A map that provides a macroscopic, trans-disciplinary introductions to the complexity sciences.

Adaptation in practice: lessons from teenage pregnancy programmes in Sierra Leone - Castillejo, Clare; Buell, Stephanie (ODI, 2020)
A discussion of initial learning emerging from the SLRC ’Adaptive approaches to reducing teenage pregnancy in Sierra Leone’ action research project.

Politically informed approaches to gender in fragile and conflict-affected settings - Castillejo, Clare; Domingo, Pilar; George, Rachel; O’Connell, Shannon (ODI, 2020)
This report summarises the discussions at a meeting held in September 2019 of a group of global development research and policy experts and practitioners, convened by ODI and the Westminster Foundation for Democracy, to share experiences and knowledge, reflect on what we already know about working politically on gender in fragile and conflict-affected settings (FCAS), and identify what further evidence would be useful. Key messages: - It is important to identify, document and learn from politically informed and adaptive ways of working in practice on gender in FCAS. - Different analytical and monitoring, evaluation and learning tools are required for politically informed programming on gender. These should be embedded within programme teams and processes, and be both gender-responsive and responsive to the political economy context. - There is a need for more politically smart use of quantitative and qualitative data in order to identify plausible entry points and ways of working on gender in FCAS. This should include increasing the capacity of programme staff to use data to inform, adapt and correct programmes. - Staff promoting politically informed work on gender equality are often isolated, with little opportunity to share experiences or learn from others. Platforms should therefore be created to share experience and knowledge, and to bring together donors and implementers involved in this work.

Tiny Tools - Measuring Change in Communities and Groups - Causemann, Bernward; Gohl, Eberhard; Brenner, Verena (Impact+, 2012)
Introduction to the Overview: Tiny Tools Why “Tiny Tools” for assessing change? Currently, change is mostly assessed by NGO staff or external experts. The vision of this paper is that communities assess and reflect change themselves and make use of that reflection with appropriate tools. All the tools presented here are relatively quick and easy to learn (therefore “tiny”). With Tiny Tools we can assess change in one session. They can therefore be used where there are not baselines. They are structured and systematic, and they are all widely tested: Experience shows that these tools lead to new insights, mobilise enthusiasm and increase the capacity of communities to bring about further change. The Tiny Tools are in line with what Participatory Rural Appraisal (PRA) wanted to achieve. Many are slight variations of PRA tools. For a detailed description of concepts, see the NGO-IDEAs Impact Toolbox (www.ngo-ideas.net/impact_toolbox) and the NGO-IDEAs Manual Self-Effectiveness (www.ngo-ideas.net/monitoring_self_effectiveness). The tools are designed to visualise change, but also enable communities to reflect on the reasons of change or verify assessments. They may be implemented once or continuously over time. We know that the time of community members is precious, and limited. Therefore all Tiny Tools can be performed in a relatively short session, provided facilitators (it could be field staff or project officers) are experienced – and the community knows and trusts them. The amount of time spent on the application of the tools may however be prolonged according to the needs of a community or NGO. All of these tools are easy to learn for a facilitator experienced in participatory processes. Which tool should be introduced to which community? It is typically the decision of a development organisation (or external experts) which tools they want to introduce into a community. The staff need to assess which tool will lead to learning and action. It could also be that the staff realise aspects of change that they do not understand well enough. These tools are good for exploring change that we have not planned for and not anticipated. They are also good for exploring change in a context where we have no prior information. Communities are the best experts for their situation, but we emphasise that the tools should be used in ways that benefit and empower the communities or individuals participating. The tool implementations should lead to consequences on the grassroots as well as the NGO level. All Tiny Tools can be integrated into PIAR, the Analysis tool in the NGO-IDEAs Impact Toolbox. Also, the Tiny Tools can help to prepare for the application of the Toolbox tools. They help to make people aware of changes that can be observed. The following box gives some hints how Tiny Tools relate to the Impact Toolbox tools, and to what extent they help to attribute change to development interventions.

The collaborative exploration of alternative futures: A different approach to Theories of Change - CEDIL programme (2022)
ParEvo is a web application that enables the collaborative construction and exploration of a range of alternative futures: likely and unlikely, desirable and undesirable. These are described in the form of a branching narrative structure, developed over a series of iterations involving the interactions of a group of participants. These detailed storylines about the future contrast with optimistic, skeletal and largely singular views of the future found in diagrammatic ToCs often encountered by evaluators. This webinar will describe a recent ParEvo exercise implemented by the Centre for the Study of Existential Risk (CSER) in Cambridge. In this exercise 11 international experts explored ideas about how global risks associated with biotechnology research could be managed, and mismanaged, in the coming four years. Including how these alternative futures were evaluated by participants and the CSER facilitators. Issues to be discussed by the panel, and others, include comparisons with other representations of Theories of Change and other approaches to the exploration of alternative futures, described variously as scenario planning, futures or foresight work. Speakers: Rick Davies, Lara Mani Tom Hobson An overview of the app can be found here: https://mscinnovations.wordpress.com/ The app website is here: https://parevo.org/

Exit for Sustainability Checklists - Cekan, Jindra (Valuing Voices, 2020)
These Checklists for Exit along the Sustainability Project Cycle are based on lessons from ex-post evaluations that Valuing Voices has done or researched. Ex-post project completion evaluations are rare and even more so those that consulted partners and participants in the field about sustained impacts. Over $3.5 trillion has been spent on public foreign aid projects in the past 70 years (OECD 2019) yet we have evaluated less than 1% of these projects for sustainability. Our Valuing Voices ex-post research of 39 organizations’ evaluations of sustainability shows that most project results decrease (20-90%) as early as two years ex-post in addition to An Asian Development Bank study of post-completion sustainability found that “some early evidence suggests that as many as 40% of all new activities are not sustained beyond the first few years after disbursement of external funding,” Most project exits are in the last quarter and sustainability handover assumptions are not validated expost. Learning from what was sustained helps us know how to exit for sustainability from the very onset of the project (green slices) as compared to the typical project cycle (orange), above. We encourage those tasked with funding, designing, implementing, monitoring & evaluating projects to use these longer checklists and view the full recording shared with participants. A partial PowerPoint can also be found on „Sustaining All of our Hard Work“ presentation for the Vienna Evaluation Network (10/20). These checklists are aimed at donors/designers and implementers of foreign aid projects outcomes and impacts and can be adapted by local NGOs, national governments, private sector, academics, to create exit plans. Local participation in creating these and feedback on how well exit is going will help them sustain results.

Webinar - Sustainability Ready: what it takes to support & measure lasting change - Cekan, Jindra (Valuing Voices, 2020)
On June 24th under GLocal’s UNConference, “Co-creating our future stories of hope and action”, Jindra Cekan, Holta Trandafili, and Isabella Jean presented their work on sustainability evaluations and exit strategies via local voices. We chaired a 2-hour discussion session on the following topics: Sustainability of global development projects and exit from them, The importance of valuing local partners’ and participants’ voices, How to embed ex-post evaluation of sustainability into the project cycle, How expectations, benchmarking, and early joint planning in exit strategies, as well as considering long-term ownership & relevance will support projects to be sustained locally, including questioning who will maintain results, Considering power dynamics between donors and ultimate ‘beneficiaries’ and the value of the impact of the project from a variety of perspectives, and more Here is the recording of our presentation or see just the PowerPoint presentation. We harvested lessons from our three presentations: Jindra Cekan: · Fear of learning about failure in our global development industry – INGOs are “waiting for a successful enough project” to commission ex-post project sustainability evaluation · It needs to be a culture of learning, not a culture of success. · Lack of transparency in sharing program evaluation results with communities and local government is widespread, and even more rarely do we come back after many years and share learnings · Participatory approaches are vital, listening to participants about sustained impacts is key · It is never attribution, always contribution. To isolate impacts, we need to look for project sites that haven’t had multiple other organizations overlapping through all phases. · Building sustainability planning throughout the project cycle is key – but often doesn’t happen Holta Trandafili: · Sustainability needs to be planned to be researched, including evaluating why or why not were project elements sustained, and why? What has the project done to enable communities to sustain improvements? · Expectations of sustainability need to be more modest (as most results are mixed good/bad) · We need to ask: How are you defining and measuring sustainability – for how long should the results last? Among how many participants? Have you set benchmarks for success? · We should expand your toolbox on methodology to investigate sustainability. Stories of success are one of a myriad of methods used, including mixed-methods, cost-benefit, etc. · Start with the need for learning not [just] accountability Isabella Jean: · Sustainability investigation/evaluation/learning should be mindful that this is NOT about projects. It is about people. · We have a system that focuses on gaps and needs to be filled vs. existing capacities’ structures to be reinforced. How can our work on measuring sustainability bring this to light and call it out, so that we change the norm? · Planning for sustainability requires the insight to integrate resources and experiences of outsiders with the assets and capacities of insiders to develop context-appropriate strategies for change If you would like to discuss this with any of us, please send us comments and we’re happy to respond. Thanks again to the G-Local UnConference team! Below please find our bios: Jindra Cekan/ova has worked in global development for 33 years focused on participatory design and M&E for global non-profits. She founded Valuing Voices 7 years ago. For details, see: Valuing Voices Founder Holta Trandafili is the Research, Learning, and Analytics Manager with World Vision US and has been leading field research, monitoring, and evaluation since 2007. She has led sustainability measurement studies for World Vision programs in Uganda, Kenya, Sri Lanka, India, Burma, and Bolivia. Her areas of expertise and interest include program and community groups’ sustainability measurements; agency-level measurements; empowerment approaches to development; integrated programming; local capacities for peace; gender analysis; and outcome monitoring. Currently, Mrs. Trandafili serves as an Advisory Committee member for InterAction’s Effectiveness and Program Evaluation Working Group and chairs one of the sub-working groups under The Movement for Community-led Development. Isabella Jean supports international and local organizations and funders to document promising practices, facilitate learning and strengthen capacities for conflict sensitivity, peacebuilding and humanitarian effectiveness. She has facilitated action research, collaborative learning and advisory engagements in over 25 countries, and serves as an advisor to policymakers, senior leadership and program teams. Isabella co-authored the book, Time to Listen: Hearing People on the Receiving End of Aid and developed practical guidance to support accountability to communities, listening and feedback loops, and responsible INGO exits. She teaches graduate-level courses on aid effectiveness, program strategies and M&E of peacebuilding at Brandeis University’s Heller School for Social Policy and Management. Previously, Isabella directed training at a community organizing network and conducted policy research for the Institute for Responsive Education, UNDP, and Coexistence International.

Participation by All - The keys to sustainability of a CRS food security project in Niger - Cekan, Jindra; Kagendo, Rutere; Towns, Alexandra (Valuing Voices, 2016)
This project that ran from 2006-2012 in Niger and was implemented by three NGOs: CRS, Cooperative for Assistance and Relief Everywhere (CARE), and Helen Keller International (HKI) under the direction of United States Agency for International Development (USAID) Office of Food for Peace (FFP) as a multi-year assistance program (MYAP) to support food security activities in the Dosso, Tahoua, and Zinder regions. PROSAN focused on increasing agricultural production and agro-enterprise, improving household health and nutrition status, reinforcing the capacities of health agents, and enhancing community resiliency. Here are the highlights from the report which itself is an excerpt from a longer analysis we did. Also please note one Annex highlights the similarlties/ differences we found to USAID/ FFP’s 4 elements of sustainability: AIM, METHODS, AND RESEARCH QUESTIONS The aim of this sustainability evaluation was to explore perceptions of sustainability from Nigeriens involved in PROSAN, former CRS staff and donors. It focused on evaluating participants’ adherence to project outcomes and their creation of new innovations. It also evaluated partners’ involvement in sustaining project outcomes. This evaluation used qualitative and quantitative methods including community mapping, focus group discussions, beneficiary interviews, and key stakeholder interviews. The evaluation was carried out in six communities in the Dosso region, with more than 500 interviewees, focusing on the following research questions: Sustainability of activities and groups: Are the communities sustaining the activities three to five years after the end of the project? What can we learn from the communities and their post-project implementation partners? Spread and unexpected outcomes: If the project was considered a success in the eyes of the community, how well did it spread? Fostering Sustainability: What are the long-term prospects for continued sustainability? FINDINGS Three years after PROSAN’s conclusion, the project was considered a success by community members, national partners, the implementer (CRS), and donor (USAID) staff. The main findings include: 1. SUSTAINABILITY OF ACTIVITIES AND GROUPS Eighty percent (80%)[*] of all activities were reported to have become self-sustained and community innovations have emerged: On average, households reported moving from being food secure for 3-6 months per year during PROSAN to 8-12 months at the time of this evaluation, which is a remarkable impact [1]. CRS_Niger_PROSAN_Sustainability_Evaluation_pdf [1] Women reported greater income through the increase in sales of food that was produced and processed due to the grain mills [1]. Respondents also reported improved household health, hygiene, and nutrition, with 91% of survey respondents indicating that their health and sense of well being had improved, especially through the efforts of the health posts and clinics that CRS helped build and the government of Niger’s efforts in sustaining them with resources and staff [1]. Community groups/committees have continued and are well-supported by NGO partners: 81% of the committees set up by PROSAN were functioning at the time of this evaluation, with many participants discussing ways to sustain best practices within their communities, and members still receiving regular trainings or updates [1]. Several new and refresher trainings come through national partners, NGOs, and new channels such as radio programs [1]. Some new NGOs and international organizations have built upon PROSAN’s success, for instance, by using land previously managed by PROSAN for a new vegetable gardening training program, building hygiene programs on past health awareness efforts, or extending agricultural credit for further inputs [1]. Twenty percent (20%) of implemented activities were not sustained or have stagnated: While hygiene practices were sustained by households and there was widespread latrine construction, sanitation was poor in the villages, and most latrines had fallen into disrepair [1]. Fewer than 50% of women reported practicing exclusive breastfeeding for children less than six months of age [1]. While almost half of all health committees no longer exist, new health clinics staff have replaced some of the work of the committees with health and agricultural promotion messages now being sent via radio, television, and cell phones [1]. Literacy training and theater groups have completely ceased [1]. With the exception of the Système Communautaire d’Alerte Précoce-Réponses aux Urgences’ (SCAP-RU) SCAP-RU early warning system which has expanded, other resilience activities such as roadwork and caring for the environment are a lesser priority due in part to the lack of food and cash-incentives to continue doing them [1]. 2. SPREAD AND UNEXPECTED OUTCOMES New innovations and ceased activities reflected the project’s legacy: Community innovations have emerged such as collective funds paying for cleaners of the new health center, community-imposed sanctions for births occurring outside of the health centers, and the monitoring of savings from well water sales. National partners have praised the project, with many lamenting its withdrawal. One non-PROSAN village told an Agriculture Ministry staff and potential NGO partner that “No one should bring a program here unless it is like PROSAN.” PROSAN-trained masons, well repair technicians, and village youth have learned land recuperation techniques (zai holes, bunds and demi-lunes) that helped generate income beyond project communities. Project activities that received free inputs have largely stopped being implemented once the incentives were withdrawn such as Food for Training (FFT), Food for Work (FFW), or Cash for Work (CFW) (e.g. literacy, seedlings, latrines, theater etc.); nonetheless the inputs were highly valued and have continued to support agriculture and health (carts, bicycles). 3. FOSTERING SUSTAINABILITY The following areas were identified as potential barriers to sustainability that could be systematically explored in other projects: Although most committees are still functioning, there are no processes in place to engage and train youth and new inhabitants of the villages. While village communities have been maintained, there is an increasing lack of ministry resources (e.g., staff, transportation, and communications) to take the place of NGOs like CRS after a program ends. There is little management of knowledge around project data, which is further exacerbated by staff changes in NGOs, government ministries, and donors. Project data (proposal content, monitoring data, evaluation results, participant lists, partner names, and exit agreements) must be managed ethically, locally and be held online, accessible for future projects to use and for villages to conduct self-evaluations.

Change: How to Make Big Things Happen - Centola, Damon (Little, Brown Spark, 2021)
How to create the change you want to see in the world using the paradigm-busting ideas in this "utterly fascinating" (Adam Grant) big-idea book.​ Most of what we know about how ideas spread comes from bestselling authors who give us a compelling picture of a world, in which "influencers" are king, "sticky" ideas "go viral," and good behavior is "nudged" forward. The problem is that the world they describe is a world where information spreads, but beliefs and behaviors stay the same. When it comes to lasting change in what we think or the way we live, the dynamics are beliefs and behaviors are not transmitted from person to person in the simple way that a virus is. The real story of social change is more complex. When we are exposed to a new idea, our social networks guide our responses in striking and surprising ways. Drawing on deep-yet-accessible research and fascinating examples from the spread of coronavirus to the success of the Black Lives Matter movement, the failure of Google+, and the rise of political polarization, Change presents groundbreaking and paradigm-shifting new science for understanding what drives change, and how we can change the world around us.

Towards informed and multi-faceted wildlife trade interventions - Challender, Daniel W.S.; Harrop, Stuart R.; MacMillan, Douglas C. (Global Ecology and Conservation, 2015)
International trade in wildlife is a key threat to biodiversity conservation. CITES, the Convention on International Trade in Endangered Species of Wild Fauna and Flora, seeks to ensure international wildlife trade is sustainable, relying on trade bans and controls. However, there has been little comprehensive review of its effectiveness and here we review approaches taken to regulate wildlife trade in CITES. Although assessing its effectiveness is problematic, we assert that CITES boasts few measurable conservation successes. We attribute this to: non-compliance, an over reliance on regulation, lack of knowledge and monitoring of listed species, ignorance of market forces, and influence among CITES actors. To more effectively manage trade we argue that interventions should go beyond regulation and should be multi-faceted, reflecting the complexity of wildlife trade. To inform these interventions we assert an intensive research effort is needed around six key areas: (1) factors undermining wildlife trade governance at the national level, (2) determining sustainable harvest rates for, and adaptive management of CITES species, (3) gaining the buy-in of local communities in implementing CITES, (4) supply and demand based market interventions, (5) means of quantifying illicit trade, and (6) political processes and influence within CITES.
Keywords: CITES; Community conservation; Compliance; Economics; Regulation; Wildlife trade

3. Reflections and directions: a personal note - Chambers, Robert (Participatory Learning and Action 50: Critical reflections, future directions, 2004)

Can we know better? Reflections for Development - Chambers, Robert (Practical Action, 2017)
This book is intended for all who are committed to human wellbeing and who want to make our world fairer, safer and more fulfilling for everyone, especially those who are 'last'. It argues that to do better we need to know better. It provides evidence that what we believe we know in international development is often distorted or unbalanced by errors, myths, biases and blind spots. Undue weight has been attached to standardised methodologies such as randomized control trials, systematic reviews, and competitive bidding: these are shown to have huge transaction costs which are rarely if ever recognized in their enormity. Robert Chambers contrasts a Newtonian paradigm in which the world is seen and understood as controllable with a paradigm of complexity which recognizes that the real world of social processes and power relations is messy and unpredictable. To confront the challenges of complex and emergent realities requires a revolutionary new professionalism. This is underpinned by a new combination of canons of rigour expressed through eclectic methodological pluralism and participatory approaches which reverse and transform power relations. Promising developments include rapid innovations in participatory ICTs, participatory statistics, and the Reality Check Approach with its up-to-date and rigorously grounded insights. Fundamental to the new professionalism, in every country and context, are reflexivity, facilitation, groundtruthing, and personal mindsets, behaviour, attitudes, empathy and love. Robert Chambers surveys the past world of international development, and his own past views, with an honest and critical eye, and then launches into the world of complexity with a buoyant enthusiasm. He draws on almost six decades of experience in varied roles in Africa, South Asia and elsewhere as practitioner, trainer, manager, teacher, evaluator and field researcher, also working in UNHCR and the Ford Foundation. He is a Research Associate and Emeritus Professor at the Institute of Development Studies, University of Sussex, his base for many years. Can We Know Better? is essential reading for researchers and students of development, for policy makers and evaluators, and for all those working towards the better world of the Sustainable Development Goals.

Debiasing: a systematic discipline and delight for development professionals - Chambers, Robert (Institute of Development Studies, 2018)
Do we really need debiasing, yet another word?  Yes, unless anyone can improve on it, because we need a word to describe a rigorous discipline we development professionals need for grounded realism. This has been coming on me slowly. But now explorations and ‘aha!’ moments in India have accumulated and combined into an epiphany.  For […]

From PRA to PLA and pluralism: practice and theory - Chambers, Robert (2007)
PRA (participatory rural appraisal) and the more inclusive PLA (participatory learning and action) are families of participatory methodologies which have evolved as behaviours and attitudes, methods, and practices of sharing. During the 1990s and 2000s PRA/PLA has spread and been applied in most countries in the world. Among the multifarious domains of application, some of the more common have been natural resource management and agriculture, programmes for equity, empowerment, rights and security, and community-level planning and action. Related participatory methodologies which have co-evolved and spread widely as movements include farmer participatory research, Integrated Pest Management, Reflect, Stepping Stones and Participatory Geographic Information Systems. Ideologically and epistemologically PRA/PLA seeks and embodies participatory ways to empower local and subordinate people, enabling them to express and enhance their knowledge and take action. It can be understood as having three main components: facilitators’ behaviours, attitudes and mindsets linked with precepts for action; methods which combine visuals, tangibles and groups; and sharing without boundaries. The interplay of these resonates with theories of chaos, complexity, emergence and deep simplicity, especially self-organising systems on the edge of chaos. Good practice has moved towards an eclectic pluralism in which branding, labels, ownership and ego give way to sharing, borrowing, improvisation, creativity and diversity, all these complemented by mutual and critical reflective learning and personal responsibility. Keywords: participatory methodologies; networks; pluralism; practice; theory.

Ideas for Development - Chambers, Robert (Routledge, 2005)
Our world seems entangled in systems increasingly dominated by power, greed, ignorance, self-deception and denial, with spiralling inequity and injustice. Against a backdrop of climate change, failing ecosystems, poverty, crushing debt and corporate exploitation, the future of our world looks dire and the solutions almost too monumental to consider. Yet all is not lost. Robert Chambers, one of the ?glass is half full? optimists of international development, suggests that the problems can be solved and everyone has the power at a personal level to take action, develop solutions and remake our world as it can and should be. Chambers peels apart and analyses aspects of development that have been neglected or misunderstood. In each chapter, he presents an earlier writing which he then reviews and reflects upon in a contemporary light before harvesting a wealth of powerful conclusions and practical implications for the future. The book draws on experiences from Africa, Asia and elsewhere, covering topics and concepts as wide and varied as irreversibility, continuity and commitment; administrative capacity as a scarce resource; procedures and principles; participation in the past, present and future; scaling up; behaviour and attitudes; responsible wellbeing; and concepts for development in the 21st century.

Inclusive rigour for complexity - Chambers, Robert (Journal of Development Effectiveness, 2015)
Rigour can be reductionist or inclusive. To learn about and understand conditions of complexity, emergence, nonlinearity and unpredictability, the inclusive rigour of mixed methods has been a step in the right direction. From analysis of mixed methods and participatory approaches and methods, this article postulates canons for inclusive rigour for research and evaluation for complexity: eclectic methodological pluralism; improvisation and innovation; adaptive iteration; triangulation; plural perspectives; optimal ignorance and appropriate imprecision; and being open, alert and inquisitive. Inclusive rigour is inherent in participatory methods and approaches, visualisations, group-visual synergy, the democracy of the ground and participatory statistics. Transparent reflexivity, personal behaviour and attitudes, and good facilitation are fundamental. Fully inclusive rigour for complexity demands many personal, institutional and professional revolutions.
Keywords: Evaluation; Mixed methods; Participatory methodologies; Research; paradigm; rigour

Into the unknown: explorations in development practice - Chambers, Robert (Practical Action Publishing, 2014)
Into the Unknown reflects on the journey of learning, and encourages readers to learn from observation, curiosity, critical feedback, play and fun. This book will be of interest to development professionals, including academics, students, NGO workers and the staff of international agencies

Paradigms, Poverty and Adaptive Pluralism - Chambers, Robert (IDS, 2010)
This paper explores participatory methodologies (PMs) associated with a paradigm of people, contrasted with a dominant paradigm associated with things.

Perverse Payment by Results: frogs in a pot and straitjackets for obstacle courses - Chambers, Robert (IDS - Participation, Power and Social Change, 2014)
Posts about Robert Chambers written by idsppsc

Poverty Unperceived: Traps, Biases and Agenda - Chambers, Robert (IDS Working Paper 270, 2006)

Rapid Action Learning and COVID-19 - Chambers, Robert (Sanitation Learning Hub, 2020)
A-ha! A moment etched in my memory: 20 or so researchers were...

Rapid Action Learning for Sanitation and Hygiene Programming - Chambers, Robert; Myers, Jamie; Vernon, Naomi (Frontiers of Sanitation, 2020)
There is a glaring gap and compelling need for approaches and methods that realign to new rigour through timeliness, cost-effectiveness, relevance and being actionable. Over the past few years, the Sanitation Learning Hub, in collaboration with the Government of India, Praxis, WSSCC and WaterAid India, have been developing Rapid Action Learning approaches. Multiple approaches have been trialled, with flexible formats, but the essential criteria is that learning is timely, relevant and actionable. These learning approaches are the focus of the latest edition of the Frontiers of Sanitation series. This Frontiers explains the advantages and disadvantages of the approaches trialled and sets out a challenge to those working in the water, sanitation and hygiene sector to: Reflect on what, for you, constitutes rigour. Adopt and adapt approaches to fit your context and needs. Develop your own approaches. Record your experiences and lessons learnt. Take the time to share your experiences with us

Changeroo - Theory of Change platform - Changeroo (2020)
Changeroo assists organisations, programs and projects with a social mission to develop and manage high-quality Theories of Change. It allows you to - together with stakeholders co-create Theories of Change, and - present these in an interactive and engaging way. It helps keep a Theory of Change alive, enables reflective monitoring, and supports capacity building among social organisations. Changeroo helps you utilize your Theory of Change for strategic learning, communication, stakeholder engagement, impact measurement, scaling, planning, monitoring and evaluation. Thus you build a culture of critical thinking, constant analysis, co-creation and continuous learning. In sum, a truly strategic approach to societal value creation that helps you to assist your target groups to flourish!

Theory of Change: From novice to master changemaker - Changeroo (2020)
Theory of Change is more than just a tool or instrument. It is a mindset! A mindset to optimise impact management. As the cornerstone of impact management it is indispensable to any purpose-driven organisation targeting social or environmental value creation. It offers you the cornerstone of a learning approach toward change and impact. A way to build a mindset and organisational culture of critical reflection, co-creation with stakeholders and constant analysis of what works, why, for whom and under what circumstances. Are you ready to take impact management to the next level with the help of Theory of Change? We offer you the premier online course to learn everything about this approach.

Partnering with communities to co-design humanitarian health strategies: A SeeChange CommunityFirst Framework for implementation in MSF projects - Chapela Trillo, Violeta; Farber, Jessica (MSF, 2034)
The CommunityFirst Framework is intended to be implemented by field teams at MSF. The theoretical aspects and evidence presented on the importance of community engagement are intended for all MSF staff seeking to learn more about why and how to shift the way we work with communities as humanitarians. We believe this guideline, and other tools like it (including OCA’s Person-Centred Approach Guidance07, and MSF Vienna Evaluation Unit’s Guidance for Involving Communities08), to be an important contribution to the growing movement of communities and humanitarian actors who are pushing for changes in the humanitarian system that translate to dignity, health, justice, equity and self-determination for communities around the world. Specifically, the CommunityFirst Framework is intended to guide MSF teams to co-design health strategies with communities, throughout all stages of the project cycle, for exploratory missions, projects that are just opening, projects that have been running for some time, or those that are closing. At the time of publication, the CommunityFirst Framework has been tested in pilot projects in: (1) Madre de Dios, Peru (MSF OCP, August 2022), (2) Tonkolili, Sierra Leone (MSF OCA, November 2022) and (3) Anzoátegui, Venezuela (MSF OCB, February 2023) The experiences from these pilots (feedback from teams, implementation results, adaptations to each context, etc.) have informed the adaptation of the Framework. CommunityFirst builds on existing community engagement work inside MSF and contributes a practical framework for co-designing health initiatives with communities. To avoid duplicating efforts and resources around community engagement inside MSF, the appendices in this guideline largely refer to already existing MSF resources.09 This guideline is meant to be a living document that can evolve and be adapted given the experience of MSF staff and community members and diverse community contexts. This guide can be used by anyone in MSF who is interested in partnering with communities to improve the responsiveness and impact of their humanitarian programs. This is the first iteration of the document. Subsequent iterations will be published based on additional testing during future phases of the CommunityFirst TIC project.

System Failure: Why Governments Must Learn to Think Differently - Chapman, Jake (Demos, 2004)
The current model of public policy-making is no longer right for a government that has set itself the challenge of delivery. Improvements are driven by central policy initiatives which assume a direct relationship between action and outcome - but this is a false assumption. Public services are complex adaptive systems which are subject to the law of unintended consequences, so intervention can make problems worse. That is why the carrot-and-stick approach to reform which links increased funding to tougher performance targets will not succeed in the long run. Renowned systems thinker Jake Chapman describes how government's energetic attempts to force change from the centre are becoming counter-productive. The alternative is government based on continuous learning. This is increasingly important as the impact of communication technology and other accelerating social trends offers a moving target for public service reformers. Systems thinking offers a better model for change in complex organisations such as the health service or the railway network. Case studies provided by the NHS confederation show the unintended and often bizarre consequences of introducing new policies without considering their impact on the whole system. Since the original publication of Systems Failure in 2002, many of its core ideas have been taken on by government. In this second edition, Chapman reflects on the experience of putting systems thinking into practice in public services, and explains why the changes he suggests are more difficult - and more urgent - than expected.

Theory of Change in complex Research for Development programmes: challenges and solutions from the Global Challenges Research Fund - Chapman, Sarah; Boodhoo, Adiilah; Duffy, Carren; Goodman, Suki; Michalopoulou, Maria (The European Journal of Development Research, 2023)
The United Kingdom Research and Innovation (UKRI) Global Challenges Research Fund (GCRF) aimed to address global challenges to achieve the United Nations (UN) Sustainable Development Goals through 12 interdisciplinary research hubs. This research documents key lessons learned around working with Theory of Change (ToC) to guide Monitoring, Evaluation and Learning (MEL) within these complex research for development hubs. Interviews and document reviews were conducted in ten of the research hubs. The results revealed that only one hub invested in an explicit visual system mapping approach, and that funder timelines, budget constraints and issues with capacity and expertise limited the application of these approaches across all hubs. In contrast, many hubs attempted to deal with visual complexity by means of ether constructing multiple, nested ToCs, or a conscious simplification of complexity through reducing their ToC towards a straightforward and uncomplicated chain model or spherical model. While the former approach had some value, most hubs struggled to find capacity to support the full articulation of nested ToCs. In contrast, the latter approach resulted in ToCs which lacked detail or mechanism articulation, but which nevertheless were often ‘fit for purpose’ in ensuring effective communication and coherence across diverse stakeholders and sub-projects. We conclude that in instances where the reporting, funding and management cycles of complex research for development programmes cannot be adapted to properly support learning-based approaches to ToC development, imposing simplicity in the ToC might be fit for purpose. This might also be preferable to more complex visual approaches that are only partially realised.

Causal inferences on the effectiveness of complex social programs: Navigating assumptions, sources of complexity and evaluation design challenges - Chatterji, Madhabi (Evaluation and Program Planning, 2016)
This paper explores avenues for navigating evaluation design challenges posed by complex social programs (CSPs) and their environments when conducting studies that call for generalizable, causal inferences on the intervention’s effectiveness. A definition is provided of a CSP drawing on examples from different fields, and an evaluation case is analyzed in depth to derive seven (7) major sources of complexity that typify CSPs, threatening assumptions of textbook-recommended experimental designs for performing impact evaluations. Theoretically-supported, alternative methodological strategies are discussed to navigate assumptions and counter the design challenges posed by the complex configurations and ecology of CSPs. Specific recommendations include: sequential refinement of the evaluation design through systems thinking, systems-informed logic modeling; and use of extended term, mixed methods (ETMM) approaches with exploratory and confirmatory phases of the evaluation. In the proposed approach, logic models are refined through direct induction and interactions with stakeholders. To better guide assumption evaluation, question-framing, and selection of appropriate methodological strategies, a multiphase evaluation design is recommended.
Keywords: Causal inferences; Complex social programs; Experimental designs; Impact evaluations; Mixed methods

Strengthening Advocacy and Civic Engagemetn in Nigeria - Chemonics (Chemonics International, 2018)

Changes for Justice Project - Final Report - Chemonics International (USAID, 2015)

Natural Disaster Monitoring with Wireless Sensor Networks: A Case Study of Data-intensive Applications upon Low-Cost Scalable Systems - Chen, Dan; Liu, Zhixin; Wang, Lizhe; Dou, Minggang; Chen, Jingying; Li, Hui (Mobile Networks and Applications, 2013)
The wireless sensor network (WSN) technology has applied in monitoring natural disasters for more than one decade. Disasters can be closely monitored by augmenting a variety of sensors, and WSN has merits in (1) low cost, (2) quick response, and (3) salability and flexibility. Natural disaster monitoring with WSN is a well-known data intensive application for the high bandwidth requirements and stringent delay constraints. It manifests a typical paradigm of data-intensive application upon low-cost scalable system. In this study, we first assessed representative works in this area by classifying those in the domains of application of WSNs for disasters and optimization technologies significantly distinguishing these from general-purpose WSNs. We then described the design of an early warning system for geohazards in reservoir region, which relies on the WSN technology inspired by the existing work with focuses on issues of (1) supporting reliable data transmission, (2) handling huge data of heterogeneous sources and types, and (3) minimizing energy consumption. This study proposes a dynamic routing protocol, a method for network recovery, and a method for managing mobile nodes to enable real-time and reliable data transmission. The system incorporates data fusion and reconstruction approaches to bring together all data into a single view of the geohazard under monitoring. A distributed algorithm for joint optimal control of power and rate has been developed, which can improve utility of network (> 95 %) and to minimize the energy consumption (reduction by > 20 % in comparison with LEACH). Experimental results indicate the potentials of the proposed approaches in terms of adapting to the needs of early warning on geohazards.
Keywords: Data-intensive application; Geohazard; Natural disaster monitoring; Scalable system; Wireless sensor network

Practical Program Evaluation: Theory-Driven Evaluation and the Integrated Evaluation Perspective - Chen, Huey (SAGE Publications, Inc, 2014)
The Second Edition of Practical Program Evaluation shows readers how to systematically identify stakeholders’ needs in order to select the evaluation options best suited to meet those needs. Within his discussion of the various evaluation types, Huey T. Chen details a range of evaluation approaches suitable for use across a program’s life cycle. At the core of program evaluation is its body of concepts, theories, and methods. This revised edition provides an overview of these, and includes expanded coverage of both introductory and more cutting-edge techniques within six new chapters. Illustrated throughout with real-world examples that bring the material to life, the Second Edition provides many new tools to enrich the evaluator’s toolbox.

The Future of Development: “Make Happen” with Portfolios of Options - CHÔRA Foundation (CHÔRA Foundation, 2021)
This Green Paper intends to review key elements of the problem that Development actors will confront as a new decade opens up ahead of us. It will articulate a solution that we believe should become an inherent feature of Development programs and initiatives. This is the outcome of an intense period of experiences and reflections in the Development space across different geographies and institutional mandates and activities, during which the Foundation has collaborated with institutions such as the UNDP and Grand Challenges Canada. At the heart of our collaborations is a Strategic Innovation and System Transformation Framework, with its associated concepts, working definitions, processes, tools and people. Sourced from CHÔRA Foundation’s knowledge and practice assets, this is a capability we intend to make relevant, customise, scale up and distribute to our partners and stakeholders. We are looking to create with them a space that offers the world a transformational capability. Central to this capability we see a distinctive and robust practice: the design and dynamic management of Portfolios of Strategic Innovation and System Transformation Options. These Portfolios are unique, context relevant, embedded mechanisms for learning, sensemaking and problem solving that social systems leverage to have an impact on themselves and their problems, and to induce the transformations that are necessary to them. It is our view that Portfolios of Options are the most effective means by which human social systems can supply themselves with budgets of possibility that ensure choice and create opportunity. They will also support pragmatic evolutionary outcomes and enable resilience.

The journey from rhetoric to reality: participatory evaluation in a development context - Chouinard, Jill Anne; Cousins, J. Bradley (Educational Assessment, Evaluation and Accountability, 2015)
In this paper, we focus on participatory evaluation in the context of international development and specifically on the emerging empirical knowledge base. In a prior review and critique of research on participatory evaluation (Cousins and Chouinard 2012), we examined 121 studies, with only 21 (17 %) situated in development contexts. However, the circumstances and challenges for international development and for development evaluation are distinct from those found in developed countries and therefore warrant separate consideration. To provide a more focused and detailed understanding of participatory evaluation in international development contexts, in this paper we augment our initial sample to a total of 40 studies on participatory evaluation in development published over the past 16.5 years. Based on an analysis of this research and related theoretical and conceptual contributions we identify and discuss eight emergent themes: multiplicity of relationships, consequences of stakeholder selection, characterization of participation, contextual complexity, methodological requirements, cultural influence, politics and power and learning and capacity building. We conclude with some reflections on an agenda for research.

Holistic Flexibility for Deploying Systems Thinking as a Cognitive Skill - Chowdhury, Rajneesh (Systemic Practice and Action Research, 2023)
Considering Systems Thinking (ST) as a cognitive skill can create greater acceptability of and openness to the discipline from practitioners and researchers outside operations research and management science. Rather than associating ST with frameworks and methodologies, ST as a cognitive skill can help popularize and democratize the discipline. This paper highlights how the conceptual lens of Holistic Flexibility can help practitioners deploy ST as a cognitive skill without the application of any traditional systems methodology. Holistic Flexibility is defined as the dynamic interplay between a state of mind that has the ability to absorb systemic complexity and a state of practice that has the ability to embrace flexibility, both in intent and in form. Through two case-studies, discussions in this paper highlight how Holistic Flexibility can serve as a conceptual lens for systems practitioners. The case-studies demonstrate the importance of a practitioner’s ability to seamlessly manage and work with multiple variables, stakeholders, and factors to deliver responsible outcomes with the aid of learning loops. The main contribution of this paper lies in the case-studies and analyses presented that provide use cases for Holistic Flexibility in ST, which will help address recent calls in the discipline for ST to be considered as a cognitive skill.

What Is Disruptive Innovation? - Christensen, Clayton M.; Raynor, Michael E.; McDonald, Rory (Harvard Business Review, 2015)
For the past 20 years, the theory of disruptive innovation has been enormously influential in business circles and a powerful tool for predicting which industry entrants will succeed. Unfortunately, the theory has also been widely misunderstood, and the “disruptive” label has been applied too carelessly anytime a market newcomer shakes up well-established incumbents. In this article, the architect of disruption theory, Clayton M. Christensen, and his coauthors correct some of the misinformation, describe how the thinking on the subject has evolved, and discuss the utility of the theory. They start by clarifying what classic disruption entails—a small enterprise targeting overlooked customers with a novel but modest offering and gradually moving upmarket to challenge the industry leaders. They point out that Uber, commonly hailed as a disrupter, doesn’t actually fit the mold, and they explain that if managers don’t understand the nuances of disruption theory or apply its tenets correctly, they may not make the right strategic choices. Common mistakes, the authors say, include failing to view disruption as a gradual process (which may lead incumbents to ignore significant threats) and blindly accepting the “Disrupt or be disrupted” mantra (which may lead incumbents to jeopardize their core business as they try to defend against disruptive competitors). The authors acknowledge that disruption theory has certain limitations. But they are confident that as research continues, the theory’s explanatory and predictive powers will only improve.

The Role of External Actors in Supporting Social and Political Action towards Empowerment and Accountability with a Focus on Fragile, Conflict- and Violence-Affected Settings - Christie, Angela; Burge, Richard (IDS Working Paper 503, 2017)
This paper explores the role and experience of external actors, particularly donors, in supporting social and political action in fragile, conflict and violence affected settings. Evidence is distilled from a wide range of synthesised sources to generate relevant findings and questions in relation to what we know and what we don’t. Included among the source material is a 2016 macro-evaluation of DFID’s empowerment and accountability (E&A) programmes which examined over 50 DFID funded projects. Themes which emerge relate to: how external actors need to think about the context and work politically; who are the most appropriate social and political actors to support in E&A; whether a direct or indirect approach to support for E&A achieves more tangible outcomes; whether external actors should move beyond short-term tools and tactics focused on one-sided engagement; and whether programmes should be designed around more strategic, multi-faceted interventions. The paper concludes with identifying a number of gaps in the evidence which are translated into a range of questions which could potentially inform the Action for Empowerment and Accountability (A4EA) research programme.

Adaptive Programming in Fragile, Conflict and Violence-Affected Settings, What Works and Under What Conditions?: The Case of Pyoe Pin, Myanmar - Christie, Angela; Green, Duncan (Action for Empowerment and Accountability Research Programme, 2018)
This paper examines adaptive approaches in aid programming in a fragile, conflict and violence-affected setting (FCVAS), namely Myanmar. A combination of desk review and field research has been used to examine some of the assertions around the ‘adaptive management’ approach, which has arisen in recent years as a response to critiques of overly rigid, pre-designed, blue-print and linear project plans. This paper explores if and how adaptive approaches, including rapid learning and planning responses (fast feedback loops and agile programming) are particularly relevant and useful for promoting empowerment and accountability in such ‘messy places’. This case study focuses on Pyoe Pin (‘Young Shoots’), a DFID-funded, British Council managed governance programme, which has been running since 2007.
Keywords: A4EA; Adaptive Development; Economy; Fishery

The Case for an Adaptive Approach to Empowerment and Accountability Programming in Fragile Settings: Synthesis report - Christie, Angela; Green, Duncan (Action for Empowerment and Accountability Research Programme, 2019)
Fragile, conflict and violence-affected settings (FCVAS) are messy and ambiguous contexts in which to plan and implement development initiatives. To work there, external actors are increasingly adopting an adaptive approach to empowerment and accountability (E&A) programming, whatever the setting. This means using a compass rather than map, where real-time political economy analysis (PEA) in relation to context and programme monitoring and evidence-informed learning in relation to intervention are used in combination and in shorter-than-usual planning cycles to maintain and adapt strategic direction. This paper brings together three case studies of large Department for International Development (DFID) governance projects in Myanmar, Nigeria and Tanzania.
Keywords: A4EA; Adaptive Development; Economy; Fishery

The Governance of Climate Change Adaptation Through Urban Policy Experiments - Chu, Eric K. (Environmental Policy and Governance, 2016)
Climate change is increasingly posing risks to infrastructure and public services in cities across the global South. Building on ideas of policy experimentation at the nexus of institutional and transition theories, this paper assesses six climate change adaptation experiments across the cities of Surat, Indore and Bhubaneswar in India to uncover the politics behind how experiments are conceived of, implemented, and supported in light of local development needs. Through employing both embedded and cross-case comparative methods, I argue that policy experiments are often framed around achieving tangible urban economic benefits and maximizing specific project complementarities, which allow emerging adaptation priorities access to established policy directives and funding streams. However, I conclude that despite being arenas for testing new ideas, quantifying climate and development co-benefits, and engaging private and civil society actors, adaptation policy experiments must be coherent with urban political economic contexts in order for them to affect sustained, equitable and transformative programmatic change. Copyright © 2016 John Wiley & Sons, Ltd and ERP Environment
Keywords: Climate change adaptation; India; Policy experiments; urban governance; urban planning

Urban climate adaptation and the reshaping of state–society relations: The politics of community knowledge and mobilisation in Indore, India - Chu, Eric K (Urban Studies, 2018)
Current research on climate change adaptation in cities highlights the role of local governments in facilitating adaptation actions, but rarely assesses whether (and if so, how) local communities organise around emerging climate priorities to affect political change. This paper explores changing state–society relationships through the reconstitution of community collectives and advocacy organisations for advancing climate change adaptation in the Indian city of Indore. The paper shows that communities are indeed recognising the need for adaptation but are, at the same time, integrating adaptation actions with existing strategies for advocating development rights. Communities are also rebuilding alliances between municipal and local institutions for public service and infrastructure provision, which point to the centrality of community politics in urban climate adaptation processes. However, such mobilisations are often dependent on existing political networks and a legacy of advocacy around poverty alleviation needs, which sideline more transformative agendas around inclusiveness, equity, and resilient urban futures.

The Dilemmas of Citizen Inclusion in Urban Planning and Governance to Enable a 1.5 °C Climate Change Scenario - Chu, Eric; Schenk, Todd; Patterson, James (Urban Planning, 2018)
Cities around the world are facilitating ambitious and inclusive action on climate change by adopting participatory and collaborative planning approaches. However, given the major political, spatial, and scalar interdependencies involved, the extent to which these planning tools equip cities to realise 1.5 °C climate change scenarios is unclear. This article draws upon emerging knowledge in the fields of urban planning and urban climate governance to explore complementary insights into how cities can pursue ambitious and inclusive climate action to realise 1.5 °C climate change scenarios. We observe that urban planning scholarship is often under-appreciated in urban climate governance research, while conversely, promising urban planning tools and approaches can be limited by the contested realities of urban climate governance. By thematically reviewing diverse examples of urban climate action across the globe, we identify three key categories of planning dilemmas: institutional heterogeneity, scalar mismatch, and equity and justice concerns. We argue that lessons from urban planning and urban climate governance scholarship should be integrated to better understand how cities can realise 1.5 °C climate change scenarios in practice.

A workshop on Doing Development Differently - CID (CID at Harvard University and ODI, 2014)
October 22-23, 2014 A workshop on Doing Development Differently Harvard Kennedy School, Cambridge, MA Hosted by the Building State Capability (BSC) program at the Center for International Development at Harvard University, and the Overseas Development Institute (ODI) with funding from the Governance Partnership Facility.

Summer school on Adaptive Management - 2019 - CID (2019)
General description of the curriculum

Civic Technologies as tools for change: Is balance between online and offline actions a necessary condition for achieving social change through civic innovation? - Civic Innovation Accelerator Fund (Evaluation Report, 2016)
Keywords: IMPORTANT

Insights for Influence: Understanding Impact Pathways in Crisis Response - Clark, Louise; Carpenter, Jo; Taylor, Joe (Institute of Development Studies, 2023)
The Covid-19 Responses for Equity (CORE) programme was a three-year initiative funded by the Canadian International Development Research Centre (IDRC) that brought together 20 projects from across the global South to understand the socioeconomic impacts of the Covid-19 pandemic, improve existing responses, and generate better policy options for recovery. The research covered 42 countries across Africa, Asia, Latin America, and the Middle East to understand the ways in which the pandemic affected the most vulnerable people and regions, and deepened existing vulnerabilities. Research projects covered a broad range of themes, including macroeconomic policies for support and recovery; supporting essential economic activity and protecting informal businesses, small producers, and women workers; and promoting democratic governance to strengthen accountability, social inclusion, and civil engagement. The Institute of Development Studies (IDS) provided knowledge translation (KT) support to CORE research partners to maximise the learning generated across the research portfolio and deepen engagement with governments, civil society, and the scientific community. As part of this support, the IDS KT team worked with CORE project teams to reconstruct and reflect on their impact pathways to facilitate South-South knowledge exchange on effective strategies for research impact, and share learning on how the CORE cohort has influenced policy and delivered change. This report presents an overview of these impact pathways and the lessons learnt from a selection of the projects chosen to represent the diversity of approaches to engage policymakers, civil society, and the media to generate and share evidence of the effect of the pandemic on diverse vulnerable groups.

Payment by Results in Development Aid: All That Glitters Is Not Gold - Clist, Paul (The World Bank Research Observer, 2016)
Payment by Results (PbR), where aid is disbursed conditional upon progress against a pre-agreed measure, is becoming increasingly important for various donors. There are great hopes that this innovative instrument will focus attention on ultimate outcomes and lead to greater aid effectiveness by passing the delivery risk on to recipients. However, there is very little related empirical evidence, and previous attempts to place it on a sure conceptual footing are rare and incomplete. This article collates and synthesises relevant insights from a wide range of subfields in economics, providing a rich framework with which to analyze Payment by Results. I argue that the domain in which it dominates more traditional forms is relatively small and if it is used too broadly, many of the results it claims are likely to be misleading. The likelihood of illusory gains stems from the difficulty of using a single indicator to simultaneously measure and reward performance: ‘once a measure becomes a target, it ceases to be a good measure.’ This does not mean PbR should not be used (indeed it will be optimal in some settings), but it does mean that claims of success should be treated with caution.
Keywords: Conditionality; Contract theory; F35; Foreign Aid; Multitask model; performance

Appreciative Inquiry Principles - Coaching Leaders (2015)
This article, written by Emotional Intelligence Coach Andy Smith, describes the anticipatory principle which is one of the underpinnings of Appreciative Inquiry (AI). It argues that it is easier and more effective to move towards a positive imagined future than away from a negative one. It is principle number 4 in a series of principles outlined. More principle are listed below.

Enabling collaboration and synthesis: in brief - Cochrane, Logan; Cundill Kemp, Georgina; Landry, Marie-Eve; Lee, Rebecca (INBRIEF, 2017)
Collaborative Adaptation Research Initiative in Africa and Asia (CARIAA) aims to build the resilience of vulnerable populations in climate change hotspots by building new knowledge and capacities to support better informed policy and practice. The program connects more than 450 researchers and practitioners from over 40 organizations. Initially, CARIAA was not directive in terms of the specific topics or forms of synthesis. This approach allowed new ideas to emerge from interactions between members of the network. However, as the brief outlines, lessons learned at mid-term regarding cross- consortia collaboration and synthesis indicate that greater programmatic leadership is required.

Enabling collaborative synthesis in multi-partner programmes - Cochrane, Logan; Cundill, Georgina (Development in Practice, 2018)
Multi-partner consortia have emerged as an important modality for knowledge generation to address complex sustainability challenges. Establishing eﬀective multi-partner consortia involves signiﬁcant investment. This article shares lessons from the Collaborative Adaptation Research Initiative in Africa and Asia (CARIAA), which aims to support policy and practice for climate change adaptation through a consortium model. Key lessons include the need to facilitate collaborative spaces to build trust and identify common interests, while accepting that this is not a guarantee of success; the importance of programmatic leadership to achieve synthesis; and the value of strategic planning in supporting motivation and alignment between partners.

A reflection on collaborative adaptation research in Africa and Asia - Cochrane, Logan; Cundill, Georgina; Ludi, Eva; New, Mark; Nicholls, Robert J.; Wester, Philippus; Cantin, Bernard; Murali, Kallur Subrammanyam; Leone, Michele; Kituyi, Evans; Landry, Marie-Eve (Regional Environmental Change, 2017)

Monitoring, Evaluation and Learning in NGO Advocacy - Findings from Comparative Policy Advocacy MEL Review Project - Coe, Jim; Majot, Juliette (ODI and Oxfam, 2013)
For organizations committed to social change, advocacy often figures as a crucial strategic element. How to assess effectiveness in advocacy is, therefore, important. The usefulness of Monitoring, Evaluation and Learning (MEL) in advocacy are subject to much current debate. Advocacy staff, MEL professionals, senior managers, the funding community, and stakeholders of all kinds are searching for ways to improve practices – and thus their odds of success – in complex and contested advocacy environments. This study considers what a selection of leading advocacy organizations are doing in practice. We set out to identify existing practice and emergent trends in advocacy-related MEL practice, to explore current challenges and innovations. The study presents perceptions of how MEL contributes to advocacy effectiveness, and reviews the resources and structures dedicated to MEL.

Analysing ICT and Development from the Perspective of the Capabilities Approach: A Study in South Brazil - Coelho, Taiane Ritta; Segatto, Andréa Paula; Frega, José Roberto (The Electronic Journal of Information Systems in Developing Countries, 2015)
Certain international agencies propose that Information and Communication Technology (ICT) allows development to be reached more efficiently and quickly. While there are success stories galore, there is acknowledgement of not all investments in ICT bringing positive effects towards development. Following the Capabilities Approach, this paper discusses how the use of ICT can promote a more effective development by studying the case of Sudotec (association for technological and industrial development), a non-profit organization that saw in ICT the opportunity to change the local scenario. The results revealed positive effects of the use of ICT in social, economical and cultural spheres, but not presenting political effect.

The Advocacy Strategy Framework. A tool for articulating an advocacy theory of change - Coffman, Julia; Beer, Tanya (Center for Evaluation Innovation, 2015)

Follow the rabbit: Field Guide to Systemic Design - CoLab (Government of Alberta, 2018)
This Field Guide is designed to support budding systemic designers to facilitate and lead systemic design projects. It’s designed for systemic designers who have basic familiarity with SD concepts and are looking for some practical tips and tools to put theory into action. While this Guide was designed with Government of Alberta staff in mind, the content applies across a range of issue areas, sectors, and intersections. The Guide goes through a systemic design project from concept to implementation. It takes you through the workshop planning process, and discusses workshop roles and client relations. In the FAQs, you’ll find explanations to some commonly asked questions about systemic design concepts to help you introduce others to SD and bring them along with you. You’ll get the most out of this field guide if you approach it with a systemic design mindset – open, willing to try things, a desire to learn, and a ‘yes, and’ orientation. Think of this field guide as an early stop in your systemic design journey: it’s not the end of your learning – it’s a jumping off point. In the Additional Resources section, you can connect to more in-depth explorations of concepts and practical applications.

Complexity and the Art of Public Policy: Solving Society's Problems from the Bottom Up - Colander, David; Kupers, Roland (Princeton University Press, 2014)
Complexity science--made possible by modern analytical and computational advances--is changing the way we think about social systems and social theory. Unfortunately, economists' policy models have not kept up and are stuck in either a market fundamentalist or government control narrative. While these standard narratives are useful in some cases, they are damaging in others, directing thinking away from creative, innovative policy solutions. Complexity and the Art of Public Policy outlines a new, more flexible policy narrative, which envisions society as a complex evolving system that is uncontrollable but can be influenced. David Colander and Roland Kupers describe how economists and society became locked into the current policy framework, and lay out fresh alternatives for framing policy questions. Offering original solutions to stubborn problems, the complexity narrative builds on broader philosophical traditions, such as those in the work of John Stuart Mill, to suggest initiatives that the authors call "activist laissez-faire" policies. Colander and Kupers develop innovative bottom-up solutions that, through new institutional structures such as for-benefit corporations, channel individuals' social instincts into solving societal problems, making profits a tool for change rather than a goal. They argue that a central role for government in this complexity framework is to foster an ecostructure within which diverse forms of social entrepreneurship can emerge and blossom.

Two Loops Guide - Colchester, Joss (Si Network, 2023)
The Two Loop model is a nonlinear theory of change based upon the ideas of living systems created by Margaret Wheatley & Deborah Frieze. It provides us with insight into the simultaneous growth and decline process that are underway within a system during a transition period. In this way, it provides a heuristic for us to better try and recognize and connect the past to the future during a change process. It likewise gives us the possibility to try and come to some consensus about where we might be as a group in this process of change and the best actions to take at different stages. This guide will be of relevance for anyone involved in a complex organizational change process.

Si Guides on System Innovation - Colchester, Joss; Si Network (Si Network, 2023)
So you have just hear about systems thinking and systems innovation and are keen to know more, Ok sparky let's get started.We have structured all the content into four main areas that we think you ...

Reflections on implementing politically informed, searching programs: lessons for aid practitioners and policy makers - Cole, William; Ladner, Debra; Koenig, Mark; Tyrrel, Lavinia (Working Politically in Practice, 2016)

Navigating the landscape of conflict: Applications of dynamical systems theory to protracted social conflict - Coleman, Peter T.; Vallacher, Robin R.; Nowak, Andrzej; Bartoli, Andrea (The Non-linearity of Peace processes. Theory and Practice of Systemic Conflict Transformation, 2011)

Jumping off Arnstein's ladder: social learning as a new policy paradigm for climate change adaptation - Collins, Kevin; Ison, Ray (Environmental Policy and Governance, 2009)
Participation of citizens, groups, organizations and businesses is now an essential element to tackle climate change effectively at international, European Union, national and local levels. However, beyond the general imperative to participate, major policy bodies offer little guidance on what this entails. We suggest that the dominance of Arnstein's ladder of citizen participation in policy discourses constrains the ways we think about, and critically the purposes we ascribe to, participation in a climate change context. We suggest an alternative framing of climate change, where no single group has clear access to understanding the issue and its resolution. Thus adaptation is fundamentally dependent on new forms of learning. Drawing on experiences of social learning approaches to natural resource managing, we explore how a commitment to social learning more accurately embodies the new kinds of role, relationship, practice and sense of purpose required to progress adaptive climate change agendas and practices. Copyright © 2009 John Wiley & Sons, Ltd and ERP Environment.
Keywords: Arnstein's ladder; Climate change; Co-evolutionary adaptation; Natural resource management; Participation; Social learning

Setting new standards for better MEL. Lessons for grantees & funders - Colnar, Megan; Azevedo, Andrea; Tolmie, Courtney; Caddick, Hannah (Better Evaluation, 2023)
How can donors and grantees work together to create effective monitoring, evaluation, and learning (MEL) practices that drive field-wide transformation? The Open Society Foundation’s Fiscal Governance Program found success by focusing on six key approaches, including empowering grantees and relinquishing power. In 2021, an external close-out evaluation by Intention to Impact of the program (which ran for 7 years and gave over $150 million in grants) revealed something pretty remarkable—the program’s deliberate focus on strengthening field-wide monitoring, evaluation, and learning practices was a success. Substantial capacity increases were observed across key institutions and grantees, new complexity-sensitive practices and methods were being actively championed and deployed, and a growing community of better-connected practitioners were exchanging tips and tricks on how to apply smart, context-specific MEL across fiscal governance issues. What’s more, in this evaluation, most grantees gave high praise to these efforts. So, how did this come about? We detail the six different approaches we used in our new publication Setting new standards for better MEL: Lessons for funders and grantees. The approaches range from checking power dynamics to growing skills for evaluative thinking and seeding peer learning and field-wide research. The publication is paired with a toolkit and showcases resources we used and iterated on across the various approaches.

What’s Next for Design Thinking - Cone, Taylor (Medium, 2019)
Thoughts on the future of creative problem-solving from across the industry

Review of the use of report cards for monitoring ecosystem and waterway health - Connolly, Rod; Bunn, Stuart; Campbell, Marnie; Escher, Beate; Hunter, Jane; Maxwell, Paul; Richmond, Sarah; Rissik, David; Roiko, Anne; Smart, Jim; Teasdale, Peter; Harbour, Sunrise Over Gladstone (Gladstone Healthy Harbour Partnership, 2013)

Spherit - Contextual reasoning maps - ContextSpheres.com (ContextSpheres.com, 2004)
Spherit is a whole view technology system that streamlines meaning making, solutioning, and action taking in business, healthcare, relationships, and life in general, by displaying complex situation-specific topics in context on a customizable conversation map. When the Spherit system is activated it generates and displays a snapshot of any complex situation in a way that makes it digestible, while engaging our intellect and our intuition in the reflecting and meaning-making process. It's a unifying visual learning system that communicates information in a non-linear graphical format. It works for individuals, teams and organizations. It has a "share and compare" feature that fast-tracks conversations between individuals or groups. And it offers powerful metrics.

From Design Thinking to Systems Change - Conway, Rowan; Masters, Jeff; Thorold, Jake (RSA, 2017)
This report takes the Small Business Research Initiative (SBRI), a twophase pre-procurement innovation programme that aims to match social challenges with new ideas, as its primary case study. It suggests augmenting the excellent design thinking deployed through SBRI with a think like a system, act like an entrepreneur lens in order to drive better social outcomes from SBRI-originating innovations. Programmes like SBRI have great potential to drive change and address pressing challenges, but must be guided by a more developed understanding of how change happens. The stakes are too high to not raise our game when it comes to social innovation. Wicked problems can be overcome but will require sophisticated theories of change able to account for the complexity and unpredictability of modern life. We offer think like a system, act like an entrepreneur as a contribution to this effort. This report is based on the following research: •• Desk based review of relevant literature; •• A series of structured interviews with participants in SBRI competitions; and •• An expert round table that brought together policymakers, commissioners, procurement experts and entrepreneurs to consider and develop initial findings.
Keywords: ⛔ No DOI found

How to set up and manage an adaptive programme - Lessons from the Action on Climate Today (ACT) Programme - Cooke, Katherine (OPM, 2017)

Scale Up Sourcebook - Cooley, Larry; Howard, Julie (Purdue University, 2019)
The Scale Up Sourcebook is informed and inspired by the September 2018 conference, Innovations in Agriculture: Scaling Up to Reach Millions, organized by Purdue University, in partnership with the African Development Bank. The Sourcebook consolidates, extends, and disseminates some of the scaling insights presented at the Purdue conference. It is intended as an easy-to-use guidebook targeted to a broad and diverse audience of stakeholders associated with scaling agricultural technologies and innovations to meet the needs of the world’s poor. The Sourcebook has nine chapters: designing with scale in mind; assessing scalability; using commercial markets to drive scaling; financing the transition to scale; creating an enabling environment for scale; tailoring metrics, monitoring, and evaluation to support sustainable outcomes at scale; and the critical role of intermediary and donor organizations. The Sourcebook provides guidance, tips, and examples, along with links and references to additional resources on scale up.

Scale Up Sourcebook - Cooley, Larry; Howard, Julie (Scale Up Conference, 2019)
The Scale Up Sourcebook is informed and inspired by the September 2018 conference, Innovations in Agriculture: Scaling Up to Reach Millions, organized by Purdue University, in partnership with the African Development Bank. The Sourcebook consolidates, extends, and disseminates some of the scaling insights presented at the Purdue conference. It is intended as an easy-to-use guidebook targeted to a broad and diverse audience of stakeholders associated with scaling agricultural technologies and innovations to meet the needs of the world’s poor. The Sourcebook has nine chapters: designing with scale in mind; assessing scalability; using commercial markets to drive scaling; financing the transition to scale; creating an enabling environment for scale; tailoring metrics, monitoring, and evaluation to support sustainable outcomes at scale; and the critical role of intermediary and donor organizations. The Sourcebook provides guidance, tips, and examples, along with links and references to additional resources on scale up.

Scaling up - From Vision to Large-Scale Change - A Management Framework for Practitioners - Cooley, Larry; Kohl, Richard; Ved, Rajani R. (MSI, 2016)
This document was originally published in 2006 and re-issued in a substantially revised Second Edition in 2012.

Taking Innovations to Scale: Methods, Applications and Lessons - Cooley, Larry; Linn, Johannes F. (R4D, 2014)
The international development community increasingly recognizes the need to go beyond fragmented, one-of projects. In response, there is now much talk and some action on scaling up successful innovations and pilot projects with an explicit goal of achieving sustainable impact at scale. However, many questions remain about the practical implications of pursuing a systematic scaling up approach and about how the approaches being pursued by diferent institutions and practitioners relate to each other.

Two Paths to Supporting Grassroots Innovation - Cooper, Nathan; Hazeldine, Shaun; Quaggiotto, Giulio (Stanford Social Innovation Review, 2017)
An innovation experiment in Indonesia yields insights on how international development organizations can effectively foster innovation within the communities they aim to help.

Assessing Rural Transformations: Piloting a Qualitative Impact Protocol in Malawi and Ethiopia - Copestake, James; Remnant, Fiona (Bath Papers in International Development and Wellbeing Working Paper, 2014)

The Qualitative Impact Assessment Protocol (QUIP) - Copestake, James; Remnant, Fiona (CDS Briefing Paper, 2015)
This brief presents an overview of the QUIP in three steps: the background to the QUIP and its main aims; the data collection and analysis methodology; and QUIP in the context of other approaches to evaluation. Each section can be read independently, depending on time available.

Participatory action research - Cornish, Flora; Breton, Nancy; Moreno-Tabarez, Ulises; Delgado, Jenna; Rua, Mohi; de-Graft Aikins, Ama; Hodgetts, Darrin (Nature Reviews Methods Primers, 2023)
Participatory action research (PAR) is an approach to research that prioritizes the value of experiential knowledge for tackling problems caused by unequal and harmful social systems, and for envisioning and implementing alternatives. PAR involves the participation and leadership of those people experiencing issues, who take action to produce emancipatory social change, through conducting systematic research to generate new knowledge. This Primer sets out key considerations for the design of a PAR project. The core of the Primer introduces six building blocks for PAR project design: building relationships; establishing working practices; establishing a common understanding of the issue; observing, gathering and generating materials; collaborative analysis; and planning and taking action. We discuss key challenges faced by PAR projects, namely, mismatches with institutional research infrastructure; risks of co-option; power inequalities; and the decentralizing of control. To counter such challenges, PAR researchers may build PAR-friendly networks of people and infrastructures; cultivate a critical community to hold them to account; use critical reflexivity; redistribute powers; and learn to trust the process. PAR’s societal contribution and methodological development, we argue, can best be advanced by engaging with contemporary social movements that demand the redressingl of inequities and the recognition of situated expertise.

Unpacking 'Participation': models, meanings and practices - Cornwall, A. (Community Development Journal, 2008)

Buzzwords and fuzzwords: deconstructing development discourse - Cornwall, Andrea (Development in Practice, 2007)

Democratising Engagement: What the UK Can Learn from International Experience - Cornwall, Andrea (Demos, 2008)

Using Participatory Process Evaluation to Understand the Dynamics of Change in a Nutrition Education Programme - Cornwall, Andrea (IDS Working Papers, 2014)
With roots in approaches to popular education and participatory action research that place the learner and the ‘beneficiary’ of development at the centre of enquiry and action, the participatory visualisation methods associated with Participatory Rural Appraisal have been widely used as tools for learning and accountability. In this article, I reflect on lessons learnt from using these methods in a participatory process evaluation of an educational programme aimed at addressing chronic malnutrition in an East African country. Building on this experience, I explore the educative and empowering dimensions of participatory visualisation methods, and consider the contribution that these methods can make to effective evaluation.
Keywords: Kenya; nutrition; participatory impact evaluation; process evaluation; randomised controlled trials

Deconstructing Development Discourse: Buzzwords and Fuzzwords - Cornwall, Andrea; Eade, Deborah (Oxfam & Practical Action Publishing, 2010)
Writing from diverse locations, contributors critically examine some of the key terms in current development discourse. Why should language matter to those who are doing development? Surely, there are more urgent things to do than sit around mulling over semantics?

From Users and Choosers to Makers and Shapers. Repositioning Participation in Social Policy - Cornwall, Andrea; Gaventa, John (IDS Bulletin, 2000)

17. Shifting perceptions, changing practices in PRA: from infinite innovation to the quest for quality - Cornwall, Andrea; Guijt, Irene (Participatory Learning and Action 50: Critical reflections, future directions, 2004)
In the beginning, there were methods. For many of us in the circle of enthusiasts of participatory approaches in the early 1990s, maps and models, calendars and Venn diagrams, matrices and rankings and the interactions and insights they produced defined what we did and what we had in common. It was this, too, that made participatory rural appraisal (PRA) – and rapid rural appraisal (RRA) before it – something that was very different from anything we’d known before. PRA bridged barriers that might otherwise have kept a social anthropologist and an irrigation engineer like us apart. And it brought us together with dozens of others, from a constellation of disciplines and professions, who shared our excitement about an approach that seemed to offer much for ‘doing development’ differently. In 1995, we co-edited PLA Notes 24 on Critical reflections on practice, in which we sought to engage practitioners and advocates in debate about the looming crises of quality that were to become so much a feature of PRA practice in the later 1990s. In this paper, we look back over more than a decade of engagement with PRA as ‘critical insiders’. Participatory Learning and Action has, naturally enough, served more as a vehicle for practitioners to share their successes and innovations than their critical reflections. Accordingly, we draw here on sources that go beyond it, including reflections from the Pathways to Participation project (see Cornwall and Pratt, 2003a, in PLA Notes 47, and contributions to Cornwall and Pratt 2003b), from work with gender and participatory development (Welbourn, 1992; Guijt and Kaul Shah, 1998; Cornwall 2000), and from the lively debates that we have had for more than a decade with colleagues the world over. These thoughts are our personal reflections, from standpoints associated with the two institutions – IIED and IDS – that were so much part of early efforts to promote and institutionalise PRA in international development practice. Our account is, therefore, very much a partial one. We offer it here as a means of locating some of the threads that have run through debates about PRA since the first issues of Participatory Learning and Action, and some of the challenges that practitioners of participatory learning and action methodologies continue to face. In it, we reflect on distinct phases in the development of PRA (see Figure 1), during which a series of issues emerged as themes for critical reflection. The phases indicated in the diagram relate generally to the prevailing sentiment and practice. Clearly there are exceptions – there have been critical voices and some were using PRA to address issues of power from day one, just as there is still innovation and excitement in some quarters today.

Spaces for Change? The Politics of Citizen Participation in New Democratic Arenas - Cornwall, Andrea; Vera Schattan Coelho (Zed Books, 2006)
The book Spaces for Change?: The Politics of Citizen Participation in New Democratic Arenas

Inclusive Social Accountability - Counterpart International (Counterpart International, 2019)
Counterpart International’s Inclusive Social Accountability (ISA) developmental framework integrates elements of social inclusion and community accountability into one comprehensive approach.

Evaluation for Improvement: A Seven Step Empowerment Evaluation Approach for Violence Prevention Organizations - Cox, PJ; Keener, D; Woodward, T; Wandersman, A (2009)
This guide, written by Pamela J. Cox, Dana Keener, Tifanee L. Woodard, & Abraham H. Wandersman for the Centers for Disease Control and Prevention (CDC) outlines a seven step process for hiring an evaluator to implement an empowerment evaluation. The process begins with preparing for the hiring and concludes with an assessment of an evaluation to ensure its sustainability. Excerpt "...concerns and experiences with independent evaluation led to the development of participatory evaluation approaches as a way to promote an organization’s use of evaluation for the improvement of its strategies. Although there are many participatory evaluation approaches, empowerment evaluation places an explicit emphasis on building the evaluation capacity of individuals and organizations so that evaluation is integrated into the organization’s day-to-day management processes. Through empowerment evaluation, both individual and organizational evaluation capacity are increased through a “learn-by-doing” process, whereby organizations and their staff evaluate their own strategies. Specifically, organizations hire an evaluator to work with them in conducting an evaluation of their strategies. Rather than evaluating an organization’s strategies and presenting an evaluation “report card,” empowerment evaluators coach individuals and organizations through an evaluation of their own strategy(ies) by providing them with the knowledge, skills, and resources they need to conduct just such an evaluation." Contents Empowerment Evaluation: An Overview 11 Principles of Empowerment Evaluation 11 Step 1: Preparing for the Hiring Process 23 Step 2: Writing a Job Announcement 31 Step 3: Finding Potential Empowerment Evaluators 39 Step 4: Assessing the Candidates 45 Step 5: Writing An Evaluation Contract 55 Step 6: Building an Effective Relationship With Your Evaluator 61 Step 7: Assessing and Sustaining the Evaluation 65 Appendix A: Resources for General Evaluation and Empowerment Evaluation 73 Appendix B: Worksheets for Hiring an Empowerment Evaluator 75 Appendix C: Sample Hiring Committee Confidentiality Statement 89 Appendix D: Sample Job 90 Appendix E: Sample Request For Proposals 91 Appendix F: Sample Interview Questions 93 Appendix G: Sample Budget and Narrative for an Evaluation Team 95

Tips for Conducting a Gender Analysis at the Activity or Project Level - Cozzarelli, Cathy (USAID, 2010)
I. What is gender analysis? II. Relevant sections of the ADS III. Process – What should you do to collect the information you need to conduct a gender analysis at the activity or project level? IV. What questions should you ask in the context of doing your gender analysis? - Access - Knowledge, Beliefs, and Perceptions - Practices and Participation - Time and Space - Legal Rights and Status - Power and Decision-making IV. What should you do after you ask these questions?

Citizen-Centered Governance: The Mayor's Office of New Urban Mechanics and the Evolution of CRM in Boston - Crawford, Susan P.; Walters, Dana (Social Science Research Network, 2013)
Over the last three years, the Boston Mayor's Office of New Urban Mechanics, the innovative, collaborative ethos within City Hall fostered by Mayor Menino and h

Emerging Technologies: Smarter ways to fight wildlife crime - Cressa, Douglas; Zommers, Zinta (Environmental Development, 2014)
The illegal trade of animals—for luxury goods, traditional medicine or cultural ceremonies, pets, entertainment, and even research—is a major threat to wildlife conservation and welfare (Baker et al., 2013). Poachers and illegal traders use highly sophisticated and rapidly changing techniques to avoid detection. To keep pace with the "war on wildlife", conservation and law enforcement communities have started to adopt cutting-edge military tools and techniques. High-tech equipment can magnify counter-poaching efforts without requiring armies of rangers or risking lives. Tools include acoustic traps, mobile technology, mikrokopters, radio frequency identification tags, encrypted data digital networks, camera traps, DNA testing, radio collars, metal scanners, and satellite imagery.

Two decades of public sector innovation: building an analytical framework from a systematic literature review of types, strategies, conditions, and results - Criado, J. Ignacio; Alcaide-Muñoz, Laura; Liarte, Irene (Public Management Review, 2023)
Scholarly attention in innovation in the public sector is growing rapidly, provoking analytical complexity. We developed a systematic literature review about Public Sector Innovation (PSI), analysing 169 articles published between 2001 and 2021, using PRISMA. We present a comprehensive approach to PSI testing and empirically develop an analytical framework based on the most common combinations of the studied dimensions. Additionally, we propose three main research avenues for the future of PSI: (1) studying PSI in different contexts, (2) expanding the analysis of configurations in PSI initiatives, and (3) analysing ambidextrous strategies to support the practical implementation of PSI.

Collaborative Overload - Cross, Rob; Rebele, Reb; Grant, Adam (Harvard Business Review, 2016)
Too much teamwork exhausts employees and saps productivity. Here’s how to avoid it.

Building a Better International NGO: Greater than the Sum of the Parts? - Crowley, James; Ryan, Morgana (Kumarian Press, 2013)
In the wake of tremendous growth in the size and scope of their activities, as well as the increased complexity of their programs, how can large international NGOs work effectively―so that the whole is greater than the sum of the parts? James Crowley and Morgana Ryan address this question, drawing on their extensive hands-on experience to offer a practical and even provocative guide. The authors cover a range of essential topics, among them: What are INGOs good at? What should they be good at? Where does new technology fit in? What about accountability? What’s the best way to tackle strategic planning? In the process, they challenge those in leadership positions to recognize and implement the changes that are needed so that their organizations can perform better―and stay relevant―in the decades to come.

Introducción a Capacity WORKS + Proyectos de Cambio - Informe - Cuéllar, Daniel (GIZ, 2014)

Fostering Innovation and Entrepreneurialism in Public Sector Reform - Cummings, Clare (Public Administration and Development, 2015)
Summary There is growing recognition within the international development sector that there is a need for a new, more effective approach to engaging in public sector reform. This article builds on an emerging body of work that advocates more entrepreneurial and adaptive public sector reform programming. Drawing on knowledge and theory from public sector management, psychology and entrepreneurialism, this article aims to understand what motivates public sector workers to work entrepreneurially and suggest how these ideas can be applied to the way in which international development agencies engage in public sector reform work. This requires a shift in thinking from predesigned, large, externally led programmes promoting international best practice to interventions in which agencies adopt the role of a facilitator, helping to establish the enabling conditions for local partners to work entrepreneurially, developing their own solutions to the problems that they identify in their work. Copyright ? 2015 John Wiley & Sons, Ltd.
Keywords: Development; Entrepreneurship; Innovation; Public sector reform; motivation

Monitoring in adaptive co-management: Toward a learning based approach - Cundill, Georgina; Fabricius, Christo (Journal of Environmental Management, 2009)
The recognition of complexity and uncertainty in natural resource management has lead to the development of a wealth of conceptual frameworks aimed at integrated assessment and complex systems monitoring. Relatively less attention has however been given to methodological approaches that might facilitate learning as part of the monitoring process. This paper reviews the monitoring literature relevant to adaptive co-management, with a focus on the synergies between existing monitoring frameworks, collaborative monitoring approaches and social learning. The paper discusses the role of monitoring in environmental management in general, and the challenges posed by scale and complexity when monitoring in adaptive co-management. Existing conceptual frameworks for monitoring relevant to adaptive co-management are reviewed, as are lessons from experiences with collaborative monitoring. The paper concludes by offering a methodological approach to monitoring that actively seeks to engender reflexive learning as a means to deal with uncertainty in natural resource management.
Keywords: Adaptive co-management; Collaborative monitoring; Complexity; Social learning

Large-Scale Transdisciplinary Collaboration for Adaptation Research: Challenges and Insights - Cundill, Georgina; Harvey, Blane; Tebboth, Mark; Cochrane, Logan; Currie‐Alder, Bruce; Vincent, Katharine; Lawn, Jon; Nicholls, Robert J.; Scodanibbio, Lucia; Prakash, Anjal; New, Mark; Wester, Philippus; et al. (Global Challenges, 2019)
An increasing number of research programs seek to support adaptation to climate change through the engagement of large-scale transdisciplinary networks that span countries and continents. While transdisciplinary research processes have been a topic of reflection, practice, and refinement for some time, these trends now mean that the global change research community needs to reflect and learn how to pursue collaborative research on a large scale. This paper shares insights from a seven-year climate change adaptation research program that supports collaboration between more than 450 researchers and practitioners across four consortia and 17 countries. The experience confirms the importance of attention to careful design for transdisciplinary collaboration, but also highlights that this alone is not enough. The success of well-designed transdisciplinary research processes is also strongly influenced by relational and systemic features of collaborative relationships. Relational features include interpersonal trust, mutual respect, and leadership styles, while systemic features include legal partnership agreements, power asymmetries between partners, and institutional values and cultures. In the new arena of large-scale collaborative science efforts, enablers of transdisciplinary collaboration include dedicated project coordinators, leaders at multiple levels, and the availability of small amounts of flexible funds to enable nimble responses to opportunities and unexpected collaborations.
Keywords: Climate change; collaboration; transdisciplinarity

Rethinking systemic change: economic evolution and institutions - Cunningham, Shawn; Jenal, Marcus (BEAM Exchange, 2016)
Resources that contain evidence of market systems interventions. Recently updated.

Rethinking systemic change: economic evolution and institutions. Discussion paper - Cunningham, Shawn; Jenal, Marcus (BEAM Exchange, 2016)
The primary aim of this research project was to find a conceptually sound definition of systemic change. To do so, it was essential to gain a better understanding of how economies change. The central part of the research work, therefore, was an extended literature review on three bodies of knowledge: evolutionary economics new institutional economics complexity theory There is a growing interest in these bodies of knowledge, combined often called New Economic Thinking, and how they affect economic development. Hence, while rethinking systemic change, this work also contributes to answering the broader question of how market systems approaches can contribute to inclusive economic development. The answer, in short, is to shift the focus away from improving transactions at the micro level towards enabling actors to continuously shape an institutional landscape that supports inclusive economic evolution. This discussion paper briefly presents the key messages from the literature review and seven principles drawing from this literature. The principles can be used by market development practitioners, including technical advisers in donor organisations, programme designers and team leaders, to shape programmes and become more in line with how change happens in the economy. A list of selected references is presented at the end. A technical paper contains a much more detailed discussion of the findings and the principles and an extensive list of references. A case study offers a practitioner perspective through the lens of one market systems development programme: DFID-funded Northern Uganda: Transforming the Economy through Climate Smart Agribusiness – Market Development (NUTEC-MD).

Rethinking systemic change: economic evolution and institutions. Technical Paper - Cunningham, Shawn; Jenal, Marcus (BEAM Exchange, 2016)
The primary aim of this research project was to find a conceptually sound definition of systemic change. To do so, it was essential to gain a better understanding of how economies change. The central part of the research work, therefore, was an extended literature review on three bodies of knowledge: evolutionary economics, new institutional economics and complexity theory. There is a growing interest in these bodies of knowledge, combined often called New Economic Thinking, and how they affect economic development. Hence, while rethinking systemic change, this work also contributes to answering the broader question of how market systems approaches can contribute to inclusive economic development. The answer, in short, is to shift the focus away from improving transactions at the micro level towards enabling actors to continuously shape an institutional landscape that supports inclusive economic evolution. This technical paper provides an in-depth review of the fields of evolutionary economics, new institutional economics and complexity and social change. It is argued that economic development is a complex, non-linear and continuous evolutionary process. Both market and non-market institutions matter greatly in shaping economic performance. The paper then explores the consequences of this understanding for market development practice. It discusses how market development practitioners can engage in and shape an intentional change processes. To translate the theory into practice, seven principles are suggested that can be applied to market systems development practice. The paper concludes with a reframed look at systemic change in market systems development. A discussion paper presents the key messages from the literature review and seven principles drawing from this literature, and a case study offers a practitioner perspective through the lens of one market systems development programme: DFID-funded Northern Uganda: Transforming the Economy through Climate Smart Agribusiness – Market Development (NUTEC-MD).

The fascinating world of unconscious bias and development policy - d’Almeida, André Corrêa; Grossi, Amanda Sue (The Guardian, 2016)
In the last few years scientists have exposed thinking patterns that may skew our decision-making. How can we counter these biases in humanitarian work?
Keywords: Academic experts; Higher Education Network; Neuroscience; Psychology; education; higher education

Bootcamp Bootleg Design Thinking Toolkit - d.school (Institute of Design, Stanford University, 2010)
Keywords: IMPORTANT

Mechanisms of Techno-Moral Change: A Taxonomy and Overview - Danaher, John; Sætra, Henrik Skaug (Ethical Theory and Moral Practice, 2023)
The idea that technologies can change moral beliefs and practices is an old one. But how, exactly, does this happen? This paper builds on an emerging field of inquiry by developing a synoptic taxonomy of the mechanisms of techno-moral change. It argues that technology affects moral beliefs and practices in three main domains: decisional (how we make morally loaded decisions), relational (how we relate to others) and perceptual (how we perceive situations). It argues that across these three domains there are six primary mechanisms of techno-moral change: (i) adding options; (ii) changing decision-making costs; (iii) enabling new relationships; (iv) changing the burdens and expectations within relationships; (v) changing the balance of power in relationships; and (vi) changing perception (information, mental models and metaphors). The paper also discusses the layered, interactive and second-order effects of these mechanisms.

Learning in the Thick of It - Darling, Marilyn; Parry, Charles; Moore, Joseph (Harvard Business Review, 2005)
After-action reviews identify past mistakes but rarely enhance future performance. Companies wanting to fully exploit this tool should look to its master: the U.S. Army’s standing enemy brigade, where soldiers learn and improve even in the midst of battle.
Keywords: Aerospace sector; Corporate governance; Decision making and problem solving; Defense industry; Defense sector; Fabrication and manufacturing; Meeting management; Military; North America; Organizational culture; Presentation skills; Project management; Psychology; Telecom

Report on outcomes and get everyone involved: The Participatory Performance Story Reporting Technique - Dart, J. (Presented at the AES conference in Perth, September 2008, 2008)
This paper outlines the background and philosophy of Collaborative Outcomes Reporting (COR) and Performance Story Reporting (PSR), providing an overview of these emerging techniques and showing how they can be used as a framework for reporting on contribution to long-term outcomes (or targets) using mixed methods and participatory process. The report serves as an introduction to these approaches in evaluation and discusses their bias, limitations and where they might best be applied.

Performance Story - Dart, J.; Mayne, J. (Encyclopedia of Evaluation, 2005)
This is a concise description of ‘Performance Story’ written by Jess Dart and John Mayne for the Sage ‘Encyclopaedia of Evaluation’.

Collaborative Outcome Mapping - Dart, J.; Roberts, M. (Better Evaluation, 2014)
Collaborative Outcomes Reporting (COR) is a participatory approach to impact evaluation based around a performance story that presents evidence of how a program has contributed to outcomes and impacts, that is then reviewed by both technical experts and program stakeholders, which may include community members. Collaborative Outcomes Reporting (COR) is a participatory approach to impact evaluation based around a performance story that presents evidence of how a program has contributed to outcomes and impacts, that is then reviewed by both technical experts and program stakeholders, which may include community members. Developed by Jess Dart, COR combines contribution analysis andMultiple Lines and Levels of Evidence (MLLE), mapping existing data and additional data against the program logic to produce a performance story. Performance story reports are essentially a short report about how a program contributed to outcomes. Although they may vary in content and format, most are short, mention program context and aims, relate to a plausible results chain, and are backed by empirical evidence (Dart and Mayne, 2005). The aim is to tell the ‘story’ of a program’s performance using multiple-lines of evidence. COR adds processes of review by an expert panel and stakeholders, sometimes including community members, to check for the credibility of the evidence about what impacts have occurred and the extent to which these can be credibly attributed to the intervention. It is these components of expert panel review (outcomes panel) and a collaborative approach to developing outcomes (through summit workshops) that differentiate COR from other approaches to outcome and impact evaluation.

What Does the Evidence Tell Us about ‘Thinking and Working Politically’ in Development Assistance? - Dasandi, Niheer; Laws, Ed; Marquette, Heather; Robinson, Mark (Politics and Governance, 2019)
Abstract: This paper critically reviews evidence on ‘thinking and working politically’ in development. Scholars and practitioners have increasingly recognised that development is fundamentally political, and efforts are underway to develop more politically informed ways of thinking and working. The literature does not yet constitute a strong evidence base to link these efforts to more effective aid programming: much evidence is anecdotal, does not meet high standards of robustness, is not comparative, and draws on self-selected successes reported by programme insiders. We discuss factors commonly considered to explain the success of politically informed programmes in areas where conventional programming approaches fall short. We consider evidence in three areas—political context, sector and organization—and provide guidance on where to focus next. Finally, we outline ways of testing the core assumptions of the ‘thinking and working politically’ agenda more thoroughly, to provide a clearer sense of the contribution it can make to aid effectiveness.

Thinking and Working Politically: from theory building to building an evidence base - Dasandi, Niheer; Marquette, Heather; Robinson, Mark (Research Paper, 2016)
This paper discusses the steps required to build a robust evidence base for 'thinking and working politically' (TWP) in development. It argues that better understanding what works, when and why is an important step in moving TWP into mainstream development programming. The paper reviews the existing evidence base on TWP, building on this and on other literature on public sector reform and 'pockets of effectiveness' to suggest research questions, case study selection criteria, and a four-level analytical framework: 1) political context; 2) sector; 3) organisation; and 4) individual. The framework aims to help build a 'rigorous enough' evidence base to show whether and how TWP happens and whether or not it influences the effectiveness of programme implementation and outcomes. The paper also calls for more focus on gender issues, and on different – and often more fragile – political contexts.
Keywords: IMPORTANT

Behavioral Design: A New Approach to Development Policy - Datta, Saugato; Mullainathan, Sendhil (Review of Income and Wealth, 2014)

Monitoring, Evaluating and Learning for Complex Programs in Complex Contexts: Three Facility Case Studies - Davda, Tara; Tyrrel, Lavinia (Governance Working Paper 6, 2019)

Monitoring, Evaluation and Learning for Complex Programs in Complex Contexts: Three Facility Case Studies – Governance Soapbox - Davda, Tara; Tyrrel, Lavinia (Abt Associates - Governance Soapbox, 2019)

Pocket Guide to Systems Wayfinding - Davidson, Seanna (The Systems School, 2019)

EvalC3 - Davies, Rick (2019)
Tools for developing, exploring and evaluating predictive models of expected outcomes