Sara Earl Outcome Mapping pt 1, 2, and 3 - Earl, Sara (2008)
These three videos from Sarah Earl provide an introduction to the concepts of Outcome Mapping

Five Ways to Make a Difference: Perceptions of Practitioners Working in Urban Neighborhoods - Durose, Catherine; van Hulst, Merlijn; Jeffares, Stephen; Escobar, Oliver; Agger, Annika; de Graaf, Laurens (Public Administration Review, 2015)

Using Randomization in Development Economics Research: A Toolkit - Duflo, Esther; Glennerster, Rachel; Kremer, Michael (National Bureau of Economic Research, 2006)
This paper is a practical guide (a toolkit) for researchers, students and practitioners wishing to introduce randomization as part of a research design in the field. It first covers the rationale for the use of randomization, as a solution to selection bias and a partial solution to publication biases. Second, it discusses various ways in which randomization can be practically introduced in a field settings. Third, it discusses designs issues such as sample size requirements, stratification, level of randomization and data collection methods. Fourth, it discusses how to analyze data from randomized evaluations when there are departures from the basic framework. It reviews in particular how to handle imperfect compliance and externalities. Finally, it discusses some of the issues involved in drawing general conclusions from randomized evaluations, including the necessary use of theory as a guide when designing evaluations and interpreting results.

Guidance Note: Practical introduction to adaptive management - DT Global (DT Global, 2022)
DT Global is proud to introduce our new Guidance Note: Practical Introduction to Adaptive Management There is a growing consensus around adaptive management as an effective (even necessary) approach when programs are tackling complex development problems. While there is no standard definition of adaptive management, there is general agreement that such programs need to routinely engage with and respond to program context; constantly test what works in that context; and adjust approaches, plans, and activities based on continuous learning. However, there remains a more limited body of evidence about what this looks like in practice—the enabling conditions, systems, resourcing, skills, and attitudes to effectively operationalise adaptive management. There is also limited guidance around when adaptive management is required, and to what extent—both critical and often overlooked considerations when planning for successful adaptive management. This Guidance Note draws together lessons and good practice in adaptive management from across DT Global’s diverse portfolio of donor-funded programs. It outlines our conceptual framework for adaptive management, with practical guidance on how it can be applied by our program teams. It is also designed to help our teams distinguish adaptive management from good (non adaptive) project management, consider when adaptive management is most useful on a program, and how adaptive a program (or part of a program) should be.

DPPD Handbook. A step-by-step guide for development practitioners to apply the Data Powered Positive Deviance method - DPPD (DPPD Initiative, 2021)
The Method Positive Deviance (PD) is based on the observation that in every community or organization, there are a few individuals who achieve significantly better outcomes than their peers, despite having similar challenges and resources. These individuals are referred to as positive deviants, and adopting their solutions is what is referred to as the PD approach¹. The method described in this Handbook follows the same logic as the PD approach but uses pre-existing, non-traditional data sources instead of — or in conjunction with — traditional data sources. Non-traditional data in this context broadly refers to data that is digitally captured (e.g. mobile phone records and financial data), mediated (e.g. social media and online data), or observed (e.g. satellite imagery). The integration of such data to complement traditional data sources generally used in PD is what we refer to as Data Powered Positive Deviance² (DPPD). The digital data opportunity Recent developments in the availability of digital data provide an opportunity to look for positive deviants³ in new ways and in unprecedented geographical and on temporal scales. A number of studies⁴ have described the challenges related to the application of the PD approach in development. Given these challenges, there are obvious opportunities for innovation in PD and our particular interest here is in the innovative opportunities offered by non-traditional data, following the increasing “datafication” of development and the growing availability of big datasets in a variety of development sectors⁵. DPPD builds on this and expands our ability to extract value from non-traditional digital data while providing a systematic process for leveraging local know-how and the collective wisdom of communities. Data Powered Positive Deviance The DPPD method described in this Handbook emerged from a process of research and testing and follows the same stages as the PD approach. The difference is that DPPD integrates pre-existing, non-traditional data across the five stages, requiring a series of new and specific methods and practices that are not required in the PD approach. The first stage is also somewhat different because it not only defines the problem, but it also checks if it is suitable and feasible to use the DPPD method for the proposed project. Table 1 lists the five stages of the DPPD method. This Handbook dedicates a section to each stage. Stage 1 Assess problem-method fit Stage 2 Determine positive deviants Stage 3 Discover underlying factors Stage 4 Design and implement interventions Stage 5 Monitor and evaluate

DE 201: A practitioner's guide to developmental evaluation - Dozois, Elizabeth; Langlois, Marc; Blanchet-Cohen, Natasha (J.W. McConnell Family Foundation, 2010)
Developmental evaluation has emerged fairly recently as a way to support adaptive learning in complex and emergent initiatives. Combining the rigour of evaluation with the flexibility and imagination required for development, this new form of evaluation brings critical thinking to bear on the creative process in initiatives involving high levels of uncertainty, innovation, emergence, and social complexity. This guidebook from J.W. McConnell Family Foundation and the International Institute for Child Rights and Development explores key aspects of Developmental Evaluation (DE) and offers suggestions for implementing the practice and includes a range of DE resources to help with its facilitation. Contents What is developmental evaluation? When is developmental evaluation appropriate? What competencies are needed to be an effective DE? How is developmental evaluation practiced? Challenges Appendices Assessing Readiness Stakeholder analysis Sample Learning Framework Systems Analysis Framework - Key Components Data Analysis Resources

Engage. Empower. Enact. - Citizen Engagement & Democratic Innovation Programme White Paper - Doyle, Linda; Smith, Bethan (Cognitive Edge, 2021)
The Cynefin Centre’s Citizen Engagement & Democratic Innovation programme provides tools for collective sense-making in the areas of community development and youth work; civic engagement and democratic innovation; collaborative service/policy design and evaluation; housing/tenant engagement; futures and planning; shared learning and peer to peer knowledge exchange.

Learning Evaluation Theory: Brinkerhoff’s Success Case Method - Downes, Andrew (Watershed, 2016)
Brinkerhoff’s model isn’t restricted to learning. It can be used to analyze any major business change, such as the purchase of new equipment or implementation of a new process. It’s based on the assumption that any initiative, no matter how successful or unsuccessful, will always include some success and some failure. It seeks to uncover the most impactful successes and failures of an initiative and then tell the stories behind them, backed by evidence. Your organization can use these stories to learn how to be more successful in the future.

Enabling Innovation: A Practical Guide to Understanding and Fostering Technological Change - Douthwaite, M. B. (Zed Books, 2002)
Enabling Innovation is an engrossing look at some of the disaster—and success—stories surrounding technological development and diffusion in industrialized and developing countries. The book tells the story of widely divergent technologies—agricultural appliances, wind turbines, Green Revolution high yielding seeds, the Linux computer operating system, and Local Economic Trading Systems. Boru Douthwaite has constructed a "how to do it" guide to innovation management that runs counter to so many current "top-down", "big is good", and "private sector is best" assumptions.
Keywords: Political science

Evaluating complex interventions: A theory-driven realist-informed approach - Douthwaite, Boru; Mayne, John; McDougall, Cynthia; Paz-Ybarnegaray, Rodrigo (Evaluation, 2017)
There is a growing recognition that programs that seek to change people’s lives are intervening in complex systems, which puts a particular set of requirements on program monitoring and evaluation. Developing complexity-aware program monitoring and evaluation systems within existing organizations is difficult because they challenge traditional orthodoxy. Little has been written about the practical experience of doing so. This article describes the development of a complexity-aware evaluation approach in the CGIAR Research Program on Aquatic Agricultural Systems. We outline the design and methods used including trend lines, panel data, after action reviews, building and testing theories of change, outcome evidencing and realist synthesis. We identify and describe a set of design principles for developing complexity-aware program monitoring and evaluation. Finally, we discuss important lessons and recommendations for other programs facing similar challenges. These include developing evaluation designs that meet both learning and accountability requirements; making evaluation a part of a program’s overall approach to achieving impact; and, ensuring evaluation cumulatively builds useful theory as to how different types of program trigger change in different contexts.

Innovation histories: A method from learning from experience - Douthwaite, B; Ashby, J (ILAC Brief, 2005)
Preparing an ‘innovation history’ is a method for recording and reflecting on an innovation process. People who have been involved in the innovation jointly construct a detailed written account (sometimes referred to as a ‘learning history’) based on their recollections and on available documents. The process of preparing this history stimulates discussion, reflection and learning amongst stakeholders. Subsequent planning can build on the lessons learned, formulate a shared vision and act as a catalyst for change. Based on the initial detailed account of the innovation process, more concise informational products can be prepared that summarize the innovation process for wider dissemination of findings. These may include public awareness materials, policy briefs or articles in professional journals.

What can the Thinking and Working Politically community learn from peace and conflict mediation? - Douglas, Alex (From Poverty to Power, 2018)
Wily aid practitioners have long understood the importance of adapting their programs to the political environment, and even use their activities to push politics in a progressive direction. But this magic was spun secretly, hidden behind logframes and results frameworks. Only recently has a range of programs been permitted to escape the dead hand of technocracy. But there was one corner of the development and humanitarian world that never needed to shroud its political ambitions; those of us working on resolving violent conflicts. Donors have always understood our work could never be disembodied from politics. This field included elements of the UN, regional organisations, and NGOs, such as the one I work for: the Centre for Humanitarian Dialogue. With a new focus on development being enabled by a series of ‘deals’ between different actors, it seems timely to examine the strategies used to reach peace agreements and whether they contain broader lessons for TWP/DDD/Adaptive Management.

Real-Time Data for Adaptive Management at USAID - Doshi, Samir (Health Communication Innovation Webinar, 2016)

Positive Deviant - Dorsey, David (Fast Company, 2000)
Jerry Sternin’s job was to help save starving children in Vietnam. Faced with an impossible time frame, he adopted a radical approach to making change. His idea: Real change begins from the inside.

Making Good Use of Adaptive Management - Doremus, Holly; Andreen, William L.; Camacho, Alejandro E.; Farber, Daniel A.; Glicksman, Robert L.; Goble, Dale D.; Karkkainen, Bradley C.; Rohlf, Dan; Tarlock, A. Dan; Zellmer, Sandra B.; Jones, Shana Campbell; Huang, Yee (White Paper #1104, 2011)

Adaptive Management, the Endangered Species Act, and the Institutional Challanges of New Age Environmental Protection - Doremus, Holly (Washburn Law Journal, 2001)

The rise of the randomistas: on the experimental turn in international aid - Donovan, Kevin P. (Economy and Society, 2018)
In recent years, the use of experimental methodologies has emerged as a central means of evaluating international aid interventions. Today, proponents of randomized control trials (so-called randomistas) are among the most influential of development experts. This paper examines the growth of this thought collective, analysing how uncertainty has become a central concern of development institutions. It demonstrates that transformations within the aid industry – including the influence of evidence-based policy, the economization of development and the retreat from macro-planning – created the conditions of possibility for experimentation. Within this field, the randomistas adeptly pursued a variety of rhetorical, affective, methodological and organizational strategies that emphasized the lack of credible knowledge within aid and the ability of experiments to rectify the situation. Importantly, they have insisted on the moral worth of experimentation; indeed, the experimental ethic has been proposed as the way to change the spirit of development. Through causal certitude, they propose to reduce human suffering. The rise of experimentation has not, however, eliminated accusations of uncertainty; rather, it has redistributed the means through which knowledge about development is considered credible.
Keywords: Development; Evidence; Experimentation; aid; uncertainty

Adaptive Programming and Business Environment Reform – Lessons for DFID Zimbabwe - Donovan, Elbereth; Manuel, Clare (DFID, 2017)
Keywords: IMPORTANT

Donor perceptions and processes: Risks to success of adaptive programming? - Browse - Knowledge Platform Security & Rule of Law - Donovan, Elbereth (Knowledge Platform - Security & Rule of Law, 2017)
Keywords: IMPORTANT

Why to be Wary of "Design for Developing Countries" - Donaldson, Krista (Ambidextrous, 2008)

Monitoring, Evaluation, Accountability and Learning in Emergencies - Dominique Morel; Hagens, Clara (Catholic Relief Services, 2012)

Monitoring for problem-solving, adaptive management, reporting and learning - Dominique Morel; Dzino-Silajdzic, Velida; Hagens, Clara (Catholic Relief Services, 2020)
Internal and external stakeholders have different information needs over a project’s life, for purposes that include adaptive management, accountability, compliance, reporting and learning. A project’s monitoring, evaluation, accountability and learning, or MEAL, system should provide the information needed by these stakeholders at the level of statistical reliability, detail and timing appropriate to inform data use. In emergency contexts where the situation is still fluid, ‘informal monitoring’ has proved helpful to staff’s ongoing assessment of the broader environment in order to identify changes in the situation, in other actors’ responses, and in priority unmet needs that would require corresponding changes in the response.2 The same distinction between informal monitoring of possible changes in the project’s operating context—whether identified as project assumptions and risk factors or not—and formal monitoring of the activities included in the response and project indicators, is relevant for development contexts too. Informal monitoring: Ongoing assessment of changes in operating context Formal monitoring: Tracking progress against project activities and indicators Within formal monitoring, it is useful to further differentiate between light monitoring and rigorous monitoring: - Light monitoring aims to provide timely feedback on new activities (or new locations or target groups) or aspects of the project’s theory of change (activity-to-output or output-to-IR change) logic that staff are less confident about, to check for early signs that progress is being made and that assumptions are holding true while there is still ample time to make adjustments if necessary.3 - Rigorous monitoring aims to collect representative data for evidence-based project management, reporting and learning, not just at midterm but throughout project implementation.

The political economy of pre-trial detention: Indonesia case study - Domingo, Pilar; Sudaryono, Leopold (ODI, 2016)

The politics of legal empowerment: Legal mobilisation strategies and implications for development - Domingo, Pilar; O'Neil, Tam (ODI, 2014)
 Legal mobilisation can improve the lives of poor or marginalised people by: o contributing to pro-poor change in policy, law and regulation of service delivery across different sectors; o advancing the realisation of rights, and achieving redress for rights violations; o contesting unjust and illegal practices of resource allocation and power relations, including in relation to land and natural resources; o enabling citizens to exercise social accountability through legal action.  The outcomes of legal empowerment of the poor are not politically neutral and need to be understood within broader social and political environments;  Better coordination between justice, sector and governance interventions will maximise the development and social impact of international support for legal empowerment.

Impact Evidence and Beyond: Using Evidence to Drive Adoption of Humanitarian Innovations - Dodgson, Kate; Crowley, Catie (Scaling series, 2021)
This learning paper provides guidance to humanitarian innovators on how to use evidence to enable and drive adoption of innovation. Innovation literature and practice show time and time again that it is difficult to scale innovations. Even when an innovation is demonstrably impactful, better than the existing solution and good value for money, it does not automatically get adopted or used in mainstream humanitarian programming. Why do evidence-based innovations face difficulties in scaling and how can innovators best position their innovation to scale? This learning paper is for innovators who want to effectively use evidence to support and enable their journey to scale. It explores the underlying social, organisational and behavioural factors that stifle uptake of innovations. It also provides guidance on how to use, prioritise and communicate evidence to overcome these barriers. The paper aims to help innovators generate and present their evidence in more tailored and nuanced ways to improve adoption and scaling of their innovations.

The case for thinking and working politically. The implications of 'doing development differently' - DLP (Research Paper, 2014)
This paper discusses the steps required to build a robust evidence base for 'thinking and working politically' (TWP) in development. It argues that better understanding what works, when and why is an important step in moving TWP into mainstream development programming. The paper reviews the existing evidence base on TWP, building on this and on other literature on public sector reform and 'pockets of effectiveness' to suggest research questions, case study selection criteria, and a four-level analytical framework: 1) political context; 2) sector; 3) organisation; and 4) individual. The framework aims to help build a 'rigorous enough' evidence base to show whether and how TWP happens and whether or not it influences the effectiveness of programme implementation and outcomes. The paper also calls for more focus on gender issues, and on different – and often more fragile – political contexts.

Back to the Drawing Board: How to improve monitoring of outcomes - Dillon, Neil; Sundberg, Amelie (ALNAP Paper, 2019)

Breaking the Mould: Alternative approaches to monitoring and evaluation - Dillon, Neil (ALNAP, 2019)
This paper looks at a range of M&E innovations that are designed specifically to provide input to ongoing iterative decision-making and learning at the project level. It identifies three key areas for potential innovation: 1) timing of M&E data provision; 2) flexibility of M&E frameworks to evolve with programme change; and 3) approaches to integrate diverse perspectives on project implementation in a meaningful way. It then looks at a collection of approaches currently being used in each of these three areas through a series of ‘practice examples’, considering the key lessons learned. Finally, the paper discusses the major opportunities and challenges for applying and scaling up the use of these approaches inside the humanitarian sector.

Nuru Kenya transition from Nuru International, Kenya - Dillan, Haley; Ouma, Joel; Yamron, David (What Transformation Takes - Evidence of Responsible INGO Transitions to Locally Led Development Around the World, 2020)
This case study is an example of a phased transfer of ownership and responsibility from INGO Nuru International to Nuru Kenya, including the exit of all international staff. Post-transition, Nuru Kenya is managed entirely by Kenyan staff, although it continues to receive financial support from Nuru International. A lot of the elements described are aligned with Adaptive Management ways of working.

Principles for Digital Development - digitalprinciples.org (2018)

Adding Up to Peace: The Cumulative Impacts of Peace Initiatives - Diana Chigas; Peter Woodrow (CDA Collaborative Learning Projects, 2018)
Adding Up to Peace: The Cumulative Impacts of Peace Initiatives aims to identify how cumulative impacts in peace practice operate at all levels, in order to provide practical lessons for policymakers, donors and practitioners to develop more effective strategies for greater progress towards peace. This book builds on CDA’s Reflecting on Peace Practice Project (RPP), launched to answer the question: What works—and what doesn’t work—in peacebuilding? It seeks to deepen our understanding of how multiple peacebuilding initiatives in a conflict zone interacted and added up (or didn’t), to result in progress towards larger societal level peace, or Peace Writ Large. The findings are a product of sixteen case studies conducted between 2007 and 2012, gathering the perceptions of both local and international stakeholders. The finalization of this book was generously funded by Humanity United. The opinions expressed are those of the authors and do not necessarily reflect the views of Humanity United or of CDA Collaborative Learning Projects.

Design Thinking is not enough – Innovate DFID - DFID, Innovate (Medium, 2016)
By Tamara Giltsoff

Assessing the strength of Evidence - DFID (How to Note, 2014)

DFID Data Disaggregation Action Plan: Better Data for Better Lives - DFID (2017)

DFID Smart Rules: Better Programme Delivery - version VI (2016.10) - DFID (DFID, 2016)
Smart Rules provide the operating framework for the Department for International Development’s (DFID’s) programmes.
Keywords: IMPORTANT; Practice

DFID Smart Rules: Better Programme Delivery - version VII (2017.04) - DFID (DFID, 2017)
Smart Rules provide the operating framework for the Department for International Development’s (DFID’s) programmes.
Keywords: IMPORTANT; Practice

DFID Smart Rules: Better Programme Delivery - version VIII (2018.04) - DFID (DFID, 2017)
Smart Rules provide the operating framework for the Department for International Development’s (DFID’s) programmes.
Keywords: IMPORTANT; Practice

DFID Smart Rules: Better Programme Delivery - version X (2019.01) - DFID (DFID, 2019)

Global Learning for Adaptive Management (GLAM) - DFID (DFID Development Tracker, 2016)
To improve the value for money and impact of development interventions by promoting the use of better monitoring, evaluation and learning strategies that support development programmes to gather and respond to emergent evidence on the effects of interventions, as well as changes in the development context. The Global Learning for Adpative Management programme will make available technical assistance to DFID, USAID and partners to develop this ‘adaptive management’ approach, as well as build an evidence base to understand links between the use of adaptive management and more effective, efficient, relevant and sustainable development interventions.

Guidance on using the revised Logical Framework - How to note - DFID (DFID, 2011)
The principal changes to the logframe from the earlier (2008) 4 x 4 matrix are: - Objectively Verifiable Indicators (OVIs) have been separated into their component elements (Indicator, Baseline and Target), and Milestones added. - Means of Verification has been renamed ‘Source’. - Inputs are now quantified in terms of funds (expressed in Sterling for DFID and all partners) and use of DFID staff time (expressed as annual Full-Time Equivalents (FTEs). - A DFID Share box now indicates the financial value of DFID’s Inputs as a percentage of the whole. - Assumptions are shown at Purpose and Output level only. - Risks are shown at Activities level only, but also rated at Output level; - At the Output level, the Impact Weighting is now shown in the logframe together with a Risk Rating for individual Outputs. - Activities are now shown separately (so do not normally appear in the logframe sent for approval), although they can be added to the logframe if this is more suitable for your purposes. - A renewed emphasis on the use of disaggregated beneficiary data within indicators, baselines and targets. The Logical Framework (logframe) was significantly re-designed in February 2009. In January 2011 a slightly amended logframe template was introduced at the same time as the launch of the new DFID Business Case. Given the extent of changes that took place in February 2009 it was only necessary to make minor amendments in January 2011. These amendments are as follows: - Results Chain terminology aligned across DFID (the terms Goal and Purpose in the old logframe template have been replaced by Impact and Outcome) - Rows added to allow achieved results to be captured alongside the planned results determined at project design stage - Word version of the logframe template removed – excel is the preferred format for logical frameworks from January 2011 - Indicator numbering introduced within logframe template

Political Economy Analysis - How to note - DFID (Practice Paper, 2009)
Political economy analysis is a powerful tool for improving the effectiveness of aid. Bridging the traditional concerns of politics and economics, it focuses on how power and resources are distributed and contested in different contexts, and the implications for development outcomes. It gets beneath the formal structures to reveal the underlying interests, incentives and institutions that enable or frustrate change. Such insights are important if we are to advance challenging agendas around governance, economic growth and service delivery, which experience has shown do not lend themselves to technical solutions alone. Political economy analysis is not a magic bullet for the resolution of intractable development problems. However, it can support more effective and politically feasible development strategies, as well as inform more realistic expectations of what can be achieved, and the risks involved. It can also contribute to better results by identifying where the main opportunities and barriers for policy reform exist and how donors can use their programming and influencing tools to promote positive change. This understanding is particularly relevant in fragile and conflict-affected environments where the challenge of building peaceful states and societies is fundamentally political. There are an increasing number of political economy tools available to development agencies for a range of analytical and operational purposes. This note brings together this material with a view to explaining the relevance and uses of political economy analysis. It is intended to be used by a wide range of DFID programme managers and advisers, as well as staff in other HMG departments and partner organisations. The main questions it addresses are: 􀂃 what is political economy analysis? 􀂃 how and why does political economy analysis add value to DFID work? 􀂃 what approaches and tools are available? 􀂃 how should the analysis be prepared, undertaken and applied to DFID’s work? 􀂃 how should we work with other development partners and across HMG on analysis? Key messages include: • Political economy analysis is central to the formulation of sound country plans and sector programmes, and can play a key role in risk mitigation and ensuring that donors avoid harmful practices. • Political economy analysis can help to improve development effectiveness by identifying how and where donors should focus efforts to promote positive change. • There are a growing number of operationally relevant tools which can be used to inform development strategies at the country or sector level, or in relation to particular development problems. • Several DFID country offices have used political economy analysis to improve the quality and impact of aid. This experience provides valuable lessons that should be considered when commissioning and undertaking political economy analysis. • Where possible, analysis should be conducted on an ongoing basis with key partners in HMG and the wider development community to encourage shared understanding and joint action.

Rwanda Multi-Donor Civil Society Support Programme (2015-2021) - DFID (Development Tracker, 2018)
Project data for the Rwanda Multi-Donor Civil Society Support Programme (2015-2021). Strengthened civil society engagement on critical social cohesion, reconciliation and governance issues in Rwanda. DFID will provide funding and technical support to Rwandan civil society organisations to support the design and implementation of governance and reconciliation focused initiatives, and to support more effective engagement (influencing) with government on these issues.

AID Programming Guide - DFAT (Australian Government, 2019)

Effective Governance. Strategy for Australia’s aid investments - DFAT (Department of Foreign Affairs and Trade, Australian Government, 2015)

Independent Review of Facilities: review and management response - DFAT (DFAT, 2018)

Market Systems Development - Operational Guidance Note - DFAT (DFAT, 2017)

If politics is the problem, how can external actors be part of the solution? - Devarajan, Shantayanan; Khemani, Stuti (The World Bank, 2016)
Despite a large body of research and evidence on the policies and institutions needed to generate growth and reduce poverty, many governments fail to adopt these policies or establish the institutions. Research advances since the 1990s have explained this syndrome, which this paper generically calls
Keywords: IMPORTANT

Managing to Adapt: Analysing adaptive management for planning, monitoring, evaluation, and learning - Desai, Harsh; Maneo, Gabriele; Pellfolk, Erica; Schlingheider, Annika (Oxfam Research Reports, 2018)
Adaptive management is at the heart of ‘Doing Development Differently’. It emerges from stakeholders’ calls for development programmes to be more flexible and responsive to their contexts. Whether it becomes a mainstreamed practice depends on how much it is

Gambling on Development: Why Some Countries Win and Others Lose - Dercon, Stefan (C Hurst & Co Publishers Ltd, 2022)

From Silos to Synergy: Learning from politically informed, gender aware programs - Derbyshire, Helen; Siow, Orlanda; Gibson, Sam; Hudson, David; Roche, Chris (DLP Program, 2018)

Politically informed, gender aware programming: Five lessons from practice - Derbyshire, Helen; Gibson, Sam; Hudson, David; Roche, Chris (DLP Program, 2018)

Adaptive programming in practice: shared lessons from the DFID-funded LASER and SAVI programmes - Derbyshire, Helen; Donovan, Elbereth (Synthesis Paper 3, 2016)
LASER synthesis papers aim to help donors and other stakeholders better understand why and how to approach investment climate reform programming differently. The papers reflect emerging best practice and lessons learnt on what works and what does not work in doing development differently. The papers have been peer-reviewed by experts in the field including senior advisers at DFID, World Bank, IFC and the Donor Committee for Enterprise Development (amongst others).
Keywords: IMPORTANT; Practice

Moving Targets, Widening Nets: monitoring incremental and adaptive change in an Empowerment and Accountability programme. The experience of the State Accountability and Voice Initiative in Nigeria - Derbyshire, Helen; Barr, Julian; Fraser, Steve; Mwamba, Wilf (DFID, 2016)
Keywords: IMPORTANT; Practice

Using stories in evaluation: Participatory Narrative Inquiry and Sensemaking (gLocal Evaluation Week 2022, 2022)
Sensemaking and Participatory Narrative Inquiry (PNI) are similar approaches, based on collecting stories about a real life experience from a large number of stakeholders on a topic of interest to the evaluation, and giving the storytellers themselves the responsibility for analyzing and making sense of the stories. Because a large number of stories are collected and self-interpreted, it is possible to conduct quantitative analysis of recurrent themes, perspectives and feelings emerging in the narratives. By combining elements of qualitative and quantitative research, these approaches help to make sense of complex and evolving realities. This session presented the general approach of Sensemaking and PNI. Panelists discussed their experiences with this method, recently used in IFAD and WFP’s evaluations and invited participants to share their own experiences with using stories in evaluation.

Creating the (organisational) conditions for an OM based M&E and learning practice - Deprez, Steff (Outcome Mapping Learning Community, 2009)

Thinking and Working politically to support developmental leadership and coalitions: The Pacific Leadership Program - Denney, Lisa; McLaren, Rebecca (Research Paper, 2016)

A problem-focused approach to violence against women: The political-economy of justice and security programming - Denney, Lisa; Domingo, Pilar (ODI, 2013)
The United Nations Commission on the Status of Women ended its 57th session on 15 March 2013 with an outcome document affirming the importance of eliminating violence against women (VAW). The Commission was unable, however, to achieve consensus on a global action plan. The negative reaction of some UN member states to an action plan is a worrying reminder of ongoing resistance to reform. These persistent challenges highlight the continuing struggle to gain a serious global commitment to address VAW and recognise it as a breach of women’s fundamental human rights. Engaging in this struggle, many donors have put addressing VAW generally, and in fragile and conflictaffected situations (FCAS) specifically, at the top of the development agenda and made it a major priority of international policy. But in practice progress remains difficult, not least due to entrenched resistance and discriminatory socio-political norms and gender relations that persist in many societies. The problem of violence against women therefore needs to be addressed from the perspective of the concrete socio-political and cultural conditions that shape its particular features and the relevant context specific dynamics of conflict, post-conflict patterns of violence and fragility. International efforts to support reform in the area of VAW in FCAS need to go beyond prescriptive approaches that focus on what access to protection, justice and redress should look like. We propose here an approach that engages with the specificities of the problem – paying attention to context, and the concrete political-economy dynamics of the drivers of VAW – and takes account of the real options that

Political Economy Analysis – Guidance for legal technical assistance - Denney, Lisa; Domingo, Pilar (ROLE UK, 2017)
Political economy analysis is about understanding how change in relation to rule of law and international development is embedded within and shaped by political and economic relations that interact and are particular to each context. These political economy dynamics determine the distribution of power and resources within any given society and must be taken into account when attempting to achieve change. Political economy analysis is important in the justice sector because rule of law and dispute resolution processes reflect the rules of the game about who wins and who loses in the allocation of power and resources. Using political economy analysis in legal technical assistance can help to ensure more relevant and effective assistance that sustainably addresses concrete problems. It can also help to avoid the risk that poorly targeted assistance might inadvertently exacerbate existing power structures in a way that was not intended.

Beyond the toolkit: supporting peace processes in Asia - Denney, Lisa; Barron, Patrick (Working Politically in Practice Series: Case Study, 2015)

Reforming solid waste management in Phnom Penh - Denney, Lisa (Working Politically in Practice, 2016)
This paper tracks the efforts of an Asia Foundation team and local stakeholders as they worked to support improvements in the solid waste management sector in Phnom Penh, Cambodia. The team worked in a flexible way with a range of partners, and with particular focus on understanding the incentives and politics affecting service delivery. While reform of the sector remains in progress, steps have been taken to introduce more competition and better public sector management of solid waste collection in the city. This case study lays out the real-time decisions and processes which drove the strategy and implementation of this project, providing useful insights into how politically astute and flexible programs can be successfully implemented. This case has emerged from an action research process, which was led by a researcher from the Overseas Development Institute (ODI) and conducted over the course of almost two years. By capturing and analyzing the experiences of the program team in Phnom Penh, the paper intends to provide practical insights for others in the development community aiming to implement similar kinds of programming.

Using political economy analysis in conflict, security and justice programmes - Denney, Lisa (ODI, 2016)

Walking the adaptive talk - Denney, Lisa (Devpolicy Blog from the Development Policy Centre, 2018)
The first in a three-part series on adaptive aid.Lisa Denney clarifies the confusion.

The Realities of Community Based Natural Resource Management and Biodiversity Conservation in Sub-Saharan Africa - DeGeorges, Paul Andre; Reilly, Brian Kevin (Sustainability, 2009)
This is an historic overview of conservation in Sub-Saharan Africa from pre-colonial times through the present. It demonstrates that Africans practiced conservation that was ignored by the colonial powers. The colonial market economy combined with the human and livestock population explosion of the 21st century are the major factors contributing to the demise of wildlife and critical habitat. Unique insight is provided into the economics of a representative safari company, something that has not been readily available to Community Based Natural Resources Management (CBNRM) practitioners. Modern attempts at sharing benefits from conservation with rural communities will fail due to the low rural resource to population ratio regardless of the model, combined with the uneven distribution of profits from safari hunting that drives most CBNRM programs, unless these ratios are changed. Low household incomes from CBNRM are unlikely to change attitudes of rural dwellers towards Western approaches to conservation. Communities must sustainably manage their natural areas as "green factories" for the multitude of natural resources they contain as a means of maximizing employment and thus household incomes, as well as meeting the often overlooked socio-cultural ties to wildlife and other natural resources, which may be as important as direct material benefits in assuring conservation of wildlife and its habitat. For CBNRM to be successful in the long-term, full devolution of ownership over land and natural resources must take place. In addition, as a means of relieving pressure on the rural resource base, this will require an urbanization process that creates a middleclass, as opposed to the current slums that form the majority of Africa‘s cities, through industrialization that transforms the unique natural resources of the subcontinent (e.g., strategic minerals, petroleum, wildlife, hardwoods, fisheries, wild medicines, agricultural products, etc.) in Africa.
Keywords: Development; conservation; industrialization; population; wildlife

A guide to agile communication - Defra digital - DEFRA Digital (Departmetn for Environment, Food & Rural Affairs (UK), 2018)
This guide is intended for: people planning communications activity on behalf of agile teams people doing the communications activity (especially blogging, presenting, or filmmaking) people who manage the people described above, who want to understand what they're doing and why The government service standard encourages teams to work in the open as much as possible, echoing item 10 in the government design principles, “make things open, it makes them better”. This guide was written to help teams do just that.

Diffusion Of Innovations Theory, Principles, And Practice - Dearing, James W.; Cox, Jeffrey G. (Health Affairs, 2018)
Aspects of the research and practice paradigm known as the diffusion of innovations are applicable to the complex context of health care, for both explanatory and interventionist purposes. This article answers the question, “What is diffusion?” by identifying the parameters of diffusion processes: what they are, how they operate, and why worthy innovations in health care do not spread more rapidly. We clarify how the diffusion of innovations is related to processes of dissemination and implementation, sustainability, improvement activity, and scale-up, and we suggest the diffusion principles that can be readily used in the design of interventions.

Moving ICTD research beyond bungee jumping: practical case studies and recommendations - Dearden, Andy; Tucker, William (IEEE Technology and Society Magazine, 2016)
The global spread of Internet and mobile communications has been accompanied by a growing interest in how information and communication technologies (ICTs) can contribute to social and economic development. There are a considerable number of such examples in developing countries. For example, M-Pesa in Kenya allows workers in the cities to send money back to families living in the countryside using SMS messages on basic mobile phones. In Ghana, the Motech project allows community health workers to use feature phones and network services to track ante-natal (and post-natal) care with the objective of improving outcomes for both mothers and babies. Other examples include Gram Vaani's (GRINS) open-source software for community radio stations, or Ushahidi's initiatives, which began with tracking post-electoral violence in Kenya in 2008 using mobile phones and Google maps. These examples illustrate different ways of leveraging ICT to improve lives and livelihoods worldwide. Such stories are inspiring many young (and not so young) researchers and innovators alike to explore how technology might support social and economic development and inclusion in global knowledge exchange

The ethical limits of bungee research in ICTD - Dearden, Andrew; Tucker, William D. (2015 IEEE International Symposium on Technology and Society, 2015)
Research in ICTD is difficult because engineers with technical expertise are separated from the challenges that they are trying to address by large physical distances and significant social differences. To overcome these challenges, much research involves occasional short visits by external researchers to developing regions to investigate problems and generate ideas which are then developed back at the engineers' home base before further return visits for deployment and evaluation. This paper highlights the ethical limitations of this `bungee research', and reflects on our experiences in evolving more fruitful research practices. We argue that relying on bungee research as a primary model of research engagement is unethical, and we suggest some minimal conditions that are necessary, but not sufficient, for such visits to be ethically defensible in ICTD research.

Scaling up co-design - Dearden, Andrew; Light, Ann; Zamenopoulos, Theodore; Graham, Paula; Plouviez, Emma; de Sousa, Sophia (PDC 2014 : Reflecting connectedness : proceedings of the 13th Participatory Design Conference, 2014)
In this paper we reflect on our experiences in a project where academic researchers and social change organizations are working together to explore how participatory and co-design practices can be disseminated and spread within the 'third sector'. The research project is itself co-designed and co-produced, but within various constraints arising from research funding models. We explore both our immediate outputs and our learning about successful co-research models for this challenge.

Release the pressure on governance practitioners - de Weijer, Frauke; Hauck, Volker (A Governance Practitioner’s Notebook: Alternative Ideas and Approaches, 2015)
The Governance Practitioner’s Notebook takes an unusual approach for the OECD-DAC Network on Governance (GovNet). It brings together a collection of specially written notes aimed at those who work as governance practitioners within development agencies. It does so, however, without attempting to offer definitive guidance – instead aiming to stimulate thinking and debate. To aid this process the book is centred on a fictional Governance Adviser. The Notebook’s format provides space for experts to speak on today’s governance issues: politics, public sector reform and stakeholder engagement. It encourages debate, charts the evolution of donor thinking, and highlights future challenges in the age of the Sustainable Development Goals. Each section introduces both technical issues and major areas of debate, providing ideas for future development support to institutional reform.
Keywords: IMPORTANT

Sometimes it is about the Tech: Choosing Tools in South African and Kenyan Transparency & Accountability Initiatives - de Lanerolle, Indra; Walker, Tom; Kinney, Sasha (MAVC Research Report, 2016)
Keywords: IMPORTANT

Why isn’t Tech for Accountability Working in Africa? - de Lanerolle, Indra (Policy Briefing No 161, 2017)
Expanding mobile networks and falling costs could transform communication between African citizens and governments. So far, however, attempts to harness new technologies to improve transparency and accountability in Africa and elsewhere have had disappointing results. What is going wrong? Research suggests that an important reason for this failure is a poor understanding of technologies and limited skills in developing and using them. It seems that civil society organisations (CSOs) and governments often ‘re-invent the flat tyre’: experimenting with new tools without finding out what has been tried (often unsuccessfully) before. They also do not follow best practices in how to source, develop and test technologies to ensure these are ‘fit for purpose’. Decision makers should focus on building an effective innovation ecosystem with better links between technologists and accountability actors in both government and civil society to enable learning from successes – and mistakes.
Keywords: IMPORTANT

Beyond magic bullets in governance reform - de Gramont, Diane (Carnegie Endowment for International Peace, 2014)

The Doing Development Different Manifesto - DDD Community (DDD Community, 2014)
Statement from the October 2014 ‘Doing Development Differently’ workshop Too many development initiatives have limited impact. Schools are built but children do not learn. Clinics are built but sic…

The 2017 Reader on Results Measurement. An introduction to the DCED Standard - DCED (DCED, 2017)

Virtuous cycles of learning: Redesigning testing during the digital revolution - Dawson, Theo; Stein, Zachary (International School on Mind, Brain, and Education, 2011)
This paper explores positive new directions for the future of educational testing by examining trends at the interface of the learning sciences and advances in educational technologies. A brief history of the relation between testing and technology sets the stage for a look at emerging “edu-tech” trends and what these might mean for the future of testing. This historical-critical look at past and present testing practices reveals that the learning sciences have been less influential in shaping the growth of testing infrastructures than cumulative advances in technology that have enabled large-scale standardization and automation. We argue that during the current “digital revolution” the learning sciences ought to assume more responsibility for shaping the adoption of new testing technologies. We propose a set of principles that, if followed, would move tomorrow’s testing infrastructures toward learning-centric design. Combining the affordances of new digital technologies with advances in our understanding of learning make it possible to build tests that promote multi-level learning in educational systems, catalyzing virtuous cycles of learning for everyone they affect—students, teachers, school leaders, policy makers, and researchers. The DiscoTest™ Initiative is presented as a reform effort that is guided by these design principles, serving as an example of positive new possibilities for testing at the interface of the learning sciences and new educational technologies.

VCoL in action: How to use micro-VCoLs to learn optimally on the fly - Dawson, Theo (Medium, 2019)
VCoL (the virtuous cycle of learning), is designed to optimize learning while leveraging human´s natural motivational system. It’s easiest to tap into this motivational system when VCoLs are small, focused, relevant, and habitual. We call VCoLs with these characteristics micro-VCoLs. What is a micro-VCoL? Micro-VCoLs are frequently iterated learning cycles that are embedded in everyday activities. Like any VCoL, they involve setting a learning goal, gathering information, applying information, and reflecting on outcomes (preferably with input from others). But in the case of the micro-VCoL, the focus is on the smaller skills (micro-skills) that make up complex sets of skills.

Learning and adapting: the use of monitoring and evaluation in countering violent extremism: a handbook for practitioners - Dawson, Laura; Edwards, Charlie; Jeffray, Calum; Royal United Services Institute for Defence and Security Studies (Royal United Services Institute for Defence and Security Studies, 2014)
IN 2013, the Royal United Services Institute for Defence and Security Studies (RUSI) was awarded a grant under the Kanishka Project to develop a handbook for monitoring and evaluating counter violent extremism (CVE) policies and programmes. The aim of this handbook is to support CVE policy-makers and practitioners (those who design, manage and evaluate CVE programmes), by providing them with key terms regarding violent extremism and radicalisation, describing the purpose of evaluation, and providing examples of key methodologies they can employ to conduct monitoring and evaluation (M&E) in this emerging policy field. The handbook will enable readers to understand why, when and how to conduct an evaluation of a CVE policy, programme or project. .

Agile Development in the Age of Adaptive Management - Davis, Taryn; Orton-Vipond, Sarah; Staid, Martha (Development Gateway, 2019)
Adaptive management – the idea that development projects should respond to real life complexities and be flexible enough to respond to unforeseen changes – is an often-praised approach to doing development differently, with donors and partners exploring how to apply it within their programming.

How Artifacts Afford: The Power and Politics of Everyday Things - Davis, Jenny L. (MIT Press, 2020)
Technologies are intrinsically social. They reflect human values and affect human behavior. The social dynamics of technology materialize through design features that shape how a technology functions and to what effect. The shaping effects of technology are represented in scholarly fields by the concept of “affordances.” Affordances are the ways design features enable and constrain user engagement and social action. This has been a central construct for designers and technology theorists since foundational statements on the topic from JJ Gibson and Don Norman in the 1970s and 80s. With the rise of digitization and widespread automation, “affordance” has entered common parlance and resurged within academic discourse and debate. Davis provides a conceptual update on affordance theory along with a cogent scaffold that shifts the orienting question from what technologies afford, to how technologies afford, for whom, and under what circumstances? “How Artifacts Afford” introduces the mechanisms and conditions framework of affordances in which technologies request, demand, encourage, discourage, refuse, and allow social action, varying across subjects and circumstances. Underlying this mechanisms and conditions framework is a sharp focus on the politics and power encoded in sociotechnical systems. In this timely theoretical reboot, Davis brings clarity to the affordance concept, situates the concept within a broader history of technology studies, and demonstrates how the mechanisms and conditions framework can serve as a transferrable tool of inquiry, critique, and (re)design.

The 'Most Significant Change' (MSC) Technique - Davies, Rick; Dart, Jess (CARE International, 2005)
This publication is aimed at organisations, community groups, students and academics who wish to use MSC to help monitor and evaluate their social change programs and projects, or to learn more about how it can be used. The technique is applicable in many different sectors, including agriculture, education and health, and especially in development programs. It is also applicable to many different cultural contexts. MSC has been used in a wide variety of countries by a range of organisations. By 2004, MSC had been used both by NGOs and governments in Africa, Asia, Latin America, Europe and Australasia.

EvalC3 - Davies, Rick (2019)
Tools for developing, exploring and evaluating predictive models of expected outcomes

Evaluating the impact of flexible development interventions using a ‘loose’ theory of change: Reflections on the Australia-Mekong NGO Engagement Platform - Davies, Rick (Methods Lab, 2016)
• For some interventions, tight and testable theories of change are not appropriate – for example, in fast moving humanitarian emergencies or participatory development programmes, a more flexible approach is needed. • However, it is still possible to have a flexible project design and to draw conclusions about causal attribution. This middle path involves ‘loose’ theories of change, where activities and outcomes may be known, but the likely causal links between them are not yet clear. • In this approach, data is collected ‘after the event’ and analysed across and within cases, developing testable models for ‘what works’. More data will likely be needed than for projects with a ‘tight’ theory of change, as there is a wider range of relationships between interventions and outcomes to analyse. The theory of change plays an important role in guiding the selection of data types. • While loose theories of change are useful to identify long term impacts, this approach can also support short cycle learning about the effectiveness of specific activities being implemented within a project’s lifespan.

ParEvo - Web-assisted participatory evolution of scenarios - Davies, Rick (2020)
ParEvo is a method of exploring alternative futures or histories, using a participatory evolutionary process (hence ParEvo). The process is designed to be used by multiple people, to produce a branching structure of storylines about what did, or could, happen. Participants are anonymous and can choose the extent to which they collaborate with others. Participants are also able to tag, comment on, and evaluate the storylines that are generated. Completed exercises can be analysed using downloaded data describing the content of storylines and the structure of people’s participation. Outcomes can be both cognitive (e.g. how we think about the future) and behavioural (e.g. how we respond to the future).

Representing theories of change: technical challenges with evaluation consequences - Davies, Rick (Journal of Development Effectiveness, 2018)
This paper looks at the technical issues associated with the representation of Theories of Change and the implications of design choices for the evaluability of those theories. The focus is on the description of connections between events rather than the events themselves, because this is seen as a widespread design weakness. Using examples and evidence from Internet sources six structural problems are described along with their consequences for evaluation. The paper then outlines a range of different ways of addressing these problems that could be used by programme designers, implementers and evaluators. The paper concludes with some caution speculating on why the design problems are so endemic but also pointing a way forward. Four strands of work are identified that CEDIL and DFID could invest in to develop solutions identified in the paper.
Keywords: Evaluation; evaluability; representation; theory of change

Pocket Guide to Systems Wayfinding - Davidson, Seanna (The Systems School, 2019)

Monitoring, Evaluating and Learning for Complex Programs in Complex Contexts: Three Facility Case Studies - Davda, Tara; Tyrrel, Lavinia (Governance Working Paper 6, 2019)

Monitoring, Evaluation and Learning for Complex Programs in Complex Contexts: Three Facility Case Studies – Governance Soapbox - Davda, Tara; Tyrrel, Lavinia (Abt Associates - Governance Soapbox, 2019)

Behavioral Design: A New Approach to Development Policy - Datta, Saugato; Mullainathan, Sendhil (Review of Income and Wealth, 2014)

Thinking and Working Politically: from theory building to building an evidence base - Dasandi, Niheer; Marquette, Heather; Robinson, Mark (Research Paper, 2016)
This paper discusses the steps required to build a robust evidence base for 'thinking and working politically' (TWP) in development. It argues that better understanding what works, when and why is an important step in moving TWP into mainstream development programming. The paper reviews the existing evidence base on TWP, building on this and on other literature on public sector reform and 'pockets of effectiveness' to suggest research questions, case study selection criteria, and a four-level analytical framework: 1) political context; 2) sector; 3) organisation; and 4) individual. The framework aims to help build a 'rigorous enough' evidence base to show whether and how TWP happens and whether or not it influences the effectiveness of programme implementation and outcomes. The paper also calls for more focus on gender issues, and on different – and often more fragile – political contexts.
Keywords: IMPORTANT

What Does the Evidence Tell Us about ‘Thinking and Working Politically’ in Development Assistance? - Dasandi, Niheer; Laws, Ed; Marquette, Heather; Robinson, Mark (Politics and Governance, 2019)
Abstract: This paper critically reviews evidence on ‘thinking and working politically’ in development. Scholars and practitioners have increasingly recognised that development is fundamentally political, and efforts are underway to develop more politically informed ways of thinking and working. The literature does not yet constitute a strong evidence base to link these efforts to more effective aid programming: much evidence is anecdotal, does not meet high standards of robustness, is not comparative, and draws on self-selected successes reported by programme insiders. We discuss factors commonly considered to explain the success of politically informed programmes in areas where conventional programming approaches fall short. We consider evidence in three areas—political context, sector and organization—and provide guidance on where to focus next. Finally, we outline ways of testing the core assumptions of the ‘thinking and working politically’ agenda more thoroughly, to provide a clearer sense of the contribution it can make to aid effectiveness.

Collaborative Outcome Mapping - Dart, J.; Roberts, M. (Better Evaluation, 2014)
Collaborative Outcomes Reporting (COR) is a participatory approach to impact evaluation based around a performance story that presents evidence of how a program has contributed to outcomes and impacts, that is then reviewed by both technical experts and program stakeholders, which may include community members. Collaborative Outcomes Reporting (COR) is a participatory approach to impact evaluation based around a performance story that presents evidence of how a program has contributed to outcomes and impacts, that is then reviewed by both technical experts and program stakeholders, which may include community members. Developed by Jess Dart, COR combines contribution analysis andMultiple Lines and Levels of Evidence (MLLE), mapping existing data and additional data against the program logic to produce a performance story. Performance story reports are essentially a short report about how a program contributed to outcomes. Although they may vary in content and format, most are short, mention program context and aims, relate to a plausible results chain, and are backed by empirical evidence (Dart and Mayne, 2005). The aim is to tell the ‘story’ of a program’s performance using multiple-lines of evidence. COR adds processes of review by an expert panel and stakeholders, sometimes including community members, to check for the credibility of the evidence about what impacts have occurred and the extent to which these can be credibly attributed to the intervention. It is these components of expert panel review (outcomes panel) and a collaborative approach to developing outcomes (through summit workshops) that differentiate COR from other approaches to outcome and impact evaluation.

Performance Story - Dart, J.; Mayne, J. (Encyclopedia of Evaluation, 2005)
This is a concise description of ‘Performance Story’ written by Jess Dart and John Mayne for the Sage ‘Encyclopaedia of Evaluation’.

Report on outcomes and get everyone involved: The Participatory Performance Story Reporting Technique - Dart, J. (Presented at the AES conference in Perth, September 2008, 2008)
This paper outlines the background and philosophy of Collaborative Outcomes Reporting (COR) and Performance Story Reporting (PSR), providing an overview of these emerging techniques and showing how they can be used as a framework for reporting on contribution to long-term outcomes (or targets) using mixed methods and participatory process. The report serves as an introduction to these approaches in evaluation and discusses their bias, limitations and where they might best be applied.

Learning in the Thick of It - Darling, Marilyn; Parry, Charles; Moore, Joseph (Harvard Business Review, 2005)
After-action reviews identify past mistakes but rarely enhance future performance. Companies wanting to fully exploit this tool should look to its master: the U.S. Army’s standing enemy brigade, where soldiers learn and improve even in the midst of battle.
Keywords: Aerospace sector; Corporate governance; Decision making and problem solving; Defense industry; Defense sector; Fabrication and manufacturing; Meeting management; Military; North America; Organizational culture; Presentation skills; Project management; Psychology; Telecom

Mechanisms of Techno-Moral Change: A Taxonomy and Overview - Danaher, John; Sætra, Henrik Skaug (Ethical Theory and Moral Practice, 2023)
The idea that technologies can change moral beliefs and practices is an old one. But how, exactly, does this happen? This paper builds on an emerging field of inquiry by developing a synoptic taxonomy of the mechanisms of techno-moral change. It argues that technology affects moral beliefs and practices in three main domains: decisional (how we make morally loaded decisions), relational (how we relate to others) and perceptual (how we perceive situations). It argues that across these three domains there are six primary mechanisms of techno-moral change: (i) adding options; (ii) changing decision-making costs; (iii) enabling new relationships; (iv) changing the burdens and expectations within relationships; (v) changing the balance of power in relationships; and (vi) changing perception (information, mental models and metaphors). The paper also discusses the layered, interactive and second-order effects of these mechanisms.

Bootcamp Bootleg Design Thinking Toolkit - d.school (Institute of Design, Stanford University, 2010)
Keywords: IMPORTANT

The fascinating world of unconscious bias and development policy - d’Almeida, André Corrêa; Grossi, Amanda Sue (The Guardian, 2016)
In the last few years scientists have exposed thinking patterns that may skew our decision-making. How can we counter these biases in humanitarian work?
Keywords: Academic experts; Higher Education Network; Neuroscience; Psychology; education; higher education

Rethinking systemic change: economic evolution and institutions - Cunningham, Shawn; Jenal, Marcus (BEAM Exchange, 2016)
Resources that contain evidence of market systems interventions. Recently updated.

Rethinking systemic change: economic evolution and institutions. Discussion paper - Cunningham, Shawn; Jenal, Marcus (BEAM Exchange, 2016)
The primary aim of this research project was to find a conceptually sound definition of systemic change. To do so, it was essential to gain a better understanding of how economies change. The central part of the research work, therefore, was an extended literature review on three bodies of knowledge: evolutionary economics new institutional economics complexity theory There is a growing interest in these bodies of knowledge, combined often called New Economic Thinking, and how they affect economic development. Hence, while rethinking systemic change, this work also contributes to answering the broader question of how market systems approaches can contribute to inclusive economic development. The answer, in short, is to shift the focus away from improving transactions at the micro level towards enabling actors to continuously shape an institutional landscape that supports inclusive economic evolution. This discussion paper briefly presents the key messages from the literature review and seven principles drawing from this literature. The principles can be used by market development practitioners, including technical advisers in donor organisations, programme designers and team leaders, to shape programmes and become more in line with how change happens in the economy. A list of selected references is presented at the end. A technical paper contains a much more detailed discussion of the findings and the principles and an extensive list of references. A case study offers a practitioner perspective through the lens of one market systems development programme: DFID-funded Northern Uganda: Transforming the Economy through Climate Smart Agribusiness – Market Development (NUTEC-MD).

Rethinking systemic change: economic evolution and institutions. Technical Paper - Cunningham, Shawn; Jenal, Marcus (BEAM Exchange, 2016)
The primary aim of this research project was to find a conceptually sound definition of systemic change. To do so, it was essential to gain a better understanding of how economies change. The central part of the research work, therefore, was an extended literature review on three bodies of knowledge: evolutionary economics, new institutional economics and complexity theory. There is a growing interest in these bodies of knowledge, combined often called New Economic Thinking, and how they affect economic development. Hence, while rethinking systemic change, this work also contributes to answering the broader question of how market systems approaches can contribute to inclusive economic development. The answer, in short, is to shift the focus away from improving transactions at the micro level towards enabling actors to continuously shape an institutional landscape that supports inclusive economic evolution. This technical paper provides an in-depth review of the fields of evolutionary economics, new institutional economics and complexity and social change. It is argued that economic development is a complex, non-linear and continuous evolutionary process. Both market and non-market institutions matter greatly in shaping economic performance. The paper then explores the consequences of this understanding for market development practice. It discusses how market development practitioners can engage in and shape an intentional change processes. To translate the theory into practice, seven principles are suggested that can be applied to market systems development practice. The paper concludes with a reframed look at systemic change in market systems development. A discussion paper presents the key messages from the literature review and seven principles drawing from this literature, and a case study offers a practitioner perspective through the lens of one market systems development programme: DFID-funded Northern Uganda: Transforming the Economy through Climate Smart Agribusiness – Market Development (NUTEC-MD).

Large-Scale Transdisciplinary Collaboration for Adaptation Research: Challenges and Insights - Cundill, Georgina; Harvey, Blane; Tebboth, Mark; Cochrane, Logan; Currie‐Alder, Bruce; Vincent, Katharine; Lawn, Jon; Nicholls, Robert J.; Scodanibbio, Lucia; Prakash, Anjal; New, Mark; Wester, Philippus; et al. (Global Challenges, 2019)
An increasing number of research programs seek to support adaptation to climate change through the engagement of large-scale transdisciplinary networks that span countries and continents. While transdisciplinary research processes have been a topic of reflection, practice, and refinement for some time, these trends now mean that the global change research community needs to reflect and learn how to pursue collaborative research on a large scale. This paper shares insights from a seven-year climate change adaptation research program that supports collaboration between more than 450 researchers and practitioners across four consortia and 17 countries. The experience confirms the importance of attention to careful design for transdisciplinary collaboration, but also highlights that this alone is not enough. The success of well-designed transdisciplinary research processes is also strongly influenced by relational and systemic features of collaborative relationships. Relational features include interpersonal trust, mutual respect, and leadership styles, while systemic features include legal partnership agreements, power asymmetries between partners, and institutional values and cultures. In the new arena of large-scale collaborative science efforts, enablers of transdisciplinary collaboration include dedicated project coordinators, leaders at multiple levels, and the availability of small amounts of flexible funds to enable nimble responses to opportunities and unexpected collaborations.
Keywords: Climate change; collaboration; transdisciplinarity

Monitoring in adaptive co-management: Toward a learning based approach - Cundill, Georgina; Fabricius, Christo (Journal of Environmental Management, 2009)
The recognition of complexity and uncertainty in natural resource management has lead to the development of a wealth of conceptual frameworks aimed at integrated assessment and complex systems monitoring. Relatively less attention has however been given to methodological approaches that might facilitate learning as part of the monitoring process. This paper reviews the monitoring literature relevant to adaptive co-management, with a focus on the synergies between existing monitoring frameworks, collaborative monitoring approaches and social learning. The paper discusses the role of monitoring in environmental management in general, and the challenges posed by scale and complexity when monitoring in adaptive co-management. Existing conceptual frameworks for monitoring relevant to adaptive co-management are reviewed, as are lessons from experiences with collaborative monitoring. The paper concludes by offering a methodological approach to monitoring that actively seeks to engender reflexive learning as a means to deal with uncertainty in natural resource management.
Keywords: Adaptive co-management; Collaborative monitoring; Complexity; Social learning

Fostering Innovation and Entrepreneurialism in Public Sector Reform - Cummings, Clare (Public Administration and Development, 2015)
Summary There is growing recognition within the international development sector that there is a need for a new, more effective approach to engaging in public sector reform. This article builds on an emerging body of work that advocates more entrepreneurial and adaptive public sector reform programming. Drawing on knowledge and theory from public sector management, psychology and entrepreneurialism, this article aims to understand what motivates public sector workers to work entrepreneurially and suggest how these ideas can be applied to the way in which international development agencies engage in public sector reform work. This requires a shift in thinking from predesigned, large, externally led programmes promoting international best practice to interventions in which agencies adopt the role of a facilitator, helping to establish the enabling conditions for local partners to work entrepreneurially, developing their own solutions to the problems that they identify in their work. Copyright ? 2015 John Wiley & Sons, Ltd.
Keywords: Development; Entrepreneurship; Innovation; Public sector reform; motivation

Introducción a Capacity WORKS + Proyectos de Cambio - Informe - Cuéllar, Daniel (GIZ, 2014)

Building a Better International NGO: Greater than the Sum of the Parts? - Crowley, James; Ryan, Morgana (Kumarian Press, 2013)
In the wake of tremendous growth in the size and scope of their activities, as well as the increased complexity of their programs, how can large international NGOs work effectively―so that the whole is greater than the sum of the parts? James Crowley and Morgana Ryan address this question, drawing on their extensive hands-on experience to offer a practical and even provocative guide. The authors cover a range of essential topics, among them: What are INGOs good at? What should they be good at? Where does new technology fit in? What about accountability? What’s the best way to tackle strategic planning? In the process, they challenge those in leadership positions to recognize and implement the changes that are needed so that their organizations can perform better―and stay relevant―in the decades to come.

Collaborative Overload - Cross, Rob; Rebele, Reb; Grant, Adam (Harvard Business Review, 2016)
Too much teamwork exhausts employees and saps productivity. Here’s how to avoid it.

Two decades of public sector innovation: building an analytical framework from a systematic literature review of types, strategies, conditions, and results - Criado, J. Ignacio; Alcaide-Muñoz, Laura; Liarte, Irene (Public Management Review, 2023)
Scholarly attention in innovation in the public sector is growing rapidly, provoking analytical complexity. We developed a systematic literature review about Public Sector Innovation (PSI), analysing 169 articles published between 2001 and 2021, using PRISMA. We present a comprehensive approach to PSI testing and empirically develop an analytical framework based on the most common combinations of the studied dimensions. Additionally, we propose three main research avenues for the future of PSI: (1) studying PSI in different contexts, (2) expanding the analysis of configurations in PSI initiatives, and (3) analysing ambidextrous strategies to support the practical implementation of PSI.

Emerging Technologies: Smarter ways to fight wildlife crime - Cressa, Douglas; Zommers, Zinta (Environmental Development, 2014)
The illegal trade of animals—for luxury goods, traditional medicine or cultural ceremonies, pets, entertainment, and even research—is a major threat to wildlife conservation and welfare (Baker et al., 2013). Poachers and illegal traders use highly sophisticated and rapidly changing techniques to avoid detection. To keep pace with the "war on wildlife", conservation and law enforcement communities have started to adopt cutting-edge military tools and techniques. High-tech equipment can magnify counter-poaching efforts without requiring armies of rangers or risking lives. Tools include acoustic traps, mobile technology, mikrokopters, radio frequency identification tags, encrypted data digital networks, camera traps, DNA testing, radio collars, metal scanners, and satellite imagery.

Citizen-Centered Governance: The Mayor's Office of New Urban Mechanics and the Evolution of CRM in Boston - Crawford, Susan P.; Walters, Dana (Social Science Research Network, 2013)
Over the last three years, the Boston Mayor's Office of New Urban Mechanics, the innovative, collaborative ethos within City Hall fostered by Mayor Menino and h

Tips for Conducting a Gender Analysis at the Activity or Project Level - Cozzarelli, Cathy (USAID, 2010)
I. What is gender analysis? II. Relevant sections of the ADS III. Process – What should you do to collect the information you need to conduct a gender analysis at the activity or project level? IV. What questions should you ask in the context of doing your gender analysis? - Access - Knowledge, Beliefs, and Perceptions - Practices and Participation - Time and Space - Legal Rights and Status - Power and Decision-making IV. What should you do after you ask these questions?

Evaluation for Improvement: A Seven Step Empowerment Evaluation Approach for Violence Prevention Organizations - Cox, PJ; Keener, D; Woodward, T; Wandersman, A (2009)
This guide, written by Pamela J. Cox, Dana Keener, Tifanee L. Woodard, & Abraham H. Wandersman for the Centers for Disease Control and Prevention (CDC) outlines a seven step process for hiring an evaluator to implement an empowerment evaluation. The process begins with preparing for the hiring and concludes with an assessment of an evaluation to ensure its sustainability. Excerpt "...concerns and experiences with independent evaluation led to the development of participatory evaluation approaches as a way to promote an organization’s use of evaluation for the improvement of its strategies. Although there are many participatory evaluation approaches, empowerment evaluation places an explicit emphasis on building the evaluation capacity of individuals and organizations so that evaluation is integrated into the organization’s day-to-day management processes. Through empowerment evaluation, both individual and organizational evaluation capacity are increased through a “learn-by-doing” process, whereby organizations and their staff evaluate their own strategies. Specifically, organizations hire an evaluator to work with them in conducting an evaluation of their strategies. Rather than evaluating an organization’s strategies and presenting an evaluation “report card,” empowerment evaluators coach individuals and organizations through an evaluation of their own strategy(ies) by providing them with the knowledge, skills, and resources they need to conduct just such an evaluation." Contents Empowerment Evaluation: An Overview 11 Principles of Empowerment Evaluation 11 Step 1: Preparing for the Hiring Process 23 Step 2: Writing a Job Announcement 31 Step 3: Finding Potential Empowerment Evaluators 39 Step 4: Assessing the Candidates 45 Step 5: Writing An Evaluation Contract 55 Step 6: Building an Effective Relationship With Your Evaluator 61 Step 7: Assessing and Sustaining the Evaluation 65 Appendix A: Resources for General Evaluation and Empowerment Evaluation 73 Appendix B: Worksheets for Hiring an Empowerment Evaluator 75 Appendix C: Sample Hiring Committee Confidentiality Statement 89 Appendix D: Sample Job 90 Appendix E: Sample Request For Proposals 91 Appendix F: Sample Interview Questions 93 Appendix G: Sample Budget and Narrative for an Evaluation Team 95

Inclusive Social Accountability - Counterpart International (Counterpart International, 2019)
Counterpart International’s Inclusive Social Accountability (ISA) developmental framework integrates elements of social inclusion and community accountability into one comprehensive approach.

Spaces for Change? The Politics of Citizen Participation in New Democratic Arenas - Cornwall, Andrea; Vera Schattan Coelho (Zed Books, 2006)
The book Spaces for Change?: The Politics of Citizen Participation in New Democratic Arenas

17. Shifting perceptions, changing practices in PRA: from infinite innovation to the quest for quality - Cornwall, Andrea; Guijt, Irene (Participatory Learning and Action 50: Critical reflections, future directions, 2004)
In the beginning, there were methods. For many of us in the circle of enthusiasts of participatory approaches in the early 1990s, maps and models, calendars and Venn diagrams, matrices and rankings and the interactions and insights they produced defined what we did and what we had in common. It was this, too, that made participatory rural appraisal (PRA) – and rapid rural appraisal (RRA) before it – something that was very different from anything we’d known before. PRA bridged barriers that might otherwise have kept a social anthropologist and an irrigation engineer like us apart. And it brought us together with dozens of others, from a constellation of disciplines and professions, who shared our excitement about an approach that seemed to offer much for ‘doing development’ differently. In 1995, we co-edited PLA Notes 24 on Critical reflections on practice, in which we sought to engage practitioners and advocates in debate about the looming crises of quality that were to become so much a feature of PRA practice in the later 1990s. In this paper, we look back over more than a decade of engagement with PRA as ‘critical insiders’. Participatory Learning and Action has, naturally enough, served more as a vehicle for practitioners to share their successes and innovations than their critical reflections. Accordingly, we draw here on sources that go beyond it, including reflections from the Pathways to Participation project (see Cornwall and Pratt, 2003a, in PLA Notes 47, and contributions to Cornwall and Pratt 2003b), from work with gender and participatory development (Welbourn, 1992; Guijt and Kaul Shah, 1998; Cornwall 2000), and from the lively debates that we have had for more than a decade with colleagues the world over. These thoughts are our personal reflections, from standpoints associated with the two institutions – IIED and IDS – that were so much part of early efforts to promote and institutionalise PRA in international development practice. Our account is, therefore, very much a partial one. We offer it here as a means of locating some of the threads that have run through debates about PRA since the first issues of Participatory Learning and Action, and some of the challenges that practitioners of participatory learning and action methodologies continue to face. In it, we reflect on distinct phases in the development of PRA (see Figure 1), during which a series of issues emerged as themes for critical reflection. The phases indicated in the diagram relate generally to the prevailing sentiment and practice. Clearly there are exceptions – there have been critical voices and some were using PRA to address issues of power from day one, just as there is still innovation and excitement in some quarters today.

From Users and Choosers to Makers and Shapers. Repositioning Participation in Social Policy - Cornwall, Andrea; Gaventa, John (IDS Bulletin, 2000)

Deconstructing Development Discourse: Buzzwords and Fuzzwords - Cornwall, Andrea; Eade, Deborah (Oxfam & Practical Action Publishing, 2010)
Writing from diverse locations, contributors critically examine some of the key terms in current development discourse. Why should language matter to those who are doing development? Surely, there are more urgent things to do than sit around mulling over semantics?

Buzzwords and fuzzwords: deconstructing development discourse - Cornwall, Andrea (Development in Practice, 2007)

Democratising Engagement: What the UK Can Learn from International Experience - Cornwall, Andrea (Demos, 2008)

Using Participatory Process Evaluation to Understand the Dynamics of Change in a Nutrition Education Programme - Cornwall, Andrea (IDS Working Papers, 2014)
With roots in approaches to popular education and participatory action research that place the learner and the ‘beneficiary’ of development at the centre of enquiry and action, the participatory visualisation methods associated with Participatory Rural Appraisal have been widely used as tools for learning and accountability. In this article, I reflect on lessons learnt from using these methods in a participatory process evaluation of an educational programme aimed at addressing chronic malnutrition in an East African country. Building on this experience, I explore the educative and empowering dimensions of participatory visualisation methods, and consider the contribution that these methods can make to effective evaluation.
Keywords: Kenya; nutrition; participatory impact evaluation; process evaluation; randomised controlled trials

Unpacking 'Participation': models, meanings and practices - Cornwall, A. (Community Development Journal, 2008)

Participatory action research - Cornish, Flora; Breton, Nancy; Moreno-Tabarez, Ulises; Delgado, Jenna; Rua, Mohi; de-Graft Aikins, Ama; Hodgetts, Darrin (Nature Reviews Methods Primers, 2023)
Participatory action research (PAR) is an approach to research that prioritizes the value of experiential knowledge for tackling problems caused by unequal and harmful social systems, and for envisioning and implementing alternatives. PAR involves the participation and leadership of those people experiencing issues, who take action to produce emancipatory social change, through conducting systematic research to generate new knowledge. This Primer sets out key considerations for the design of a PAR project. The core of the Primer introduces six building blocks for PAR project design: building relationships; establishing working practices; establishing a common understanding of the issue; observing, gathering and generating materials; collaborative analysis; and planning and taking action. We discuss key challenges faced by PAR projects, namely, mismatches with institutional research infrastructure; risks of co-option; power inequalities; and the decentralizing of control. To counter such challenges, PAR researchers may build PAR-friendly networks of people and infrastructures; cultivate a critical community to hold them to account; use critical reflexivity; redistribute powers; and learn to trust the process. PAR’s societal contribution and methodological development, we argue, can best be advanced by engaging with contemporary social movements that demand the redressingl of inequities and the recognition of situated expertise.

Assessing Rural Transformations: Piloting a Qualitative Impact Protocol in Malawi and Ethiopia - Copestake, James; Remnant, Fiona (Bath Papers in International Development and Wellbeing Working Paper, 2014)

The Qualitative Impact Assessment Protocol (QUIP) - Copestake, James; Remnant, Fiona (CDS Briefing Paper, 2015)
This brief presents an overview of the QUIP in three steps: the background to the QUIP and its main aims; the data collection and analysis methodology; and QUIP in the context of other approaches to evaluation. Each section can be read independently, depending on time available.

Two Paths to Supporting Grassroots Innovation - Cooper, Nathan; Hazeldine, Shaun; Quaggiotto, Giulio (Stanford Social Innovation Review, 2017)
An innovation experiment in Indonesia yields insights on how international development organizations can effectively foster innovation within the communities they aim to help.

Taking Innovations to Scale: Methods, Applications and Lessons - Cooley, Larry; Linn, Johannes F. (R4D, 2014)
The international development community increasingly recognizes the need to go beyond fragmented, one-of projects. In response, there is now much talk and some action on scaling up successful innovations and pilot projects with an explicit goal of achieving sustainable impact at scale. However, many questions remain about the practical implications of pursuing a systematic scaling up approach and about how the approaches being pursued by diferent institutions and practitioners relate to each other.

Scaling up - From Vision to Large-Scale Change - A Management Framework for Practitioners - Cooley, Larry; Kohl, Richard; Ved, Rajani R. (MSI, 2016)
This document was originally published in 2006 and re-issued in a substantially revised Second Edition in 2012.

Scale Up Sourcebook - Cooley, Larry; Howard, Julie (Purdue University, 2019)
The Scale Up Sourcebook is informed and inspired by the September 2018 conference, Innovations in Agriculture: Scaling Up to Reach Millions, organized by Purdue University, in partnership with the African Development Bank. The Sourcebook consolidates, extends, and disseminates some of the scaling insights presented at the Purdue conference. It is intended as an easy-to-use guidebook targeted to a broad and diverse audience of stakeholders associated with scaling agricultural technologies and innovations to meet the needs of the world’s poor. The Sourcebook has nine chapters: designing with scale in mind; assessing scalability; using commercial markets to drive scaling; financing the transition to scale; creating an enabling environment for scale; tailoring metrics, monitoring, and evaluation to support sustainable outcomes at scale; and the critical role of intermediary and donor organizations. The Sourcebook provides guidance, tips, and examples, along with links and references to additional resources on scale up.

Scale Up Sourcebook - Cooley, Larry; Howard, Julie (Scale Up Conference, 2019)
The Scale Up Sourcebook is informed and inspired by the September 2018 conference, Innovations in Agriculture: Scaling Up to Reach Millions, organized by Purdue University, in partnership with the African Development Bank. The Sourcebook consolidates, extends, and disseminates some of the scaling insights presented at the Purdue conference. It is intended as an easy-to-use guidebook targeted to a broad and diverse audience of stakeholders associated with scaling agricultural technologies and innovations to meet the needs of the world’s poor. The Sourcebook has nine chapters: designing with scale in mind; assessing scalability; using commercial markets to drive scaling; financing the transition to scale; creating an enabling environment for scale; tailoring metrics, monitoring, and evaluation to support sustainable outcomes at scale; and the critical role of intermediary and donor organizations. The Sourcebook provides guidance, tips, and examples, along with links and references to additional resources on scale up.

How to set up and manage an adaptive programme - Lessons from the Action on Climate Today (ACT) Programme - Cooke, Katherine (OPM, 2017)

From Design Thinking to Systems Change - Conway, Rowan; Masters, Jeff; Thorold, Jake (RSA, 2017)
This report takes the Small Business Research Initiative (SBRI), a twophase pre-procurement innovation programme that aims to match social challenges with new ideas, as its primary case study. It suggests augmenting the excellent design thinking deployed through SBRI with a think like a system, act like an entrepreneur lens in order to drive better social outcomes from SBRI-originating innovations. Programmes like SBRI have great potential to drive change and address pressing challenges, but must be guided by a more developed understanding of how change happens. The stakes are too high to not raise our game when it comes to social innovation. Wicked problems can be overcome but will require sophisticated theories of change able to account for the complexity and unpredictability of modern life. We offer think like a system, act like an entrepreneur as a contribution to this effort. This report is based on the following research: •• Desk based review of relevant literature; •• A series of structured interviews with participants in SBRI competitions; and •• An expert round table that brought together policymakers, commissioners, procurement experts and entrepreneurs to consider and develop initial findings.
Keywords: ⛔ No DOI found

Spherit - Contextual reasoning maps - ContextSpheres.com (ContextSpheres.com, 2004)
Spherit is a whole view technology system that streamlines meaning making, solutioning, and action taking in business, healthcare, relationships, and life in general, by displaying complex situation-specific topics in context on a customizable conversation map. When the Spherit system is activated it generates and displays a snapshot of any complex situation in a way that makes it digestible, while engaging our intellect and our intuition in the reflecting and meaning-making process. It's a unifying visual learning system that communicates information in a non-linear graphical format. It works for individuals, teams and organizations. It has a "share and compare" feature that fast-tracks conversations between individuals or groups. And it offers powerful metrics.

Review of the use of report cards for monitoring ecosystem and waterway health - Connolly, Rod; Bunn, Stuart; Campbell, Marnie; Escher, Beate; Hunter, Jane; Maxwell, Paul; Richmond, Sarah; Rissik, David; Roiko, Anne; Smart, Jim; Teasdale, Peter; Harbour, Sunrise Over Gladstone (Gladstone Healthy Harbour Partnership, 2013)

What’s Next for Design Thinking - Cone, Taylor (Medium, 2019)
Thoughts on the future of creative problem-solving from across the industry

Setting new standards for better MEL. Lessons for grantees & funders - Colnar, Megan; Azevedo, Andrea; Tolmie, Courtney; Caddick, Hannah (Better Evaluation, 2023)
How can donors and grantees work together to create effective monitoring, evaluation, and learning (MEL) practices that drive field-wide transformation? The Open Society Foundation’s Fiscal Governance Program found success by focusing on six key approaches, including empowering grantees and relinquishing power. In 2021, an external close-out evaluation by Intention to Impact of the program (which ran for 7 years and gave over $150 million in grants) revealed something pretty remarkable—the program’s deliberate focus on strengthening field-wide monitoring, evaluation, and learning practices was a success. Substantial capacity increases were observed across key institutions and grantees, new complexity-sensitive practices and methods were being actively championed and deployed, and a growing community of better-connected practitioners were exchanging tips and tricks on how to apply smart, context-specific MEL across fiscal governance issues. What’s more, in this evaluation, most grantees gave high praise to these efforts. So, how did this come about? We detail the six different approaches we used in our new publication Setting new standards for better MEL: Lessons for funders and grantees. The approaches range from checking power dynamics to growing skills for evaluative thinking and seeding peer learning and field-wide research. The publication is paired with a toolkit and showcases resources we used and iterated on across the various approaches.

Jumping off Arnstein's ladder: social learning as a new policy paradigm for climate change adaptation - Collins, Kevin; Ison, Ray (Environmental Policy and Governance, 2009)
Participation of citizens, groups, organizations and businesses is now an essential element to tackle climate change effectively at international, European Union, national and local levels. However, beyond the general imperative to participate, major policy bodies offer little guidance on what this entails. We suggest that the dominance of Arnstein's ladder of citizen participation in policy discourses constrains the ways we think about, and critically the purposes we ascribe to, participation in a climate change context. We suggest an alternative framing of climate change, where no single group has clear access to understanding the issue and its resolution. Thus adaptation is fundamentally dependent on new forms of learning. Drawing on experiences of social learning approaches to natural resource managing, we explore how a commitment to social learning more accurately embodies the new kinds of role, relationship, practice and sense of purpose required to progress adaptive climate change agendas and practices. Copyright © 2009 John Wiley & Sons, Ltd and ERP Environment.
Keywords: Arnstein's ladder; Climate change; Co-evolutionary adaptation; Natural resource management; Participation; Social learning

Navigating the landscape of conflict: Applications of dynamical systems theory to protracted social conflict - Coleman, Peter T.; Vallacher, Robin R.; Nowak, Andrzej; Bartoli, Andrea (The Non-linearity of Peace processes. Theory and Practice of Systemic Conflict Transformation, 2011)

Reflections on implementing politically informed, searching programs: lessons for aid practitioners and policy makers - Cole, William; Ladner, Debra; Koenig, Mark; Tyrrel, Lavinia (Working Politically in Practice, 2016)

Si Guides on System Innovation - Colchester, Joss; Si Network (Si Network, 2023)
So you have just hear about systems thinking and systems innovation and are keen to know more, Ok sparky let's get started.We have structured all the content into four main areas that we think you ...

Two Loops Guide - Colchester, Joss (Si Network, 2023)
The Two Loop model is a nonlinear theory of change based upon the ideas of living systems created by Margaret Wheatley & Deborah Frieze. It provides us with insight into the simultaneous growth and decline process that are underway within a system during a transition period. In this way, it provides a heuristic for us to better try and recognize and connect the past to the future during a change process. It likewise gives us the possibility to try and come to some consensus about where we might be as a group in this process of change and the best actions to take at different stages. This guide will be of relevance for anyone involved in a complex organizational change process.

Complexity and the Art of Public Policy: Solving Society's Problems from the Bottom Up - Colander, David; Kupers, Roland (Princeton University Press, 2014)
Complexity science--made possible by modern analytical and computational advances--is changing the way we think about social systems and social theory. Unfortunately, economists' policy models have not kept up and are stuck in either a market fundamentalist or government control narrative. While these standard narratives are useful in some cases, they are damaging in others, directing thinking away from creative, innovative policy solutions. Complexity and the Art of Public Policy outlines a new, more flexible policy narrative, which envisions society as a complex evolving system that is uncontrollable but can be influenced. David Colander and Roland Kupers describe how economists and society became locked into the current policy framework, and lay out fresh alternatives for framing policy questions. Offering original solutions to stubborn problems, the complexity narrative builds on broader philosophical traditions, such as those in the work of John Stuart Mill, to suggest initiatives that the authors call "activist laissez-faire" policies. Colander and Kupers develop innovative bottom-up solutions that, through new institutional structures such as for-benefit corporations, channel individuals' social instincts into solving societal problems, making profits a tool for change rather than a goal. They argue that a central role for government in this complexity framework is to foster an ecostructure within which diverse forms of social entrepreneurship can emerge and blossom.

Follow the rabbit: Field Guide to Systemic Design - CoLab (Government of Alberta, 2018)
This Field Guide is designed to support budding systemic designers to facilitate and lead systemic design projects. It’s designed for systemic designers who have basic familiarity with SD concepts and are looking for some practical tips and tools to put theory into action. While this Guide was designed with Government of Alberta staff in mind, the content applies across a range of issue areas, sectors, and intersections. The Guide goes through a systemic design project from concept to implementation. It takes you through the workshop planning process, and discusses workshop roles and client relations. In the FAQs, you’ll find explanations to some commonly asked questions about systemic design concepts to help you introduce others to SD and bring them along with you. You’ll get the most out of this field guide if you approach it with a systemic design mindset – open, willing to try things, a desire to learn, and a ‘yes, and’ orientation. Think of this field guide as an early stop in your systemic design journey: it’s not the end of your learning – it’s a jumping off point. In the Additional Resources section, you can connect to more in-depth explorations of concepts and practical applications.

The Advocacy Strategy Framework. A tool for articulating an advocacy theory of change - Coffman, Julia; Beer, Tanya (Center for Evaluation Innovation, 2015)

Analysing ICT and Development from the Perspective of the Capabilities Approach: A Study in South Brazil - Coelho, Taiane Ritta; Segatto, Andréa Paula; Frega, José Roberto (The Electronic Journal of Information Systems in Developing Countries, 2015)
Certain international agencies propose that Information and Communication Technology (ICT) allows development to be reached more efficiently and quickly. While there are success stories galore, there is acknowledgement of not all investments in ICT bringing positive effects towards development. Following the Capabilities Approach, this paper discusses how the use of ICT can promote a more effective development by studying the case of Sudotec (association for technological and industrial development), a non-profit organization that saw in ICT the opportunity to change the local scenario. The results revealed positive effects of the use of ICT in social, economical and cultural spheres, but not presenting political effect.

Monitoring, Evaluation and Learning in NGO Advocacy - Findings from Comparative Policy Advocacy MEL Review Project - Coe, Jim; Majot, Juliette (ODI and Oxfam, 2013)
For organizations committed to social change, advocacy often figures as a crucial strategic element. How to assess effectiveness in advocacy is, therefore, important. The usefulness of Monitoring, Evaluation and Learning (MEL) in advocacy are subject to much current debate. Advocacy staff, MEL professionals, senior managers, the funding community, and stakeholders of all kinds are searching for ways to improve practices – and thus their odds of success – in complex and contested advocacy environments. This study considers what a selection of leading advocacy organizations are doing in practice. We set out to identify existing practice and emergent trends in advocacy-related MEL practice, to explore current challenges and innovations. The study presents perceptions of how MEL contributes to advocacy effectiveness, and reviews the resources and structures dedicated to MEL.

A reflection on collaborative adaptation research in Africa and Asia - Cochrane, Logan; Cundill, Georgina; Ludi, Eva; New, Mark; Nicholls, Robert J.; Wester, Philippus; Cantin, Bernard; Murali, Kallur Subrammanyam; Leone, Michele; Kituyi, Evans; Landry, Marie-Eve (Regional Environmental Change, 2017)

Enabling collaborative synthesis in multi-partner programmes - Cochrane, Logan; Cundill, Georgina (Development in Practice, 2018)
Multi-partner consortia have emerged as an important modality for knowledge generation to address complex sustainability challenges. Establishing eﬀective multi-partner consortia involves signiﬁcant investment. This article shares lessons from the Collaborative Adaptation Research Initiative in Africa and Asia (CARIAA), which aims to support policy and practice for climate change adaptation through a consortium model. Key lessons include the need to facilitate collaborative spaces to build trust and identify common interests, while accepting that this is not a guarantee of success; the importance of programmatic leadership to achieve synthesis; and the value of strategic planning in supporting motivation and alignment between partners.

Enabling collaboration and synthesis: in brief - Cochrane, Logan; Cundill Kemp, Georgina; Landry, Marie-Eve; Lee, Rebecca (INBRIEF, 2017)
Collaborative Adaptation Research Initiative in Africa and Asia (CARIAA) aims to build the resilience of vulnerable populations in climate change hotspots by building new knowledge and capacities to support better informed policy and practice. The program connects more than 450 researchers and practitioners from over 40 organizations. Initially, CARIAA was not directive in terms of the specific topics or forms of synthesis. This approach allowed new ideas to emerge from interactions between members of the network. However, as the brief outlines, lessons learned at mid-term regarding cross- consortia collaboration and synthesis indicate that greater programmatic leadership is required.

Appreciative Inquiry Principles - Coaching Leaders (2015)
This article, written by Emotional Intelligence Coach Andy Smith, describes the anticipatory principle which is one of the underpinnings of Appreciative Inquiry (AI). It argues that it is easier and more effective to move towards a positive imagined future than away from a negative one. It is principle number 4 in a series of principles outlined. More principle are listed below.

Payment by Results in Development Aid: All That Glitters Is Not Gold - Clist, Paul (The World Bank Research Observer, 2016)
Payment by Results (PbR), where aid is disbursed conditional upon progress against a pre-agreed measure, is becoming increasingly important for various donors. There are great hopes that this innovative instrument will focus attention on ultimate outcomes and lead to greater aid effectiveness by passing the delivery risk on to recipients. However, there is very little related empirical evidence, and previous attempts to place it on a sure conceptual footing are rare and incomplete. This article collates and synthesises relevant insights from a wide range of subfields in economics, providing a rich framework with which to analyze Payment by Results. I argue that the domain in which it dominates more traditional forms is relatively small and if it is used too broadly, many of the results it claims are likely to be misleading. The likelihood of illusory gains stems from the difficulty of using a single indicator to simultaneously measure and reward performance: ‘once a measure becomes a target, it ceases to be a good measure.’ This does not mean PbR should not be used (indeed it will be optimal in some settings), but it does mean that claims of success should be treated with caution.
Keywords: Conditionality; Contract theory; F35; Foreign Aid; Multitask model; performance

Insights for Influence: Understanding Impact Pathways in Crisis Response - Clark, Louise; Carpenter, Jo; Taylor, Joe (Institute of Development Studies, 2023)
The Covid-19 Responses for Equity (CORE) programme was a three-year initiative funded by the Canadian International Development Research Centre (IDRC) that brought together 20 projects from across the global South to understand the socioeconomic impacts of the Covid-19 pandemic, improve existing responses, and generate better policy options for recovery. The research covered 42 countries across Africa, Asia, Latin America, and the Middle East to understand the ways in which the pandemic affected the most vulnerable people and regions, and deepened existing vulnerabilities. Research projects covered a broad range of themes, including macroeconomic policies for support and recovery; supporting essential economic activity and protecting informal businesses, small producers, and women workers; and promoting democratic governance to strengthen accountability, social inclusion, and civil engagement. The Institute of Development Studies (IDS) provided knowledge translation (KT) support to CORE research partners to maximise the learning generated across the research portfolio and deepen engagement with governments, civil society, and the scientific community. As part of this support, the IDS KT team worked with CORE project teams to reconstruct and reflect on their impact pathways to facilitate South-South knowledge exchange on effective strategies for research impact, and share learning on how the CORE cohort has influenced policy and delivered change. This report presents an overview of these impact pathways and the lessons learnt from a selection of the projects chosen to represent the diversity of approaches to engage policymakers, civil society, and the media to generate and share evidence of the effect of the pandemic on diverse vulnerable groups.

Civic Technologies as tools for change: Is balance between online and offline actions a necessary condition for achieving social change through civic innovation? - Civic Innovation Accelerator Fund (Evaluation Report, 2016)
Keywords: IMPORTANT

A workshop on Doing Development Differently - CID (CID at Harvard University and ODI, 2014)
October 22-23, 2014 A workshop on Doing Development Differently Harvard Kennedy School, Cambridge, MA Hosted by the Building State Capability (BSC) program at the Center for International Development at Harvard University, and the Overseas Development Institute (ODI) with funding from the Governance Partnership Facility.

Summer school on Adaptive Management - 2019 - CID (2019)
General description of the curriculum

The Dilemmas of Citizen Inclusion in Urban Planning and Governance to Enable a 1.5 °C Climate Change Scenario - Chu, Eric; Schenk, Todd; Patterson, James (Urban Planning, 2018)
Cities around the world are facilitating ambitious and inclusive action on climate change by adopting participatory and collaborative planning approaches. However, given the major political, spatial, and scalar interdependencies involved, the extent to which these planning tools equip cities to realise 1.5 °C climate change scenarios is unclear. This article draws upon emerging knowledge in the fields of urban planning and urban climate governance to explore complementary insights into how cities can pursue ambitious and inclusive climate action to realise 1.5 °C climate change scenarios. We observe that urban planning scholarship is often under-appreciated in urban climate governance research, while conversely, promising urban planning tools and approaches can be limited by the contested realities of urban climate governance. By thematically reviewing diverse examples of urban climate action across the globe, we identify three key categories of planning dilemmas: institutional heterogeneity, scalar mismatch, and equity and justice concerns. We argue that lessons from urban planning and urban climate governance scholarship should be integrated to better understand how cities can realise 1.5 °C climate change scenarios in practice.

The Governance of Climate Change Adaptation Through Urban Policy Experiments - Chu, Eric K. (Environmental Policy and Governance, 2016)
Climate change is increasingly posing risks to infrastructure and public services in cities across the global South. Building on ideas of policy experimentation at the nexus of institutional and transition theories, this paper assesses six climate change adaptation experiments across the cities of Surat, Indore and Bhubaneswar in India to uncover the politics behind how experiments are conceived of, implemented, and supported in light of local development needs. Through employing both embedded and cross-case comparative methods, I argue that policy experiments are often framed around achieving tangible urban economic benefits and maximizing specific project complementarities, which allow emerging adaptation priorities access to established policy directives and funding streams. However, I conclude that despite being arenas for testing new ideas, quantifying climate and development co-benefits, and engaging private and civil society actors, adaptation policy experiments must be coherent with urban political economic contexts in order for them to affect sustained, equitable and transformative programmatic change. Copyright © 2016 John Wiley & Sons, Ltd and ERP Environment
Keywords: Climate change adaptation; India; Policy experiments; urban governance; urban planning

Urban climate adaptation and the reshaping of state–society relations: The politics of community knowledge and mobilisation in Indore, India - Chu, Eric K (Urban Studies, 2018)
Current research on climate change adaptation in cities highlights the role of local governments in facilitating adaptation actions, but rarely assesses whether (and if so, how) local communities organise around emerging climate priorities to affect political change. This paper explores changing state–society relationships through the reconstitution of community collectives and advocacy organisations for advancing climate change adaptation in the Indian city of Indore. The paper shows that communities are indeed recognising the need for adaptation but are, at the same time, integrating adaptation actions with existing strategies for advocating development rights. Communities are also rebuilding alliances between municipal and local institutions for public service and infrastructure provision, which point to the centrality of community politics in urban climate adaptation processes. However, such mobilisations are often dependent on existing political networks and a legacy of advocacy around poverty alleviation needs, which sideline more transformative agendas around inclusiveness, equity, and resilient urban futures.

Adaptive Programming in Fragile, Conflict and Violence-Affected Settings, What Works and Under What Conditions?: The Case of Pyoe Pin, Myanmar - Christie, Angela; Green, Duncan (Action for Empowerment and Accountability Research Programme, 2018)
This paper examines adaptive approaches in aid programming in a fragile, conflict and violence-affected setting (FCVAS), namely Myanmar. A combination of desk review and field research has been used to examine some of the assertions around the ‘adaptive management’ approach, which has arisen in recent years as a response to critiques of overly rigid, pre-designed, blue-print and linear project plans. This paper explores if and how adaptive approaches, including rapid learning and planning responses (fast feedback loops and agile programming) are particularly relevant and useful for promoting empowerment and accountability in such ‘messy places’. This case study focuses on Pyoe Pin (‘Young Shoots’), a DFID-funded, British Council managed governance programme, which has been running since 2007.
Keywords: A4EA; Adaptive Development; Economy; Fishery

The Case for an Adaptive Approach to Empowerment and Accountability Programming in Fragile Settings: Synthesis report - Christie, Angela; Green, Duncan (Action for Empowerment and Accountability Research Programme, 2019)
Fragile, conflict and violence-affected settings (FCVAS) are messy and ambiguous contexts in which to plan and implement development initiatives. To work there, external actors are increasingly adopting an adaptive approach to empowerment and accountability (E&A) programming, whatever the setting. This means using a compass rather than map, where real-time political economy analysis (PEA) in relation to context and programme monitoring and evidence-informed learning in relation to intervention are used in combination and in shorter-than-usual planning cycles to maintain and adapt strategic direction. This paper brings together three case studies of large Department for International Development (DFID) governance projects in Myanmar, Nigeria and Tanzania.
Keywords: A4EA; Adaptive Development; Economy; Fishery

The Role of External Actors in Supporting Social and Political Action towards Empowerment and Accountability with a Focus on Fragile, Conflict- and Violence-Affected Settings - Christie, Angela; Burge, Richard (IDS Working Paper 503, 2017)
This paper explores the role and experience of external actors, particularly donors, in supporting social and political action in fragile, conflict and violence affected settings. Evidence is distilled from a wide range of synthesised sources to generate relevant findings and questions in relation to what we know and what we don’t. Included among the source material is a 2016 macro-evaluation of DFID’s empowerment and accountability (E&A) programmes which examined over 50 DFID funded projects. Themes which emerge relate to: how external actors need to think about the context and work politically; who are the most appropriate social and political actors to support in E&A; whether a direct or indirect approach to support for E&A achieves more tangible outcomes; whether external actors should move beyond short-term tools and tactics focused on one-sided engagement; and whether programmes should be designed around more strategic, multi-faceted interventions. The paper concludes with identifying a number of gaps in the evidence which are translated into a range of questions which could potentially inform the Action for Empowerment and Accountability (A4EA) research programme.

What Is Disruptive Innovation? - Christensen, Clayton M.; Raynor, Michael E.; McDonald, Rory (Harvard Business Review, 2015)
For the past 20 years, the theory of disruptive innovation has been enormously influential in business circles and a powerful tool for predicting which industry entrants will succeed. Unfortunately, the theory has also been widely misunderstood, and the “disruptive” label has been applied too carelessly anytime a market newcomer shakes up well-established incumbents. In this article, the architect of disruption theory, Clayton M. Christensen, and his coauthors correct some of the misinformation, describe how the thinking on the subject has evolved, and discuss the utility of the theory. They start by clarifying what classic disruption entails—a small enterprise targeting overlooked customers with a novel but modest offering and gradually moving upmarket to challenge the industry leaders. They point out that Uber, commonly hailed as a disrupter, doesn’t actually fit the mold, and they explain that if managers don’t understand the nuances of disruption theory or apply its tenets correctly, they may not make the right strategic choices. Common mistakes, the authors say, include failing to view disruption as a gradual process (which may lead incumbents to ignore significant threats) and blindly accepting the “Disrupt or be disrupted” mantra (which may lead incumbents to jeopardize their core business as they try to defend against disruptive competitors). The authors acknowledge that disruption theory has certain limitations. But they are confident that as research continues, the theory’s explanatory and predictive powers will only improve.

Holistic Flexibility for Deploying Systems Thinking as a Cognitive Skill - Chowdhury, Rajneesh (Systemic Practice and Action Research, 2023)
Considering Systems Thinking (ST) as a cognitive skill can create greater acceptability of and openness to the discipline from practitioners and researchers outside operations research and management science. Rather than associating ST with frameworks and methodologies, ST as a cognitive skill can help popularize and democratize the discipline. This paper highlights how the conceptual lens of Holistic Flexibility can help practitioners deploy ST as a cognitive skill without the application of any traditional systems methodology. Holistic Flexibility is defined as the dynamic interplay between a state of mind that has the ability to absorb systemic complexity and a state of practice that has the ability to embrace flexibility, both in intent and in form. Through two case-studies, discussions in this paper highlight how Holistic Flexibility can serve as a conceptual lens for systems practitioners. The case-studies demonstrate the importance of a practitioner’s ability to seamlessly manage and work with multiple variables, stakeholders, and factors to deliver responsible outcomes with the aid of learning loops. The main contribution of this paper lies in the case-studies and analyses presented that provide use cases for Holistic Flexibility in ST, which will help address recent calls in the discipline for ST to be considered as a cognitive skill.

The journey from rhetoric to reality: participatory evaluation in a development context - Chouinard, Jill Anne; Cousins, J. Bradley (Educational Assessment, Evaluation and Accountability, 2015)
In this paper, we focus on participatory evaluation in the context of international development and specifically on the emerging empirical knowledge base. In a prior review and critique of research on participatory evaluation (Cousins and Chouinard 2012), we examined 121 studies, with only 21 (17 %) situated in development contexts. However, the circumstances and challenges for international development and for development evaluation are distinct from those found in developed countries and therefore warrant separate consideration. To provide a more focused and detailed understanding of participatory evaluation in international development contexts, in this paper we augment our initial sample to a total of 40 studies on participatory evaluation in development published over the past 16.5 years. Based on an analysis of this research and related theoretical and conceptual contributions we identify and discuss eight emergent themes: multiplicity of relationships, consequences of stakeholder selection, characterization of participation, contextual complexity, methodological requirements, cultural influence, politics and power and learning and capacity building. We conclude with some reflections on an agenda for research.

The Future of Development: “Make Happen” with Portfolios of Options - CHÔRA Foundation (CHÔRA Foundation, 2021)
This Green Paper intends to review key elements of the problem that Development actors will confront as a new decade opens up ahead of us. It will articulate a solution that we believe should become an inherent feature of Development programs and initiatives. This is the outcome of an intense period of experiences and reflections in the Development space across different geographies and institutional mandates and activities, during which the Foundation has collaborated with institutions such as the UNDP and Grand Challenges Canada. At the heart of our collaborations is a Strategic Innovation and System Transformation Framework, with its associated concepts, working definitions, processes, tools and people. Sourced from CHÔRA Foundation’s knowledge and practice assets, this is a capability we intend to make relevant, customise, scale up and distribute to our partners and stakeholders. We are looking to create with them a space that offers the world a transformational capability. Central to this capability we see a distinctive and robust practice: the design and dynamic management of Portfolios of Strategic Innovation and System Transformation Options. These Portfolios are unique, context relevant, embedded mechanisms for learning, sensemaking and problem solving that social systems leverage to have an impact on themselves and their problems, and to induce the transformations that are necessary to them. It is our view that Portfolios of Options are the most effective means by which human social systems can supply themselves with budgets of possibility that ensure choice and create opportunity. They will also support pragmatic evolutionary outcomes and enable resilience.

Practical Program Evaluation: Theory-Driven Evaluation and the Integrated Evaluation Perspective - Chen, Huey (SAGE Publications, Inc, 2014)
The Second Edition of Practical Program Evaluation shows readers how to systematically identify stakeholders’ needs in order to select the evaluation options best suited to meet those needs. Within his discussion of the various evaluation types, Huey T. Chen details a range of evaluation approaches suitable for use across a program’s life cycle. At the core of program evaluation is its body of concepts, theories, and methods. This revised edition provides an overview of these, and includes expanded coverage of both introductory and more cutting-edge techniques within six new chapters. Illustrated throughout with real-world examples that bring the material to life, the Second Edition provides many new tools to enrich the evaluator’s toolbox.

Natural Disaster Monitoring with Wireless Sensor Networks: A Case Study of Data-intensive Applications upon Low-Cost Scalable Systems - Chen, Dan; Liu, Zhixin; Wang, Lizhe; Dou, Minggang; Chen, Jingying; Li, Hui (Mobile Networks and Applications, 2013)
The wireless sensor network (WSN) technology has applied in monitoring natural disasters for more than one decade. Disasters can be closely monitored by augmenting a variety of sensors, and WSN has merits in (1) low cost, (2) quick response, and (3) salability and flexibility. Natural disaster monitoring with WSN is a well-known data intensive application for the high bandwidth requirements and stringent delay constraints. It manifests a typical paradigm of data-intensive application upon low-cost scalable system. In this study, we first assessed representative works in this area by classifying those in the domains of application of WSNs for disasters and optimization technologies significantly distinguishing these from general-purpose WSNs. We then described the design of an early warning system for geohazards in reservoir region, which relies on the WSN technology inspired by the existing work with focuses on issues of (1) supporting reliable data transmission, (2) handling huge data of heterogeneous sources and types, and (3) minimizing energy consumption. This study proposes a dynamic routing protocol, a method for network recovery, and a method for managing mobile nodes to enable real-time and reliable data transmission. The system incorporates data fusion and reconstruction approaches to bring together all data into a single view of the geohazard under monitoring. A distributed algorithm for joint optimal control of power and rate has been developed, which can improve utility of network (> 95 %) and to minimize the energy consumption (reduction by > 20 % in comparison with LEACH). Experimental results indicate the potentials of the proposed approaches in terms of adapting to the needs of early warning on geohazards.
Keywords: Data-intensive application; Geohazard; Natural disaster monitoring; Scalable system; Wireless sensor network

Changes for Justice Project - Final Report - Chemonics International (USAID, 2015)

Strengthening Advocacy and Civic Engagemetn in Nigeria - Chemonics (Chemonics International, 2018)

Causal inferences on the effectiveness of complex social programs: Navigating assumptions, sources of complexity and evaluation design challenges - Chatterji, Madhabi (Evaluation and Program Planning, 2016)
This paper explores avenues for navigating evaluation design challenges posed by complex social programs (CSPs) and their environments when conducting studies that call for generalizable, causal inferences on the intervention’s effectiveness. A definition is provided of a CSP drawing on examples from different fields, and an evaluation case is analyzed in depth to derive seven (7) major sources of complexity that typify CSPs, threatening assumptions of textbook-recommended experimental designs for performing impact evaluations. Theoretically-supported, alternative methodological strategies are discussed to navigate assumptions and counter the design challenges posed by the complex configurations and ecology of CSPs. Specific recommendations include: sequential refinement of the evaluation design through systems thinking, systems-informed logic modeling; and use of extended term, mixed methods (ETMM) approaches with exploratory and confirmatory phases of the evaluation. In the proposed approach, logic models are refined through direct induction and interactions with stakeholders. To better guide assumption evaluation, question-framing, and selection of appropriate methodological strategies, a multiphase evaluation design is recommended.
Keywords: Causal inferences; Complex social programs; Experimental designs; Impact evaluations; Mixed methods

Theory of Change in complex Research for Development programmes: challenges and solutions from the Global Challenges Research Fund - Chapman, Sarah; Boodhoo, Adiilah; Duffy, Carren; Goodman, Suki; Michalopoulou, Maria (The European Journal of Development Research, 2023)
The United Kingdom Research and Innovation (UKRI) Global Challenges Research Fund (GCRF) aimed to address global challenges to achieve the United Nations (UN) Sustainable Development Goals through 12 interdisciplinary research hubs. This research documents key lessons learned around working with Theory of Change (ToC) to guide Monitoring, Evaluation and Learning (MEL) within these complex research for development hubs. Interviews and document reviews were conducted in ten of the research hubs. The results revealed that only one hub invested in an explicit visual system mapping approach, and that funder timelines, budget constraints and issues with capacity and expertise limited the application of these approaches across all hubs. In contrast, many hubs attempted to deal with visual complexity by means of ether constructing multiple, nested ToCs, or a conscious simplification of complexity through reducing their ToC towards a straightforward and uncomplicated chain model or spherical model. While the former approach had some value, most hubs struggled to find capacity to support the full articulation of nested ToCs. In contrast, the latter approach resulted in ToCs which lacked detail or mechanism articulation, but which nevertheless were often ‘fit for purpose’ in ensuring effective communication and coherence across diverse stakeholders and sub-projects. We conclude that in instances where the reporting, funding and management cycles of complex research for development programmes cannot be adapted to properly support learning-based approaches to ToC development, imposing simplicity in the ToC might be fit for purpose. This might also be preferable to more complex visual approaches that are only partially realised.

System Failure: Why Governments Must Learn to Think Differently - Chapman, Jake (Demos, 2004)
The current model of public policy-making is no longer right for a government that has set itself the challenge of delivery. Improvements are driven by central policy initiatives which assume a direct relationship between action and outcome - but this is a false assumption. Public services are complex adaptive systems which are subject to the law of unintended consequences, so intervention can make problems worse. That is why the carrot-and-stick approach to reform which links increased funding to tougher performance targets will not succeed in the long run. Renowned systems thinker Jake Chapman describes how government's energetic attempts to force change from the centre are becoming counter-productive. The alternative is government based on continuous learning. This is increasingly important as the impact of communication technology and other accelerating social trends offers a moving target for public service reformers. Systems thinking offers a better model for change in complex organisations such as the health service or the railway network. Case studies provided by the NHS confederation show the unintended and often bizarre consequences of introducing new policies without considering their impact on the whole system. Since the original publication of Systems Failure in 2002, many of its core ideas have been taken on by government. In this second edition, Chapman reflects on the experience of putting systems thinking into practice in public services, and explains why the changes he suggests are more difficult - and more urgent - than expected.

Partnering with communities to co-design humanitarian health strategies: A SeeChange CommunityFirst Framework for implementation in MSF projects - Chapela Trillo, Violeta; Farber, Jessica (MSF, 2034)
The CommunityFirst Framework is intended to be implemented by field teams at MSF. The theoretical aspects and evidence presented on the importance of community engagement are intended for all MSF staff seeking to learn more about why and how to shift the way we work with communities as humanitarians. We believe this guideline, and other tools like it (including OCA’s Person-Centred Approach Guidance07, and MSF Vienna Evaluation Unit’s Guidance for Involving Communities08), to be an important contribution to the growing movement of communities and humanitarian actors who are pushing for changes in the humanitarian system that translate to dignity, health, justice, equity and self-determination for communities around the world. Specifically, the CommunityFirst Framework is intended to guide MSF teams to co-design health strategies with communities, throughout all stages of the project cycle, for exploratory missions, projects that are just opening, projects that have been running for some time, or those that are closing. At the time of publication, the CommunityFirst Framework has been tested in pilot projects in: (1) Madre de Dios, Peru (MSF OCP, August 2022), (2) Tonkolili, Sierra Leone (MSF OCA, November 2022) and (3) Anzoátegui, Venezuela (MSF OCB, February 2023) The experiences from these pilots (feedback from teams, implementation results, adaptations to each context, etc.) have informed the adaptation of the Framework. CommunityFirst builds on existing community engagement work inside MSF and contributes a practical framework for co-designing health initiatives with communities. To avoid duplicating efforts and resources around community engagement inside MSF, the appendices in this guideline largely refer to already existing MSF resources.09 This guideline is meant to be a living document that can evolve and be adapted given the experience of MSF staff and community members and diverse community contexts. This guide can be used by anyone in MSF who is interested in partnering with communities to improve the responsiveness and impact of their humanitarian programs. This is the first iteration of the document. Subsequent iterations will be published based on additional testing during future phases of the CommunityFirst TIC project.

Changeroo - Theory of Change platform - Changeroo (2020)
Changeroo assists organisations, programs and projects with a social mission to develop and manage high-quality Theories of Change. It allows you to - together with stakeholders co-create Theories of Change, and - present these in an interactive and engaging way. It helps keep a Theory of Change alive, enables reflective monitoring, and supports capacity building among social organisations. Changeroo helps you utilize your Theory of Change for strategic learning, communication, stakeholder engagement, impact measurement, scaling, planning, monitoring and evaluation. Thus you build a culture of critical thinking, constant analysis, co-creation and continuous learning. In sum, a truly strategic approach to societal value creation that helps you to assist your target groups to flourish!

Theory of Change: From novice to master changemaker - Changeroo (2020)
Theory of Change is more than just a tool or instrument. It is a mindset! A mindset to optimise impact management. As the cornerstone of impact management it is indispensable to any purpose-driven organisation targeting social or environmental value creation. It offers you the cornerstone of a learning approach toward change and impact. A way to build a mindset and organisational culture of critical reflection, co-creation with stakeholders and constant analysis of what works, why, for whom and under what circumstances. Are you ready to take impact management to the next level with the help of Theory of Change? We offer you the premier online course to learn everything about this approach.

Rapid Action Learning for Sanitation and Hygiene Programming - Chambers, Robert; Myers, Jamie; Vernon, Naomi (Frontiers of Sanitation, 2020)
There is a glaring gap and compelling need for approaches and methods that realign to new rigour through timeliness, cost-effectiveness, relevance and being actionable. Over the past few years, the Sanitation Learning Hub, in collaboration with the Government of India, Praxis, WSSCC and WaterAid India, have been developing Rapid Action Learning approaches. Multiple approaches have been trialled, with flexible formats, but the essential criteria is that learning is timely, relevant and actionable. These learning approaches are the focus of the latest edition of the Frontiers of Sanitation series. This Frontiers explains the advantages and disadvantages of the approaches trialled and sets out a challenge to those working in the water, sanitation and hygiene sector to: Reflect on what, for you, constitutes rigour. Adopt and adapt approaches to fit your context and needs. Develop your own approaches. Record your experiences and lessons learnt. Take the time to share your experiences with us

3. Reflections and directions: a personal note - Chambers, Robert (Participatory Learning and Action 50: Critical reflections, future directions, 2004)

Can we know better? Reflections for Development - Chambers, Robert (Practical Action, 2017)
This book is intended for all who are committed to human wellbeing and who want to make our world fairer, safer and more fulfilling for everyone, especially those who are 'last'. It argues that to do better we need to know better. It provides evidence that what we believe we know in international development is often distorted or unbalanced by errors, myths, biases and blind spots. Undue weight has been attached to standardised methodologies such as randomized control trials, systematic reviews, and competitive bidding: these are shown to have huge transaction costs which are rarely if ever recognized in their enormity. Robert Chambers contrasts a Newtonian paradigm in which the world is seen and understood as controllable with a paradigm of complexity which recognizes that the real world of social processes and power relations is messy and unpredictable. To confront the challenges of complex and emergent realities requires a revolutionary new professionalism. This is underpinned by a new combination of canons of rigour expressed through eclectic methodological pluralism and participatory approaches which reverse and transform power relations. Promising developments include rapid innovations in participatory ICTs, participatory statistics, and the Reality Check Approach with its up-to-date and rigorously grounded insights. Fundamental to the new professionalism, in every country and context, are reflexivity, facilitation, groundtruthing, and personal mindsets, behaviour, attitudes, empathy and love. Robert Chambers surveys the past world of international development, and his own past views, with an honest and critical eye, and then launches into the world of complexity with a buoyant enthusiasm. He draws on almost six decades of experience in varied roles in Africa, South Asia and elsewhere as practitioner, trainer, manager, teacher, evaluator and field researcher, also working in UNHCR and the Ford Foundation. He is a Research Associate and Emeritus Professor at the Institute of Development Studies, University of Sussex, his base for many years. Can We Know Better? is essential reading for researchers and students of development, for policy makers and evaluators, and for all those working towards the better world of the Sustainable Development Goals.

Debiasing: a systematic discipline and delight for development professionals - Chambers, Robert (Institute of Development Studies, 2018)
Do we really need debiasing, yet another word?  Yes, unless anyone can improve on it, because we need a word to describe a rigorous discipline we development professionals need for grounded realism. This has been coming on me slowly. But now explorations and ‘aha!’ moments in India have accumulated and combined into an epiphany.  For […]

From PRA to PLA and pluralism: practice and theory - Chambers, Robert (2007)
PRA (participatory rural appraisal) and the more inclusive PLA (participatory learning and action) are families of participatory methodologies which have evolved as behaviours and attitudes, methods, and practices of sharing. During the 1990s and 2000s PRA/PLA has spread and been applied in most countries in the world. Among the multifarious domains of application, some of the more common have been natural resource management and agriculture, programmes for equity, empowerment, rights and security, and community-level planning and action. Related participatory methodologies which have co-evolved and spread widely as movements include farmer participatory research, Integrated Pest Management, Reflect, Stepping Stones and Participatory Geographic Information Systems. Ideologically and epistemologically PRA/PLA seeks and embodies participatory ways to empower local and subordinate people, enabling them to express and enhance their knowledge and take action. It can be understood as having three main components: facilitators’ behaviours, attitudes and mindsets linked with precepts for action; methods which combine visuals, tangibles and groups; and sharing without boundaries. The interplay of these resonates with theories of chaos, complexity, emergence and deep simplicity, especially self-organising systems on the edge of chaos. Good practice has moved towards an eclectic pluralism in which branding, labels, ownership and ego give way to sharing, borrowing, improvisation, creativity and diversity, all these complemented by mutual and critical reflective learning and personal responsibility. Keywords: participatory methodologies; networks; pluralism; practice; theory.

Ideas for Development - Chambers, Robert (Routledge, 2005)
Our world seems entangled in systems increasingly dominated by power, greed, ignorance, self-deception and denial, with spiralling inequity and injustice. Against a backdrop of climate change, failing ecosystems, poverty, crushing debt and corporate exploitation, the future of our world looks dire and the solutions almost too monumental to consider. Yet all is not lost. Robert Chambers, one of the ?glass is half full? optimists of international development, suggests that the problems can be solved and everyone has the power at a personal level to take action, develop solutions and remake our world as it can and should be. Chambers peels apart and analyses aspects of development that have been neglected or misunderstood. In each chapter, he presents an earlier writing which he then reviews and reflects upon in a contemporary light before harvesting a wealth of powerful conclusions and practical implications for the future. The book draws on experiences from Africa, Asia and elsewhere, covering topics and concepts as wide and varied as irreversibility, continuity and commitment; administrative capacity as a scarce resource; procedures and principles; participation in the past, present and future; scaling up; behaviour and attitudes; responsible wellbeing; and concepts for development in the 21st century.

Inclusive rigour for complexity - Chambers, Robert (Journal of Development Effectiveness, 2015)
Rigour can be reductionist or inclusive. To learn about and understand conditions of complexity, emergence, nonlinearity and unpredictability, the inclusive rigour of mixed methods has been a step in the right direction. From analysis of mixed methods and participatory approaches and methods, this article postulates canons for inclusive rigour for research and evaluation for complexity: eclectic methodological pluralism; improvisation and innovation; adaptive iteration; triangulation; plural perspectives; optimal ignorance and appropriate imprecision; and being open, alert and inquisitive. Inclusive rigour is inherent in participatory methods and approaches, visualisations, group-visual synergy, the democracy of the ground and participatory statistics. Transparent reflexivity, personal behaviour and attitudes, and good facilitation are fundamental. Fully inclusive rigour for complexity demands many personal, institutional and professional revolutions.
Keywords: Evaluation; Mixed methods; Participatory methodologies; Research; paradigm; rigour

Into the unknown: explorations in development practice - Chambers, Robert (Practical Action Publishing, 2014)
Into the Unknown reflects on the journey of learning, and encourages readers to learn from observation, curiosity, critical feedback, play and fun. This book will be of interest to development professionals, including academics, students, NGO workers and the staff of international agencies

Paradigms, Poverty and Adaptive Pluralism - Chambers, Robert (IDS, 2010)
This paper explores participatory methodologies (PMs) associated with a paradigm of people, contrasted with a dominant paradigm associated with things.

Perverse Payment by Results: frogs in a pot and straitjackets for obstacle courses - Chambers, Robert (IDS - Participation, Power and Social Change, 2014)
Posts about Robert Chambers written by idsppsc

Poverty Unperceived: Traps, Biases and Agenda - Chambers, Robert (IDS Working Paper 270, 2006)

Rapid Action Learning and COVID-19 - Chambers, Robert (Sanitation Learning Hub, 2020)
A-ha! A moment etched in my memory: 20 or so researchers were...

Towards informed and multi-faceted wildlife trade interventions - Challender, Daniel W.S.; Harrop, Stuart R.; MacMillan, Douglas C. (Global Ecology and Conservation, 2015)
International trade in wildlife is a key threat to biodiversity conservation. CITES, the Convention on International Trade in Endangered Species of Wild Fauna and Flora, seeks to ensure international wildlife trade is sustainable, relying on trade bans and controls. However, there has been little comprehensive review of its effectiveness and here we review approaches taken to regulate wildlife trade in CITES. Although assessing its effectiveness is problematic, we assert that CITES boasts few measurable conservation successes. We attribute this to: non-compliance, an over reliance on regulation, lack of knowledge and monitoring of listed species, ignorance of market forces, and influence among CITES actors. To more effectively manage trade we argue that interventions should go beyond regulation and should be multi-faceted, reflecting the complexity of wildlife trade. To inform these interventions we assert an intensive research effort is needed around six key areas: (1) factors undermining wildlife trade governance at the national level, (2) determining sustainable harvest rates for, and adaptive management of CITES species, (3) gaining the buy-in of local communities in implementing CITES, (4) supply and demand based market interventions, (5) means of quantifying illicit trade, and (6) political processes and influence within CITES.
Keywords: CITES; Community conservation; Compliance; Economics; Regulation; Wildlife trade

Change: How to Make Big Things Happen - Centola, Damon (Little, Brown Spark, 2021)
How to create the change you want to see in the world using the paradigm-busting ideas in this "utterly fascinating" (Adam Grant) big-idea book.​ Most of what we know about how ideas spread comes from bestselling authors who give us a compelling picture of a world, in which "influencers" are king, "sticky" ideas "go viral," and good behavior is "nudged" forward. The problem is that the world they describe is a world where information spreads, but beliefs and behaviors stay the same. When it comes to lasting change in what we think or the way we live, the dynamics are beliefs and behaviors are not transmitted from person to person in the simple way that a virus is. The real story of social change is more complex. When we are exposed to a new idea, our social networks guide our responses in striking and surprising ways. Drawing on deep-yet-accessible research and fascinating examples from the spread of coronavirus to the success of the Black Lives Matter movement, the failure of Google+, and the rise of political polarization, Change presents groundbreaking and paradigm-shifting new science for understanding what drives change, and how we can change the world around us.

Participation by All - The keys to sustainability of a CRS food security project in Niger - Cekan, Jindra; Kagendo, Rutere; Towns, Alexandra (Valuing Voices, 2016)
This project that ran from 2006-2012 in Niger and was implemented by three NGOs: CRS, Cooperative for Assistance and Relief Everywhere (CARE), and Helen Keller International (HKI) under the direction of United States Agency for International Development (USAID) Office of Food for Peace (FFP) as a multi-year assistance program (MYAP) to support food security activities in the Dosso, Tahoua, and Zinder regions. PROSAN focused on increasing agricultural production and agro-enterprise, improving household health and nutrition status, reinforcing the capacities of health agents, and enhancing community resiliency. Here are the highlights from the report which itself is an excerpt from a longer analysis we did. Also please note one Annex highlights the similarlties/ differences we found to USAID/ FFP’s 4 elements of sustainability: AIM, METHODS, AND RESEARCH QUESTIONS The aim of this sustainability evaluation was to explore perceptions of sustainability from Nigeriens involved in PROSAN, former CRS staff and donors. It focused on evaluating participants’ adherence to project outcomes and their creation of new innovations. It also evaluated partners’ involvement in sustaining project outcomes. This evaluation used qualitative and quantitative methods including community mapping, focus group discussions, beneficiary interviews, and key stakeholder interviews. The evaluation was carried out in six communities in the Dosso region, with more than 500 interviewees, focusing on the following research questions: Sustainability of activities and groups: Are the communities sustaining the activities three to five years after the end of the project? What can we learn from the communities and their post-project implementation partners? Spread and unexpected outcomes: If the project was considered a success in the eyes of the community, how well did it spread? Fostering Sustainability: What are the long-term prospects for continued sustainability? FINDINGS Three years after PROSAN’s conclusion, the project was considered a success by community members, national partners, the implementer (CRS), and donor (USAID) staff. The main findings include: 1. SUSTAINABILITY OF ACTIVITIES AND GROUPS Eighty percent (80%)[*] of all activities were reported to have become self-sustained and community innovations have emerged: On average, households reported moving from being food secure for 3-6 months per year during PROSAN to 8-12 months at the time of this evaluation, which is a remarkable impact [1]. CRS_Niger_PROSAN_Sustainability_Evaluation_pdf [1] Women reported greater income through the increase in sales of food that was produced and processed due to the grain mills [1]. Respondents also reported improved household health, hygiene, and nutrition, with 91% of survey respondents indicating that their health and sense of well being had improved, especially through the efforts of the health posts and clinics that CRS helped build and the government of Niger’s efforts in sustaining them with resources and staff [1]. Community groups/committees have continued and are well-supported by NGO partners: 81% of the committees set up by PROSAN were functioning at the time of this evaluation, with many participants discussing ways to sustain best practices within their communities, and members still receiving regular trainings or updates [1]. Several new and refresher trainings come through national partners, NGOs, and new channels such as radio programs [1]. Some new NGOs and international organizations have built upon PROSAN’s success, for instance, by using land previously managed by PROSAN for a new vegetable gardening training program, building hygiene programs on past health awareness efforts, or extending agricultural credit for further inputs [1]. Twenty percent (20%) of implemented activities were not sustained or have stagnated: While hygiene practices were sustained by households and there was widespread latrine construction, sanitation was poor in the villages, and most latrines had fallen into disrepair [1]. Fewer than 50% of women reported practicing exclusive breastfeeding for children less than six months of age [1]. While almost half of all health committees no longer exist, new health clinics staff have replaced some of the work of the committees with health and agricultural promotion messages now being sent via radio, television, and cell phones [1]. Literacy training and theater groups have completely ceased [1]. With the exception of the Système Communautaire d’Alerte Précoce-Réponses aux Urgences’ (SCAP-RU) SCAP-RU early warning system which has expanded, other resilience activities such as roadwork and caring for the environment are a lesser priority due in part to the lack of food and cash-incentives to continue doing them [1]. 2. SPREAD AND UNEXPECTED OUTCOMES New innovations and ceased activities reflected the project’s legacy: Community innovations have emerged such as collective funds paying for cleaners of the new health center, community-imposed sanctions for births occurring outside of the health centers, and the monitoring of savings from well water sales. National partners have praised the project, with many lamenting its withdrawal. One non-PROSAN village told an Agriculture Ministry staff and potential NGO partner that “No one should bring a program here unless it is like PROSAN.” PROSAN-trained masons, well repair technicians, and village youth have learned land recuperation techniques (zai holes, bunds and demi-lunes) that helped generate income beyond project communities. Project activities that received free inputs have largely stopped being implemented once the incentives were withdrawn such as Food for Training (FFT), Food for Work (FFW), or Cash for Work (CFW) (e.g. literacy, seedlings, latrines, theater etc.); nonetheless the inputs were highly valued and have continued to support agriculture and health (carts, bicycles). 3. FOSTERING SUSTAINABILITY The following areas were identified as potential barriers to sustainability that could be systematically explored in other projects: Although most committees are still functioning, there are no processes in place to engage and train youth and new inhabitants of the villages. While village communities have been maintained, there is an increasing lack of ministry resources (e.g., staff, transportation, and communications) to take the place of NGOs like CRS after a program ends. There is little management of knowledge around project data, which is further exacerbated by staff changes in NGOs, government ministries, and donors. Project data (proposal content, monitoring data, evaluation results, participant lists, partner names, and exit agreements) must be managed ethically, locally and be held online, accessible for future projects to use and for villages to conduct self-evaluations.

Exit for Sustainability Checklists - Cekan, Jindra (Valuing Voices, 2020)
These Checklists for Exit along the Sustainability Project Cycle are based on lessons from ex-post evaluations that Valuing Voices has done or researched. Ex-post project completion evaluations are rare and even more so those that consulted partners and participants in the field about sustained impacts. Over $3.5 trillion has been spent on public foreign aid projects in the past 70 years (OECD 2019) yet we have evaluated less than 1% of these projects for sustainability. Our Valuing Voices ex-post research of 39 organizations’ evaluations of sustainability shows that most project results decrease (20-90%) as early as two years ex-post in addition to An Asian Development Bank study of post-completion sustainability found that “some early evidence suggests that as many as 40% of all new activities are not sustained beyond the first few years after disbursement of external funding,” Most project exits are in the last quarter and sustainability handover assumptions are not validated expost. Learning from what was sustained helps us know how to exit for sustainability from the very onset of the project (green slices) as compared to the typical project cycle (orange), above. We encourage those tasked with funding, designing, implementing, monitoring & evaluating projects to use these longer checklists and view the full recording shared with participants. A partial PowerPoint can also be found on „Sustaining All of our Hard Work“ presentation for the Vienna Evaluation Network (10/20). These checklists are aimed at donors/designers and implementers of foreign aid projects outcomes and impacts and can be adapted by local NGOs, national governments, private sector, academics, to create exit plans. Local participation in creating these and feedback on how well exit is going will help them sustain results.

Webinar - Sustainability Ready: what it takes to support & measure lasting change - Cekan, Jindra (Valuing Voices, 2020)
On June 24th under GLocal’s UNConference, “Co-creating our future stories of hope and action”, Jindra Cekan, Holta Trandafili, and Isabella Jean presented their work on sustainability evaluations and exit strategies via local voices. We chaired a 2-hour discussion session on the following topics: Sustainability of global development projects and exit from them, The importance of valuing local partners’ and participants’ voices, How to embed ex-post evaluation of sustainability into the project cycle, How expectations, benchmarking, and early joint planning in exit strategies, as well as considering long-term ownership & relevance will support projects to be sustained locally, including questioning who will maintain results, Considering power dynamics between donors and ultimate ‘beneficiaries’ and the value of the impact of the project from a variety of perspectives, and more Here is the recording of our presentation or see just the PowerPoint presentation. We harvested lessons from our three presentations: Jindra Cekan: · Fear of learning about failure in our global development industry – INGOs are “waiting for a successful enough project” to commission ex-post project sustainability evaluation · It needs to be a culture of learning, not a culture of success. · Lack of transparency in sharing program evaluation results with communities and local government is widespread, and even more rarely do we come back after many years and share learnings · Participatory approaches are vital, listening to participants about sustained impacts is key · It is never attribution, always contribution. To isolate impacts, we need to look for project sites that haven’t had multiple other organizations overlapping through all phases. · Building sustainability planning throughout the project cycle is key – but often doesn’t happen Holta Trandafili: · Sustainability needs to be planned to be researched, including evaluating why or why not were project elements sustained, and why? What has the project done to enable communities to sustain improvements? · Expectations of sustainability need to be more modest (as most results are mixed good/bad) · We need to ask: How are you defining and measuring sustainability – for how long should the results last? Among how many participants? Have you set benchmarks for success? · We should expand your toolbox on methodology to investigate sustainability. Stories of success are one of a myriad of methods used, including mixed-methods, cost-benefit, etc. · Start with the need for learning not [just] accountability Isabella Jean: · Sustainability investigation/evaluation/learning should be mindful that this is NOT about projects. It is about people. · We have a system that focuses on gaps and needs to be filled vs. existing capacities’ structures to be reinforced. How can our work on measuring sustainability bring this to light and call it out, so that we change the norm? · Planning for sustainability requires the insight to integrate resources and experiences of outsiders with the assets and capacities of insiders to develop context-appropriate strategies for change If you would like to discuss this with any of us, please send us comments and we’re happy to respond. Thanks again to the G-Local UnConference team! Below please find our bios: Jindra Cekan/ova has worked in global development for 33 years focused on participatory design and M&E for global non-profits. She founded Valuing Voices 7 years ago. For details, see: Valuing Voices Founder Holta Trandafili is the Research, Learning, and Analytics Manager with World Vision US and has been leading field research, monitoring, and evaluation since 2007. She has led sustainability measurement studies for World Vision programs in Uganda, Kenya, Sri Lanka, India, Burma, and Bolivia. Her areas of expertise and interest include program and community groups’ sustainability measurements; agency-level measurements; empowerment approaches to development; integrated programming; local capacities for peace; gender analysis; and outcome monitoring. Currently, Mrs. Trandafili serves as an Advisory Committee member for InterAction’s Effectiveness and Program Evaluation Working Group and chairs one of the sub-working groups under The Movement for Community-led Development. Isabella Jean supports international and local organizations and funders to document promising practices, facilitate learning and strengthen capacities for conflict sensitivity, peacebuilding and humanitarian effectiveness. She has facilitated action research, collaborative learning and advisory engagements in over 25 countries, and serves as an advisor to policymakers, senior leadership and program teams. Isabella co-authored the book, Time to Listen: Hearing People on the Receiving End of Aid and developed practical guidance to support accountability to communities, listening and feedback loops, and responsible INGO exits. She teaches graduate-level courses on aid effectiveness, program strategies and M&E of peacebuilding at Brandeis University’s Heller School for Social Policy and Management. Previously, Isabella directed training at a community organizing network and conducted policy research for the Institute for Responsive Education, UNDP, and Coexistence International.

The collaborative exploration of alternative futures: A different approach to Theories of Change - CEDIL programme (2022)
ParEvo is a web application that enables the collaborative construction and exploration of a range of alternative futures: likely and unlikely, desirable and undesirable. These are described in the form of a branching narrative structure, developed over a series of iterations involving the interactions of a group of participants. These detailed storylines about the future contrast with optimistic, skeletal and largely singular views of the future found in diagrammatic ToCs often encountered by evaluators. This webinar will describe a recent ParEvo exercise implemented by the Centre for the Study of Existential Risk (CSER) in Cambridge. In this exercise 11 international experts explored ideas about how global risks associated with biotechnology research could be managed, and mismanaged, in the coming four years. Including how these alternative futures were evaluated by participants and the CSER facilitators. Issues to be discussed by the panel, and others, include comparisons with other representations of Theories of Change and other approaches to the exploration of alternative futures, described variously as scenario planning, futures or foresight work. Speakers: Rick Davies, Lara Mani Tom Hobson An overview of the app can be found here: https://mscinnovations.wordpress.com/ The app website is here: https://parevo.org/

Tiny Tools - Measuring Change in Communities and Groups - Causemann, Bernward; Gohl, Eberhard; Brenner, Verena (Impact+, 2012)
Introduction to the Overview: Tiny Tools Why “Tiny Tools” for assessing change? Currently, change is mostly assessed by NGO staff or external experts. The vision of this paper is that communities assess and reflect change themselves and make use of that reflection with appropriate tools. All the tools presented here are relatively quick and easy to learn (therefore “tiny”). With Tiny Tools we can assess change in one session. They can therefore be used where there are not baselines. They are structured and systematic, and they are all widely tested: Experience shows that these tools lead to new insights, mobilise enthusiasm and increase the capacity of communities to bring about further change. The Tiny Tools are in line with what Participatory Rural Appraisal (PRA) wanted to achieve. Many are slight variations of PRA tools. For a detailed description of concepts, see the NGO-IDEAs Impact Toolbox (www.ngo-ideas.net/impact_toolbox) and the NGO-IDEAs Manual Self-Effectiveness (www.ngo-ideas.net/monitoring_self_effectiveness). The tools are designed to visualise change, but also enable communities to reflect on the reasons of change or verify assessments. They may be implemented once or continuously over time. We know that the time of community members is precious, and limited. Therefore all Tiny Tools can be performed in a relatively short session, provided facilitators (it could be field staff or project officers) are experienced – and the community knows and trusts them. The amount of time spent on the application of the tools may however be prolonged according to the needs of a community or NGO. All of these tools are easy to learn for a facilitator experienced in participatory processes. Which tool should be introduced to which community? It is typically the decision of a development organisation (or external experts) which tools they want to introduce into a community. The staff need to assess which tool will lead to learning and action. It could also be that the staff realise aspects of change that they do not understand well enough. These tools are good for exploring change that we have not planned for and not anticipated. They are also good for exploring change in a context where we have no prior information. Communities are the best experts for their situation, but we emphasise that the tools should be used in ways that benefit and empower the communities or individuals participating. The tool implementations should lead to consequences on the grassroots as well as the NGO level. All Tiny Tools can be integrated into PIAR, the Analysis tool in the NGO-IDEAs Impact Toolbox. Also, the Tiny Tools can help to prepare for the application of the Toolbox tools. They help to make people aware of changes that can be observed. The following box gives some hints how Tiny Tools relate to the Impact Toolbox tools, and to what extent they help to attribute change to development interventions.

Politically informed approaches to gender in fragile and conflict-affected settings - Castillejo, Clare; Domingo, Pilar; George, Rachel; O’Connell, Shannon (ODI, 2020)
This report summarises the discussions at a meeting held in September 2019 of a group of global development research and policy experts and practitioners, convened by ODI and the Westminster Foundation for Democracy, to share experiences and knowledge, reflect on what we already know about working politically on gender in fragile and conflict-affected settings (FCAS), and identify what further evidence would be useful. Key messages: - It is important to identify, document and learn from politically informed and adaptive ways of working in practice on gender in FCAS. - Different analytical and monitoring, evaluation and learning tools are required for politically informed programming on gender. These should be embedded within programme teams and processes, and be both gender-responsive and responsive to the political economy context. - There is a need for more politically smart use of quantitative and qualitative data in order to identify plausible entry points and ways of working on gender in FCAS. This should include increasing the capacity of programme staff to use data to inform, adapt and correct programmes. - Staff promoting politically informed work on gender equality are often isolated, with little opportunity to share experiences or learn from others. Platforms should therefore be created to share experience and knowledge, and to bring together donors and implementers involved in this work.

Adaptation in practice: lessons from teenage pregnancy programmes in Sierra Leone - Castillejo, Clare; Buell, Stephanie (ODI, 2020)
A discussion of initial learning emerging from the SLRC ’Adaptive approaches to reducing teenage pregnancy in Sierra Leone’ action research project.

2018 Map of the Complexity Sciences - Castellani, Brian (Durham University, 2018)
A map that provides a macroscopic, trans-disciplinary introductions to the complexity sciences.

Using middle-level theory to improve programme and evaluation design - Cartwright, N (CEDIL, 2020)
What can middle-level theory do? Middle-level theory (MLT) has several uses in development planning and evaluation. It helps predict whether a programme can be expected to work in a new setting. It offers insights into what design features are needed for success. It provides invaluable information for monitoring to see if the programme is on track and to fix problems that arise. It reveals the causal processes and related assumptions to be tested in an evaluation and helps identify evaluation questions. It helps in interpreting evaluation findings, assessing their relevance and locating a description of them that is useful for programme design and evaluation in other settings

Where next for development effectiveness? Implementing development effectiveness: a reality check - Carter, Paddy (2016 CAPE Conference, 2016)

An inventory and review of countering violent extremism and insurgency monitoring systems - Carter, Lynn; Phyllis, Dinino (USAID, 2012)

Scaling Up Inclusive Approaches for Marginalised and Vulnerable People - Carter, Becky; Joshi, Anu; Remme, Michelle (2018)
This rapid review summarises the evidence on how to scale up inclusive approaches to complex social change. It looks at how to design scalable inclusive change interventions, as well as how to plan and manage the scale-up process. Focusing on interventions with the aim of reaching the most marginalised and transform social norms, it covers programmes aiming to deliver inclusive outcomes for women and girls (with a particular focus on preventing violence against women and girls) and persons with disabilities. To date, many interventions seeking to change harmful gender and disability norms have been implemented as small-scale projects. There are limited experiences of scale-up and fewer evaluations of these experiences. However, there are some documented case studies as well as emerging analysis that draw out lessons learned. From this evidence base, this rapid desk review identifies eight critical issues commonly highlighted as important considerations when scaling up inclusive change interventions: 1. Opportunities for systemic approach, including integrating political and community-level scale-up, and coordinating across multiple sectors and stakeholders 2. Political support for scale-up 3. Strategic choices: balancing reach, speed, cost, quality, equity, and sustainability 4. Catalysing change: tipping points, diffusion effects, and local champions 5. Locally grounded, participatory, and adaptive approaches 6. Long-term approaches with funding models to match 7. Cost-effective and financially feasible scale-up strategies 8. Measuring impact and sustainability.

Development Aid Confronts Politics: The Almost Revolution - Carothers, Thomas; de Gramont, Diane (EDS Publications Ltd., 2013)
A new lens on development is changing the world of international aid. The overdue recognition that development in all sectors is an inherently political process is driving aid providers to try to learn how to think and act politically. Major donors are pursuing explicitly political goals alongside their traditional socioeconomic aims and introducing more politically informed methods throughout their work. Yet these changes face an array of external and internal obstacles, from heightened sensitivity on the part of many aid-receiving governments about foreign political interventionism to inflexible aid delivery mechanisms and entrenched technocratic preferences within many aid organizations. This pathbreaking book assesses the progress and pitfalls of the attempted politics revolution in development aid and charts a constructive way forward.