Building justice and peace from below? Supporting community dispute resolution in Asia - Valters, Craig (Working Politically in Practice Series: Case Study, 2016)

Building State Capability: Evidence, Analysis, Action - Andrews, Matt; Pritchett, Lant; Woolcock, Michael (Oxford University Press, 2017)
This is an open access title available under the terms of a CC BY-NC-ND 4.0 licence. It is free to read at Oxford Scholarship Online and offered as a free PDF download from OUP and selected open access locations. Governments play a major role in the development process, and constantly introduce reforms and policies to achieve developmental objectives. Many of these interventions have limited impact, however; schools get built but children don't learn, IT systems areintroduced but not used, plans are written but not implemented. These achievement deficiencies reveal gaps in capabilities, and weaknesses in the process of building state capability.This book addresses these weaknesses and gaps. It starts by providing evidence of the capability shortfalls that currently exist in many countries, showing that many governments lack basic capacities even after decades of reforms and capacity building efforts. The book then analyses this evidence, identifying capability traps that hold many governments back - particularly related to isomorphic mimicry (where governments copy best practice solutions from other countries that make them look morecapable even if they are not more capable) and premature load bearing (where governments adopt new mechanisms that they cannot actually make work, given weak extant capacities). The book then describes a process that governments can use to escape these capability traps. Called PDIA (problem driveniterative adaptation), this process empowers people working in governments to find and fit solutions to the problems they face. The discussion about this process is structured in a practical manner so that readers can actually apply tools and ideas to the capability challenges they face in their own contexts. These applications will help readers devise policies and reforms that have more impact than those of the past.
Keywords: IMPORTANT

Building tech-powered public services - Bickerstaffe, Sarah (Institute for Public Policy Research, 2013)
Given the rapid pace of technological change and take up by the public it is a question of when not if public services become tech powered This new paper asks how we can ensure that innovations are successfully introduced and deployed

Built to improve: Leveraging realtime M&E for adaptive youth employment programming - Skelton, John (Prospects practice paper, 2, 2016)
Recognising that aid and development programming takes place in complex contexts, Mercy Corps is increasingly seeking to understand how best to manage programs which iterate, adapt and respond to the consistently evolving settings in which we work. This brief Practice Paper provides some examples of what adaptive management looks like in practice on the Prospects youth employment program in Liberia. It does not seek to function as a manual or set of guidelines, but simply provides some practical examples and insights into how a youth employment program governed by principles of adaptive management operates.

Busan Outcome Document (2011)

Buzzing Communities: How to build bigger, better, and more active online communities - Millington, Richard (Feverbee, 2012)
How to Build Bigger, Better, and More Active Online CommunitiesBuzzing Communities cuts through the fluff to offer a clear process for creating thriving online communities. This book combines a century of proven science, dozens of real-life examples, practical tips, and trusted community-building methods. This step-by-step guide includes a lifecycle for tracking your progress and a framework for managing your organization's community efforts. This Book Will Help You to Understand what the members of your community really want. Dramatically increase the number of newcomers that become regulars. Avoid the mistakes most organizations make when they try to build online communities. Develop a fantastic, user-friendly website for your members. Grow your online community to critical mass and beyond Keep members engaged and active in your community. Measure the community's return on investment and explain the benefits to your organization.

Caja de Herramientas PDIA - Un enfoque “hazlo tú mismo” para resolver problemas complejos - Samji, Salimah; Andrews, Matt; Pritchett, Lant; Woolcock, MIchael (Center for International Development at Harvard University, 2018)
(Spanish version of he PDIA toolkit) The PDIAtoolkit is designed to guide you through the process of solving complex problems which requires working in teams. We call it a Do-it-Yourself (DIY) kit, where the ‘you’ is a committed team of 4-6 people mobilized to work together to solve a complex problem that cannot be solved by one person.

Calibrating adaptive programming across multi-country, multi-partner programs - Gray, Stephen; Carl, Andy (Adapt Peacebuilding, 2019)
This past week Andy Carl and I joined the international NGO Christian Aid Ireland team in Dublin to reflect on progress in a key feature of their work - adaptive programming. This post presents what Andy Carl and I learned in reflecting this week with the international NGO Christian Aid Ireland r

Can policy-makers think like designers? - Adler, Natalia (A workshop on Doing Development Differently, 2014)
This is the poster used by Natalia Adler, from Unicef, at the Doing Development Differently workshop in 2014. Can policy-makers think like designers? Since 2012, UNICEF has been supporting two autonomous governments in Nicaragua to develop empathy-driven policies for children. While policies are the final product, the goal of the Designing for Children Initiative is to make government officials think like designers. A good policy or service is nothing without active and engaged frontline workers. From the onset, our objective was to transform public employees into ‘public entrepreneurs.’ In doing so, we have disrupted the traditional assumptions about participatory governance, where it normally suffices to hold a meeting and have people talk about their needs and aspirations. For participation to work, government officials have to relearn how to listen. They have to let go of pre-determined assumptions and their expert status, and put themselves in the shoes of the people they are trying to reach. This is the process of empathy-driven policy-making. For the past two years, we have used a Human Centered Design (HCD) approach to make this happen. While HCD is often seen as an innovation in itself, for us, it’s just a means to an end: common-sense development.

Can SMS-Mobilization Increase Citizen Reporting of Public Service Deficiencies to Politicians? - Grossman, Guy; Michelitch, Kristin; Santamaria, Marta (2015)

Can’t See the Wood For the Logframe: Integrating Logframes and Theories of Change in Development Evaluation - Freer, Gordon; Lemire, Sebastian (Canadian Journal of Program Evaluation, 2019)
There are numerous ways in which to model the underlying theory of programs. In the context of international development evaluation, the most ubiquitous are likely “logframes” and to some extent “theories of change,” both of which may serve to guide program development and management, monitoring, and evaluation. While logframes and theories of change are often developed in parallel, they are rarely fully integrated in their practical application. Drawing on lessons from a recent theory-based evaluation, this article argues that fully integrating the program theory of change within the program logframe provides for a stronger and more holistic understanding of program progress.

Can we know better? Reflections for Development - Chambers, Robert (Practical Action, 2017)
This book is intended for all who are committed to human wellbeing and who want to make our world fairer, safer and more fulfilling for everyone, especially those who are 'last'. It argues that to do better we need to know better. It provides evidence that what we believe we know in international development is often distorted or unbalanced by errors, myths, biases and blind spots. Undue weight has been attached to standardised methodologies such as randomized control trials, systematic reviews, and competitive bidding: these are shown to have huge transaction costs which are rarely if ever recognized in their enormity. Robert Chambers contrasts a Newtonian paradigm in which the world is seen and understood as controllable with a paradigm of complexity which recognizes that the real world of social processes and power relations is messy and unpredictable. To confront the challenges of complex and emergent realities requires a revolutionary new professionalism. This is underpinned by a new combination of canons of rigour expressed through eclectic methodological pluralism and participatory approaches which reverse and transform power relations. Promising developments include rapid innovations in participatory ICTs, participatory statistics, and the Reality Check Approach with its up-to-date and rigorously grounded insights. Fundamental to the new professionalism, in every country and context, are reflexivity, facilitation, groundtruthing, and personal mindsets, behaviour, attitudes, empathy and love. Robert Chambers surveys the past world of international development, and his own past views, with an honest and critical eye, and then launches into the world of complexity with a buoyant enthusiasm. He draws on almost six decades of experience in varied roles in Africa, South Asia and elsewhere as practitioner, trainer, manager, teacher, evaluator and field researcher, also working in UNHCR and the Ford Foundation. He is a Research Associate and Emeritus Professor at the Institute of Development Studies, University of Sussex, his base for many years. Can We Know Better? is essential reading for researchers and students of development, for policy makers and evaluators, and for all those working towards the better world of the Sustainable Development Goals.

Canada's Feminist International Assistance Policy - GAC (Global Affairs Canada, 2017)

Capacity WORKS - GIZ (2014)
One of GIZ’s core competencies is understanding how cooperation works in societies, and supporting that process. The kind of process we mean is cooperation between state, civil society and private-sector actors who wish to jointly shape societal changes. GIZ has systematised its knowledge on how to achieve this, and made it available in the Capacity WORKS management model. The model describes how to manage cooperation systems.

Capacity Works - online training - GIZ (GIZ, 2014)

Caracterizando la participación ciudadana en el marco del Gobierno Abierto - Prieto-Martín, Pedro; Ramírez-Alujas, Álvaro V. (Revista del CLAD. Reforma y Democracia, 2014)
Este artículo profundiza conceptualmente en las dimensiones del Gobierno Abierto, centrándose en el análisis y caracterización de su dimensión participativa. Se propone, en primer lugar, una tipología de actos participativos que muestra el efecto potenciador que las TIC ejercen sobre las distintas formas de participación. En segundo lugar, se presentan los denominados “Esquemas de participación” (EdP), un instrumento conceptual que facilita el análisis y la representación estandarizada de las dimensiones más importantes de la participación. Los EdP proporcionan así, por un lado, un modelo de categorización que extiende nuestra comprensión crítica de la participación y, por otro lado, una herramienta potente y flexible para la comunicación, el diseño y la evaluación de diversos tipos de iniciativas participativas.

Case studies of results-based management by providers: Canada - OECD (OECD, 2017)

Case studies of results-based management by providers: New Zealand - OECD (OECD, 2017)

Case studies of results-based management by providers: Sweden - OECD (OECD, 2017)

Case studies of results-based management by providers: Switzerland - OECD (OECD, 2017)

Case studies of results-based management by providers: The Netherlands - OECD (OECD, 2017)

Case studies of results-based management by providers: United Kingdom - OECD (OECD, 2017)

Case studies of results-based management by providers: World Bank Group - OECD (OECD, 2017)

Case study: Embedding reform and exiting: LASER’s application of the hourglass approach to achieve sustainable results - Manuel, Clare (DFID-LASER Programme, 2016)
This case study describes how LASER has gone about enabling systemic change and sustainable uptake of reforms that address complex institutional problems in Kenya, Rwanda, Sierra Leone, Somaliland and Uganda. In each of these countries LASER has designed-in a sustainable approach from the start based on: (i) local ownership and leadership of reforms based on developing country (rather than donor) priorities; (ii) use of country (rather than donor programme) systems; and (iii) an understanding that the role of the donor / development practitioner is to support (rather than buy) reform. The case study uses LASER’s hour glass methodology, illustrated with examples from LASER interventions, to show how these principles guide LASER operations every step of the way.
Keywords: IMPORTANT; Practice

Case study - Lepra - Adaptive programming in “reaching the unreached” - UK Aid Direct (DFID, 2017)

Case Study Research and Applications: Design and Methods - Yin, Dr Robert K. (SAGE Publications, Inc, 2018)
Winner of the 2019 McGuffey Longevity Award from the Textbook & Academic Authors Association (TAA) Recognized as one of the most cited methodology books in the social sciences, the Sixth Edition of Robert K. Yin′s bestselling text provides a complete portal to the world of case study research. With the integration of 11 applications in this edition, the book gives readers access to exemplary case studies drawn from a wide variety of academic and applied fields. Ultimately, Case Study Research and Applications will guide students in the successful use and application ofthe case study research method.

“Cash Plus” programmes for children - Save the Children (Resource Paper, 2017)
This paper provides a resource on “Cash Plus” interventions for children. These interventions combine household cash transfers with complementary, context-relevant interventionsn in order to address the multiple drivers of childhood deprivations and generate more powerful impacts for children across Save the Children’s Breakthroughs, in both development and humanitarian contexts.

Causal inferences on the effectiveness of complex social programs: Navigating assumptions, sources of complexity and evaluation design challenges - Chatterji, Madhabi (Evaluation and Program Planning, 2016)
This paper explores avenues for navigating evaluation design challenges posed by complex social programs (CSPs) and their environments when conducting studies that call for generalizable, causal inferences on the intervention’s effectiveness. A definition is provided of a CSP drawing on examples from different fields, and an evaluation case is analyzed in depth to derive seven (7) major sources of complexity that typify CSPs, threatening assumptions of textbook-recommended experimental designs for performing impact evaluations. Theoretically-supported, alternative methodological strategies are discussed to navigate assumptions and counter the design challenges posed by the complex configurations and ecology of CSPs. Specific recommendations include: sequential refinement of the evaluation design through systems thinking, systems-informed logic modeling; and use of extended term, mixed methods (ETMM) approaches with exploratory and confirmatory phases of the evaluation. In the proposed approach, logic models are refined through direct induction and interactions with stakeholders. To better guide assumption evaluation, question-framing, and selection of appropriate methodological strategies, a multiphase evaluation design is recommended.
Keywords: Causal inferences; Complex social programs; Experimental designs; Impact evaluations; Mixed methods

Causal Link Monitoring - Britt, Heather; Hummelbrunner, Richard; Greene, Jacqueline (2017)
Causal Link Monitoring (CLM) 1 integrates design and monitoring to support adaptive management of projects. CLM helps project planners and managers identify the processes that are required to achieve desired results, and then to observe whether those processes take place, and how. Result-producing processes specify the causal links between results in a logic model or results framework—in other words, the processes between results.2 CLM focuses on how specific individuals or organizations use results to achieve other results. In CLM, planners start by creating a logic model to help document predictable, agreed-upon elements of the project. Next, they refine the causal links by describing the processes that will transform results at one point in the causal chain to the next. Planners are often less certain about these resultproducing processes. Finally, the CLM logic model is enhanced with information about two important sources of uncertainty, contextual factors that may influence the project and diverse perspectives on the problem and its solution.

Causal Loop Diagrams: Little Known Analytical Tool | iSixSigma - Rushing, William (2010)
The causal loop diagram is an analytical tool that is seldom used in Six Sigma but nonetheless is still very valuable. It is a foundational tool used in system dynamics, a method of analysis used to develop an understanding of complex systems.

Causality and attribution in market systems development - Jenal, Marcus; Liesner, Mollie (BEAM, 2017)
Resources that contain evidence of market systems interventions. Recently updated.

Change in challenging contexts - Williamson, Tim (ODI, 2015)
This report explores how genuine institutional change takes place in fragile and conflict-affected states reforms can be supported.

Changes for Justice Project - Final Report - Chemonics International (USAID, 2015)

Changing humanitarian action? - Knox-Clarke, Paul (ALNAP Working Paper, 2017)
We live in times of profound change. This has had a great impact on humanitarian needs, and the approaches taken to meet these needs. Changes in technology, ecology, politics, economics and demographics have shaped, and will continue to shape, humanitarian action. Many humanitarians and observers of humanitarian action have suggested that change initiatives in the sector have been unambitious and unsuccessful. Indeed, many people think that the humanitarian system is unable, or unwilling, to make the changes that are required to remain effective and relevant in a rapidly changing world. Following the World Humanitarian Summit many stakeholders have made commitments to significant changes. But can the system change? And if so, how? As a network which exists to support change and improvement, it seems appropriate that ALNAP meets to consider how change occurs in the humanitarian system, and how it can be done better. Find out more about the 31st Annual Meeting by reading the concept note, or by visiting alnap.org/31am.

Chaos Report 2015 - Standish Group (Standish Group, 2015)

Cherry-Picked Intelligence. The Weapons of Mass Destruction Dispositive as a Legitimation for National Security in the Post 9/11 Age - van der Heide, Liesbeth (Historical Social Research / Historische Sozialforschung, 2013)
»Geheimdienste mit Scheuklappen: Das Dispositiv der Massenvernichtungswaffen als Legitimation für Nationale Sicherheit nach 9/11«. The claim that Iraq possessed Weapons of Mass Destruction (WMD) led to the invasion of Iraq in 2003 by the US army. For the George W. Bush administration, the likely presence of WMD in Iraq was the major justification for going to war. However, Bush' opponents suspected he used the WMD-dispositive as a legitimation for an invasion that was already set in motion for different reasons. The Iraq invasion and the underlying ideas about the presence of WMD thus provide a tangible case for the analysis of theories of conspiracy and security. The development of the WMD-dispositive will be contextualized using the toolkit of securitization theory. The article explores the notions of security and conspiracy that were used to build the dispositive and shows how it ultimately failed and turned into a counter-narrative in which the Bush administration itself became the Great Conspirator.

Chris Argyris: theories of action, double-loop learning and organizational learning - Smith, Mark K. (The encyclopedia of pedagogy and informal education, 2013)
Chris Argyris: theories of action, double-loop learning and organizational learning. The work of Chris Argyris (1923-2013) has influenced thinking about the relationship of people and organizations…

Christian Practical Wisdom: What It Is, Why It Matters - Bass, Dorothy C.; Cahalan, Kathleen A.; McLemore, Bonnie J.; Nieman, James R.; Scharen, Christian B. (Wm. B. Eerdmans Publishing Company, 2016)
Why is the very kind of knowledge that people need to live well ― practical wisdom ― often the least understood, the hardest to learn, and the most devalued kind of knowledge?In this book five distinguished practical theologians examine the wisdom that is basic for faithful Christian living, question why it has been largely devalued, and advocate for its renewal. After first showing several concrete situations in which this kind of wisdom is visible ― marriage, church, community, culture, and more ― the authors then delve into the reasons for the decline of practical wisdom and set forth constructive cases for its renewal through biblical imagination and spiritual practice.

Citizen-Centered Governance: The Mayor's Office of New Urban Mechanics and the Evolution of CRM in Boston - Crawford, Susan P.; Walters, Dana (Social Science Research Network, 2013)
Over the last three years, the Boston Mayor's Office of New Urban Mechanics, the innovative, collaborative ethos within City Hall fostered by Mayor Menino and h

Citizen engagement: emerging digital technologies create new risks and value - Peixoto, Tiago; Steinberg, Tom (World Bank, 2019)
The recent rapid evolution of digital technologies has been changing behaviors and expectations in countries around the world. These shifts make it the right time to pose the key question this paper explores: Will digital technologies, both those that are already widespread and those that are still emerging, have substantial impacts on the way citizens engage and the ways through which power is sought, used, or contested? The authors address this question both to mitigate some of the World Bank’s operational risks, and to initiate a conversation with peers about how those risks might require policy shifts. The overall framing question also is being explored in case theapproaches to citizen engagement advocated by the World Bank are changing and may require different advice for client countries. Despite the lower technology penetration levels in developing countries, their more malleable governance contexts may be more influenced by the effects of emerging technologies than older states with greater rigidity. Digitally influencedcitizen engagement is, in short, one of those “leapfrog” areas in which developing nations may exploit technologies before the wealthier parts of the world. But countries can leapfrog to worse futures, not just better ones. This paper explores what technology might mean for engagement, makespredictions, and offers measures for governments to consider.

Citizen-generated data and sustainable development - Rono-Bett, Karen; Kenei, Steve (DevInit and DRT, 2017)
The potential of citizen-generated data in the sustainable development agenda

Citizen participation and the rise of the open source city in Spain - Peña-López, Ismael (MAVC & IT for Change, 2017)
Research on the Information Society, the Digital Divide and Information and Communication Technologies for development

Citizen science in hydrology and water resources: opportunities for knowledge generation, ecosystem service management, and sustainable development - Buytaert, Wouter; Zulkafli, Zed; Grainger, Sam; Acosta, Luis; Alemie, Tilashwork C.; Bastiaensen, Johan; De Bièvre, Bert; Bhusal, Jagat; Clark, Julian; Dewulf, Art; Foggin, Marc; Hannah, David M.; et al. (Frontiers in Earth Science, 2014)
The participation of the general public in the research design, data collection and interpretation process together with scientists is often referred to as citizen science. While citizen science itself has existed since the start of scientific practice, developments in sensing technology, data processing and visualisation, and communication of ideas and results, are creating a wide range of new opportunities for public participation in scientific research. This paper reviews the state of citizen science in a hydrological context and explores the potential of citizen science to complement more traditional ways of scientific data collection and knowledge generation for hydrological sciences and water resources management. Although hydrological data collection often involves advanced technology, the advent of robust, cheap and low-maintenance sensing equipment provides unprecedented opportunities for data collection in a citizen science context. These data have a significant potential to create new hydrological knowledge, especially in relation to the characterisation of process heterogeneity, remote regions, and human impacts on the water cycle. However, the nature and quality of data collected in citizen science experiments is potentially very different from those of traditional monitoring networks. This poses challenges in terms of their processing, interpretation, and use, especially with regard to assimilation of traditional knowledge, the quantification of uncertainties, and their role in decision support. It also requires care in designing citizen science projects such that the generated data complement optimally other available knowledge. Lastly, we reflect on the challenges and opportunities in the integration of hydrologically-oriented citizen science in water resources management, the role of scientific knowledge in the decision-making process, and the potential contestation to established community institutions posed by co-generation of new knowledge.
Keywords: Citizen science; Co-generation of knowledge; Water Resources Management; hydrological sensing; poly-centric governance

Citizens Against Corruption: Report from the Front Line - Landell-Mills, Pierre (Matador, 2013)
Citizens Against Corruption: Report From The Front Line tells the story of how groups of courageous and dedicated citizens across the globe are taking direct action to root out corruption. It shows how people are no longer prepared to accept the predatory activities of dishonest officials and are challenging their scams. It draws on over 200 unique case studies that describe initiatives undertaken by 130 civil society organisations (CSOs) which engage directly with public agencies to stop the bribery and extortion that damages peoples' lives and obstructs social and economic progress. This book challenges the notion that, at best, civil society can only have a marginal impact on reducing corruption and argues that aid donors need to radically rethink their assistance for governance reform. Part 1 analyses the role citizens can play in fighting corruption and promoting good governance and briefly tells the story of the Partnership for Transparency Fund (PTF). Part 2 presents studies of India, Mongolia, Philippines, and Uganda - each with its unique history and distinctive circumstances - to illustrate activities undertaken by CSOs to root out corruption, including the tools and approaches that are being used to build pressure on corrupt public agencies to become transparent and accountable. Part 3 addresses key themes - strengthening the rule of law, putting in place effective national anti-corruption strategies and institutions, making public buying and selling honest, promoting grassroots monitoring of public expenditures and the provision of public services, mounting media campaigns to expose and defeat corruption, and empowering ordinary citizens to keep watch on what actually happens at the point of delivery of public services. Part 4 is a summary of lessons learnt and explores the potential, as well as the risks and limitations, of civic activism in a world where greed and dishonesty is the norm. Finally, the book explores the opportunities and dangers faced by aid donors in supporting local CSOs and charts a way forward. Citizens Against Corruption: Report From The Front Line will be of interest to staff working in CSOs and aid agencies, policy analysts and researchers concerned about corruption and poor governance.

Citizens’ Use of New Media in Authoritarian Regimes: A Case Study of Uganda - Grönlund, Åke; Wakabi, Wairagala (The Electronic Journal of Information Systems in Developing Countries, 2015)
By subsidizing the costs of civic participation, the use of the Internet use is believed to stimulate participation but there are fears that intensive Internet use causes withdrawal from public life. This paper investigates the connection between the way individuals participate online and offline in authoritarian, low-income regimes, and the nature of eParticipation among citizens in authoritarian regimes such as Uganda. Based on personal interviews with 116 Internet users, the study found that common drivers of eParticipation, such as low cost, security and anonymity are hard to transplant into the offline world for citizens of authoritarian states such as Uganda. Perceived risks of retribution and intimidation for expressing a particular opinion or supporting a political cause mean that citizen-to-citizen participation is the predominant form but still at low levels, while citizen-to-government participation is negligible.

Civic Technologies as tools for change: Is balance between online and offline actions a necessary condition for achieving social change through civic innovation? - Civic Innovation Accelerator Fund (Evaluation Report, 2016)
Keywords: IMPORTANT

CLA for More Effective Development Programs (video) - USAID (USAID LearningLab, 2014)
This presentation features USAID/PPL's Stacey Young discussing the history of learning at USAID; how collaborating, learning, and adapting (CLA) can enhance development outcomes, and the role of implementing partners in supporting this vision.

CLA Maturity Tool: Example Spectrum Cards - USAID (2016)

Clearing the fog: new tools for improving the credibility of impact claims - Befani, Barbara; D'Errico, Stefano; Booker, Francesca; Giuliani, Alessandra (iied Briefing Papers, 2016)
Development actors facing pressure to provide more rigorous assessments of their impact on policy and practice need new methods to deliver them. There is now a broad consensus that the traditional counterfactual analysis leading to the assessment of the net effect of an intervention is incapable of capturing the complexity of factors at play in any particular policy change. We suggest that evaluations focus instead on establishing whether a clearly-defined process of change has taken place, and improve the validity and credibility of qualitative impact statements. IIED research in Uganda shows that the methods of process tracing and Bayesian updating facilitate a dialogue between theory and evidence that allows us to assess our degree of confidence in ‘contribution claims’ in a transparent and replicable way.

Cognitive bias cheat sheet. An organized list of cognitive biases because thinking is hard - Benson, Buster (Better Humans, 2016)

Collaborate Learn Adapt - Case Competition - USAID (USAID Learning Lab, 2015)

Collaborating, Learning, and Adapting (CLA). Framework and Maturity Matrix Overview - Learning Lab (USAID, 2016)

Collaborating, Learning and Adapting (CLA) - Maturity Matrix Overview - USAID (ADS 201 Additional Help, 2016)
Collaborating, Learning and Adapting (CLA) involves strategic collaboration, continuous learning, and adaptive management. CLA approaches to development include collaborating intentionally with stakeholders to share knowledge and reduce duplication of effort, learning systematically by drawing on evidence from a variety of sources and taking time to reflect on implementation, and applying learning by adapting intentionally. The purpose of the maturity matrix tool is to help USAID Missions think more deliberately about how to plan for and implement CLA approaches that fit the Mission’s context and needs. Through a set of easy-to-use cards, the CLA maturity matrix offers examples of what CLA looks like at different stages of maturity. USAID staff can use the decks of cards to both assess current practice and plan for the future. The maturity matrix consists of two decks of cards corresponding to the dimensions of CLA: ● CLA in the Program Cycle: By using the matrix cards to guide a conversation, teams can explore how well CLA is incorporated into the planning and implementation processes of the Program Cycle. ● Enabling Conditions: The cards encourage discussion of the conditions that can significantly influence how CLA and the Program Cycle are implemented at a Mission, including operating processes, organizational culture, and resourcing. Within these decks, the matrix covers 16 subcomponents of CLA. Each has one key concept card and five matrix cards that describe the component in practice, along a spectrum ranging from Not Yet Present to Institutionalized.

Collaborating, Learning, and Adapting. Framework & Key Concepts - Learning Lab (USAID, 2016)

Collaborating, Learning, and Adapting Framework & Key Concepts - USAID (USAID, 2016)
Although collaborating, learning, and adapting (CLA) are not new to USAID, they often do not happen regularly or systematically and are not intentionally resourced. The CLA framework above identifies components and subcomponents to help you think more deliberately about what approach to CLA might be best tailored to your organizational or project context. The framework recognizes the diversity of what CLA can look like in various organizations and projects while also giving CLA structure, clarity, and coherence across two key dimensions: CLA in the Program Cycle: how CLA is incorporated throughout Program Cycle processes, including strategy, project, and activity design and implementation; and Enabling Conditions: how an organization’s culture, business processes, and resource allocation support CLA integration. Organizations need both integrated CLA practices appropriate for their context and conducive enabling conditions to become stronger learning organizations capable of managing adaptively. The framework stresses the holistic and integrated nature of the various components of CLA to reinforce the principle that CLA is not a separate workstream—it should be integrated into existing processes to strengthen the discipline of development and improve aid effectiveness.

Collaboration for Impact (2018)
The site seeks to accelerate the adoption of system collaboration and Collective Impact in Australia. It does so by creating knowledge, network and tools; shining a light on successful Collective Impact initiatives; and building an Australian community of practice.

Collaborative geomatics and the Mushkegowuk Cree First Nations: Fostering adaptive capacity for community-based sub-arctic natural resource management - McCarthy, Daniel D. P.; Whitelaw, Graham S.; Anderson, Scott; Cowan, Donald; McGarry, Fred; Robins, Anthony; Gardner, Holly L.; Barbeau, Christine D.; Charania, Nadia A.; General, Zachariah; Liedtke, Jeff; Sutherland, Celine; et al. (Geoforum, 2012)
The remote First Nation (FN) communities of the Mushkegowuk Territory on the west coast of James Bay, Ontario, Canada are currently facing increased development pressures and the imposition of a government land use planning process. The land use planning process is mandated in the Far North Act (received Royal Assent on September 23, 2010). There is a need for capacity enhancement for community-based natural resource planning and management in the Territory. A number of frameworks are emerging for addressing change brought on by resource development and building resilience to such change at the community level. Among these include the concept of adaptive capacity. In collaboration with FN community leaders, we explored the use of “collaborative geomatics” tools to foster adaptive capacity. Our action research suggests that collaborative geomatics technologies should enhance the Mushkegowuk First Nations’ adaptive capacity to address environmental and policy change by allowing them to collect and manage data collaboratively (e.g., traditional environmental knowledge, western science) to create opportunities for innovative community development, including natural resource development and management.
Keywords: Adaptive capacity; Collaborative geomatics; Community development; Cree communities; Land use plans

Collaborative Outcome Mapping - Dart, J.; Roberts, M. (Better Evaluation, 2014)
Collaborative Outcomes Reporting (COR) is a participatory approach to impact evaluation based around a performance story that presents evidence of how a program has contributed to outcomes and impacts, that is then reviewed by both technical experts and program stakeholders, which may include community members. Collaborative Outcomes Reporting (COR) is a participatory approach to impact evaluation based around a performance story that presents evidence of how a program has contributed to outcomes and impacts, that is then reviewed by both technical experts and program stakeholders, which may include community members. Developed by Jess Dart, COR combines contribution analysis andMultiple Lines and Levels of Evidence (MLLE), mapping existing data and additional data against the program logic to produce a performance story. Performance story reports are essentially a short report about how a program contributed to outcomes. Although they may vary in content and format, most are short, mention program context and aims, relate to a plausible results chain, and are backed by empirical evidence (Dart and Mayne, 2005). The aim is to tell the ‘story’ of a program’s performance using multiple-lines of evidence. COR adds processes of review by an expert panel and stakeholders, sometimes including community members, to check for the credibility of the evidence about what impacts have occurred and the extent to which these can be credibly attributed to the intervention. It is these components of expert panel review (outcomes panel) and a collaborative approach to developing outcomes (through summit workshops) that differentiate COR from other approaches to outcome and impact evaluation.

Collaborative Overload - Cross, Rob; Rebele, Reb; Grant, Adam (Harvard Business Review, 2016)
Too much teamwork exhausts employees and saps productivity. Here’s how to avoid it.

Collective Impact - Kania, John; Kramer, Mark (Stanford Social Innovation Review, 2011)
Large-scale social change requires broad cross-sector coordination, not the isolated intervention of individual organizations.

Collective intelligence and achieving the Sustainable Development Goals - Mulgan, Geoff (nesta, 2018)
Collective intelligence and achieving the Sustainable Development Goals

Combating Wildlife Trafficking Case Study Compilation: Capacity Building for Enforcement and Prosecution - USAID (2018)

Combating Wildlife Trafficking Cross-Mission Learning Agenda - Present, Teresa; Peabody, Shawn (USAID, 2017)

Combining Big Data and Thick Data to Improve Services Delivery - Ang, Yuen Yuen (IBM Center for The Business of Government, 2018)

Community-based monitoring of Indigenous food security in a changing climate: Global trends and future directions - Lam, Steven; Dodd, Warren; Skinner, Kelly; Papadopoulos, Andrew; Zivot, Chloe; Ford, James; Garcia, Patricia J.; Team, IHACC Research; Harper, Sherilee L. (Environmental Research Letters, 2019)
Climate change is expected to exacerbate existing food security challenges, especially in Indigenous communities worldwide. Community-based monitoring is considered a promising strategy to improve monitoring of, and local adaptation to climatic and environmental change. Yet, it is unclear how this approach can be applied in food security or Indigenous contexts. The objectives of this paper are to: 1) review and synthesize the published literature on community-based monitoring of Indigenous food security; and, 2) identify gaps and trends in these monitoring efforts in the context of climate change. Using a systematic search and screening process, we identified 86 published articles. To be included, articles had to be published in a journal, describe a community-based monitoring system, describe any aspect of food security, and explicitly mention an Indigenous community. Relevant articles were thematically analyzed to characterize elements of community-based monitoring in the context of climate change. Results show that the number of articles published over time was steady and increased more than two-fold within the last five years. The reviewed articles reported on monitoring mainly in North America (37%) and South America (28%). In general, monitoring was either collaborative with local communities (51%) or externally-driven (37%), and focused primarily on tracking wildlife (29%), followed by natural resources (16%), environmental change (15%), fisheries (13%), climate change (9%), or some combination of these topics (18%). This review provides an evidence-base on the uses, characteristics, and opportunities of community-based monitoring, to guide future food security monitoring efforts in the context of climate change.

Complexity, Adaptation, and Results - Barder, Owen; Ramalingam, Ben (Center For Global Development, 2012)
In the last of a series of three blog posts looking at the implications of complexity theory for development, Owen Barder and Ben Ramalingam look at the implications of complexity for the trend towards results-based management in development cooperation. They argue that is a common mistake to see a contradiction between recognising complexity and focusing on results: on the contrary, complexity provides a powerful reason for pursuing the results agenda, but it has to be done in ways which reflect the context. In the 2012 Kapuscinski lecture Owen argued that economic and political systems can best be thought of as complex adaptive systems, and that development should be understood as an emergent property of those systems. As explained in detail in Ben’s forthcoming book, these interactive systems are made up of adaptive actors, whose actions are a self-organised search for fitness on a shifting landscape. Systems like this undergo change in dynamic, non-linear ways; characterised by explosive surprises and tipping points as well as periods of relative stability. If development arises from the interactions of a dynamic and unpredictable system, you might draw the conclusion that it makes no sense to try to assess or measure the results of particular development interventions. That would be the wrong conclusion to reach. While the complexity of development implies a different way of thinking about evaluation, accountability and results, it also means that the ‘results agenda’ is more important than ever.
Keywords: IMPORTANT

Complexity and the Art of Public Policy: Solving Society's Problems from the Bottom Up - Colander, David; Kupers, Roland (Princeton University Press, 2014)
Complexity science--made possible by modern analytical and computational advances--is changing the way we think about social systems and social theory. Unfortunately, economists' policy models have not kept up and are stuck in either a market fundamentalist or government control narrative. While these standard narratives are useful in some cases, they are damaging in others, directing thinking away from creative, innovative policy solutions. Complexity and the Art of Public Policy outlines a new, more flexible policy narrative, which envisions society as a complex evolving system that is uncontrollable but can be influenced. David Colander and Roland Kupers describe how economists and society became locked into the current policy framework, and lay out fresh alternatives for framing policy questions. Offering original solutions to stubborn problems, the complexity narrative builds on broader philosophical traditions, such as those in the work of John Stuart Mill, to suggest initiatives that the authors call "activist laissez-faire" policies. Colander and Kupers develop innovative bottom-up solutions that, through new institutional structures such as for-benefit corporations, channel individuals' social instincts into solving societal problems, making profits a tool for change rather than a goal. They argue that a central role for government in this complexity framework is to foster an ecostructure within which diverse forms of social entrepreneurship can emerge and blossom.

Complexity-Aware Monitoring - Britt, Heather; Patsalides, Melissa (Briefing on USAID's Discussion Note, 2013)

Complexity-Aware Monitoring Discussion Note (Screencast) - Patsalides, Melissa; Britt, Heather (USAID, 2014)
This screencast covers information included in the Complexity-Aware Monitoring Discussion Note. The topic is intended for those seeking cutting-edge solutions to monitoring complex aspects of strategies and projects. Most of the principles and promising approaches discussed here have a significant body of theory and practice behind them, but many have not been used to monitor USAID strategies and projects. We have much to learn about whether and how they can be applied successfully in the Agency. USAID's Office of Learning, Evaluation, and Research in the Bureau of Policy, Planning, and Learning has partnered with different groups through monitoring trials to build a body of evidence regarding which complexity-aware M&E approaches are most effective in the contexts of USAID programming.

Complexity & Development 2.0: From Agreeing We Should Adapt to Creating the Conditions that Enable Adaptation - Ang, Yuen Yuen (2018)
The field of global development has reached a critical turning point. Almost gone is the mechanical, one-size-fits-all “good governance” paradigm of the past. In its place is a growing embrace of complexity and systems thinking. While this is an encouraging shift in the right direction, the discussion mostly ends by concluding that we should adapt. Yuen Yuen Ang urges that it’s time to take our conversation on “complexity & development” to the next level: how to enable adaptation. Effective adaptation doesn’t automatically arise just because we desire it—rather, it requires certain enabling conditions. In How China Escaped the Poverty Trap (2016), she introduces a generic complexity 2.0 framework that she terms “directed improvisation.” Effective adaptation, Yuen Yuen argues, requires a paradoxical blend of top-down direction and bottom-up improvisation. Such a system can be created—and produce dramatic results and adaptive solutions—even within a closed political regime like China.

Complexity, Institutions and Public Policy: Agile Decision-making in a Turbulent World - Room, Graham (Edward Elgar Pub, 2011)
Graham Room argues that conventional approaches to the conceptualization and measurement of social and economic change are unsatisfactory. As a result, researchers are ill-equipped to offer policy advice. This book offers a new analytical approach, combining complexity science and institutionalism. It also provides tools for policy makers in turbulent times. Part 1 is concerned with the conceptualization of socio-economic change. It integrates complexity science and institutionalism into a coherent ontology of social and policy dynamics. Part 2 is concerned with models and measurement. It combines some of the principal approaches developed in complexity analysis with models and methods drawn from mainstream social and political science. Part 3 offers empirical applications to public policy: the dynamics of social exclusion; the social dimension of knowledge economies; the current financial and economic crisis. These are supplemented by a toolkit for the practice of 'agile policy making'. This is a stimulating, provocative and highly original book. It will appeal to academics and students in social and policy studies and to a wide range of scholars in other disciplines where complexity science is already well-developed. It will also be of major interest for decision makers coping with complex and turbulent policy terrains.Contents: Preface 1. Introduction Part I: Concepts 2. The Complexity Paradigm 3. Complex Adaptive Systems 4. The Economy as a Complex Adaptive System 5. Institutional Settings and Architectures 6. Institutional Dynamics 7. The Struggle for Positional Advantage 8. Conceptualising Social Dynamics Part II: Methods 9. Attractors and Orbits in Dynamic Systems 10. Patterns in Time and Space 11. Connections and Networks 12. Mobility on Social Landscapes 13. Towards a Generic Methodology Part III: Policies 14. Agile Policy-Making 15. Poverty and Social Exclusion 16. Social Dynamics of the Knowledge Economy 17. Global Turbulence and Crisis Postscript: Tools for Policy-Makers References Index

Conceptualizing community resilience to natural hazards – the emBRACE framework - Forrester, John Martin; Kruse, Sylvia; Abeling, Thomas; Deeming, Hugh; Fordham, Maureen; Forrester, John; Jülich, Sebastian; Karanci, A. Nuray; Kuhlicke, Christian; Pelling, Mark; Pedoth, Lydia; Schneiderbauer, Stefan (Natural Hazards and Earth System Sciences, 2017)
Abstract. The level of community is considered to be vital for building disaster resilience. Yet, community resilience as a scientific concept often remains vaguely defined and lacks the guiding characteristics necessary for analysing and enhancing resilience on the ground. The emBRACE framework of community resilience presented in this paper provides a heuristic analytical tool for understanding, explaining and measuring community resilience to natural hazards. It was developed in an iterative process building on existing scholarly debates, on empirical case study work in five countries and on participatory consultation with community stakeholders where the framework was applied and ground-tested in different contexts and for different hazard types. The framework conceptualizes resilience across three core domains: (i) resources and capacities, (ii) actions and (iii) learning. These three domains are conceptualized as intrinsically conjoined within a whole. Community resilience is influenced by these integral elements as well as by extra-community forces comprising disaster risk governance and thus laws, policies and responsibilities on the one hand and on the other, the general societal context, natural and human-made disturbances and system change over time. The framework is a graphically rendered heuristic, which through application can assist in guiding the assessment of community resilience in a systematic way and identifying key drivers and barriers of resilience that affect any particular hazard-exposed community.

Conclusion: Agency in the face of complexity and the future of assumption-aware evaluation practice - Morrow, Nathan; Nkwake, Apollo M. (Evaluation and Program Planning, 2016)
This final chapter in the volume pulls together common themes from the diverse set of articles by a group of eight authors in this issue, and presents some reflections on the next steps for improving the ways in which evaluators work with assumptions. Collectively, the authors provide a broad overview of existing and emerging approaches to the articulation and use of assumptions in evaluation theory and practice. The authors reiterate the rationale and key terminology as a common basis for working with assumption in program design and evaluation. They highlight some useful concepts and categorizations to promote more rigorous treatment of assumptions in evaluation. A three-tier framework for fostering agency for assumption-aware evaluation practice is proposed-agency for themselves (evaluators); agency for others (stakeholders); and agency for standards and principles.
Keywords: Agency; Complexity

Conflict Aid Goes “Lean” - Shinkle, Whitney (Stanford Social Innovation Review, 2017)
Iterative design methods are essential to development work—even (or especially) in regions marked by war and violence.

Conflict and Human Rights Shareweb (2019)

Confronting the Contradiction - An exploration into the dual purpose of accountability and learning in aid evaluation - Reinertsen, Hilde; Bjørkdahl, Kristian; McNeill, Desmond (Rapport 2017:06, 2017)
Keywords: IMPORTANT

Conjunctions: Introducing Cultural Participation as a Transdisciplinary Project - Reestorff, Camilla Møhring; Fabian, Louise; Fritsch, Jonas; Stage, Carsten; Stephensen, Jan Løhmann (Conjunctions. Transdisciplinary Journal of Cultural Participation, 2014)
In the introduction of Conjunction: Transdisciplinary Journal of Cultural Participation we introduce 1) the aim of the journal, 2) the journal’s conception of transdisciplinarity as an important precondition for understanding contemporary processes and dilemmas of participation, 3) important trajectories in the existing literature on participation that focus on participation as linked to technological changes, to democratic processes of transferring power, and to complex social situations calling for analytical and evaluative frameworks able to grasp multiplicity and competing interests, and 4) the theme and articles of the this special issue: cultural participation and citizenship.
Keywords: Cultural participation; Participatory citizenship; Power dynamics; democracy; transdisciplinarity

Connect. Learn. Adapt. Repeat - Practicing adaptive management in complex, conflict-affected environments: barriers and promising practices - Queen, Emily Forsyth (2018)
To shift aid culture toward adaptive management, we can: - Stay humble, empathetic, and build skills in facilitation and listening. - Focus on working with more flexible foundations or individual donors. Or, work for more rigid donors and help make their policies more flexible. - Get clearer about goals and processes while finding ways to be less specific and more committed to local leadership about pathways to get to the goal. - Resist looking for a magic adaptive management tool and instead get clearer about when teams make what kinds of decisions and matching to tools that support that decision-making. - Validate that everyone’s perspective is a form of data and try out simple ways to document how teams learns and changes. - Broaden and ground the idea of expertise – remembering that, especially when working with folx on the margins, people are the only experts on their own life. Practitioners must also examine how dominant patriarchal, white supremacist, colonial ideas have pushed us toward wanting more control, less flexibility, and less space for equitable decision making.

Connecting the Dots for Accountability: Civil Society Policy Monitoring and Advocacy Strategies - Fox, Jonathan; Halloran, Brendan (Transparency & Accountability Initiative, 2016)
Keywords: IMPORTANT

Connecting the Dots: Systems Practice & Political Economy Analysis - Walker, Tjip; Jacobstein, David (Local Systems Community, 2017)
This slide deck, from a presentation to the Local Systems Community by Tjip Walker and David Jacobstein, shows various ways in which assessing the political economy of a context and understanding that context through the lens of systems thinking can reinforce each other. Effective systems practice should be grounded in the incentives and power dynamics of a particular local system; thinking and working politically requires understanding the systems dynamics of an issue or sector.

Conservation Enterprises: Using A Theory of Change Approach to Synthesize Lessons from USAID Biodiversity Projects - Boshoven, Judy (Measuring Impact, 2017)
In an effort to increase the understanding of conservation enterprises’ activities and outcomes and to improve the effectiveness of biodiversity programming, this brief synthesizes lessons from past USAID-funded efforts to support conservation enterprises

Constituent Voice: Technical Note 1 - Keystone Accountability (Keystone Accountability, 2014)

Context-Driven Adaptation (Overview) - Jacobstein, David (USAID Learning Lab, 2018)
CONTEXT-DRIVEN ADAPTATION COLLECTION

Contracts for adaptive programming - Bryan, Kevin; Carter, Paddy (ODI, 2016)
Adaptive programming is an approach to development that encourages experimentation, learning & adaptation. This report examines the contractual underpinnings of this approach.

Cooperation Management for Practitioners: Managing Social Change With Capacity Works - GIZ (Springer Gabler, 2015)

Coping with Complexity - Gerard Seijts; Niels Billou; Mary Crossan (Ivey Business Journal, 2010)

COUNT - Understanding the challenge of government responsiveness - McGee, Rosemary (Think Piece, 2014)

Course: Introduction to Collaborating, Learning and Adapting (CLA) in the Program Cycle - USAID LEARN (USAID Learning Lab, 2018)

Critical agency and development: applying Freire and Sen to ICT4D in Zambia and Brazil - Poveda, Sammia; Roberts, Tony (Information Technology for Development, 2017)
(2017). Critical agency and development: applying Freire and Sen to ICT4D in Zambia and Brazil. Information Technology for Development. Ahead of Print. doi: 10.1080/02681102.2017.1328656

Critical systems heuristics - Ulrich, Werner; Reynolds, Martin (Systems Approaches to Manging Change: A Practical Guide, 2010)
This chapter provides a detailed introduction to critical systems heuristics and the use of its central tool boundary critique. What Is CSH? Two Studies in Applying CSH Using CSH as an Intervention Tool: Some Basic Concepts A Core Concept of CSH: Systematic Boundary Critique Boundary Critique Applied to NRUA-Botswana Boundary Critique Applied to ECOSENSUS-Guyana Boundary Critique and Personal Competence Recognising Boundary Judgements – and Keeping Them Fluid Towards a New Ethos of Professional Responsibility

Crowdsourcing citizen feedback on district development in Ghana using interactive voice response surveys - Pegus, Ciana-Marie (Making All Voices Count Practice Paper, 2016)
Keywords: IMPORTANT

DAC - Mid-term Peer Review of Switzaerland - 2016 - OECD (OECD, 2016)

DAC Peer Review of Switzerland - 2013 - OECD (OECD, 2013)

DAC Peer Review of Switzerland - 2019 - OECD (OECD, 2019)

Data and monitoring needs for a more ecological agriculture - Zaks, David P. M.; Kucharik, Christopher J. (Environmental Research Letters, 2011)
Information on the life-cycle environmental impacts of agricultural production is often limited. As demands grow for increasing agricultural output while reducing its negative environmental impacts, both existing and novel data sources can be leveraged to provide more information to producers, consumers, scientists and policy makers. We review the components and organization of an agroecological sensor web that integrates remote sensing technologies and in situ sensors with models in order to provide decision makers with effective management options at useful spatial and temporal scales for making more informed decisions about agricultural productivity while reducing environmental burdens. Several components of the system are already in place, but by increasing the extent and accessibility of information, decision makers will have the opportunity to enhance food security and environmental quality. Potential roadblocks to implementation include farmer acceptance, data transparency and technology deployment.

DE 201: A practitioner's guide to developmental evaluation - Dozois, Elizabeth; Langlois, Marc; Blanchet-Cohen, Natasha (J.W. McConnell Family Foundation, 2010)
Developmental evaluation has emerged fairly recently as a way to support adaptive learning in complex and emergent initiatives. Combining the rigour of evaluation with the flexibility and imagination required for development, this new form of evaluation brings critical thinking to bear on the creative process in initiatives involving high levels of uncertainty, innovation, emergence, and social complexity. This guidebook from J.W. McConnell Family Foundation and the International Institute for Child Rights and Development explores key aspects of Developmental Evaluation (DE) and offers suggestions for implementing the practice and includes a range of DE resources to help with its facilitation. Contents What is developmental evaluation? When is developmental evaluation appropriate? What competencies are needed to be an effective DE? How is developmental evaluation practiced? Challenges Appendices Assessing Readiness Stakeholder analysis Sample Learning Framework Systems Analysis Framework - Key Components Data Analysis Resources

Dealing with uncertainty: Reflections on donor preferences for pre-planned project models - Tyrrel, Lavinia; Cole, William (Working Politically in Practice, 2016)
Keywords: IMPORTANT

Debiasing: a systematic discipline and delight for development professionals - Chambers, Robert (Institute of Development Studies, 2018)
Do we really need debiasing, yet another word?  Yes, unless anyone can improve on it, because we need a word to describe a rigorous discipline we development professionals need for grounded realism. This has been coming on me slowly. But now explorations and ‘aha!’ moments in India have accumulated and combined into an epiphany.  For […]

Decide Madrid: a case study on e-Participation - Pina, Vicente; Torres, Lourdes; Royo, Sonia; García-Rayado, Jaime (XX International AECA Congress, 2019)
This paper analyses the award-winning e-participation initiative of the city council of Madrid, Decide Madrid, to discover the critical success factors at contextual, organizational and individual level. This analysis is carried out with desk research and semi-structured interviews. Results show that the most relevant success factors are the socio-economic context, the commitment of the city council, the method used to recruit the workers and the knowledge of senior managers about citizen participation and ICTs. However, the lack of transparency and poor functioning of some of its participation activities are negatively affecting its performance.

Decision-Making and Data Use Landscaping [at DFID] - Powell, Josh; Orton-Vipond, Sarah; Bhatia, Vinisha; Kilroy, Annie (Development Gateway, 2018)
As DFID aims to harness the Data Revolution, ensuring that data1 drive decision-making, public accountability, and the achievement of the Sustainable Development Goals (SDGs), ensuring that systems, processes, and skills for data are aligned with these objectives is paramount. Across sector policy teams, country offices, and various analytical and technical cadres, different strengths and weaknesses, as well as needs and ambitions exist. To inform a strategic approach to data, as framed in its forthcoming Data Roadmap, DFID collaborated with Development Gateway to perform a Decision and Data Use Landscaping study. This report details lessons learned from approximately 60 interviews across 4 DFID country offices, all sector policy teams, senior managers, and various analytical and technical cadres and offices.

Deconstructing Development Discourse: Buzzwords and Fuzzwords - Cornwall, Andrea; Eade, Deborah (Oxfam & Practical Action Publishing, 2010)
Writing from diverse locations, contributors critically examine some of the key terms in current development discourse. Why should language matter to those who are doing development? Surely, there are more urgent things to do than sit around mulling over semantics?

Defining and using evidence in conservation practice - Salafsky, Nick; Boshoven, Judith; Burivalova, Zuzana; Dubois, Natalie S.; Gomez, Andres; Johnson, Arlyne; Lee, Aileen; Margoluis, Richard; Morrison, John; Muir, Matthew; Pratt, Stephen C.; Pullin, Andrew S.; et al. (Conservation Science and Practice, 2019)
There is growing interest in evidence-based conservation, yet there are no widely accepted standard definitions of evidence, let alone guidance on how to use it in the context of conservation and natural resource management practice. In this paper, we first draw on insights of evidence-based practice from different disciplines to define evidence as being the “relevant information used to assess one or more hypotheses related to a question of interest.” We then construct a typology of different kinds of information, hypotheses, and evidence and show how these different types can be used in different steps of conservation practice. In particular, we distinguish between specific evidence used to assess project hypotheses and generic evidence used to assess generic hypotheses. We next build on this typology to develop a decision tree to support practitioners in how to appropriately use available specific and generic evidence in a given conservation situation. Finally, we conclude with a discussion of how to better promote and enable evidence-based conservation in both projects and across the discipline of conservation. Our hope is that by understanding and using evidence better, conservation can both become more effective and attract increased support from society.
Keywords: Adaptive Management; Evidence-based conservation; Evidence-based practice; Natural resource management; Project management; biodiversity; environmental evidence

Defining the burden of proof in conservation - Salafsky, Nick; Redford, Kent H. (Biological Conservation, 2013)
Conservationists often must take action in the face of uncertainty about the costs and benefits of different options. Although this uncertainty can be paralyzing when the stakes are high, there is obviously a cost to inaction as well as action, and decision makers need to be encouraged to act when appropriate. Many other fields of human endeavor such as law, medicine, and public safety have formally developed the “burden and standards of proof” that decision makers have to meet in choosing to take action. In this paper, we review the standards developed in these other fields to help define a similar framework for conservation. Specifically we propose that a conservation decision maker must assume the burden of proof when there is a decision to act that substantially affects others, in which the decision maker has professional standing, where there is not immediate urgency, and where there is some, but not complete certainty about the outcomes of acting versus not acting. Once these initial tests have been met, in situations in which the decision maker is more worried about the consequences of not acting, then a relatively low standard of proof is required for taking action. If the decision maker is concerned with the consequences of acting in error, but the action is relatively reversible, then a medium standard of proof is required. And finally, if there are concerns about the consequences of acting in error, but the action is relatively irreversible, then a high standard of proof is required.
Keywords: Biodiversity; Burden of proof; Decision theory; Standard of proof; Uncertainty

Definitions of Agile Software Development and Agility - Laanti, Maarit; Similä, Jouni; Abrahamsson, Pekka (Springer, 2013)
The Agile Manifesto and Agile Principles are typically referred to as the definitions of "agile" and "agility". However, many other definitions exist in the literature. Thus the different definitions provide interesting source for research. For each definition we examine where their emphasis is and compare that to the emphases found in the Agile Principles.

Deliberation and Development: Rethinking the Role of Voice and Collective Action in Unequal Societies - Heller, Patrick; Rao, Vijayendra (World Bank Publications, 2015)
This book marries two fields that rarely converse with one another:deliberative democracy and development studies. The study ofdeliberation―which explores normative and practical questions aroundgroup-based decision making through discussion or debate―has emergedas a critical area of study over the past two decades. Concurrently, the fieldof development has seen a spurt of interest in community-led developmentand participation premised on the ability of groups to arrive at decisionsand manage resources via a process of discussion and debate. Despite thegrowing interest in both fields, they have rarely engaged with one another.This book, which brings together new essays by some of the leading scholarsin the field, deepens our understanding of participatory decision makingin developing countries while initiating a new field of study for scholarsof deliberation. In the process, it sheds light on how to best design andimplement policies to strengthen the role of participation in development.

Delivering institutional reform at scale: Problem-driven approaches supported by adaptive programming - Manuel, Clare (Synthesis Paper, 2, 2016)
LASER synthesis papers aim to help donors and other stakeholders better understand why and how to approach investment climate reform programming differently. The papers reflect emerging best practice and lessons learnt on what works and what does not work in doing development differently. The papers have been peer-reviewed by experts in the field including senior advisers at DFID, World Bank, IFC and the Donor Committee for Enterprise Development (amongst others). Second synthesis paper - Delivering institutional reform at scale: problem-driven approaches supported by adaptive programming February 2016 Drawing on our experience on the ground, this peer-reviewed paper suggests how problem driven approaches, supported by adaptive programme management can be implemented at scale in relation to donor programming aimed at institutional reform and improving state capability.
Keywords: IMPORTANT

Delivering large-scale IT projects on time, on budget, and on value - Bloch, Michael; Blumberg, Sven; Laartz, Jürgen (McKinsey on Business Technology, 2012)
Large IT efforts often cost much more than planned; some can put the whole organization in jeopardy. The companies that defy these odds are the ones that master key dimensions that align IT and business value.

Demanding Good Governance: Lessons from Social Accountability Initiatives in Africa - McNeil, Mary; Malena, Carmen (World Bank Publications, 2010)
Accountability is the cornerstone of good governance. Unless public officials can be held to account, then critical benefits associated with good governance, such as social justice, poverty reduction and development remain elusive. The impacts of non-responsive and unaccountable governance are perhaps most harshly felt by the citizens of Africa, where corruption and governance failures are broadly acknowledged as a principal obstacle to the achievement Over the past decade, a range of social accountability practices―such as participatory budgeting, independent budget analysis, participatory monitoring of public expenditure and citizen evaluation of public services have been experimented with in many Africa countries. Their outcomes and lessons have, thus far, received little attend and documentation. This volume aims to make a contribution towards filling this gap by describing and analyzing a selection of social accountability initiatives from seven Sub-Saharan countries.

Design for Sustainability: Countering the Drivers of Unsustainability in Development Projects - Meyer, Isabel; Marais, Mario Alphonso (The Journal of Community Informatics, 2015)
Development projects aim to make a difference in communities. Funders often require that the intervention needs to last, or that it needs to effect change that will last, over an extended period of time. In short, a sustainable difference needs to be made and this is an important measure of success.  However, there are inherent drivers in the combined system of donors and beneficiaries that counter sustainability. This article explores these drivers, and identifies project design elements that need to be in place in order to promote sustainability by countering the drivers. This approach is applied to an education project, and implications for ICT4D projects are developed.
Keywords: Development; Project design; Systems Approaches; sustainability

Design reality gap issues within an ICT4D project: an assessment of Jigawa State Community Computer Center - Kanya, Rislana Abdulazeez; Good, Alice (Sixth International Conference on Information and Communication Technologies and Development (ICTD2013), 2013)
This paper evaluates the Jigawa State Government Community Computer centre project using the design reality gap framework. The purpose of this was to analyse the shortfall between design expectations and implementation realities, in order to find out the current situation of the project. Furthermore to analyse whether it would meet the key stakeholder’s expectation. The Majority of Government ICT Projects is classified as either failure or partial failure. Our research will underpin a case study of Jigawa State Community Computer centre project. To support our argument we conducted a qualitative case study in which we conducted two interviews, and a survey to find out the current status of the project. Our findings indicated that the project can be classified as a partial failure because few of the centres, operating in some areas of the community, offered socio-economic advancement. Our results also indicated that the project design reality gap is quite significant. This gap occurred due to poor planning and implementation of the project. Our research reveals several challenges that could impact upon the successfulness of the project provide a foundation for further research and add to existing literature. The challenges associated with the project we identify include poor state of power supply, lack of community engagement during the project planning and implementation, lack of commitment from the Local Government Administration. Our research has potential in adding ICT4D literature, reveals how ICT4D project evaluation can be carried out using design reality gap framework and provides guideline for policy makers.

Design Thinking for Social Innovation - Brown, Tim; Wyatt, Jocelyn (Stanford Social Innovation Review, 2010)
Designers have traditionally focused on enhancing the look and functionality of products. Recently, they have begun using design techniques to tackle more complex problems, such as finding ways to provide low-cost healthcare throughout the world. Businesses were the first to embrace this new approach—called design thinking—and nonprofits are beginning to adopt it too.

Design Thinking is not enough – Innovate DFID - DFID, Innovate (Medium, 2016)
By Tamara Giltsoff

Design thinking: understand - improve - apply - Plattner, Hasso; Meinel, Christoph; Leifer, Larry (Understanding innovation, 2011)
"In this book, the researchers take a system's view that begins with a demand for deep, evidence-based understanding of design thinking phenomena. They continue with an exploration of tools which can help improve the adaptive expertise needed for design thinking. The final part of the book concerns design thinking in information technology and its relevance for business process modeling and agile software development, i.e. real world creation and deployment of products, services, and enterprise systems"--Cover
Keywords: Creative ability in business; Creative thinking; Designer; Industrial management; Innovation; Organizational change; Product development; System design; Technological innovations

Designing for Public Services - Nesta (Nesta/IDEO, 2016)

Designing Monitoring and Evaluation Approaches for Learning An FOS How-To Guide - FOS (FOS, 2019)

Designing Participatory Meetings and Brownbags: A TOPS Quick Guide to Linking Development Practitioners - TOPS (Technical and Operational Performance Support Program, USAID, 2013)
Visit this resource for ideas on designing meetings and brownbags that are engaging and build inopportunities for participant dialogue.

Designing Regenerative Cultures - Wahl, Daniel Christian (Triarchy Press Ltd, 2016)
This is a 'Whole Earth Catalog' for the 21st century: an impressive and wide-ranging analysis of what's wrong with our societies, organizations, ideologies, worldviews and cultures - and how to put them right. The book covers the finance system, agriculture, design, ecology, economy, sustainability, organizations and society at large. In this remarkable book, Daniel Wahl explores ways in which we can reframe and understand the crises that we currently face, and he explores how we can live our way into the future. Moving from patterns of thinking and believing to our practice of education, design and community living, he systematically shows how we can stop chasing the mirage of certainty and control in a complex and unpredictable world. The book asks how can we collaborate in the creation of diverse regenerative cultures adapted to the unique biocultural conditions of place? How can we create conditions conducive to life? *** "This book is a valuable contribution to the important discussion of the worldview and value system we need to redesign our businesses, economies, and technologies - in fact, our entire culture - so as to make them regenerative rather than destructive." --Fritjof Capra, author of The Web of Life, co-author of The Systems View of Life: A Unifying Vision *** "This is an excellent addition to the literature on ecological design and it will certainly form a keystone in the foundations of the new MA in Ecological Design Thinking at Schumacher College, Devon. It not only contains a wealth of ideas on what Dr Wahl has termed 'Designing Regenerative Cultures' but what is probably more important, it provides some stimulating new ways of looking at persistent problems in our contemporary culture and hence opens up new ways of thinking and acting in the future." -- Seaton Baxter OBE, Prof. in Ecological Design Thinking, Schumacher College, UK [Subject: Systems Thinking, Education, Social Anthropology, Environmentalism, Ecology, Regenerative Culture, Sociology]

Desired and unwanted: Policy work by participation practitioners - Escobar, Óliver (XXII World Congress of Political Science: ‘Reordering Power, Shifting Boundaries’, 2012)
"This paper presents findings from doctoral research in a Scottish Local Authority Area, where I am developing an interpretive ethnography of ‘the work of participation’ (cf. Colebatch, 2005c, 2006). My focus is on engagement practitioners:
Keywords: Academia; Biology; Computer Science; Earth Sciences; Geography; History; Law; Math; Medicine; Philosophy; Physics; Political science; Psychology; Religion; Research; economics; universities

Developing an effective adaptive monitoring network to support integrated coastal management in a multiuser nature reserve - Vugteveen, Pim; van Katwijk, Marieke M.; Rouwette, Etiënne; Lenders, H. J. Rob; Hanssen, Lucien (Ecology and Society, 2015)
ABSTRACT. We elaborate the necessary conceptual and strategic elements for developing an effective adaptive monitoring network to support Integrated Coastal Management (ICM) in a multiuser nature reserve in the Dutch Wadden Sea Region. We discuss quality criteria and enabling actions essential to accomplish and sustain monitoring excellence to support ICM. The Wadden Sea Long-Term Ecosystem Research project (WaLTER) was initiated to develop an adaptive monitoring network and online data portal to better understand and support ICM in the Dutch Wadden Sea Region. Our comprehensive approach integrates ecological and socioeconomic data and links research-driven and policy-driven monitoring for system analysis using indicators of pressures, state, benefits, and responses. The approach and concepts we elaborated are transferable to other coastal regions to accomplish ICM in complex social-ecological systems in which scientists, multisectoral stakeholders, resource managers, and governmental representatives seek to balance long-term ecological, economic, and social objectives within natural limits.
Keywords: IMPORTANT

Developing and Using Useful ToCs - Mayne, John (Evergreen Briefing Note, 2018)
Developing useful theories of change (ToCs) for anintervention, especially complex interventions, is not straightforward nor something done in a couple of hourswith limited effort. Agreement is needed on a number of basic concepts and terms, key challenges need to be addressed, and there are numerous issues that need to be considered.Butthe effort is worth the investment of resources and time.Theory-based evaluation approaches need good ToCs.Some of the ideas here are discussed in the context of agricultural research for nutrition and health interventions by Mayne and Johnson (2015) (10) Developing and Using Useful ToCs. Available from: https://www.researchgate.net/publication/323868372_Developing_and_Using_Useful_ToCs [accessed Jun 13 2018].

Developing ICT Services in a Low-Resource Development Context - Bon, Anna; Akkermans, Hans; Gordijn, Jaap (Complex Systems Informatics and Modeling Quarterly, 2016)
Keywords: IMPORTANT

Development Aid Confronts Politics: The Almost Revolution - Carothers, Thomas; de Gramont, Diane (EDS Publications Ltd., 2013)
A new lens on development is changing the world of international aid. The overdue recognition that development in all sectors is an inherently political process is driving aid providers to try to learn how to think and act politically. Major donors are pursuing explicitly political goals alongside their traditional socioeconomic aims and introducing more politically informed methods throughout their work. Yet these changes face an array of external and internal obstacles, from heightened sensitivity on the part of many aid-receiving governments about foreign political interventionism to inflexible aid delivery mechanisms and entrenched technocratic preferences within many aid organizations. This pathbreaking book assesses the progress and pitfalls of the attempted politics revolution in development aid and charts a constructive way forward.

Development entrepreneurship: how donors and leaders can foster institutional change - Faustino, Jaime; Booth, David (Working Politically in Practice, 2014)
Various communities of practice have been established recently to advance the general idea of thinking and working politically in development agencies. This paper makes a contribution by describing the practice of what has been called development entrepreneurship and explaining some of the ideas from outside the field of development that have inspired it.

Development innovation: Fad, silo or catalyst? - Ramalingam, Ben (Nesta, 2015)
In the first of a two-part blog piece, Ben Ramalingam, affiliate of the Overseas Development Institute / Institute of Development Studies, discusses the challenges of implementing innovation in to the development sector - from keeping expectations realistic to managing the innovation process and assessing impact and value.

Development innovation: Taking the high road - Ramalingam, Ben (Nesta, 2015)
In part two of his blog on the challenges facing development innovation, Ben Ramalingam suggests how we might take the ‘high road’ to bring about long-lasting and meaningful innovation in the sector.

Development is Going Digital: What is the role of INGOs? ICT for Development programmes in the Horn, East and Central Africa - Haikin, Matt; Flatters, George (Policy & Practice, 2017)
Development is going digital and INGOs like Oxfam have a vital convening role to play. This paper draws on ICT for Development in Oxfam’s programmes in the Horn, East and Central Africa to consider what this role is.  In order to realise the opportunities

Developmental Evaluation - Tamarack Community (2012)
This webpage from Tamarack Community provides links to audio files of an interview between Mark Cabaj and Michael Patton in which they discuss the topic of development evaluation. This is an "approach that has proven particularly useful and effective at addressing the unique challenges of evaluating the real nature of community change work. Learning Objectives: To deepen appreciation for the role of evaluation and evaluation thinking To explore the distinctions between various types of evaluation To understand more about developmental evaluation and its use To investigate concepts, tools and resources available to support working with developmental evaluation methods" (Tamarack Community)

Developmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use - Patton, Michael Quinn (Guilford Press, 2010)
Developmental evaluation (DE) offers a powerful approach to monitoring and supporting social innovations by working in partnership with program decision makers. In this book, eminent authority Michael Quinn Patton shows how to conduct evaluations within a DE framework. Patton draws on insights about complex dynamic systems, uncertainty, nonlinearity, and emergence. He illustrates how DE can be used for a range of purposes: ongoing program development, adapting effective principles of practice to local contexts, generating innovations and taking them to scale, and facilitating rapid response in crisis situations. Students and practicing evaluators will appreciate the book's extensive case examples and stories, cartoons, clear writing style, "closer look" sidebars, and summary tables. Provided is essential guidance for making evaluations useful, practical, and credible in support of social change.See also Developmental Evaluation Exemplars, edited by Michael Quinn Patton, Kate McKegg, and Nan Wehipeihana, which presents 12 in-depth case studies.
Keywords: Evaluation; Measurement; Organizational effectiveness; Project management

Developmental evaluation: Bridging the gaps between proposal, program, and practice , Developmental evaluation: Bridging the gaps between proposal, program, and practice - Lawrence, Rachael B.; Rallis, Sharon F.; Davis, Laura C.; Harrington, Karen (Evaluation, 2018)
Developmental evaluation supports grant-funded initiatives seeking innovation and change. Programs born from aspirational grant language and plans often need guidance as they work toward creating workable models for social innovation. This article describes the challenge of designing and implementing complex programs and presents a case that illustrates how a program moves from proposal to practice. The Massachusetts Charter Public School Association Capacity Building Network is a complex intervention, funded by the US federal government, aimed at raising school capacity to serve students with disabilities and English language learners. Developmental evaluation served to bridge the gaps between an aspirational proposal, an ambitious and ambiguous program plan, and emerging practices to serve this population of students. Jointly reviewing our experience in this developmental evaluation, the evaluation team and a program director share important thematic lessons learned about the developmental evaluation approach., Developmental evaluation supports grant-funded initiatives seeking innovation and change. Programs born from aspirational grant language and plans often need guidance as they work toward creating workable models for social innovation. This article describes the challenge of designing and implementing complex programs and presents a case that illustrates how a program moves from proposal to practice. The Massachusetts Charter Public School Association Capacity Building Network is a complex intervention, funded by the US federal government, aimed at raising school capacity to serve students with disabilities and English language learners. Developmental evaluation served to bridge the gaps between an aspirational proposal, an ambitious and ambiguous program plan, and emerging practices to serve this population of students. Jointly reviewing our experience in this developmental evaluation, the evaluation team and a program director share important thematic lessons learned about the developmental evaluation approach.

Developmental Evaluation: How Barriers & Enablers Emerge Over Time - Baylor, Rebecca; Fatehi, Y. K.; Esper, H. (USAID, 2019)

Developmental Evaluation in Practice: Tips, Tools, and Templates - USAID (USAID, 2017)

DFID Data Disaggregation Action Plan: Better Data for Better Lives - DFID (2017)

DFID’s approach to delivering impact - ICAI (Independent Commission for Aid Impact (ICAI), 2015)
UK aid, at its best, makes a real and positive difference to the lives and livelihoods of poor people around the world. Ensuring the best possible performance across a large and multifaceted aid programme is, however, a complex management challenge. This report reviews ICAI’s previous 44 reports and looks at how well DFID ensures positive, long-term, transformative impact across its work.

DFID’s approach to value for money in programme and portfolio management - ICAI (Independent Commission for Aid Impact (ICAI), 2018)
ICAI published this review on DFID’s approach to value for money in February 2018, and as value for money is both a process and an outcome and cuts across all aspects of DFID’s operations, did not score this review. We made five recommendations and published a follow-up to this review in July 2019. All UK government departments are required to achieve value for money in their use of public funds. In recent years, DFID has been working to build value for money considerations further into its management processes and its relationships with implementers and multilateral partners, establishing itself as a global champion on value for money. Review This review was published in February. Though it was not rated, ICAI made five recommendations, and found that the Department for International Development’s approach to value for money was helping to make UK aid spending go further, but improvements are still needed. Findings This review found that DFID has strengthened its processes and systems for ensuring it gains maximum value for each pound spent, has taken swift remedial action to tackle under-performing programmes, and has become a strong global champion on value for money. The review also found that DFID has been diligent in its efforts to cut waste, detect fraud, and improve efficiency, and that this work is improving the return on the UK investment in aid. However, the review found that DFID’s approach was not adequately reporting and capturing results and value for money at the country portfolio level, or how programmes work together to deliver lasting impact, including reducing future dependency on aid. It also found that weakness in the annual review process could undermine DFID’s approach to value for money. It found that targets were frequently revised, and that there could be pressures for optimistic scoring of programmes. Recommendations Based on this review, we made the following five recommendations to help DFID improve its approach to value for money still further: DFID country offices should articulate cross-cutting value for money objectives at the country portfolio level, and should report periodically on progress at that level. Drawing on its experience with introducing adaptive programming, DFID should encourage programmes to experiment with different ways of delivering results more cost-effectively, particularly for more complex programming. DFID should ensure that principles of development effectiveness – such as ensuring partner country leadership, building national capacity and empowering beneficiaries – are more explicit in its value for money approach. Programmes should reflect these principles in their value for money frameworks, and where appropriate incorporate qualitative indicators of progress at that level. DFID should be more explicit about the assumptions underlying the economic case in its business cases, and ensure that these are taken into account in programme monitoring. Delivery plans should specify points in the programme cycle when the economic case should be fully reassessed. Senior responsible owners should also determine whether a reassessment is needed following material changes in the programme, results targets or context. Annual review scores should include an assessment of whether programmes are likely to achieve their intended outcomes in a cost-effective way. DFID should consider introducing further quality assurance into the setting and adjustment of logframe targets.

DFID’s partnerships with civil society organisations - A performance review - ICAI (Independent Commission for Aid Impact (ICAI), 2019)
DFID values civil society organisations (CSOs), but its funding and partnership practices do not fully support the long-term health of the civil society sector.

DFID Smart Rules: Better Programme Delivery - version VI (2016.10) - DFID (DFID, 2016)
Smart Rules provide the operating framework for the Department for International Development’s (DFID’s) programmes.
Keywords: IMPORTANT; Practice

DFID Smart Rules: Better Programme Delivery - version VII (2017.04) - DFID (DFID, 2017)
Smart Rules provide the operating framework for the Department for International Development’s (DFID’s) programmes.
Keywords: IMPORTANT; Practice

DFID Smart Rules: Better Programme Delivery - version VIII (2018.04) - DFID (DFID, 2017)
Smart Rules provide the operating framework for the Department for International Development’s (DFID’s) programmes.
Keywords: IMPORTANT; Practice

DFID Smart Rules: Better Programme Delivery - version X (2019.01) - DFID (DFID, 2019)

Dialogic Organization Development: The Theory and Practice of Transformational Change - Bushe, Gervase R. (EDS Publications Ltd., 2015)
Dialogic Organization Development is a compelling alternative to the classical action research approach to planned change. Organizations are seen as fluid,socially constructed realities that are continuously created through conversations and images change happens when those conversations and images change. Leaders and consultants can help foster, support, or accelerate the emergence of transformational possibilities by encouraging disruptions to taken-for-granted ways of thinking and acting and the use of generative images to stimulate new organizational conversations and narratives. Dialogic OD is a different mindset, but it s also the previously unrecognized underpinning of such diverse change methods as Appreciative Inquiry, the Art of Convening, Future Search, and many more.

Diffusion Of Innovations Theory, Principles, And Practice - Dearing, James W.; Cox, Jeffrey G. (Health Affairs, 2018)
Aspects of the research and practice paradigm known as the diffusion of innovations are applicable to the complex context of health care, for both explanatory and interventionist purposes. This article answers the question, “What is diffusion?” by identifying the parameters of diffusion processes: what they are, how they operate, and why worthy innovations in health care do not spread more rapidly. We clarify how the diffusion of innovations is related to processes of dissemination and implementation, sustainability, improvement activity, and scale-up, and we suggest the diffusion principles that can be readily used in the design of interventions.

Digital Democracy: The Tools Transforming Political Engagement - Simon, Julie; Bass, Theo; Boelman, Victoria; Mulgan, Geoff (NESTA, 2017)
This paper shares lessons from Nesta’s research into some of the pioneering innovations in digital democracy which are taking place across Europe and beyond

Digital Development: Elements of a Critical ICT4D Theory and Praxis - Bon, Anna; Akkermans, Hans (Springer International Publishing, 2019)
In recent years, critical research literature in ICT4D has grown. It is widely accepted that theory is to inform practice. However, the inverse directionality, practice informs theory, is much less present in ICT4D, including in critical research. In this paper, we discuss ways how ICT4D research and theory may be better informed by practice—in terms of (i) recognizing praxis-oriented research paradigms and integrating their results, (ii) development of foundational theories, (iii) critical analysis of ICT4D emerging policies, and (iv) positioning ICT4D in the wider development debate. This suggests several elements or directions in which critical research has the potential to push current boundaries of ICT4D in terms of content as well as relevance.
Keywords: Action research paradigm; Critical research; Network complexity theory; Principles for Digital Development

Digital lives in Ghana, Kenya and Uganda - Bailur, Savita; Donner, Jonathan; Locke, Chris; Schoemaker, Emrys; Smart, Charlotte (Caribou Digital, 2015)
Keywords: IMPORTANT

Digital Principles into practice - HDIF (HDIF, 2018)

Digital Technologies for Democratic Governance in Latin America: Opportunities and Risks - Breuer, Anita; Welp, Yanina (Routledge, 2016)
This book is the first to comprehensively analyse the political and societal impacts of new Information and Communication Technologies (ICT) in a region of the Global South. It evaluates under what conditions some Latin American governments and people have succeeded in taking up the opportunities related to the spread of ICTs, while others are confronted with the pessimist scenario of increased, digitally induced social and democratic cleavages. Specifically, the book examines if and how far the spread and use of new ICT affected central aims of democratic governance such as reducing socio-economic and gender inequality; strengthening citizen participation in political decision making; increasing the transparency of legislative processes; improving administrative processes; providing free access to government data and information; and expanding independent spaces of citizen communication. The country case and cross-country explore a range of bottom-up driven initiatives to reinforce democracy in the region. The book offers researchers and students an interdisciplinary approach to these issues by linking it to established theories of media and politics, political communication, political participation, and governance. Giving voice to researchers native to the region and with direct experience of the region, it uniquely brings together contributions from political scientists, researchers in communication studies and area studies specialists who have a solid record in political activism and international development co-operation.

Discussion Note: Complexity-Aware Monitoring - USAID (Program Cycle, 2018)
This Discussion Note complements ADS 201 and outlines general principles and promising approaches for monitoring complex aspects of USAID development assistance. Complexity-aware monitoring is a type of complementary monitoring that is useful when results are difficult to predict due to dynamic contexts or unclear cause and-effect relationships. Key principles of the Program Cycle include applying analytic rigor, managing adaptively, and utilizing a range of approaches to achieve results. ADS 201.3.5.5 identifies three types of program monitoring – performance, context, and complementary. All USAID programming incorporates performance monitoring and should include context monitoring. Performance monitoring “is the ongoing and systematic collection of performance indicator data and other quantitative or qualitative information to reveal whether implementation is on track and whether expected results are being achieved.” Context monitoring is “[t]he systematic collection of information about conditions and external factors relevant to the implementation and performance of an operating units (OU’s) strategy, projects, and activities.” As stated in ADS 201.3.5.5, complementary monitoring may be used by missions and Washington OUs to complement performance and context monitoring in situations where results are difficult to predict due to dynamic contexts or unclear cause-andeffect relationships. This Discussion Note provides an explanation of when to use complementary monitoring approaches that are complexity-aware and summarizes the three principles of complexity-aware monitoring.

Dispatch on Switzerland's International Cooperation 2017–2020: Key points in brief - SDC (Federal Department of Foreign Affairs FDFA, 2016)
The “Dispatch on Switzerland’s International Cooperation, 2017–2020”, is a report to the Swiss Parliament outlining the strategic priorities proposed by the Federal Council in this area. It includes framework credits for each of the five policy instruments used by Switzerland to implement its international cooperation strategy. These are implemented by the Swiss Agency for Development and Cooperation (SDC) of the Federal Department of Foreign Affairs (FDFA), the Human Security Division (HSD) of the FDFA’s Directorate of Political Affairs, and the State Secretariat for Economic Affairs (SECO) of the Federal Department of Economic Affairs, Education and Research (EAER).

DIY - Development Impact and You: Practical Tools to Trigger and Support Social Innovation - Nesta (NESTA, 2014)
Keywords: IMPORTANT

Does Foreign Aid Really Work? An Updated Assessment - Riddell, Roger C. (Social Science Research Network, 2014)
This paper draws widely from the book Does foreign aid really work?, building on that discussion to provide an updated answer to the question based on recent evidence and contemporary debates on aid effectiveness. It starts with a brief discussion (Section 2) of the question: ‘does emergency aid work?’ This is important to the wider debate for two linked reasons. Firstly, the harshest critics of development aid are all supportive of emergency aid, with a number calling for its expansion in spite of evidence of major weaknesses and failures. Secondly, the sharp historical distinction made between emergency and development aid is becoming increasingly strained, as more emergency aid is being used a year or more after emergencies strike to rebuild lives and restore livelihoods, while more development aid is used to directly save lives.The rest of the paper focuses exclusively on development aid. Section 3 provides a rapid overview of the evidence of the impact of individual aid projects, including those of Non-Governmental Organisations (NGOs). The picture is overwhelmingly positive: well over 75% of projects meet their immediate objectives and impact has improved, even though sustaining benefits remains a challenge and there continue to be aid failures. Section 4 reviews the evidence of the wider and long-term impact of aid at the sectoral and country level, including a brief discussion of academic studies on aid and growth. Though there are still major gaps in our knowledge, the quality of the data is improving. However, there is little firm, quantitative evidence to show the specific contribution that aid has made to help achieve the Millennium Development Goals (MDGs), which are a central purpose of many current donor programmes (Section 4.2). More widely, there is plenty of evidence to suggest that aid has contributed positively to both growth and wider development at the sector and country level, though some studies suggest aid has had little or no impact. Overall, the contribution that aid makes to aggregate development is lower than the public has been led to believe (Sections 4.1, 4.3. and 4.4). Assessments of the overall impact of the aid provided by NGOs are rare, but a recent study suggests it has been positive (Section 4.5). More attention is now given to the issues of corruption in aid. Although there is evidence of aid funds being used for corrupt purposes and of aid worsening corruption, on balance it remains a minor issue. Aid has had significant successes in helping the poor affected by corruption (Section 4.6). The second half of the paper shifts focus to the large gap between what aid has done and what it might do. Section 5 discusses a range of inefficiencies within and across the aid system and their costs in terms of reduced impact, including the way aid is allocated, its growing complexity, and the volatility and unpredictability of aid flows (Section 5.1 and 5.2). These inefficiencies place in a different light the evidence of aid’s overall positive impact. The paper looks at the different initiatives that have been mounted to begin to address these weaknesses and failures, including the 2005 Paris Declaration, and discusses why donors have failed to honour the promises they have made to change the ways that they give aid.In Section 5.3, the paper argues that the most critical debate about whether aid works concerns the assessment of whether the short-term, immediate and extensive benefits that aid undoubtedly brings are outweighed by the direct and indirect systemic problems that it risks creating or accentuating. As increasingly over the last decade donors have channelled more of their aid into short-term, quick-impact projects, assessing the wider negative systemic effects of aid has become even more important. Some recent studies suggest that aid’s systemic problems are large and growing, narrowing the gap between aid’s harshest critics and broader analyses of aid impact. Against the backdrop of already too many proposals of how to make aid work better, Section 6 lays out nine concrete proposals for doing this: deepening knowledge of local contexts; ensuring short-term uses of aid are consistent with and supportive of long-term development, and that all aid is more closely related to overall recipient development goals and processes; helping build local capacities for recipients to be able to coordinate aid better; moving from rhetoric to reality in learning lessons from aid; using aid to help the poor in middle income countries; reducing volatility in aid at the country level; encouraging budget support by addressing donor-country political concerns; and rethinking ways of communicating about aid. Section 7 concludes. It suggests that, paradoxically, aid’s impact may well have been harmed by focussing too narrowly on trying to make short-term aid work better, and that the main focus of attention needs to widen to assess how aid can contribute more to a recipient’s own development goals. Additionally, donors need to help build the capacity of developing countries and developing country scholars to enable them to play a bigger role in helping to answer the question of whether aid works; unsettling though their assessments may be.

Doing Accountability Differently: A 'Vertically Integrated' Approach - Amakom, Uzochukwu; Fashola, Temitope; Gay, Charles; Shutt, Cathy (Christian Aid, 2018)

Doing adaptive management at Sida - Tim Ruffer; Helen Bailey; Stefan Dahlgren; Patrick Spaven; Mark Winters (Evaluation Brief, 2019)
Lessons from the market systems development approach The evaluation focuses on Sida’s management of MSD projects. The projects are applying the MSD approach with an aim to: - contribute to improved MSD programming by Sida through better management practices across the project cycle - generate recommendations on how Sida can create conducive conditions for systems approaches and adaptive programming more generally. The brief assesses Sida’s organisational capacity for adaptive management in three dimensions: - leadership and culture - staff capacities - skills, and systems and procedures

Doing Anti-corruption Differently - Jorge (www.globalintegrity.org, 2016)
By Alan Hudson, Executive Director Corruption and how to tackle it is center-stage in London this week, with the spotlight brighter than ever as a result of the Panama Papers. This is welcome news. The Anti-Corruption Summit, hosted by the...

Doing Development Differently at Scale - Pellini, Arnaldo; Karetji, Petrarca C.; Soekadis, Ade (Knowledge, Politics and Policymaking in Indonesia, 2018)
In recent decades there has been an increasing recognition that politics and political institutions matter for development. There is also a much greater interest in contextually grounded approaches. This has stemmed from an acknowledgement that purely technocratic approaches to development often result in failure because they do not take into account the nature of political institutions. Nor do they take account of the context in a particular developing country and the interests and incentives of powerful national actors. Policy processes are embedded in specific social, political and organisational contexts. Approaches that focus on implementing universal best practices in evidence-informed policymaking are unlikely to be successful. Instead, what is needed is an approach that takes the local context as the starting point for understanding what issues are relevant to policymakers and developing contextually appropriate solutions. The authors of this chapter reflect on the management approaches and systems that may be required to enable and support large-scale development programmes to be flexible and adaptive to the local policy context and circumstances. The chapter argues that such programmes struggle to adopt adaptive management principle and that to do that at scale requires some changes in the way such programmes are managed.
Keywords: Adaptive Management; Doing development differently; Evidence-informed policymaking; Indonesia; Knowledge sector; Thinking and working politically

Doing Development Differently at the World Bank: updating the plumbing to fit the architecture - Bain, Katherine A.; Booth, David; Wild, Leni (ODI, 2016)
Keywords: IMPORTANT

Doing Development Differently in the Global South - Workshop Report - CARE (CARE and British Council, 2018)

Doing Development Differently: Understanding the Landscape and Implications of New Approaches to Governance and Public-sector Reforms - Fritz, Verena (Transformation, Politics and Implementation, 2017)
Seeking to accelerate development, the agencies and individuals involved have regularly advanced new ideas of how external support can function better, deliver more, and achieve greater impact. There has been a particular flourishing of new ideas within the broad field of governance and public-sector reforms in the 2000s. This chapter starts off with a review of the “landscape of new ideas,” focusing on five proposed approaches in particular: political economy analysis (PEA), Problem-Driven Iterative Adaptation (PDIA), Doing Development Differently (DDD), Thinking and Working Politically (TWP), and the “science of delivery.” It sets out the “problem-diagnostic” that underpins each of these

Doing Development Differently: Who we are, What we’re doing, What we’re learning - ODI (ODI, 2016)
In November 2014, the doing development differently community got together in Harvard to discuss what successful development interventions look like. Two years on, our community is broader than aid. It's broader than donors. It's about all organisations delivering change, producing real solutions to real problems that have real impact. It's about building trust, empowering people and promoting sustainability. Over the past two years, the community has been putting these ideas into practice across the world – being honest about what we are learning, including where we are not getting things right. This document aims to be an entry point for anyone interested in doing development differently. It explores the things that could be stopping you including: You are constrained by a disabling environment. You have strict reporting requirements. People aren't sold on the idea. It's easier to do things the way you've always done it. It's difficult to do in practice. If you are facing one, several, or all of these constraints, this document gives you a place to start. Using 43 case studies from practitoners within donors, governments, implementing organisations and NGOs across the globe, we aim to draw out some key lessons learnt, and give some advice for people considering this approach. These case studies are split across five categories: Swimming against the tide. Working in and with government. Feedback loops and data. Organisational change. Diffusion. Finally, if you want to know more, the document concludes with a suggested list of blogs and reports which explain these concepts in more detail.
Keywords: IMPORTANT

Doing Digital Development Differently: Lessons in adaptive management from technology for governance initiatives in Kenya - Prieto Martin, Pedro; Hernandez, Kevin; Faith, Becky; Ramalingam, Ben (MAVC Research Report, 2017)
Development projects don’t always work as planned. This has long been acknowledged by those in the sector, and has led to several approaches that seek to solve complex development problems through enabling and encouraging greater adaptiveness and learning within projects (e.g. Doing Development Differently and Problem-Driven Iterative Adaptation). Digital development projects experience many of these issues. Using technology for transparency and accountability (Tech4T&A) projects in Kenya as case studies, our research analysed the many different theoretical approaches to learning and adaptation, and then tested how these play out in reality. Firstly, we conducted an extensive review of the literature on the spectrum of approaches to adaptive learning. The findings were used to develop a framework through which to analyse adaptiveness at the different layers of complexity in projects (e.g. software design and development, programme design and management). The second part of the research consisted of interviews and focus group discussions with participants in Tech4T&A projects in Kenya. Respondents helped us identify the main characteristics of adaptiveness in their projects (e.g. who needs to adapt, and how and when) and the challenges and issues that inhibit projects’ abilities to be adaptive. This process also revealed how accountability interplays with adaptiveness, and considered how better collaboration flows can enable adaptiveness. From our literature review and empirical study, we draw several conclusions for increasing adaptiveness in digital development projects. These include simplifying the many adaptive theories that abound, increasing responsiveness to project beneficiaries and stakeholders, and for stakeholders to keep on experimenting, networking and advocating.
Keywords: IMPORTANT

Doing Iterative and Adaptive Work - Andrews, Matt; Pritchett, Lant; Woolcock, Michael (CID Working Paper, 2016)
Many of the challenges in international development are complex in nature. They involve many actors in uncertain contexts and with unclear solutions. Our work has proposed an approach to addressing such challenges, called Problem Driven Iterative Adaptation (PDIA). This paper is the most recent in a series intended to show how one can do PDIA, building on the first paper, "Doing Problem Driven Work.” The current paper addresses a key part of the approach one moves to once a problem has been identified, performing real-time experimental iterations. This is intended as a practical paper that builds on experience and embeds exercises for readers who are actually involved in this kind of work.
Keywords: IMPORTANT

Doing legal empowerment differently: Learning from pro-poor litigation in Bangladesh - O'Neil, Tam; Valters, Craig; Farid, Cynthia (ODI, 2015)
Marginalised groups and their allies can, and do, use the law and justice systems, including public interest litigation, to improve their access to rights, goods and services.  Yet there is no automatic link between legal action and improved outcomes for poor people.  Where some minimum conditions are met – a progressive legal framework, a sympathetic judiciary and legal advocacy organisation – pro-poor litigation is a potential tool in disputes over rights and resources.  But concrete benefits for poor people also requires state action to enforce progressive rulings.  Much depends on whether claimants, legal activists and state reformers cooperate around shared interests, and whether activists can negotiate power and interest structures to motivate government action to implement rulings.  Effective strategies are those that link litigation with grassroots legal action and other forms of political and social activism and advocacy.  Donors need to fund legal advocacy organisations in ways that enable them to select social issues that are locally relevant and political feasible – and allows activists and reformers to work in politically smart and adaptive ways.

Doing Problem Driven Work - Andrews, Matt; Pritchett, Lant; Woolcock, Michael (HKS Working Paper, 2015)
Keywords: IMPORTANT

Doing the Transparent State: open government data as performance indicators - Ruppert, Evelyn; others (A World of Indicators: The production of knowledge and justice in an interconnected world, 2013)

Doing things differently: Rethinking monitoring and evaluation to understand change - Saferworld (Saferworld, 2016)
Doing things differently: Rethinking monitoring and evaluation to understand change Learning paper Over the past four years, Saferworld has put in place a way of monitoring, evaluating and learning from our work focused on behaviour and relationship change. This paper outlines the process we have gone through to adapt, embed, and embrace an approach inspired by Outcome Mapping and Outcome Harvesting (OH). Key benefits of our monitoring, evaluation and learning approach are: It is simple, but promotes complex discussion and analysis. It allows conflict- and gender-sensitivity to be built into programmes; it promotes analysis of and adaptation to context. Bringing front-line staff and partners into wider conversations with others substantially increases cross-organisational learning.

Doing Urban Development Differently - Jones, Harry; Adhikari, Bishnu (From Poverty to Power, 2017)
Guest post from Harry Jones and Bishnu Adhikari, both of Palladium on what urban aid and development can learn from the Doing Development Differently movement

Donor Committee for Enterprise Development (DCED, 2018)
The DCED is a forum for learning about the most effective ways to fulfil the SDGs – based on practical experience in Private Sector Development (PSD).

Donor perceptions and processes: Risks to success of adaptive programming? - Browse - Knowledge Platform Security & Rule of Law - Donovan, Elbereth (Knowledge Platform - Security & Rule of Law, 2017)
Keywords: IMPORTANT

(Draft) Managing to Adapt - Analysing Adaptive Management for Planning, Monitoring, Evaluation, and Learning (draft) - Schlingheider, Annika; Pellfolk, Erica; Maneo, Gabriele; Desai, Harsh (Oxfam Research Reports, 2017)
Adaptive management is at the heart of ‘doing development differently’ (Wild et al., 2016). Whether it is here to stay depends on how much it is mainstreamed into existing development programming by donors and implementers alike, especially in planning, monitoring, evaluation, and learning (PMEL) cycles. In this report, we find that mainstreaming adaptive management in PMEL involves three strategies: 1. planning for flexibility; 2. developing locally owned monitoring and evaluation (M&E); and 3. creating an enabling environment for learning. Adopting these strategies contributes to virtuous cycles of PMEL

DRG Center practical tips to implement more context-adaptive programming - Jacobstein, David (#AdaptDev, 2018)
Hi #adaptdevers, The cross-sectoral programs team in the DRG Center have been working in support of ways that programming can be made more aware of, and responsive to, context considerations that have to do with incentives and relationships between different actors - often called power dynamics or political economy. Following several discussions with field folks, we were asked to come up with simple and practical tips that could help staff to implement more context-adaptive programming, or to better Work Politically to use TWP jargon. With assistance from many of our field staff and partners, we've put together three documents (to start) that have now been cleared to share publicly: • Tips on Making Your Solicitations Invite Context-Driven Adaptive Programming - suggestions spanning most sections of a typical solicitation to better weave in Thinking and Working Politically. I'm particularly excited that this document contains embedded links to excerpts from a set of solicitations that model good practice. You can also find a summary of all the excerpts from real solicitations, and links onward to the public posting of those solicitations on Fed Biz Ops or Grants.gov, here. • Tips on Power Dynamics and Theories of Change - suggestions relevant to those working on project designs and logic models. • Tips for Better Use of Advisory Councils - suggestions to set up better advisory bodies that help you to incorporate political economy more automatically into your programmatic adjustments. I hope that you'll find these practical and helpful! Feedback is always welcome. Best, David

Dynamic gridlock: Adaptive Humanitarian Action in the Democratic Republic of Congo - Obrecht, Alice (ALNAP Country Study, 2018)

edX MOOC: Adaptive Leadership in Development - edX (edX, 2016)
Gain the skills to be an adaptive leader in development and learn how to uncover local solutions to complex problems in developing countries.

Effective Governance. Strategy for Australia’s aid investments - DFAT (Department of Foreign Affairs and Trade, Australian Government, 2015)

Eight Practices for Strategic Agility - Algoso, Dave (Stanford Social Innovation Review, 2019)
Rather than a glossy brochure that no one reads, your strategy should be an ongoing practice that informs your decisions and adapts as circumstances change. A Viewpoint from the Summer 2019 issue.

Embracing Complexity: Strategic Perspectives for an Age of Turbulence - Boulton, Jean G.; Allen, Peter M.; Bowman, Cliff (Oxford University Press, 2015)
The book describes what it means to say the world is complex and explores what that means for managers, policy makers and individuals. The first part of the book is about the theory and ideas of complexity. This is explained in a way that is thorough but not mathematical. It compares differing approaches, and also provides a historical perspective, showing how such thinking has been around since the beginning of civilisation. It emphasises the difference between a complexity worldview and the dominant mechanical worldview that underpins much of current management practice. It defines the complexity worldview as recognising the world is interconnected, shaped by history and the particularities of context. The comparison of the differing approaches to modelling complexity is unique in its depth and accessibility. The second part of the book uses this lens of complexity to explore issues in the fields of management, strategy, economics, and international development. It also explores how to facilitate others to recognise the implications of adopting a complex rather than a mechanical worldview and suggests methods of research to explore systemic, path-dependent emergent aspects of situations. The authors of this book span both science and management, academia and practice, thus the explanations of science are authoritative and yet the examples of changing how you live and work in the world are real and accessible. The aim of the book is to bring alive what complexity is all about and to illustrate the importance of loosening the grip of a modernist worldview with its hope for prediction, certainty and control.

Embracing Emergence: How Collective Impact Addresses Complexity - Kania, John; Kramer, Mark (Stanford Social Innovation Review, 2013)
Collective impact is upending conventional wisdom on how we achieve social progress.

Embracing the Chaotic: Cynefin and Humanitarian Response - Morealtitude (WanderLust, 2010)
Note: Many thanks to Dave Snowden for his willingness to comment on this article prior to release Because I’m always a little behind the eight-ball, a friend of mine* recently introduced me to the …

Emerging Opportunities: Monitoring and Evaluation in a Tech-Enabled World - Raftree, Linda; Bamberger, Michael (Discussion Paper, 2014)
Monitoring and evaluation practice is using information and communication technologies for more timely data, and more inclusive voice and feedback.

Emerging Technologies: Smarter ways to fight wildlife crime - Cressa, Douglas; Zommers, Zinta (Environmental Development, 2014)
The illegal trade of animals—for luxury goods, traditional medicine or cultural ceremonies, pets, entertainment, and even research—is a major threat to wildlife conservation and welfare (Baker et al., 2013). Poachers and illegal traders use highly sophisticated and rapidly changing techniques to avoid detection. To keep pace with the "war on wildlife", conservation and law enforcement communities have started to adopt cutting-edge military tools and techniques. High-tech equipment can magnify counter-poaching efforts without requiring armies of rangers or risking lives. Tools include acoustic traps, mobile technology, mikrokopters, radio frequency identification tags, encrypted data digital networks, camera traps, DNA testing, radio collars, metal scanners, and satellite imagery.

Empowerment and Accountability in difficult settings: What are we learning? - Gaventa, John; Oswald, Katy (Key messages emerging from theAction for Empowerment and Accountability Programme, 2019)
Empowerment and Accountability in Difficult Settings: What Are We Learning? Key Messages Emerging from the Action for Empowerment and Accountability Programme Empowerment and accountability have long been part of the international development vocabulary and a core part of governance, social development and civil society programmes. Yet, much of what has been learnt about these approaches has been drawn from studies in somewhat stable, open and middle-income places around the world. Less is known about how empowerment and accountability are achieved through social and political action in more difficult settings – those faced by institutional fragility, conflict, violence, and closing civic space. This document highlights key messages emerging from the work of the Action for Empowerment and Accountability Research Programme (A4EA), and the implications for how donors, policy makers and practitioners support strategies for empowerment and accountability in fragile, conflict and violence affected settings (FCVAS). Our eight key messages have strong implications for the theories of change used for effective programming in the field.

Empowerment evaluation - Fettermen, David (2014)

Enabling citizen-driven improvement of public services. Leveraging Technology to Strengthen Accountability in Nigerian Healthcare - ICT4SA (World Bank and Reboot, 2015)
Effective public service delivery begins with knowing whether the services offered are working as intended. We launched a system to enable citizen input on the delivery of public services.

Enabling collaboration and synthesis: in brief - Cochrane, Logan; Cundill Kemp, Georgina; Landry, Marie-Eve; Lee, Rebecca (INBRIEF, 2017)
Collaborative Adaptation Research Initiative in Africa and Asia (CARIAA) aims to build the resilience of vulnerable populations in climate change hotspots by building new knowledge and capacities to support better informed policy and practice. The program connects more than 450 researchers and practitioners from over 40 organizations. Initially, CARIAA was not directive in terms of the specific topics or forms of synthesis. This approach allowed new ideas to emerge from interactions between members of the network. However, as the brief outlines, lessons learned at mid-term regarding cross- consortia collaboration and synthesis indicate that greater programmatic leadership is required.

Enabling collaborative synthesis in multi-partner programmes - Cochrane, Logan; Cundill, Georgina (Development in Practice, 2018)
Multi-partner consortia have emerged as an important modality for knowledge generation to address complex sustainability challenges. Establishing eﬀective multi-partner consortia involves signiﬁcant investment. This article shares lessons from the Collaborative Adaptation Research Initiative in Africa and Asia (CARIAA), which aims to support policy and practice for climate change adaptation through a consortium model. Key lessons include the need to facilitate collaborative spaces to build trust and identify common interests, while accepting that this is not a guarantee of success; the importance of programmatic leadership to achieve synthesis; and the value of strategic planning in supporting motivation and alignment between partners.

Engaging Farmers in Climate Change Adaptation Planning: Assessing Intercropping as a Means to Support Farm Adaptive Capacity - Himanen, Sari J.; Mäkinen, Hanna; Rimhanen, Karoliina; Savikko, Riitta (Agriculture, 2016)
Agriculture is one of the most vulnerable and adaptation-prone sources of livelihood facing climate change. Joint adaptation planning by farmers and researchers can help develop practically feasible and environmentally and economically sound adaptation actions as well as encourage the proactive building of farm adaptive capacity. Here, the perceptions of Finnish farmers and rural stakeholders regarding intercropping, the cultivation of two or more crop genotypes together in time and space, as a means to prepare for climate change, were collected in an open workshop. Our aim was to identify the potentials and challenges associated with intercropping, its role as an adaptation strategy, and in farm adaptive capacity. Qualitative analysis revealed better yield security, increased nutrient and protein self-sufficiency, soil conservation and maintenance, reduced pathogen pressure and regulation of water dynamics as the main perceived potentials of intercropping. Potentials relating to the farm economy and environment were also recognized. The main challenges associated with intercropping were related to the lack of information on crop variety performance and optimal yielding in mixtures, industry and policy requirements for seed purity, more complicated crop management and harvesting, and the economic risks associated with experimenting with novel mixtures. Nitrogen-fixing legumes; deep-rooted species, such as lucerne (Medicago sativa L.); special crops, such as herbs in forage mixtures; and autumn-sown winter oilseeds and cereals were highlighted as the most promising intercrops. Because the recognized potentials relate to the safeguarding of field cropping from anticipated climate change and the associated weather variability, we conclude that intercropping can serve as one adaptation strategy to strengthen the adaptive capacity of Finnish farms. However, assuring markets and policies that allow the development of intercropping, performing experiments to assess the benefits and implement options in practice, and providing farmers and farm advisors with more knowledge on the method represent the critical prerequisites for the broader adoption of intercropping.
Keywords: Adaptation planning; Adaptive capacity; Climate change; ecological intensification; intercropping; yield security

Engaging Stakeholders in Planning for Sea Level Rise and Resilience - Yusuf, Juita-Elena (Wie); John, Burton St; Covi, Michelle; Nicula, J. Gail (Journal of Contemporary Water Research & Education, 2018)
This case study describes a region-wide, multi-sectoral, and whole-of-community stakeholder engagement approach for addressing sea level rise (SLR) and flooding. This approach was implemented through a university-led community engagement event, the Hampton Roads Resilient Region Reality Check (H4RC), which allowed an examination of its effectiveness as a mechanism for capturing community-wide perceptions regarding SLR, flooding, and associated risks; engaging stakeholders in discussion within and across different groups; and assessing community willingness to address flooding and SLR. The results show that the event helped participants broaden their perspectives and understanding of flooding and SLR. In an approach that called for participants to engage in social learning across social networks, the event had some effect on individual efficacy. However, there was little impact on participants' already-established perception that the region does not possess significant willingness to take action.
Keywords: Social learning; flooding; resilience; social capital; stakeholder engagement

Engineering Complex Scaled Up Innovations in the Humanitarian and Development Sector - McClure, Dan; Gray, Ian (ThoughtWorks, 2015)

Engines of Change: What Civic Tech can learn from Social Movements - Purpose; Omidyar Network (Omidyar Network and Purpose, 2016)

EPE Week: Lee-Anne Molony on Collaborative Outcomes Reporting - Molony, L A (AEA365 a Tip-a-day by and for Evaluators, 2013)
This AEA365 blog, written by Lee-Anne Molony a Principal Consultant at Clear Horizon, provides a brief overview on Collaborative Outcomes Reporting (COR).

Escaping Capability Traps through Problem-Driven Iterative Adaptation (PDIA) - Andrews, Matt; Pritchett, Lant; Woolcock, Michael (HKS Working Paper, 2012)
Keywords: IMPORTANT

Essentials of Utilization-Focused Evaluation - Patton, Michael Quinn (SAGE Publications, 2011)
Based on Michael Quinn Patton's best-selling Utilization-Focused Evaluation, this briefer book provides an overall framework and essential checklist steps for designing and conducting evaluations that actually get used. The new material and innovative graphics present the utilization-focused evaluation process as a complex adaptive system, incorporating current understandings about systems thinking and complexity concepts. The book integrates theory and practice, is based on both research and professional experience, and offers new case examples and cartoons with Patton's signature humor.
Keywords: Reference / Research; Research

EvalC3 - Davies, Rick (2019)
Tools for developing, exploring and evaluating predictive models of expected outcomes

Evaluability assessment for Impact Evaluation: Guidance, checklists and decision support - Peersman, Greet; Guijt, Irene; Pasanen, Tiina (ODI, 2015)
This guidance note focuses on the utility of, and guidance for, evaluability assessment before undertaking an impact evaluation. The primary audience for this guidance note is evaluators conducting an evaluability assessment for impact evaluation. The secondary audience is people commissioning or managing an evaluability assessment for impact evaluation, as well as funders of an impact evaluation. Sections one and two provide an overview of evaluability assessment and how it can be used for impact evaluation. Section three provides guidance for planning to undertake an evaluability assessment for impact evaluation. This is informative for all intended users of the guidance note. Section four includes checklists and decision support for evaluability assessments. The checklist is geared to those conducting the evaluability assessment and can be adapted to suit a particular context or purpose. The decision support provides those conducting an evaluability assessment with evidence-based recommendations for impact evaluation funders and commissioners, about whether, when and how to proceed with the evaluation. Sections five and six provide guidance on what to do after the assessment is concluded, and offer lessons learned from evaluability assessments in practice.

Evaluating Community Impact: Capturing and Making Sense of Community Outcomes - Tamarack Institute (2017)

Evaluating complex interventions: A theory-driven realist-informed approach - Douthwaite, Boru; Mayne, John; McDougall, Cynthia; Paz-Ybarnegaray, Rodrigo (Evaluation, 2017)
There is a growing recognition that programs that seek to change people’s lives are intervening in complex systems, which puts a particular set of requirements on program monitoring and evaluation. Developing complexity-aware program monitoring and evaluation systems within existing organizations is difficult because they challenge traditional orthodoxy. Little has been written about the practical experience of doing so. This article describes the development of a complexity-aware evaluation approach in the CGIAR Research Program on Aquatic Agricultural Systems. We outline the design and methods used including trend lines, panel data, after action reviews, building and testing theories of change, outcome evidencing and realist synthesis. We identify and describe a set of design principles for developing complexity-aware program monitoring and evaluation. Finally, we discuss important lessons and recommendations for other programs facing similar challenges. These include developing evaluation designs that meet both learning and accountability requirements; making evaluation a part of a program’s overall approach to achieving impact; and, ensuring evaluation cumulatively builds useful theory as to how different types of program trigger change in different contexts.

Evaluating Complexity. Propositions for improving practice - Preskill, Hallie; Gopal, Srik (FSG, 2014)
9 propositions can help evaluators measure progress on complex social problems.
Keywords: IMPORTANT

Evaluating Countering Violent Extremism: Practice and Progress - Fink, Naureen Chowdhury; Romaniuk, Peter; Barakat, Rafia (Center on Global Counterterrorism Cooperation, 2013)

Evaluating development projects: exploring a synthesis model of the logical framework approach and outcome mapping - Yang, Ting (2018)
Under the current results-driven development agenda, sound evaluation, and a corresponding evaluation toolkit, need to be in place to examine whether and to what extent development interventions have achieved their targeted objectives and results, and to generate lessons for further development learning and improvement. My review of the literature shows that innovative and appropriate evaluation approaches are needed to address key challenges in evaluation such as the tension between learning and accountability objectives, the need to unpack the mechanisms linking outputs and outcomes or goal, and to add an actor perspective. Irrespective of project type, the Logical Framework Approach (LFA) is often a standard requirement of major official donor agencies on projects they fund, so as to fulfil bureaucratic imperatives. However, it is often considered inadequate in addressing key challenges in development evaluation. Given the dominant status of the LFA with such strong support from donors, it is helpful to seek a ‘middle way’: a combination of the LFA with other approaches in order to address some of its inadequacies, while satisfying donor agencies’ requirements. A synthesis of the LFA and Outcome Mapping (OM) is one such option. This thesis explores the practical value and usefulness of a synthesis model empirically. Applying the model in two case study aid projects, I found that it serves well as a theory-based evaluation tool with a double-stranded (actor strand and results chain) theory of change. The model helps reconcile learning and accountability and add explanatory power and an explicit actor perspective. It also helps establish causation and enable attribution claims at various results levels with its different elements. The model has some limitations but my results suggest it can be usefully adopted. The choice of its application depends on project evaluation context and purpose in specific cases.

Evaluating Humanitarian Innovation - Obrecht, Alice; Warner, Alexandra; Dillon, Neil (HIF-ALNAP working paper, 2017)

Evaluating interventions that prevent or counter violent extremism: A practical guide - Hofman, Joanna; Sutherland, Alex (RAND Corporation, 2018)

Evaluating megaprojects: From the ‘iron triangle’ to network mapping - Lehtonen, Markku (Evaluation, 2014)
Evaluation literature has paid relatively little attention to the specific needs of evaluating large, complex industrial and infrastructure projects, often called ‘megaprojects’. The abundant megaproject governance literature, in turn, has largely focused on the so-called ‘megaproject pathologies’, i.e. the chronic budget overruns, and failure of such projects to keep to timetables and deliver the expected social and economic benefits. This article draws on these two strands of literature, identifies shortcomings, and suggests potential pathways towards an improved evaluation of megaprojects. To counterbalance the current overemphasis on relatively narrowly defined accountability as the main function of megaproject evaluation, and the narrow definition of project success in megaproject evaluation, the article argues that conceptualizing megaprojects as dynamic and evolving networks would provide a useful basis for the design of an evaluation approach better able to promote learning and to address the socio-economic aspects of megaprojects. A modified version of ‘network mapping’ is suggested as a possible framework for megaproject evaluation, with the exploration of the multiple accountability relationships as a central evaluation task, designed to reconcile learning and accountability as the central evaluation functions. The article highlights the role of evaluation as an ‘emergent’ property of spontaneous megaproject ‘governing’, and explores the challenges that this poses to the role of the evaluator.