Learning, monitoring and evaluating: achieving and measuring change in adaptive programmes - Callaghan, Sarah; Plank, Georgia (Synthesis Paper, 5, 2017)

Learning Lab - Collaborate, Learn and Adapt for better development outcomes - Learning Lab (USAID, 2013)
CLA is: a component of several missions' CDCSes. a conceptual framework for some principles and operational processes that can enable USAID to become a more effective learning organization and thereby a more effective development organization. an approach to facilitating local participation and capacity and promoting country-led development. For more information on CLA visit:

‘Learning journeys’ for adaptive management – Where does it take us? - Ørnemark, Charlotte (GPSA Note 12, 2016)
Keywords: IMPORTANT

Learning in the Thick of It - Darling, Marilyn; Parry, Charles; Moore, Joseph (Harvard Business Review, 2005)
After-action reviews identify past mistakes but rarely enhance future performance. Companies wanting to fully exploit this tool should look to its master: the U.S. Army’s standing enemy brigade, where soldiers learn and improve even in the midst of battle.
Keywords: Aerospace sector; Corporate governance; Decision making and problem solving; Defense industry; Defense sector; Fabrication and manufacturing; Meeting management; Military; North America; Organizational culture; Presentation skills; Project management; Psychology; Telecom

Learning in Development Co-operation - Carlsson, Jerker; Wohlgemuth, Lennart (Almqvist & Wiksell International, 2000)

Learning how to learn: eight lessons for impact evaluations that make a difference - Ramalingam, Ben (ODI, 2011)
This Background Note outlines key lessons on impact evaluations, utilisation-focused evaluations and evidence-based policy. While methodological pluralism is the key to effective impact evaluation in development, the focus here is on the factors that need to be considered for impact evaluations to be used in policy and practice – regardless of the method employed.

Learning how to go local: Lessons from six learning journeys for the Open Government Partnership - Moses, Michael; Soal, Sue (2017)
This brief reviews the evidence from Learning to Make All Voices Count (L-MAVC), a programme funded by Making All Voices Count, and implemented in collaboration with Global Integrity. L-MAVC intended to support six Making All Voices Count grantees, working in five countries, in co-creating and applying a participatory, learning-centred, and adaptive approach to strengthening citizen engagement in governance processes in their contexts, including with respect to the Open Government Partnership (OGP). The evidence from L-MAVC suggests that supporting citizen engagement with, and use of, OGP, and improving the extent to which OGP commitments are shaped by and matter to citizens in subnational districts, is not straightforward. Findings suggest that efforts to broaden and deepen citizen engagement with OGP, including at subnational levels, may be more effective when combined with support that helps local OGP champions iteratively learn and adapt, and discover and apply localisation models that fit best in their contexts. OGP and its partners may strengthen the impact of the initiative, and indeed, the impact of those working to leverage OGP at and below country level, by making structured learning support more available to local reformers. Targeted advocacy, focused on institutionalising collaborative OGP processes, and on linking subnational action with National Action Plans (NAPs), may also be useful.

Learning from Results-Based Management evaluations and reviews - Vähämäki, Janet; Verger, Chantal (Development Co-operation Working Papers, 2019)
What have we learned from implementing results-based management in development co-operation organisations? What progress and benefits can be seen? What are the main challenges and unintended consequences? Are there good practices to address these challenges? To respond to these questions this paper reviews and analyses the findings from various evaluations and reviews of results-based management systems conducted by members of the Development Assistance Committee (DAC), the OECD/DAC Results Community Secretariat and other bodies in the past four years (2015-2018). It also draws on emerging lessons from new methods for managing development co-operation results. This analytical work aims to: identify recent trends in results-based management, explore challenges faced by providers when developing their results approaches and systems, select good practices in responding to these challenges that can be useful for the OECD/DACResults Community, considering new approaches, new technologies and evolving contexts. This body of evidence will inform the development of a core set of generic guiding principles for results-based management in development co-operation.

Learning from Life Story Collection and Analysis With Children Who Work in the Worst Forms of Child Labour in Nepal - Karki, Shanta; Apgar, Marina; Snijder, Mieke; Sharma, Ranjana (CLARISSA Learning Note, 2022)
The CLARISSA Nepal team collected and analysed 400 life stories of children and young people engaged in or affected by the worst forms of child labour (WFCL), particularly in the “Adult Entertainment” sector in Nepal, which includes children working in Dohoris (restaurants playing folk music), dance bars, spa-massage parlours, khaja ghars (tea/snack shop) and guest houses. Stories were also collected from children in CLARISSA’s focus neighbourhoods, children in this category include street connected children and those working in transportation, party palaces, domestic labour and construction sites. Of the 400 stories collected, 350 were collected by adult researchers and 50 were collected by children themselves.

Learning from Life Story Collection and Analysis with Children who Work in the Leather Sector in Bangladesh - Sayem, Mashrique; Paul, Sukanta; Apgar, Marina; Snijder, Mieke (2022)
CLARISSA (Child Labour: Action-Research-Innovation in South and South-eastern Asia) is a participatory evidence and innovation generating programme. We are generating evidence on the drivers of the worst forms of child labour (WFCL) and exploring how to address them through participatory Action Research (PAR) with children and other stakeholders in the leather supply chain in Dhaka, Bangladesh. Our main intervention modality is Systemic Action Research (SAR) (Burns, 2007), of which life story collection and analysis (LSC&A) is the first step in our participatory design that will inform child-led PAR groups which will become the engines of innovative responses to WFCL. The LSC&A methodology is a storytelling and story listening methodology and was chosen because of the universal power of stories to make sense of complex realities and seek new futures. People across the world like to tell their stories; they like to feel listened to and they are interested in how their story connects and compares to others. By collecting and analysing stories from hundreds of children in WFCL we can visualise the bigger system that each individual story is connected to. We hypothesize that through engagement in the process of telling, listening, collecting, and analysing life stories, children engaged in harmful and hazardous work will use their understanding of systems dynamics to move into creating their own solutions to the drivers of WFCL. In 2021 in Bangladesh, we collected 405 life stories from children living in Hazaribagh, Hemayetpur, Lalbagh, and Bhairab in Dhaka, with more than one hundred of these stories collected by children themselves. Following the story collection and transcription, children were supported by the CLARISSA implementation team to collectively analyse the stories through identifying critical ‘factors’ (events which have causes and consequences) and understanding how they causally relate to each other. The analysis of the 405 life stories resulted in the development of large system maps that illustrate all the causal dynamics that underpin lived experiences of WFCL. Based on the systemic analysis process the children identified themes of the PAR to be set up in their localities. Our experience with the LSC&A methodology is the first in the context of children in WFCL. The methodology has been used in one other project in Bangladesh to date. We therefore intentionally aimed to learn from the implementation process and to evaluate if and how the telling of, listening to, collecting and analysing of life stories is empowering and in turn whether it leads to increased ownership of the problems which motivates collective action (Burns, 2021). In this learning note we share our methodological learning and reflect on operational implications for designing and facilitating an LSC&A process with children which we hope will support adaptation and use of the methodology by others working in participatory programming with children.

Learning From Failure 2020 - What CARE’s evaluations tell us about how to improve our work - CARE (CARE, 2020)
“Ever failed. No matter. Try again. Fail again. Fail better.” --Samuel Beckett Here’s my favorite part of that quote: the ultimate goal is not a lack of failure; it’s better failures. That’s good news for CARE, because we just published round two of our Learning From Failure initiative, and…I know this will surprise everyone…we haven’t stopped failures yet. We do have some hopeful signs that we’re failing better; or at least, that we’re improving on some concrete weaknesses we identified in the first round. It’s an interesting process to launch the second phase of learning from failure. The first round, we didn’t know what we were going to find. We spent as much time talking about how it was the first-ever report of its kind as we did about the actual failures. Our case study admitted, “It's still very early to see specific development impacts.” Round two isn’t quite the same. It’s not new anymore, so there’s less excitement at having invented something. We’re not discovering data and themes for the first time. In a lot of ways, the stakes are higher. Round two of learning from failure becomes an exercise in continuous performance improvement, rather than a journey of discovery. If we don’t see improvements, we don’t have the excuse that it’s too early to tell. It also takes a sustained commitment. Launching an exploratory exercise at a small scale is easy, especially when no one quite knows what the answers will be. Pulling together a few pieces of content over a few months is pretty straightforward. It takes some staying power—and real support from leadership—to keep up the work over time, especially in the middle of a pandemic. That’s even more true once we’ve seen one round of results and had a chance to understand the work that it takes to improve.

Learning from adaptive programmes - 10 lessons and 10 case studies - Valters, Craig (Overseas Development Institute, 2018)
Internal DFID document from the DevAdapt Programme. Based on another previous document (also internal).

Learning for social-ecological change: a qualitative review of outcomes across empirical literature in natural resource management - Suškevičs, Monika; Hahn, Thomas; Rodela, Romina; Macura, Biljana; Pahl-Wostl, Claudia (Journal of Environmental Planning and Management, 2018)

Learning for change in accountable governance programming - Brock, Karen; Shutt, Cathy; Ashlin, Alison (MAVC Learning Review, 2016)
Keywords: IMPORTANT

Learning Evaluation Theory: Brinkerhoff’s Success Case Method - Downes, Andrew (Watershed, 2016)
Brinkerhoff’s model isn’t restricted to learning. It can be used to analyze any major business change, such as the purchase of new equipment or implementation of a new process. It’s based on the assumption that any initiative, no matter how successful or unsuccessful, will always include some success and some failure. It seeks to uncover the most impactful successes and failures of an initiative and then tell the stories behind them, backed by evidence. Your organization can use these stories to learn how to be more successful in the future.

Learning and Results in World Bank Operations: Toward a New Learning Strategy - World Bank (IEG , The World Bank, 2015)
This report is the second in a program of evaluations that the Independent Evaluation Group (IEG) is conducting on the learning that takes place through World Bank projects. Learning and knowledge are treated as parts of a whole and are presumed to be mutually reinforcing.
Keywords: IMPORTANT

Learning and not learning from experience in rural project planning - Hulme, David (Public Administration and Development, 1989)
The theme of learning from experience as a means of improving the effectiveness of rural development projects and programmers has been common in recent years. Considerable effort has been put into refining, monitoring and evaluation systems to enhance organizational learning processes. However, an emphasis on normative approaches to evaluation and learning from experience has led to the neglect of research into the actual processes by which rural development agencies utilize experience. The case study presented here points to the shortcomings of such approaches and illustrates the partisan manner in which individuals and organizations treat the lessons of experience. Actively ‘not learning from experience’ is as much a part of organizational processes as learning from experience. This paper examines the implications of this finding and reviews alternative approaches to improving experiential learning in rural development activities. It is found that such a perspective does not generate the innocuous technical prescriptions characteristic of conventional approaches, but a number of useful directions for further research can be identified.

Learning and adapting: the use of monitoring and evaluation in countering violent extremism: a handbook for practitioners - Dawson, Laura; Edwards, Charlie; Jeffray, Calum; Royal United Services Institute for Defence and Security Studies (Royal United Services Institute for Defence and Security Studies, 2014)
IN 2013, the Royal United Services Institute for Defence and Security Studies (RUSI) was awarded a grant under the Kanishka Project to develop a handbook for monitoring and evaluating counter violent extremism (CVE) policies and programmes. The aim of this handbook is to support CVE policy-makers and practitioners (those who design, manage and evaluate CVE programmes), by providing them with key terms regarding violent extremism and radicalisation, describing the purpose of evaluation, and providing examples of key methodologies they can employ to conduct monitoring and evaluation (M&E) in this emerging policy field. The handbook will enable readers to understand why, when and how to conduct an evaluation of a CVE policy, programme or project. .

Learning and adaptation: 6 pitfalls to avoid - Valters, Craig (Devex, 2016)

Learning and Accountability - Simister, Nigel; Scholz, Vera (INTRAC, 2020)
Most people agree that monitoring and evaluation (M&E) should be used for both learning and accountability. However, there is no consensus about which one is more important. The debate matters as there is sometimes tension between the two purposes. In the past there has often been a disconnect between M&E and learning. Many M&E systems are primarily designed to enable accountability to donors.

Learning, Adaptation & Change: the future of Making All Voices Count - MAVC (Making All Voices Count, 2014)
Learning, Adaptation & Change: what Making All Voices Count has learned since September 2013 and how the programme will adapt and change in the future.

Learning about Theories of Change for the Monitoring and Evaluation of Research Uptake - Barnett, Chris; Gregorowski, Robbie (IDS Practice Paper In Brief, 2013)
This paper captures lessons from recent experiences on using ‘theories of change’ amongst organisations involved in the research–policy interface. The literature in this area highlights much of the complexity inherent in the policymaking process, as well as the challenges around finding meaningful ways to measure research uptake. As a tool, ‘theories of change’ offers much, but the paper argues that the very complexity and dynamism of the research-to-policy process means that any theory of change will be inadequate in this context. Therefore, rather than overcomplicating a static depiction of change at the start (to be evaluated at the end), incentives need to be in place to regularly collect evidence around the theory, test it periodically, and then reflect and reconsider its relevance and assumptions.

Learning about New Technologies and the Changing Evidence Base for Social Science Research and Decision Making in International Development - Berdou, Evangelia (IDS Practice Paper in Brief, 2011)

LearnAdapt: a synthesis of our work on adaptive programming with DFID/FCDO (2017–2020) - Laws, Ed; Pett, Jamie; Proud, Emma; Rocha Menocal, Alina (Briefing Note, 2021)
Key takeaways. • Development is not linear or straightforward, but rather complex, uncertain and context-specific. This calls for international development actors to work differently, in ways that are based on deliberate experimentation, learning and adaptation, to inform decisions and drive effective development. • Although it might go by different names, adaptive programming has been used in a variety of areas and fields in both the public and private sectors. Development practitioners have much to learn from and contribute to these different approaches and experiences. • Trust and relationship-building across all relevant stakeholders are among the most critical enabling factors for adaptive management. They are essential to give partners the space, autonomy and authority needed to try, test, reflect, iterate and feed back at the frontline of implementation, and to give donors the confidence that decisions are being made on the basis of evidence and learning to improve effectiveness. • There is an urgent need to rethink how accountability requirements, results frameworks, value for money considerations, performance markers, procurement and contracting mechanisms and other processes are understood and applied so that they are better aligned with and can support adaptive management more effectively. • The role of senior managers leading adaptive programmes from the donor side should be to create a space for experimentation and learning. Funders should hold their partners accountable for learning and how it feeds into effective programming, rather than for delivering on predetermined targets. • While formal guidance is important, leadership, champions, institutional incentives, a supportive management culture and appropriate mindsets are essential to encourage adaptive ways of working. • Adaptive management is resource-intensive. It requires skill, commitment, time for building trust and investments in learning. It is a journey, not an immediate destination – so it calls for patience, open-mindedness and a more nuanced approach to risk.

LEARN Monitoring, Evaluation, Research, and Learning Plan - Learning Lab (USAID, 2016)
LEARN and USAID/PPL are managing an area of work known as Evidence Base for Collaborating, Learning, and Adapting (EB4CLA). The purpose of this work is to answer key learning questions:

LEARN End of Contract Report - Learning Lab (USAID, 2020)
In September of 2014, USAID’s Office of Learning, Evaluation & Research (LER) awarded the Learning and Knowledge Management (LEARN) contract to Dexis Consulting Group and subcontractor RTI International.1 This document—the End of Contract Report—captures five and half years of results and reflections for our stakeholders. Our intention is to share the good and the bad, and while this report would not be considered a “tell all,” we think we have a story worth sharing, particularly to USAID CORs and AORs, activity managers, and other implementers of institutional support contracts.2 LEARN’s primary purpose was to support organizational change at USAID. More specifically, the contract was focused on helping USAID staff integrate collaborating, learning, and adapting (CLA) approaches into the design, implementation, monitoring, and evaluation of programs (what is known at USAID as the Program Cycle). It was clear that most USAID staff, whether they realized it or not, were already integrating CLA into their work to some extent. The focus of our efforts, therefore, was to make those practices more systematic, intentional, resourced, and ultimately more widespread throughout the Agency, which would have a ripple effect on implementing partners and even other stakeholders, such as host country governments. This was based on the theory—later borne out by evidence—that by becoming a better learning organization, USAID could be a more effective development organization. And that theory brought the USAID CLA team within USAID’s Bureau for Policy, Planning & Learning (PPL) and LEARN contractors together, driven by a shared purpose of improving how USAID does business. LEARN was designed based on this belief and, as you might expect from a learning-oriented contract, began with more questions than answers. Primary among those questions was: could an institutional support contract do more than carry out requested services—could it actually accelerate positive organizational change at USAID? And if so, how and under what conditions?

Lean vs Agile vs Design Thinking: What you really need to know to build high-performing digital product teams - Gothelf, Jeff (CreateSpace, 2017)
As companies evolve to adopt, integrate and leverage software as the defining element of their success in the 21st century, a rash of processes and methodologies are vying for their product teams' attention. In the worst of cases, each discipline on these teams -- product management, design and software engineering -- learn a different model. This short, tactical book reconciles the perceived differences in Lean Startup, Design Thinking and Agile software development by focusing not on rituals and practices but on the values that underpin all 3 methods.

Lean from the Trenches: Managing Large-Scale Projects with Kanban - Kniberg, Henrik (Pragmatic Bookshelf, 2011)
You know the Agile and Lean development buzzwords, you've read the books. But when systems need a serious overhaul, you need to see how it works in real life, with real situations and people. Lean from the Trenches is all about actual practice. Every key point is illustrated with a photo or diagram, and anecdotes bring you inside the project as you discover why and how one organization modernized its workplace in record time.Lean from the Trenches is all about actual practice.Find out how the Swedish police combined XP, Scrum, and Kanban in a 60-person project. From start to finish, you'll see how to deliver a successful product using Lean principles. We start with an organization in desperate need of a new way of doing things and finish with a group of sixty, all working in sync to develop a scalable, complex system. You'll walk through the project step by step, from customer engagement, to the daily "cocktail party," version control, bug tracking, and release. In this honest look at what works--and what doesn't--you'll find out how to:Make quality everyone's business, not just the testers.Keep everyone moving in the same direction without micromanagement.Use simple and powerful metrics to aid in planning and process improvement.Balance between low-level feature focus and high-level system focus.You'll be ready to jump into the trenches and streamline your own development process.

Lean Data Approaches to Measure Social Impact - ACUMEN (NovoEd, 2018)

Leading in a VUCA Environment: V Is for Volatility - Kail, Col Eric G. (Harvard Business Review, 2010)
This post is part of an HBR Spotlight examining leadership lessons from the military This is the first in a series on the four aspects of VUCA, a framework used by the U.S. military to describe the environment in terms of volatility, uncertainty, complexity, and ambiguity. Do challenges and opportunities that once took days or […]
Keywords: Leadership

Leading in a VUCA Environment: U is for Uncertainty - Kail, Col Eric G. (Harvard Business Review, 2010)
This post is part of an HBR Spotlight examining leadership lessons from the military. It’s the second in a series on the four aspects of VUCA, a framework used by the U.S. military to describe the environment in terms of volatility, uncertainty, complexity, and ambiguity. The frenetic pace of our environment, brought on by volatility, […]
Keywords: Leadership

Leading Effectively in a VUCA Environment: C is for Complexity - Kail, Col Eric G. (Harvard Business Review, 2010)
This is the third in a series on the four aspects of VUCA, a framework used by the U.S. military to describe the environment in terms of volatility, uncertainty, complexity, and ambiguity. Our complex environment demands a perspective that goes beyond viewing threats and opportunities as collective; we must see them as interactive. Leading through […]
Keywords: Leadership; Leadership development

Leading Effectively in a VUCA Environment: A is for Ambiguity - Kail, Col Eric G. (Harvard Business Review, 2011)
This is the last in a series on the four aspects of VUCA, a framework used by the U.S. military to describe the environment in terms of volatility, uncertainty, complexity, and ambiguity. Diversity and global reach introduce ambiguity to the environment; therefore opportunities and challenges must be appreciated from multiple aspects, not just our own […]
Keywords: Leadership; Leading teams

Leading Change Through Adaptive Design - Berstein, Maya; Linsky, Marty (Stanford Social Innovation Review, 2016)
By integrating two practices—design thinking and adaptive leadership—social innovators can manage projects in a way that’s both creatively confident and relentlessly realistic.

Laying the Foundations for Impact: Lessons from the GCRF Evaluation - Vogel, Isabel; Barnett, Chris (The European Journal of Development Research, 2023)
Research for development (R4D) aims to make a tangible difference to development challenges, but these effects typically take years to emerge. Evaluation (especially impact evaluation) often takes place before there is evidence of development impact. In this paper, we focus on opportunities for assessing the potential for impact at earlier stages in the research and innovation process. We argue that such a focus can help research programme managers and evaluators learn about the pre-conditions for impact and adjust accordingly. Using the Global Challenges Research Fund (GCRF) as a large-scale case of R4D evaluation, we identify and explore some of the building blocks that can increase impact potential. Guided by GCRF’s theory of change, we explore emerging evidence that highlights the importance of ways of working that supports positioning for impact. We conclude by drawing out a unifying construct around standards of development excellence; to sit alongside notions of scientific excellence for research intended to have an impact. Standards can help programme managers, researchers and evaluators learn and adapt to increase the likelihood of impact.

Laudes Rubrics - Measurement and Learning Approach - Laudes Foundation (Laudes Foundation, 2023)
How can we measure and learn when promoting systems change? It’s a challenge that has inspired Laudes Foundation to develop a rubrics-based methodology to help us, our partners and the wider field of philanthropy, understand our contribution to change, while learning and adapting to new and unforeseen circumstances. Change cannot be captured by numbers alone because metrics put the focus on what can be counted, not always what’s most important. Rubrics are a framework that set a standard for what ‘good’ looks like – and create a shared language for describing and assessing it using both quantitative and qualitative evidence. At Laudes Foundation, the rubrics are integrated into our grantmaking processes – from the design phase through to measurement, evaluation and learning. The four Laudes Foundation rubrics categories Laudes Foundation has developed 21 rubrics that work across different levels, from processes to long-term impact. When measuring a specific initiative, a smaller set of relevant rubrics are chosen and assessed on a rating scale from ‘harmful’ to ‘thrivable’. The 21 rubrics are categorised into four groups, with some natural overlap between categories B, C and D. Category A focuses on the process-related aspects of initiatives, including design, implementation, monitoring, communication and learning, and organisation and network effectiveness. Category B focuses on the early and later changes that need to happen to create the right conditions to achieve the 2025 outcomes. Category C captures the 2025 outcomes, focusing on how policymakers, financiers, business leaders, and workers and producers behave. Category D captures the 2030 impacts, describing the new reality created as a result of sustained efforts.

Lasting Roots: Naatal Mbay and the Integrated Finance Model in Senegal - Fowler, Ben; Courbois, Laura (MSP Ex-Post Study, 2023)
This report addresses the well-recognized evidence gap1 on the longer-term impacts created by marketdriven programming; specifically, programming influenced by market systems development (MSD) principles. It does so by presenting the findings of an ex-post study conducted three and a half years after the close of USAID’s Feed the Future Senegal Naatal Mbay Activity (hereafter Naatal Mbay) in 2019. It examines the scale and sustainability of changes resulting from Naatal Mbay’s introduction of an integrated finance model (IFM) – described in Error! Reference source not found. below – in the domestic rice sector. This study is one in a series of ex-post evaluations that are being conducted between 2023-2026 on USAID-funded MSD interventions around the world. This study focused on four questions, noted below in Figure 1. These were addressed using a mix of desk research, 122 key informant interviews with market actors and other stakeholders remotely and in Senegal, focus group discussions with 26 rice producers networks in Senegal, and a validation workshop with USAID/Senegal, implementing partner staff and market actors. Findings were analyzed leveraging the Disrupting System Dynamics (DSD) framework (see Figure 4 in the body of the report) as an analytical tool for understanding systems change.

Large-Scale Transdisciplinary Collaboration for Adaptation Research: Challenges and Insights - Cundill, Georgina; Harvey, Blane; Tebboth, Mark; Cochrane, Logan; Currie‐Alder, Bruce; Vincent, Katharine; Lawn, Jon; Nicholls, Robert J.; Scodanibbio, Lucia; Prakash, Anjal; New, Mark; Wester, Philippus; et al. (Global Challenges, 2019)
An increasing number of research programs seek to support adaptation to climate change through the engagement of large-scale transdisciplinary networks that span countries and continents. While transdisciplinary research processes have been a topic of reflection, practice, and refinement for some time, these trends now mean that the global change research community needs to reflect and learn how to pursue collaborative research on a large scale. This paper shares insights from a seven-year climate change adaptation research program that supports collaboration between more than 450 researchers and practitioners across four consortia and 17 countries. The experience confirms the importance of attention to careful design for transdisciplinary collaboration, but also highlights that this alone is not enough. The success of well-designed transdisciplinary research processes is also strongly influenced by relational and systemic features of collaborative relationships. Relational features include interpersonal trust, mutual respect, and leadership styles, while systemic features include legal partnership agreements, power asymmetries between partners, and institutional values and cultures. In the new arena of large-scale collaborative science efforts, enablers of transdisciplinary collaboration include dedicated project coordinators, leaders at multiple levels, and the availability of small amounts of flexible funds to enable nimble responses to opportunities and unexpected collaborations.
Keywords: Climate change; collaboration; transdisciplinarity

Large language model applications for evaluation: Opportunities and ethical implications - Head, Cari Beth; Jasper, Paul; McConnachie, Matthew; Raftree, Linda; Higdon, Grace (New Directions for Evaluation, 2023)
Large language models (LLMs) are a type of generative artificial intelligence (AI) designed to produce text-based content. LLMs use deep learning techniques and massively large data sets to understand, summarize, generate, and predict new text. LLMs caught the public eye in early 2023 when ChatGPT (the first consumer facing LLM) was released. LLM technologies are driven by recent advances in deep-learning AI techniques, where language models are trained on extremely large text data from the internet and then re-used for downstream tasks with limited fine-tuning required. They offer exciting opportunities for evaluators to automate and accelerate time-consuming tasks involving text analytics and text generation. We estimate that over two-thirds of evaluation tasks will be affected by LLMs in the next 5 years. Use-case examples include summarizing text data, extracting key information from text, analyzing and classifying text content, writing text, and translation. Despite the advances, the technologies pose significant challenges and risks. Because LLM technologies are generally trained on text from the internet, they tend to perpetuate biases (racism, sexism, ethnocentrism, and more) and exclusion of non-majority languages. Current tools like ChatGPT have not been specifically developed for monitoring, evaluation, research, and learning (MERL) purposes, possibly limiting their accuracy and usefulness for evaluation. In addition, technical limitations and challenges with bias can lead to real world harm. To overcome these technical challenges and ethical risks, the evaluation community will need to work collaboratively with the data science community to co-develop tools and processes and to ensure the application of quality and ethical standards.

Landscape Analysis of Learing Agendas: USAID/Washington and beyond - Learning Lab (USAID, 2017)
EXECUTIVE SUMMARY U.S. government agencies and development organizations around the world are increasingly recognizing and supporting learning activities— often informed by a learning agenda—as important tools for improving organizational effectiveness and efficiency. A learning agenda comprises a set of broad questions directly related to the work that an agency conducts; when answered, they enable the agency to work more effectively and efficiently, particularly pertaining to evaluation, evidence, and decisionmaking. This report surveys the landscape of learning agendas at USAID and beyond to inform the learning agenda initiative planned by the Office of Learning, Evaluation, and Research (LER) in the Bureau for Policy, Planning and Learning (PPL). Reporting on research conducted over a 6-month period (September 2016 to February 2017), this landscape analysis focuses on six documented, office-, bureau-, or initiative-wide learning agendas being used at USAID/Washington. It also considers 11 new or noteworthy learning initiatives at USAID and five learning efforts at other federal agencies. The research team interviewed 60 staff from 20 USAID offices and bureaus, as well as staff from five other federal agencies. (See Annexes 1 through IV for more information.) The team also convened two focus groups: one with staff in USAID/Washington who had recently returned from serving in Missions, and one with PPL staff who discussed that bureau’s learning activities. The report details the interviewees’ remarks on six topics:  Motivations behind their decisions to pursue a learning agenda, such as expectations of accountability, especially in response to leadership demands  The key benefits emerging from their learning agenda efforts, which have included identifying gaps in knowledge and evidence, and supporting other cultural and organizational change processes  The participatory and consultative strategies they used to engage with stakeholders, including engagement with Mission staff and inclusion of academics and outside experts  The learning activities and products related to their initiatives  Challenges and strategies on resources, dissemination, and utilization, including ways to update their learning agenda to ensure that it remains a “living document”  Recommendations they had for PPL and others considering embarking on a learning agenda initiative

LAC MEL Specialists Use Peer Network to Improve Quality and Use of Evidence - Anderson, Todd M; Prevatt, Amy (CLA Case Competition, 2019)
Based on consultations and stocktakings with LAC Missions, the LAC Bureau identified Mission Monitoring, Evaluation and Learning (MEL) Specialists as influential decision makers regarding data and evidence use. The LAC Bureau aims to improve the quality and use of evidence for decision making, and ultimately to improve development outcomes.

Knowledge Retention and Transfer (KRT) - Model overview presentation - USAID (USAID, 2023)
What problem is the KRT model trying to solve? For workforces that experience continuous staff turnover, the lack of systematic knowledge transfer can often lead to: - Loss of programmatic momentum, - Duplication of efforts and frustration, and - Wasted time and resources. The Knowledge Retention and Transfer (KRT) model provides tools, processes, and practices to individuals, teams, offices, and organizations to improve knowledge handover, which in turn improves efficiency and programmatic and operational learning.

Knowledge Retention and Transfer (KRT) - Model and Matsurity Matrix - USAID (CLA Toolkit, 2019)
The Maturity Matrix is not a standalone tool. It is one of the three major components of the KRT Model. The Maturity Matrix is meant to be used in conjunction with the KRT Toolkit and Implementation Plan.

Knowledge Networks: Innovation Through Communities of Practice - Hildreth, Paul; Kimble, Chris (IGI Global, 2003)
Knowledge Networks: Innovations Through Communities of Practice draws on the experience of people who have worked with CoPs in the real world and to present their combined wisdom in a form that is accessible to a wide audience. CoPs are examined from a practical, rather than a purely academic point of view. The book also examines the benefits that CoPs can bring to an organization, provides a number of case studies, lessons learned and sets of guidelines. It also looks at virtual CoPs and to the future by asking 'what next?' This book is a resource for all people who work with CoPs - both in academia and in the real world.

Knowledge Management strategies and processes in Agile Software Development: a systematic literature review - Ouriques, Raquel Andrade Barros; Wnuk, Krzysztof; Gorschek, Tony; Svensson, Richard Berntsson (CoRR, 2018)
Knowledge-intensive companies that adopt Agile Software Development (ASD) relay on efficient implementation of Knowledge Management (KM) strategies to promotes different Knowledge Processes (KPs) to gain competitive advantage. This study aims to

Knowledge-based Communication Processes in Software Engineering - Fischer, Gerhard; Schneider, Matthias (IEEE Press, 1984)
A large number of problems to be solved with the help of computer systems are ill-structured. Their solution requires incremental design processes, because complete and stable specifications are net available. For tasks of this sort, life cycle models are inadequate. Our design methodology is based on a rapid prototyping approach which supports the coevolution of specification and implementation. Communication between customers, designers and implementors and communication between the humans and the knowledge base in which the emerging product is embedded are of crucial importance. Our work is centered around knowledge-based systems which enhance and support the communication needs in connection with software systems. Program documentation systems are used as an example to illustrate the relevance of knowledge-based human-computer communication in software engineering.
Keywords: Rapid prototyping; experimental programming environments; human-computer communication; incremental design; knowledge-based systems; program documentation; user interfaces

Knowing When to Adapt - A Decision Tree - USAID (USAID LEARN, 2019)
This job aid will help you determine how best to resolve a challenge/issue in programming. It is intended for use by USAID, partners, and others working in international development.

Key Issues in Digitalisation and Governance - Roberts, Tony; Hernandez, Kevin; Faith, Becky; Prieto Martin, Pedro (SDC, 2022)
Digitalisation is perhaps the most important strategic challenge that governance will face over the coming decade. The process is delivering digital dividends as well as new exclusions and injustices, with the rapid but uneven increase in access to mobile and internet technologies transforming how social and economic life takes place. This report highlights the key opportunities and challenges arising from digitalisation.

Key Concepts in Ethnography - O'Reilly, Karen (SAGE Publications, 2009)

Kenya’s tech community will not save journalism - Benequista, Nicholas (Briefing Note, 1, 2014)

Keeping it Real: Using Mechanisms to Promote Use in the Realist Evaluation of the Building Capacity to Use Research Evidence Program - Punton, Melanie; Vogel, Isabel (New Directions for Evaluation, 2020)
This chapter explores the use of mechanisms within the realist evaluation of the Building Capacity to Use Research Evidence (BCURE) program, a £15.7 million initiative aiming to improve the use of evidence in decision-making in low and middle-income countries. The evaluation was commissioned to establish not just whether BCURE worked but also how and why capacity building can contribute to increased use of evidence in policymaking in the very different contexts in which the program operated. This chapter argues that using mechanisms helped provide nuanced and robust insights into these questions, while also strengthening the usefulness and policy relevance of the evaluation. Drawing primarily on qualitative data, including interviews with more than 500 stakeholders over 3 years, the evaluation explored the mechanisms that promote capacities to use evidence in decision-making, through developing and testing realist context-intervention-mechanism-outcome configurations (CIMOs). Uncovering the value of mechanisms for policy and program learning was not easy, and the chapter sets out some of the thorny challenges faced and how the BCURE evaluation navigated these. Ultimately, the use of mechanisms in the BCURE evaluation helped to generate practical and nuanced insights that fed directly into the design of a £17 million follow-up program. The seven mechanisms uncovered are continuing to inform our own and others’ work on institutional capacity change in a wide range of fields.

Jumping off Arnstein's ladder: social learning as a new policy paradigm for climate change adaptation - Collins, Kevin; Ison, Ray (Environmental Policy and Governance, 2009)
Participation of citizens, groups, organizations and businesses is now an essential element to tackle climate change effectively at international, European Union, national and local levels. However, beyond the general imperative to participate, major policy bodies offer little guidance on what this entails. We suggest that the dominance of Arnstein's ladder of citizen participation in policy discourses constrains the ways we think about, and critically the purposes we ascribe to, participation in a climate change context. We suggest an alternative framing of climate change, where no single group has clear access to understanding the issue and its resolution. Thus adaptation is fundamentally dependent on new forms of learning. Drawing on experiences of social learning approaches to natural resource managing, we explore how a commitment to social learning more accurately embodies the new kinds of role, relationship, practice and sense of purpose required to progress adaptive climate change agendas and practices. Copyright © 2009 John Wiley & Sons, Ltd and ERP Environment.
Keywords: Arnstein's ladder; Climate change; Co-evolutionary adaptation; Natural resource management; Participation; Social learning

Journalism from the ‘Silicon Savannah’: The Vexed Relationship Between Nairobi’s Newsmakers and its ICT4D Community - Benequista, Nicholas (Stability: International Journal of Security and Development, 2015)
During the course of a year-long knowledge exchange initiative called the Networked News Lab, a small group of Kenyan journalists and a PhD researcher from the London School of Economics and Political Science sought to identify opportunities for collaboration between newsmakers and practitioners from the field of information and communication technologies for development (ICT4D). In almost every instance, the project failed to promote cooperation between the two groups, though it succeeded in highlighting the fundamental issues that separate them. Drawing from interviews, project documents and participant observation, this chapter describes the incompatibilities between the two communities and what they suggest about current efforts to strengthen journalism in Africa through the application of ICTs.
Keywords: ICT4D; ICTs; IMPORTANT; Journalism; Kenya; state-building

Joint Programming in Conflict-Affected and Fragile States - Koenig, Sibylle; Brusset, Emery (Joint Programming - EU, 2019)
On the Joint Programming Practices from the EU in fragile settings

John F. Kennedy Address at Rice University on the Space Effort - Kennedy, John F. (Public Papers of the Presidents of the United States, 1962)

Iterative Design and Monitoring for Adaptive Management: How Causal Link Monitoring can help - Britt, Heather; Hummelbrunner, Richard; Green, Jackie (Better Evaluation, 2018)
Development actors are embracing the concept and practice of adaptive management, using evidence to inform ongoing revisions throughout implementation. In this guest blog, Heather Britt, Richard Hummelbrunner and Jackie Greene discuss a practical approach that donors and partners can use to agree on what’s most important to monitor as a project continues to evolve.

Iterative and incremental developments: A brief history - Larman, Craig; Basili, Victor R. (Computer, 2003)
Although many view iterative and incremental development as a modern practice, its application dates as far back as the mid-1950s. Prominent software-engineering thought leaders from each succeeding decade supported IID practices, and many large projects used them successfully. These practices may have differed in their details, but all had a common theme-to avoid a single-pass sequential, document-driven, gated-step approach.
Keywords: Agile methods; Application software; Feedback; Government; History; Iterative and incremental developments; Iterative methods; Personnel; Programming; Radio access networks; Terminology; Testing; iterative enhancement; software engineering; software system

It's the politics! Can donors rise to the challenge? - Unsworth, Sue (A Governance Practitioner’s Notebook: Alternative Ideas and Approaches, 2015)
The Governance Practitioner’s Notebook takes an unusual approach for the OECD-DAC Network on Governance (GovNet). It brings together a collection of specially written notes aimed at those who work as governance practitioners within development agencies. It does so, however, without attempting to offer definitive guidance – instead aiming to stimulate thinking and debate. To aid this process the book is centred on a fictional Governance Adviser. The Notebook’s format provides space for experts to speak on today’s governance issues: politics, public sector reform and stakeholder engagement. It encourages debate, charts the evolution of donor thinking, and highlights future challenges in the age of the Sustainable Development Goals. Each section introduces both technical issues and major areas of debate, providing ideas for future development support to institutional reform.
Keywords: IMPORTANT

It's All About MeE: Using Structured Experiential Learning (“e”) to Crawl the Design Space - Pritchett, Lant; Samji, Salimah; Hammer, Jeffrey (Working Paper 322, 2013)
This paper argues that within-project variations in design can serve as their own counterfactual, reducing the incremental cost of evaluation and increasing the direct usefulness of evaluation to implementing agencies. It suggests combining monitoring (‘M’), structured experiential learning (‘e’), and evaluation (‘E’) so as to facilitate innovation and organisational capability building while also providing accountability …

It’s About Results at Scale, Not Collective Impact - Edmondson, Jeff; Santhosh-Kumar, Parvathi (Stanford Social Innovation Review, 2017)
Improving outcomes at scale requires a paradigm shift in how we work.

Is your evidence robust enough? Questions for policy makers and practitioners - Shaxson, Louise (Evidence & Policy: A Journal of Research, Debate and Practice, 2005)
This article examines the reasons we need evidence for policy, discusses where evidence is needed in the policy-making process, and the nature of the evidence base for strategy and policy. Working relationships between policy makers and their advisers are key: as policy makers come from a variety of backgrounds, developing a common language helps set discussions about the robustness of the evidence base on a sound footing. The article identifies five components of robustness, proposes a series of questions that could be used to address them and discusses the implications for the processes of policy making.

Is (Web) Science Ready for Empowerment? - Akkermans, Hans; Gyan, Nana Baah; Bon, Anna; Tuyp, Wendelien; Grewal, Aman; Boyera, Stéphane; Allen, Mary (ACM WebSci'11, 2011)

Is there a new Washington Consensus? An analysis of five World Development Reports - Evans, Alice (From Poverty to Power, 2017)
Is there a new Washington Consensus? Alice Evans analyses the last five World Development Reports and finds significant changes in orthodoxy, but also big gaps

Is the problem driven iterative adaptation approach (PDIA) a panacea for public financial management reform? Evidence from six African countries - Lawson, Andrew; Harris, Jamelia (World Development Perspectives, 2023)
This article assesses the application of the problem driven iterative adaptation (PDIA) approach to public financial management reform in six African countries. It draws on primary data collected using a mix of interviews, overt participation observations and a short survey. PDIA responds to shortcomings in orthodox approaches to reform and technical assistance in developing countries. It stresses local solutions to local problems, achieved through experimentation and adaptation. The principles of PDIA are appealing, but its empirical assessment is in its infancy. This study aims to fill part of this gap. Findings show that PDIA delivers results in the short-term, particularly in cases where there is an influential authorising agent and dedicated team. Progress was less forthcoming for reforms that required high level political buy-in from senior officials. The approach does exceptionally well to develop staff capability, transferable skills, and local empowerment to solve local problems, thus potentially benefitting future reforms.

Is It Time for a New Paradigm for "Citizen Engagement"? The Role of Context and What the Evidence Tells Us - O'Meally, Simon (People, Spaces, Deliberation, 2013)
The meteoric rise of "citizen engagement" Almost all development agencies promote some form of citizen engagement and accountability, often framed as 'voice', 'demand-side governance', 'demand for good governance' or 'social accountability'. The current World Bank president, Jim Yong Kim, recently put it that, "citizen voice can be pivotal in providing the demand-side pressure on government, service providers, and organizations such as the World Bank that is needed to encourage full and swift response to citizen needs". There has, in turn, been a mushrooming of useful operational guidance on different "tools" for social accountability - i.e. steps, inputs and methodologies - that guide discrete interventions, ranging from citizen score cards to participatory expenditure tracking. One might, however, be forgiven for thinking that some of the debates on citizen engagement need an injection of realism; especially as contextual factors can make or break a "tool's" implementation. A review of experience to date would be one good place to start.

Is DFID Getting Real About Politics?A stocktake of how DFID has adopted a politically-informed approach (2010-2015) - Piron, Laure-Hélène; Baker, Aislin; Savage, Laura; Wiseman, Katie (DFID, 2016)
1. Background This internal stocktake assesses whether DFID is “getting real about politics” - how it is taking power and politics into account in all its operations. Country Poverty Reduction Diagnostics undertaken by DFID teams identify politics as the most frequent barrier to poverty reduction and growth. The UK 2015 Aid Strategy has committed DFID to spending 50% of Official Development Assistance (ODA) in fragile states. This requires a “patient, long-term approach” to addressing barriers to peace and stability which are fundamentally political, rather than purely financial or technical. The stocktake is based on three DFID offices case studies (Democratic Republic of the Congo, Pakistan and Malawi) as well as extensive internal and external consultations between June and December 2015. It provides illustrations of how DFID is evolving but does not systematically offer evidence of development impacts or non-country work, as this would have required a different methodology. 2. What does it mean to take politics into account? Politically-informed approaches are based on a large body of evidence that confirms the importance of institutions and politics for sustainable development. External assistance needs to support locally-led change. Success depends on timing, context, political processes and local actors. Desirable outcomes are hard to achieve and difficult to predict. Politically-informed approaches improve development effectiveness through:  The ‘what’: political goals, using development assistance to shift how power is distributed in the economy and society. The two main elements are: aiming for long term transformation of institutions; and supporting locally-led change processes more likely to be sustainable and successful: locallyowned (i.e. with local salience) and locally-negotiated.  The ‘how’: politically-smart methods, with greater realism and feasibility. The three main elements are: understanding power and politics in a specific context in order to identify opportunities and barriers for change; influencing and stakeholder management skills; and proactive risk management. To influence DFID operations, a politically-informed approach needs to be iterative, not one-off. The explicit understanding of context, whether formal setpiece studies or more routine analysis, should inform policy and programme decisions, from high level strategic choices, to day-to-day implementation, for both international policy and country support. This is a dynamic process: as the context evolves and lessons are learned about what works, analyses and decisions are updated. These are the principles behind the ‘flexible and adaptive’ agenda.

Investment Climate Reform: Doing it Differently - Manuel, Clare (Synthesis Paper, 1, 2015)
LASER synthesis papers aim to help donors and other stakeholders better understand why and how to approach investment climate reform programming differently. The papers reflect emerging best practice and lessons learnt on what works and what does not work in doing development differently. The papers have been peer-reviewed by experts in the field including senior advisers at DFID, World Bank, IFC and the Donor Committee for Enterprise Development (amongst others). First synthesis paper - Investment climate reform: doing it differently June 2015 Drawing on our experience in taking a problem-focused approach to investment climate reform, we discuss in this peer-reviewed paper emerging lessons and reflections on what works, both in recent literature and in practical experience.

Introduction - Towards Systemic Approaches to Evaluation and Impact - Befani, Barbara; Ramalingam, Ben; Stern, Elliot (IDS Bulletin, 2015)

Introduction to Systems Thinking - Kim, Daniel H (Pegasus Communications, 1999)

Introduction to SAVI's way of working - State Accountability and Voice Initiative (SAVI) - SAVI (DFID, 2015)
We are piloting a new approach to identifying and supporting our partners.  This breaks with convention in many ways in order to improve impact.  SAVI Approach Papers summarise key aspects of SAVI’s way of working. They explain what we do, and why – and link to relevant tools and frameworks. Our approach is summarized in...
Keywords: Practice

Introduction to Project Management - The Case of GIZ Projects - Lacroix, Eric J. (Khulna University, 2015)
In this course, we will try to understand the complexity and the structure of the management of a development project implemented by the GIZ for the German Development cooperation. We will first define the frame of management and project to enter in the map of two logics. Then, we will overfly the 5 success factors of Capacity WORKS, with concrete examples in annexe. It will bring us to the monitoring, the standard processes in GIZ cooperation projects, the basic tools for project implementation and the evaluation. The team building will allow us to enter in a specific aspect of project management.

Introduction to International Futures - International Futures at the Pardee Center (International Futures Help System, 2016)
INTERNATIONAL FUTURES HELP SYSTEM Introduction to IFs Purposes Visual Representation of IFs Issues and Modules Quick Survey of IFs Issues and Modules IFs Background IFs Geographic Representation of the World IFs Time Horizon Instructional Use Acknowledgements Feedback Support for IFs Use Development Mode Features

Introduction: Opening Governance – Change, Continuity and Conceptual Ambiguity - McGee, Rosie; Edwards, Duncan (IDS Bulletin, 2016)

Introduction: Making change happen–citizen action and national policy reform - Gaventa, John; McGee, Rosemary (Citizen Action and National Policy Reform. London: Zed Books, 2010)

Introduction - Localising Governance: An Outlook on Research and Policy - Joshi, Anuradha; Schultze-Kraft, Markus (IDS Bulletin, 2014)

Introducing the CLA Maturity Tool for Implementing Partners - Salib, Monalisa; Ziegler, Jessica (Social Impact, 2023)
On December 13, 2022, Social Impact hosted a webinar in our Evidence for Impact series, "Strengthen Your Team's CLA Practices: Introducing the CLA Maturity Tool for USAID Implementers." Through the session, we shared more about the origin and history of the USAID tool upon which this version is based, why and how we updated

Introducción a Capacity WORKS + Proyectos de Cambio - Informe - Cuéllar, Daniel (GIZ, 2014)

Into the unknown: explorations in development practice - Chambers, Robert (Practical Action Publishing, 2014)
Into the Unknown reflects on the journey of learning, and encourages readers to learn from observation, curiosity, critical feedback, play and fun. This book will be of interest to development professionals, including academics, students, NGO workers and the staff of international agencies

Interview protocol: Most significant turning points - Prieto Martin, Pedro; Faith, Becky (Institute of Development Studies, 2017)
This interview protocol was used for a research project on adaptiveness in technology for governance initiatives in Kenya. For more information, please read the research report at: Prieto Martin, P.; Hernandez, K.; Faith, B. and Ramalingam, B. (2017) Doing Digital Development Differently: Lessons in adaptive management from technology for governance initiatives in Kenya, MAVC Research Report, Brighton: Institute of Development Studies, ids.ac.uk/project/making-all-voices-count
Keywords: IMPORTANT

Intervention or Collaboration? Redesigning Information and Communication Technologies for Development. - Bon, Anna (2020)
How can we design and build digital technologies to support people in poor and low resource environments to achieve their objectives? And how can we do this inclusively and ethically, while considering the complexity of their living and working environments? This is the central question in my research. One of the grand challenges of international development cooperation is to make digital technologies available for social and economic development of poor regions of the world. To achieve this goal – often referred to as ICT4D – knowledge and technologies are transferred from wealthy countries to poor regions. Nevertheless, these efforts have often turned out unsuccessful and unsustainable, despite large budgets and numerous projects in prestigious international development programs. Mismatch between the transferred technologies and the target environment is a recurrent problem of ICT4D projects. Improvement can be achieved, for example, by involving end-users in the design process. International development organizations are aware of this, and terms like "co-creation", "participation" and "user-oriented design" have nowadays become part of the international development discourse. However, real co-creation and user-centered design are incompatible with unidirectional transfer of technologies and knowledge (this is how ICT4D is commonly organized, in conventional international development). Moreover, the term participation becomes meaningless, in the light of externally formulated development goals. One key question to ask is: what do the envisaged users want? Remarkably, many ICT4D projects, programs and policies do not really ask and (field) investigate this question, which can only be answered by extensive research on-the-ground. This thesis describes the search for and the design of an alternative approach to ICT4D. Ten years of field and action research with partners in Mali, Burkina Faso, and Ghana have led to a collaborative, iterative and adaptive approach, dubbed "ICT4D 3.0". What is novel of this alternative approach and how does it answer the central question? First of all, ICT4D 3.0 is a practical approach for critical investigation and action. It consists of a reconfigurable framework that guides the design and development of information systems, bridging the knowledge gap between developers and users to unlock and integrate different domains of (global, local, indigenous, academic, nonacademic) knowledge. It targets complex, resource-constrained environments where many (for the ICT developers and researchers) unfamiliar conditions or obstacles may exist. It fosters innovative capacity and learning in action, bringing together people with different backgrounds and perspectives in trans-disciplinary and multicultural teams. It is socio-technical, result-oriented, focused on the objectives of the stakeholders and the requirements of their livelihoods. This approach has been validated in various different contexts, by users, ICT developers, practitioners and students. Second, ICT4D 3.0 contributes to a theoretical understanding of ICT4D as a process of networked innovation in complex (adaptive) systems. The underlying idea is that knowledge sharing and diffusion of innovations are complex (non-linear) dynamic processes that evolve and propagate through social networks in rather unpredictable ways, whereby innovation works out differently, depending on context, and whereby contextual (e.g. social, cultural, environmental, political) factors play an important role, and have to be considered. This theoretical framework explains the effectiveness of a collaborative, iterative, adaptive approach in ICT4D. Third, ICT4D 3.0 is built on ethical principles. When reflecting on the meaning and purpose of digital development, it is clear that digital development is not only a question of technology and practice, and collaboration is more than a prerequisite for successful technological innovation and long-term sustainability: collaboration is a fundamental human, ethical value. Therefore, as a reflective practitioner, one has to ask oneself whose interests one is actually looking after, which goals one is trying to achieve, where they come from, how power and political issues play a role and which core values are at stake. This makes ICT4D 3.0 into a democratic process of dialogue and deliberation, in which all voices are heard, in which the local context and complexity are central and in which development goals are determined by the users themselves and not imposed from outside. In this light, the approach proposed in this thesis takes a value position and can be considered a decolonial approach, striving for democracy, emancipation, autonomy and social and economic betterment. Field experience shows that ICT4D can be a meaningful, collaborative, networked process of knowledge sharing, driven by local initiatives, realizing change for the better, in a complex world.

International Public Participation Models 1969-2020 - Hussey, Sally (Bang The Table, 2020)
International Public Participation Models 1969 – 2020 provides an essential resource of 60 different models to better map public participation in practice and theory.

International Development - Illusions and Realities - Black, Maggie (New Internationalist, 2015)
Part of the popular, reissued NoNonsense series from New Internationalist'Development' is often misunderstood and can embrace everything from building a large dam to planting trees. The idea can often mask confusion, contradiction, deceit and corruption. This book is essential reading for anyone wanting to know what development actually is. It covers all the key themes and critically suggests ways to bring the poor and marginalised into the process.

Integrating Top-Down and Bottom-Up Adaptation Planning to Build Adaptive Capacity: A Structured Learning Approach - Butler, J. R. A.; Wise, R. M.; Skewes, T. D.; Bohensky, E. L.; Peterson, N.; Suadnya, W.; Yanuartati, Y.; Handayani, T.; Habibi, P.; Puspadi, K.; Bou, N.; Vaghelo, D.; et al. (Coastal Management, 2015)
Climate adaptation planning provides an opportunity to enhance the adaptive capacity of stakeholders across multiple levels. However, reviews of standard top-down and bottom-up approaches indicate that the value of multistakeholder involvement is not fully recognized or incorporated into guidelines. Focusing on provinces in Indonesia and Papua New Guinea within the Coral Triangle region, we present a novel integrated top-down and bottom-up planning approach. Based on Participatory Systemic Inquiry the process involves three stages of workshops intentionally designed to promote social learning, knowledge exchange, empowerment and social networks among multilevel stakeholders. Stage 1 workshops engage government, nongovernment and science stakeholders at the provincial level to analyze sub-districts' vulnerability and design appropriate adaptation strategies. Stage 2 engages local government, non-government and community stakeholders within vulnerable sub-districts identified in Stage 1. Stage 3 combines Stage 1 and 2 stakeholders to refine adaptation strategies and design action plans for sub-districts. Evaluation demonstrated that different stakeholder groups' perceptions of community adaptation needs varied significantly, justifying the approach. In terms of adaptive capacity, the primary outcome for all stakeholder groups was innovative ideas, suggesting that social learning and knowledge exchange had occurred. Empowerment was a secondary outcome. We discuss how the approach could be further refined.
Keywords: Climate change; Coral Triangle; Evaluation; Social learning; knowledge cultures

Integrating modelling and smart sensors for environmental and human health - Reis, Stefan; Seto, Edmund; Northcross, Amanda; Quinn, Nigel W. T.; Convertino, Matteo; Jones, Rod L.; Maier, Holger R.; Schlink, Uwe; Steinle, Susanne; Vieno, Massimo; Wimberly, Michael C. (Environmental Modelling & Software, 2015)
Sensors are becoming ubiquitous in everyday life, generating data at an unprecedented rate and scale. However, models that assess impacts of human activities on environmental and human health, have typically been developed in contexts where data scarcity is the norm. Models are essential tools to understand processes, identify relationships, associations and causality, formalize stakeholder mental models, and to quantify the effects of prevention and interventions. They can help to explain data, as well as inform the deployment and location of sensors by identifying hotspots and areas of interest where data collection may achieve the best results. We identify a paradigm shift in how the integration of models and sensors can contribute to harnessing ‘Big Data’ and, more importantly, make the vital step from ‘Big Data’ to ‘Big Information’. In this paper, we illustrate current developments and identify key research needs using human and environmental health challenges as an example.
Keywords: Big data; Environmental health; Environmental sensors; Integrated modelling; Population health

Integrating Local Knowledge in Development Programming - Johnson, Madelyn; Maunder, Ishan; Pinga, Andie (USAID, 2022)
The objective of this report, Integrating Local Knowledge in Development Programming is to share knowledge of how development donors and implementing organizations leverage local knowledge to inform programming. In a recent speech at Georgetown University, United States Agency for International Development (USAID) Administrator Samantha Power said, “As Americans with a fraught history living up to our own values, we’ve got to approach this work with intention and humility. But the entire development community needs to interrogate the traditional power dynamics of donor-driven development and look for ways to amplify the local voices of those who too often have been left out of the conversation.” To that end, USAID’s Agency Knowledge Management and Organizational Learning (KMOL) function facilitated conversations with multilateral and bilateral donors and local organizations to understand how organizations define, utilize, and incorporate local knowledge into their programmatic and operational activities. Using qualitative tools to gather data for this report, the research team explored five overarching themes: 1. Local Knowledge Nomenclature and Definitions 2. Best Practices 3. Outcomes 4. Ethics and Power Dynamics 5. Challenges

Integrating Livelihood and Conservation Goals: A retrospective Analysis of World Bank Projects - Gómez, Andrés; Price, Claire (Measuring Impact, 2017)
Using a database of World Bank project evaluations, E3/FAB’s new study called “Integrating Livelihood and Conservation Goals: A Retrospective Analysis of World Bank Projects” aims to contribute to building the evidence base around the integration of biodiversity conservation and livelihood goals.

Integrating Food Security and Wild Caught Fisheries Management in USAID Programming. Illustrative situation Model and Results Chain - Swaminathan, Vinaya; Best, Barbara; Ajroud, Brittany (Measuring Impact, 2018)
Integrating Food Security and Wild Caught Fisheries Management in USAID Programming is an illustrative case example that demonstrates how two adaptive management programming tools—situation models and results chains—can help USAID staff and its partners to better design and implement activities that integrate food security, nutrition, and sustainable management of wild fisheries.

Integrating farmers’ adaptive knowledge into flood management and adaptation policies in the Vietnamese Mekong Delta: A social learning perspective - Tran, Thong Anh; Rodela, Romina (Global Environmental Change, 2019)
Flood management and adaptation are important elements in sustaining farming production in the Vietnamese Mekong Delta (VMD). While over the past decades hydraulic development introduced by the central government has substantially benefited the rural economy, it has simultaneously caused multiple barriers to rural adaptation. We investigate the relational practices (i.e., learning interactions) taking place within and across the flood management and adaptation boundaries from the perspective of social learning. We explore whether and how adaptive knowledge (i.e., experimental and experiential knowledge) derived from farmers’ everyday adaptation practices contributes to local flood management and adaptation policies in the selected areas. We collected data through nine focus groups with farmers and thirty-three interviews with government officials, environmental scientists, and farmers. Qualitative analysis suggests that such processes are largely shaped by the institutional context where the boundary is embedded. This study found that while the highly bureaucratic operation of flood management creates constraints for feedback, the more informal arrangements set in place at the local level provide flexible platforms conducive to open communication, collaborative learning, and exchange of knowledge among the different actors. This study highlights the pivotal role of shadow systems that provide space for establishing and maintaining informal interactions and relationships between social actors (e.g., interactions between farmers and extension officials) in stimulating and influencing, from the bottom-up, the emergence of adaptive knowledge about flood management and adaptation in a local context.
Keywords: Adaptation; Flood management; Knowledge brokers; Mekong Delta; Shadow systems; Social learning; Vietnamese

Integrating blueprint and process: A structured flexibility approach to development management - Brinkerhoff, Derick W.; Ingle, Marcus D. (Public Administration and Development, 1989)
Managing socio-economic development according to highly detailed pre-implementation plans rigidly applied has not had a high degree of success in generating sustained progress in the world's poorer nations. At the other end of the spectrum is the process approach that avoids specifying targets in advance, and concentrates upon building problem-solving capacity among the people involved. Many international donor and developing country agencies favour the blueprint model, despite its performance weaknesses, for its control and specificity. The process approach is limited by its lack of fit with agency procedures and incentives. This article discusses a structured flexibility approach to development management that integrates the blueprint model's planned structuring of action with the process model's flexibility and iterative learning orientation. This blend provides the basis for the programmatic and financial accountability required to obtain support from donor and developing country bureaucracies, and facilitates adaptive management to deal with uncertain and changing task environments. Case examples from the Caribbean, Portugal, and Pakistan illustrate the application of the structured flexibility approach.
Keywords: IMPORTANT

Integrating Big Data and Thick Data to Transform Public Services Delivery - Ang, Yuen Yuen (IBM Center for The Business of Government, 2019)
This report explains how public organizations can combine big data and thick data to transform public services delivery—a strategy called mixed analytics. Governments can greatly enhance the value of big data by combining it with “thick” data—rich qualitative information about users, such as their values, goals, and consumption behavior, obtained by observing or interacting with them in their daily lives. Big data holds great promise for improving public services delivery and innovation in government, but they are not a panacea . Having lots of data can be overwhelming or have little utility if the data are “thin”—that is, they lack meaning for users or fail to capture issues that matter most . By yielding insights into what citizens really care about and how they consume services, thick data can inform both the collection and analysis of big data. This report introduces the concept of “mixed analytics,” integrating big data and thick data to transform government decision making, public services delivery, and communication. The report presents three case studies of organizations that employ mixed analytics at the international, federal, and city level, respectively. Together, this research offers a set of transferable lessons for agencies at all levels of government: Lesson 1: Big data is a means to an end, rather than an end. Lesson 2: Thick data can identify unexpected problems or previously unexpressed needs. Lesson 3: Thick data can inform the analysis of big data. Lesson 4: Mixed analytics can offer both scale and depth. Lesson 5: Applying technology is a social activity, not an isolated technical task. Lesson 6: The best solutions are not always high-tech. The report concludes with five actionable recommendations for public managers. Make data and technology relevant to the people who use it. Leverage thick data at appropriate stages of the problem-solving process. Build an interdisciplinary team of quantitative and qualitative experts who work closely with stakeholders. Combine big and thick data to improve communication Improve government agencies’ knowledge of mixed research methods. This report builds on multiple past IBM Center reports about how government can leverage data and analytics to improve decisions, including Data-Driven Government: The Role of Chief Data Officers, by Jane Wiseman; Ten Actions to Implement Big Data Initiatives: A Study of 65 Cities, by Alfred Ho and Bo McCall, and Realizing The Promise of Big Data, by Kevin DeSouza. The report also complements several chapters that assess the past and potential use of data across the public sector in our recent book, Government For The Future: Reflection and Vision For Tomorrow’s Leaders. At a time when the US and other governments continue to enhance their use of data as a strategic asset for transformation, we hope that Professor Ang’s report provides useful insights for government managers and stakeholders.

Integrated Governance: Achieving Governance Results and Contributing to Sector Outcomes - Frazer, Sarah; Granius, Mark; Brinkerhoff, Derick W.; McGregor, Lisa (RTI Press Publication, 2022)
Achieving broad-based socio-economic development requires interventions that bridge disciplines, strategies, and stakeholders. Effective sustained progress requires more than simply an accumulation of sector projects, and poverty reduction, individual wellbeing, community development, and societal advancement do not fall neatly into sectoral categories. However, researchers and practitioners recognize key operational challenges to achieving effective integration that stem from the structures and processes associated with the current practice of international development. Integration calls for the intentional linking of intervention designs, implementation, and evaluation across sectors and disciplines to achieve mutually reinforcing outcomes. In this report, we summarize the results of a study we conducted to explore the challenges facing governance programs that integrate with sector interventions to achieve governance outcomes and contribute to sector outcomes. Through a review of policy documents and project reports from recent integrated governance programs and interviews with donor and practitioner staff, we found three integrated governance programming variants, an emphasis on citizen and government collaboration to improve service delivery, interventions that serve as the glue between sectors, and a balancing act for indicators to measure contribution to sectoral outcomes. Our analysis identified four key success factors: contextual readiness, the application of learning and adapting approaches, donor support, and recognition of the limitations of integrated governance. We then discuss recommendations and implications and for answering the challenge of integrating governance and sector programming to achieve development outcomes.

Institutional Histories - Better Evaluation (Better Evaluation)
An institutional history (IH) is a narrative that records key points about how institutional arrangements – new ways of working – have evolved over time and have created and contributed to more effective ways to achieve project or programme goals. An IH is generated and recorded in a collaborative way by scientists, farmers and other stakeholders. A key intention behind institutional histories is to introduce institutional factors into the legitimate narrative of success and failure in research organizations. Histories can be written by using interviews and ‘writeshops’ to construct a timeline, gain a clear understanding of roles and relationships, enquire into what triggers successful innovations and reflect on failures. Lessons drawn from this analysis can be used to improve performance. The dialogue that is promoted between the actors during the preparation of institutional histories can promote learning and capacity building.

Institutional Change, Political Economy, and State Capabilities : Learning from Edo State, Nigeria - Bain, Katherine; Porter, Doug; Watts, Michael (Justice, security, and development series, 2015)
This paper is one of a series aimed at deepening the World Bank’s capacity to follow through on commitments made in response to the World Development Report (WDR) 2011, which gave renewed prominence to the nexus between conflict, security, and development. Nigeria is a remarkable illustration of how deeply intractable the cycle of poverty, conflict, and fragility can become when tied to the ferocious battles associated with the political economy of oil. This paper places the corpus of analytic and programmatic work concerning institutional reform in conversation with a now substantial body of work on resource politics and most especially, the debate over the politico-institutional character (sometimes called political settlements or pacting arrangements associated with the order of power) and reform landscape of the petro-state. Recent institution reform policy writing appears to have little to say about the political and economic conditions in which crises and institutional disjunctures may authorize, and thereby enable, agents to embark on institutional reforms. The authors focus on Edo state for two reasons. First, it does not on its face appear to be an obvious location in which to explore a reform experience, given its entanglement in the Niger Delta conflict and the maladies typically associated with state fragility. Second, Edo is of interest also because of the changes that its experience is contributing to the World Bank country team’s effort to engage operationally across all its instruments with the political economy of institutional reform in Nigeria, its largest client country in Africa.

Instituições que aprendem - Relatório para a XXVII Cimeira Ibero-Americana de Chefes de Estado e de Governo - Oliván Cortés, Raúl (XXVII Cimeira Ibero-Americana, 2020)
A pandemia da Covid-19 surgiu de súbito num momento de transição para as instituições e organizações sociais de meio mundo. Antes ainda de se ter ultrapassado a crise de confiança da última década entre os cidadãos e os governos, num momento de grande impulso das iniciativas de governo aberto e de planos de inovação e transformação digital para tornar mais democráticas e eficientes as administrações através de programas políticos encaminhados para configurar um novo contrato social, verde e digital no quadro da Agenda 2030, o coronavírus provocou um choque histórico alterando o curso do século XXI e exigindo uma aceleração de todos os processos em andamento. A complexidade e dimensão da pandemia revelou a necessidade de arquiteturas institucionais mais flexíveis, ágeis e resilientes, capazes de incorporar toda a energia civil para aprenderem com o seu talento e criatividade, dando maior protagonismo à cidadania (ativistas, empreendedores, tecido associativo, academia, makers…) não só na tomada de decisões mas também na configuração e implementação das estratégias. À medida que se afastava do centro a milhões de empregados para teletrabalhar a partir de casa, tornou-se mais poderosa a ideia de pensar nas organizações como fluxos que excedem os organigramas estáticos de lugares e pessoas. Transformar as hierarquias em redes, concebê-las como corpos sociais dinâmicos, não só alarga o seu raio de ação e conectividade externa, mas também reativa as suas forças internas, aflora as lideranças ocultas, multiplica o valor social produzido e maximiza o uso eficiente dos recursos numa época de limitações. Os laboratórios de inovação pública, social ou cidadã, ou laboratórios de governo, a par de outras formas de inovação aberta e configuração social, reivindicam-se como projetos inspiradores de uma mudança de paradigma: de instituições que ordenam para instituições que aprendem. Pensar nas organizações sob a ótica da ciência das redes e da ética dos rizomas – nós, ligações, hubs, comunidades… – deverá permitir-nos uma aproximação à complexa e subtil tarefa de configurar os ecossistemas de inovação e criatividade no âmbito público e social. Este relatório propõe um modelo denominado Hexágono da Inovação Pública (HIP) que promove uma transformação sistémica através de seis vetores (OPEN_ aberto, TRANS_ transversal, FAST_ rápido, PROTO_ modelado, CO_ colaborativo e TEC_ tecnológico) baseados nas propriedades das redes e na análise de 105 metodologias usadas pelas agências mais inovadoras do mundo. Incluem-se uma ferramenta de autodiagnóstico e o HIP-SIM, uma primeira aproximação a um software aberto para visualizar, modelar e simular a criação de ecossistemas inovadores com o qual queremos favorecer a comunidade e o debate internacional.

Instituciones que aprenden - Informe para la XXVII Cumbre Iberoamericana de Jefes y Jefas de Estado y de Gobierno - Oliván Cortés, Raúl (XXVII Cumbre Iberoamericana, 2020)
La pandemia de la Covid-19 ha brotado súbitamente en un momento de transición para las instituciones y organizaciones sociales de medio mundo. Cuando aún no se había superado la crisis de confianza de la última década entre los ciudadanos y los gobiernos, en un momento de gran impulso de las iniciativas de gobierno abierto, planes de innovación y transformación digital, para hacer más democráticas y eficientes las administraciones a través de programas políticos encaminados a configurar un nuevo contrato social, verde y digital en el marco de la Agenda 2030; el coronavirus ha provocado un shock histórico alterando el decurso del siglo XXI y exigiendo una aceleración de todos los procesos en marcha. La complejidad y dimensión de la pandemia ha puesto de manifiesto la necesidad de arquitecturas institucionales más flexibles, ágiles y resilientes, que sean capaces de incorporar toda la energía civil para aprender de su talento y creatividad, dándole mayor protagonismo a la ciudadanía (activistas, emprendedores, tejido asociativo, academia, makers…) no solo en la toma de decisiones sino también en el diseño e implementación de las estrategias. Conforme se centrifugaba a millones de empleados a teletrabajar desde sus casas, se hacía más poderosa la idea de pensar las organizaciones como flujos más allá de los organigramas estáticos de lugares y personas. Transformar las jerarquías en redes, concebirlas como cuerpos sociales dinámicos, no solo amplía su radio de acción y su conectividad exterior, también reactiva sus fortalezas internas, aflora los liderazgos ocultos, multiplica el valor social producido y maximiza el uso eficiente de los recursos en una época de limitaciones. Los laboratorios de innovación pública, social o ciudadana, o laboratorios de gobierno, junto a otras formas de innovación abierta y diseño social, se reivindican como proyectos inspiradores de un cambio de paradigma: de las instituciones que ordenan a las instituciones que aprenden. Pensar las organizaciones bajo el prisma de la ciencia de redes y la ética de los rizomas –nodos, enlaces, hubs, comunidades…– nos debería permitir una aproximación a la compleja y escurridiza tarea de configurar los ecosistemas de innovación y creatividad en el ámbito de lo público y lo social. Este informe propone un modelo denominado Hexágono de la Innovación Pública (HIP) que promueve un cambio sistémico a través de seis vectores (OPEN_ abierto, TRANS_ transversal, FAST_ ágil, PROTO_ modelado, CO_ colaborativo y TEC_ tecnológico) basados en las propiedades de las redes y en el análisis de 105 metodologías que usan las agencias más innovadoras del mundo. Se incluyen una herramienta de autodiagnóstico y el HIP-SIM, una primera aproximación a un software abierto para visualizar, modelar y simular la creación de ecosistemas innovadores con el que queremos propiciar una comunidad y un debate internacional.

Inspiring Radically Better Futures - Evidence and Hope for Impact at Scale in a Time of Crisis - Guijt, Irene; Mayne, Ruth (Oxfam, 2020)
The world faces converging crises of health, climate, gender and racial injustice and extreme economic inequality. The calls are mounting to ‘build back better’ to create more inclusive, caring and environmentally sustainable futures. But what evidence exists that this is possible? The Inspiring Better Futures case study series investigates whether radical change at scale is possible and how it was achieved. This paper synthesises 18 cases which show that people are already successfully building better futures, benefitting millions of people, even against the odds in some of the world’s toughest contexts in lower-income countries. Together they offer hope that transformative change and radically better futures after the pandemic are within reach.

Insights for Influence: Understanding Impact Pathways in Crisis Response - Clark, Louise; Carpenter, Jo; Taylor, Joe (Institute of Development Studies, 2023)
The Covid-19 Responses for Equity (CORE) programme was a three-year initiative funded by the Canadian International Development Research Centre (IDRC) that brought together 20 projects from across the global South to understand the socioeconomic impacts of the Covid-19 pandemic, improve existing responses, and generate better policy options for recovery. The research covered 42 countries across Africa, Asia, Latin America, and the Middle East to understand the ways in which the pandemic affected the most vulnerable people and regions, and deepened existing vulnerabilities. Research projects covered a broad range of themes, including macroeconomic policies for support and recovery; supporting essential economic activity and protecting informal businesses, small producers, and women workers; and promoting democratic governance to strengthen accountability, social inclusion, and civil engagement. The Institute of Development Studies (IDS) provided knowledge translation (KT) support to CORE research partners to maximise the learning generated across the research portfolio and deepen engagement with governments, civil society, and the scientific community. As part of this support, the IDS KT team worked with CORE project teams to reconstruct and reflect on their impact pathways to facilitate South-South knowledge exchange on effective strategies for research impact, and share learning on how the CORE cohort has influenced policy and delivered change. This report presents an overview of these impact pathways and the lessons learnt from a selection of the projects chosen to represent the diversity of approaches to engage policymakers, civil society, and the media to generate and share evidence of the effect of the pandemic on diverse vulnerable groups.

Inside Foreign Aid - Tendler, Judith (The Johns Hopkins University Press, 1975)
A classic, important study in the anthropology of development, grounded in the author's own work within USAID, and analysis of the organizational and institutional pressures that constrain and shape development agency employees' cognition and action.
Keywords: IMPORTANT

Innovative M&E from the Sandbox and beyond - Vester, Søren; Tran, Samuel (Medium, 2023)
In this blog we are sharing a digest of some of the many useful and innovative monitoring, evaluation and learning resources and efforts that have come through the M&E Sandbox in 2022. A lot of these resources have been shared by our community in response to the overwhelmingly positive feedback from the launch of the Sandbox (please keep them coming!). We hope you find it useful. We have grouped these efforts and resources under six broad questions: - How do we measure systems transformation? - How do we know if we are on track? - How do we rethink complexity and independence in evaluation? - Why, how and for whom do we measure? - How do we generate insights and learn? - How do we make decisions and adapt?

Innovations in international humanitarian action - Ramalingam, Ben; Scriven, Kim; Foley, Conor (8th review of humanitarian action, 2009)

Innovation teams and labs. A Practice Guide - Puttick, Ruth (Nesta, 2014)

Innovation, Sustainability, Development: A New Manifesto - STEPS Centre (STEPS Centre, 2010)
Our Manifesto project publication is available in print, on CD or to view online. Innovation, Sustainability, Development: A New Manifesto recommends new ways of linking science and innovation to development for a more sustainable, equitable and resilient future. The multimedia version, with added audio, video and background documents, is available on CD and online.

Innovation lifecycle and the missing middle - Gray, Ian; McClure, Dan (Managing Humanitarian Innovation - The cutting edge of aid, 2018)

Innovation in development: Sharing learning, improving impact - Vogel, Isabel; Minkley, Gabrielle; Chowdhury, Sajid (Ideas to Impact / IMC Worldwide, 2017)

Innovation History - Better Evaluation (Better Evaluation)
Preparing an ‘innovation history’ is an option for recording and reflecting on an innovation process. People who have been involved in the innovation jointly construct a detailed written account (sometimes referred to as a ‘learning history’) based on their recollections and on available documents. The process of preparing this history stimulates discussion, reflection and learning among stakeholders. Subsequent planning drawing on the innovation history, can (i) build on the lessons learned, (ii) inform a shared vision, (iii) act as a catalyst for change and (iv) improve future performance. An innovation history is developed in stages. Based on the initial detailed account of the innovation process, more concise informational products can be prepared that summarize the innovation process for internal use. Products designed for wider dissemination of findings can help external parties build upon and expand their knowledge and understanding about how innovations are brought about. Such products may include public awareness materials, policy briefs and articles in professional journals. They may be based on the study of an individual case or on reviews that compare and contrast experiences across several cases. Innovation histories are underpinned by two sets of concepts that guide data gathering and analysis. The first set comes from a model of the innovation process called the ‘learning selection’ model (Douthwaite, 2002). The second set is derived from social network analysis (e.g. Cross and Parker, 2004). These concepts help participants involved in creating the innovation history to appreciate innovation as an evolutionary process driven by experiential learning cycles. The experimentation and learning involved in this evolutionary process leads to the generation of novelty, followed by its selection and promulgation. During this process, technologies become ‘fitter’, in the sense that they perform better. Stakeholder group’s social networks influence how this evolutionary learning selection process evolves hence the importance of identifying, tracking and documenting them.

Innovation histories: A method from learning from experience - Douthwaite, B; Ashby, J (ILAC Brief, 2005)
Preparing an ‘innovation history’ is a method for recording and reflecting on an innovation process. People who have been involved in the innovation jointly construct a detailed written account (sometimes referred to as a ‘learning history’) based on their recollections and on available documents. The process of preparing this history stimulates discussion, reflection and learning amongst stakeholders. Subsequent planning can build on the lessons learned, formulate a shared vision and act as a catalyst for change. Based on the initial detailed account of the innovation process, more concise informational products can be prepared that summarize the innovation process for wider dissemination of findings. These may include public awareness materials, policy briefs or articles in professional journals.

Innovation for International Development: Navigating the Paths and Pitfalls - Ramalingam, Ben; Bound, Kirsten (NESTA, 2016)
Experiences, insights and practical advice from over 20 leading practitioners in innovation for international development, brought together in one collection.

Innovation for Development Impact: Lessons from the OECD Development Assistance Committee - OECD (The Development Dimension, 2020)
The development co-operation community needs to innovate to meet the global challenges ahead. Although it has an established track record for innovating partnerships, funding instruments and technologies, they are not enough to deliver the Sustainable Development Goals. This report synthesises the lessons emerging from an OECD Development Assistance Committee peer learning exercise on how innovation efforts can be strengthened, individually and collectively, to achieve the 2030 Agenda. The report is organised around three blocks – strategy, management and culture; organisation and collaboration; and, the innovation process – and provides recommendations on how innovation can best benefit poor and vulnerable people around the world.

Innovation at UNDP: from weekend sport to daily practice - Quaggiotto, Giulio; Begovic, Mellie (Nesta, 2016)
The experience of working to embed innovation approaches in everyday practice at UNDP's country offices
Keywords: IMPORTANT

Innovating in Development Learning Event - Challenge brief - Vogel, Isabel (Ideas to Impact / iMC, 2017)

Innovating for pro-poor services: why politics matter - Mason, Nathaniel; Doczi, Julian; Cummings, Clare (2016)
This report addresses how politics matter for innovations. How politically smart approaches can help deliver access to services.

Innovating for inclusive rigour in peacebuilding evaluation - Apgar, Marina; Báez-Silva, Ángela Maria; Deng, Ayak Chol; Fairey, Tiffany; Rohrbach, Livia; Alamoussa, Dioma; Bradburn, Helene; Cubillos, Edwin; Gray, Stephen; Wingender, Leslie (Institute of Development Studies, 2022)
Inclusive and rigorous peacebuilding evaluation is both vital and complex. In this blog we share examples of how we are innovating our methodologies to move towards participatory and adaptive practice.

ING’s agile transformation - Schlatmann, Bart (McKinsey Quarterly, 2017)
Two senior executives from the global bank describe their recent journey.

Information Technology and Political Engagement: Mixed Evidence from Uganda - Grossman, Guy (2016)

Information Systems and Developing Countries: Failure, Success, and Local Improvisations - Heeks, Richard (The Information Society, 2002)
This article presents evidence that–alongside the successes– many information systems in developing countries can be categorized as failing either totally or partially. It then develops a new model that seeks to explain the high rates of failure. The model draws on contingency theory in order to advance the notion of design-actuality gaps: the match or mismatch between IS designs and local user actuality. This helps identify two high-risk archetypes that affect IS in developing countries: country context gaps and hard-soft gaps. The model is also of value in explaining the constraints that exist to local IS improvisations in developing countries. Overall, the article shows how model and theory help understand IS cases in developing countries, and equally, how those cases provide valuable data to help develop IS models and theories.
Keywords: Developing Country; Evaluation; Failure; Information System; implementation

Information needs and policy change - Potter, Stephen; Subrahumanian, Ramya (Sage, 2007)

Information lives of the poor: fighting poverty with technology - Elder, Laurent; Samarajiva, Rohan; Gillwald, Alison; Galperin, Hernan (2014)

Information and Communications Technology for Development (ICT4D)-A design challenge? - Tongia, Rahul; Subrahmanian, Eswaran (IEEE, 2006)
Keywords: IMPORTANT

Independent Review of Facilities: review and management response - DFAT (DFAT, 2018)

Independent Evaluation of SDC’s Results-Based Management System with a Focus on Poverty Reduction - Schmidt, Martin; Palenberg, Markus; Vähämäki, Janet (SDC, 2017)
The SDC's results-based management system ensures that the processes and instruments used for the design and implementation of programs and projects contribute to achieving the desired results (outputs, outcomes and impact). The independent evaluation examines the extent to which these processes and tools have fostered the results culture within the organization, and improved competencies for results-based management decisions, learning and communication. In addition to the findings, conclusions and recommendations, the evaluation report includes the management response of SDC’s Directorate.

Incubating policy for economic transformation: Lessons from Nepal - Booth, David (ODI, 2018)

Increasing Participation in Evaluation - Baker, A; Bruner, B (Effectiveness Initiatives, 2014)
The Increasing Participation in Evaluation bulletin was developed by Anita Baker with Beth Bruner to help organizations integrate evaluative thinking into their organizational practice. This three page bulletin discusses how Organization Staff, Evaluators, and Funders are typically involved in participatory evaluation. The guide also defines the term "Ripple", and how to accomplish Ripple as well as examining what it looks like when Executive Leaders and Management Staff use Evaluative Thinking. Contents How are Organization Staff, Evaluators, and Funders typically involved in Participatory Evaluation? Organization Managers/Staff Roles Evaluators/Roles Funder Roles Shared Roles What is Ripple Anyway? How do you accomplish Ripple? What does it look like when Executive Leaders and Management Staff Use Evaluative Thinking? How to use these Bulletins

Incorporating Geospatial Analysis into USAID Biodiversity Program Design - Higgins, Mark; Salafsky, Nick; Adeney, Marion; Petrova, Silvia (Measuring Impact, 2017)
Incorporating Geospatial Analysis into USAID Biodiversity Program Design is a biodiversity case example that describes the use of geospatial data and analysis for program design, including examples and lessons learned.

Inclusive Social Accountability - Counterpart International (Counterpart International, 2019)
Counterpart International’s Inclusive Social Accountability (ISA) developmental framework integrates elements of social inclusion and community accountability into one comprehensive approach.

Inclusive rigour for complexity - Chambers, Robert (Journal of Development Effectiveness, 2015)
Rigour can be reductionist or inclusive. To learn about and understand conditions of complexity, emergence, nonlinearity and unpredictability, the inclusive rigour of mixed methods has been a step in the right direction. From analysis of mixed methods and participatory approaches and methods, this article postulates canons for inclusive rigour for research and evaluation for complexity: eclectic methodological pluralism; improvisation and innovation; adaptive iteration; triangulation; plural perspectives; optimal ignorance and appropriate imprecision; and being open, alert and inquisitive. Inclusive rigour is inherent in participatory methods and approaches, visualisations, group-visual synergy, the democracy of the ground and participatory statistics. Transparent reflexivity, personal behaviour and attitudes, and good facilitation are fundamental. Fully inclusive rigour for complexity demands many personal, institutional and professional revolutions.
Keywords: Evaluation; Mixed methods; Participatory methodologies; Research; paradigm; rigour

Inclusive participatory approaches: A facilitator’s guide - Zaremba, Haley; Elias, Marlène; Devi, J. Tulasi; Priyadarshini, Pratiti (2021)
In community engagement and participatory processes, facilitators must make intentional efforts and adopt inclusive strategies to include marginalized and frequently overlooked groups. Yet, there is a lack of guidance on how to inclusively facilitate participatory processes. Facilitators are therefore often poorly prepared to engage with the power relations that underlie these processes, including those between the facilitator and participants and among participants themselves. This guide addresses this shortcoming by presenting strategies that have been shown to enhance the meaningful participation of women and marginalized groups in participatory processes. The aim is to equip facilitators with tools to create inclusive participatory spaces and community engagement. Although it refers to processes related to natural resource management, the guide is also applicable to the facilitation of participatory processes focusing on other issues or fields of significance to communities.

Inclusion in Making All Voices Count - Kelbert, Alexandra (Making All Voices Count, 2014)
Part of a sequenced learning process for MAVC's Research and Evidence Component, the summary of a thematic discussion led by researcher Evangelia Berdou.

In the goldfish bowl: science and technology policy dialogues in a digital world - Latta, Susie; Mulcare, Charlotte; Zacharzewski, Anthony (Sciencewise, 2013)

In pursuit of the deep and sustained shifts necessary for adaptive management - Simister, Nigel (INTRAC, 2018)
The final blog in Nigel Simister's series on adaptive management and the M&E of complex projects and programmes.

In praise of... Logframes - Teskey, Graham (From Poverty to Power, 2021)
In all the jobs I have held, the only training that has ever stayed with me was a three-day course on logframes, held in a very pleasant beach hotel on Fiji’s beautiful coral coast. This was a few months after I joined what was then the Overseas Development Administration, DFID’s forerunner. Three days on logframes. Yes really. Our Pacific team were gathered together to learn this new skill. The course was designed not only to help us think rigorously about how change happens, but also to ensure that we had a shared understanding of what constitutes good design. Twenty-five years later I am aware that logframes are out of fashion: references to the ‘tyranny of the logframe’ abound, its vertical determinism, and its lack of flexibility. Donors seem to have replaced logframes with things called ‘Program Logics’, as in the schematic below. You don’t have to be able to read it to get the picture… (and it’s logframes that are supposed to be too vertical…?).

Improving the Measurement of Civic Space - Malena, Carmen (Transparency & Accountability Initiative, 2015)
‘Civic space’ – i.e. the freedom and means to speak, access information, associate, organise, and participate in public decision-making – is essential to the healthy functioning and development of any society and a precondition for accountable governance and social justice. When civic space is restricted, human and civil rights are denied, government accountability is jeopardised, …

Improving the Evaluability of INGO Empowerment and Accountability Programmes - Shutt, Cathy; McGee, Rosemary (CDI Practice Paper 1, 2013)

Improving our legacy: Incorporation of adaptive management into state wildlife action plans - Fontaine, Joseph J. (Journal of Environmental Management, 2011)
The loss of biodiversity is a mounting concern, but despite numerous attempts there are few large scale conservation efforts that have proven successful in reversing current declines. Given the challenge of biodiversity conservation, there is a need to develop strategic conservation plans that address species declines even with the inherent uncertainty in managing multiple species in complex environments. In 2002, the State Wildlife Grant program was initiated to fulﬁll this need, and while not explicitly outlined by Congress follows the fundamental premise of adaptive management, ‘Learning by doing’. When action is necessary, but basic biological information and an understanding of appropriate management strategies are lacking, adaptive management enables managers to be proactive in spite of uncertainty. However, regardless of the strengths of adaptive management, the development of an effective adaptive management framework is challenging. In a review of 53 State Wildlife Action Plans, I found a keen awareness by planners that adaptive management was an effective method for addressing biodiversity conservation, but the development and incorporation of explicit adaptive management approaches within each plan remained elusive. Only w25% of the plans included a framework for how adaptive management would be implemented at the project level within their state. There was, however, considerable support across plans for further development and implementation of adaptive management. By furthering the incorporation of adaptive management principles in conservation plans and explicitly outlining the decision making process, states will be poised to meet the pending challenges to biodiversity conservation.

Improving development aid design and evaluation: Plan for sailboats, not trains - Kleinfeld, Rachel (Carnegie Endowment for International Peace, 2015)
How do reforms that require political engagement differ from traditional technical reforms? Why is political engagement different, and what are the implications for design and evaluation? How should development programmes that engage politics be designed? And how can those who fund or implement such programmes evaluate whether their efforts are contributing to reform? This report …
Keywords: IMPORTANT

Importing Democracy: The Role of NGO's in South Africa, Tajikistan, & Argentina - Fisher, Julie (Kettering Foundation Press, 2013)
While street protesters demanding democratic reforms make headlines in the international news, Importing Democracy: The Role of NGOs in South Africa, Tajikistan, and Argentina, written by Julie Fisher and published by the Kettering Foundation Press, focuses on a quieter movement led by democratization NGOs. In South Africa, the Good Governance Learning Network shares participatory tools to make local governments more responsive. In Tajikistan, Jahan teaches local police about human rights. In Argentina, seven democratization NGOs sponsor public deliberations in local communities and have organized a nationwide citizens network to combat municipal government corruption. The book is organized around three chapters for each country, South Africa, Tajikistan, and Argentina. The first chapter of each country s section begins with the historical, political, and economic context and continues with a discussion of the general contours of civil society. The second chapter in each section deals with the role of democratization NGOs in promoting both loyal opposition and law-based civil liberties. The third chapter focuses on their role in promoting political culture and political participation. Loyal opposition and law-based civil liberties help define democratization at the national level, whereas changes in political culture and increased political participation often occur throughout society. Following the nine country chapters, the book concludes with a comparative overview and implications for international policy. Fisher, a former Kettering Foundation program officer, writes that the idea that democracy can be exported has lost credibility in recent years. In many countries, however, democratization NGOs are importing democratic ideas and recovering local democratic traditions.

Implementing the new development agenda - Wrap up - Teskey, Graham (DDD 4 Conference, 2017)

Implementing Innovation: A User's Manual for Open Government Programs - Reboot Design (2015)
This guide draws from our experience around the world helping government reformers achieve real change. It is a practical resource for anyone working to implement an open government initiative.

Implementing adaptive management: A front-line effort — Is there an emerging practice? - Teskey, Graham; Tyrrel, Lavinia (Working Paper, 2021)
Among the many principles that currently inform donor-funded development initiatives, three appear to stand out: they should be politically informed, locally led, and adaptive. There is as yet little practical guidance for aid implementers regarding how to operationalise these approaches. What will it take to shift practice away from linear and planned approaches, towards models which foster local leadership and which engage with emergent and complex systems? This paper suggests that the answer is not to throw out the discipline of the logical framework, results frameworks, or theories of change. Rather they need to be handled rather more reflectively and ‘elastically’. The purpose of this paper is to set out how this can be achieved, and to propose 15 tools for donors, implementors and front-line staff to apply adaptive management (AM) in practice, at critical stages of the project cycle and within the dominant aid paradigm. This is what we are calling PILLAR: politically informed, locally led and adaptive responses. We are framing PILLAR to cover the full project cycle (design, implementation and review), hence the nomenclature of an ‘end to end’ approach. Our hope is that these tools will eventually replace the current planned, log-frame driven and top-down approach to aid design and delivery which dominates the development sector.

Implementing Adaptive Approaches in Real World Scenarios: A Nigeria Case Study, with Lessons for Theory and Practice - Bridges, Kate; Woolcock, Michael (The World Bank, 2019)
How does adaptive implementation work in practice? Drawing on extensive interviews and observations, this paper contrasts the ways in which an adaptive component of a major health care project was implemented in three program and three matched comparison states in Nigeria. The paper examines the bases on which claims and counterclaims about the effectiveness of these approaches were made by different actors, concluding that resolution requires any such claims to be grounded in a fit-for-purpose theory of change and evaluation strategy. The principles of adaptive development may be gaining broad acceptance, but a complex array of skills, expectations, political support, empirical measures, and administrative structures needs to be deftly integrated if demonstrably positive operational results are to be obtained, especially when undertaken within institutional systems, administrative logics, and political imperatives that are predisposed to serve rather different purposes.

Implementation of the first adaptive management plan for a European migratory waterbird population: The case of the Svalbard pink-footed goose Anser brachyrhynchus - Madsen, Jesper; Williams, James Henty; Johnson, Fred A.; Tombre, Ingunn M.; Dereliev, Sergey; Kuijken, Eckhart (Ambio, 2017)
An International Species Management Plan for the Svalbard population of the pink-footed goose was adopted under the Agreement on the Conservation of African-Eurasian Migratory Waterbirds in 2012, the first case of adaptive management of a migratory waterbird population in Europe. An international working group (including statutory agencies, NGO representatives and experts) agreed on objectives and actions to maintain the population in favourable conservation status, while accounting for biodiversity, economic and recreational interests. Agreements include setting a population target to reduce agricultural conflicts and avoid tundra degradation, and using hunting in some range states to maintain stable population size. As part of the adaptive management procedures, adjustment to harvest is made annually subject to population status. This has required streamlining of monitoring and assessment activities. Three years after implementation, indicators suggest the attainment of management results. Dialogue, consensus-building and engagement among stakeholders represent the major process achievements.
Keywords: Adaptive harvest management; Human–wildlife conflict; Population target; Stakeholder involvement; Structured decision-making; Tundra degradation

Impact networks: measuring towards success - Small Foundation (Small Foundation, 2021)
How does Small Foundation think about the impact…

Impact Management Software & Measurement Platform - Sopact
Impact Management platform is designed for social impact investing funds, grantmakers & public agency to provide comprehensive social impact measurement & impact management.

Impact Evidence and Beyond: Using Evidence to Drive Adoption of Humanitarian Innovations - Dodgson, Kate; Crowley, Catie (Scaling series, 2021)
This learning paper provides guidance to humanitarian innovators on how to use evidence to enable and drive adoption of innovation. Innovation literature and practice show time and time again that it is difficult to scale innovations. Even when an innovation is demonstrably impactful, better than the existing solution and good value for money, it does not automatically get adopted or used in mainstream humanitarian programming. Why do evidence-based innovations face difficulties in scaling and how can innovators best position their innovation to scale? This learning paper is for innovators who want to effectively use evidence to support and enable their journey to scale. It explores the underlying social, organisational and behavioural factors that stifle uptake of innovations. It also provides guidance on how to use, prioritise and communicate evidence to overcome these barriers. The paper aims to help innovators generate and present their evidence in more tailored and nuanced ways to improve adoption and scaling of their innovations.

Impact Evaluation: Taking stock and looking ahead - Conference report - Visser, Irene; Guijt, Irene; Kusters, Cecile (Centre for Development Innovation, 2013)
This report summarises the presentations and discussions of the Conference ‘Impact evaluation. Taking stock and looking ahead’, which took place in Wageningen on March 25 and 26, 2013. The Conference was organised and funded by the Centre for

Impact Evaluation of Development Interventions: A Practical Guide - White, Howard; Raitzer, David (Asian Development Bank, 2017)
This book offers guidance on the principles, methods, and practice of impact evaluation. It contains material for a range of audiences, from those who may use or manage impact evaluations to applied researchers.

Impact evaluation for portfolio programmes on policy influence: Reflections on the Indonesian Poverty Reduction Support Facility - Mackenzie, Jessica; Hearn, Simon (Methods Lab, 2016)
• Donors are increasingly using portfolio-based programmes that embrace ‘good failure’ and adaptive, political programming. • However, measuring the impact of these programmes is challenging, especially for those working on policy influence and building country systems; not only do you need to measure the positive and negative impact of the overall portfolio, but also the different pathways tested. • Programmes, therefore, need a light-touch monitoring and evaluation system that allows it to remain flexible. • Good practice examples of portfolio-based programmes present six strategies to evaluate impact: 1. Develop appropriate logic models 2. Collect observational data throughout implementation 3. Develop stories of change or case studies 4. Understand causal relationships without a counterfactual 5. Purposefully select which activities to study 6. Be explicit about how impact will be valued across the portfolio. • These strategies are only useful if monitoring and evaluation is placed at the centre of programme decision-making.

Impact assessment of ICT-for-development projects a compendium of approaches - Heeks, Richard; Molla, Alemayehu (University of Manchester. Institute for development policy and management (IDPM), 2009)

Impact assessment and the quest for the Holy Grail - Bymolt, Roger (KIT Working papers, 2015)

Illogical Framework: The Importance of Monitoring and Evaluation in International Development Studies - Pomerantz, Jessica R. (Cornell Policy Review, 2011)
In my brief experience with monitoring and evaluation, I have become convinced that it is critically important both as an international development project component and as a field of academic study. Throughout my academic career at Cornell University, I have, at times, argued that monitoring and evaluation has actually impeded development efforts, but here I wish to amend my opinion. Bad monitoring and evaluation can sabotage development projects and our meaningful interpretation of development impacts; failures can appear to be successes and vice-versa. As a student and practitioner of monitoring and evaluation, I have drawn the conclusions listed below and I submit them for your consideration. • Monitoring and evaluation is a key element of the international development industry applicable to many areas of public administration, domestic and international. • International development failures could be discovered and averted or corrected given proper monitoring and evaluation activities. • Anecdotal evidence from development activities in Afghanistan provides one example of the international community’s lack of attention to monitoring and evaluation concerning an ongoing development catastrophe. • Higher education ought to be filling the monitoring and evaluation knowledge gap but to date is failing to do so.

Illegal Wildlife Trade - Frameworks - Oxford Martin Programme on the Illegal Wildlife Trade (Oxford Martin Programme on the Illegal Wildlife Trade, 2018)
Our frameworks will enable a better understanding of wildlife product consumer preferences and motivations to effectively influence the system.

If politics is the problem, how can external actors be part of the solution? - Devarajan, Shantayanan; Khemani, Stuti (The World Bank, 2016)
Despite a large body of research and evidence on the policies and institutions needed to generate growth and reduce poverty, many governments fail to adopt these policies or establish the institutions. Research advances since the 1990s have explained this syndrome, which this paper generically calls
Keywords: IMPORTANT

Identifying general trends and patterns in complex systems research: An overview of theoretical and practical implications - Preiser, Rika (Systems Research and Behavioral Science, 2019)
Research on complex systems is becoming more prolific, and there is a need to provide some point of orientation to researchers and practitioners that are drawing on the body of literature that informs the field of complexity research. In this paper, I aim to give an overview of the development of the field and offer some overarching trends and patterns that are recognizable in research on complex systems. The paper then draws on the work to provide six organizing principles of complex systems to inform practical implications and methods for studying and understanding complex systems.
Keywords: complex systems; heuristics; trends and patterns

Ideas for Development - Chambers, Robert (Routledge, 2005)
Our world seems entangled in systems increasingly dominated by power, greed, ignorance, self-deception and denial, with spiralling inequity and injustice. Against a backdrop of climate change, failing ecosystems, poverty, crushing debt and corporate exploitation, the future of our world looks dire and the solutions almost too monumental to consider. Yet all is not lost. Robert Chambers, one of the ?glass is half full? optimists of international development, suggests that the problems can be solved and everyone has the power at a personal level to take action, develop solutions and remake our world as it can and should be. Chambers peels apart and analyses aspects of development that have been neglected or misunderstood. In each chapter, he presents an earlier writing which he then reviews and reflects upon in a contemporary light before harvesting a wealth of powerful conclusions and practical implications for the future. The book draws on experiences from Africa, Asia and elsewhere, covering topics and concepts as wide and varied as irreversibility, continuity and commitment; administrative capacity as a scarce resource; procedures and principles; participation in the past, present and future; scaling up; behaviour and attitudes; responsible wellbeing; and concepts for development in the 21st century.

ICT4D Blog » A citizen participation ecosystem - Peña-López, Ismael (ICTlogy, 2019)
Research on the Information Society, the Digital Divide and Information and Communication Technologies for development

ICT4D and Sustainability - Marais, Mario (The International Encyclopedia of Digital Communication and Society, 2015)

I know what I know (but how do I know what I don’t?) - Smit, Debbie; de Lanerolle, Indra; Braam, Tamara; Byrne, Deborah; Legong, Gontse (MAVC, 2017)
An important support function of Making All Voices Count South Africa is to design, plan and facilitate community of practice gatherings for sustained learning and sharing across Making All Voices Count grantees. This report aims to capture the content of a one-day Making All Voices Count South African Community of Practice (CoP) Meeting held in November 2016. The South African MAVC CoP has been running for three years and has met between two and four times a year. It is a space for MAVC grantees and others working to foster innovation in the fields of transparency and accountability, to share experiences and knowledge, and collaborate in learning and improving work.

Humanitarian Innovation Guide - ELHRA (2018)
The Humanitarian Innovation Guide is a growing online resource to help individuals and organisations define humanitarian problems and successfully develop innovative solutions. ABOUT THE GUIDE The humanitarian sector is investing in exciting innovations, but it is not yet producing a steady pipeline of well-designed solutions that effectively address problems, evidence their impact, and have the potential to be scaled. As stated in a recent independent evaluation of the Humanitarian Innovation Fund (Triple Line, 2017), a review of the innovation ecosystem in 2015 found significant gaps in resources for innovation, including a shortage of guidance on the skills needed to manage successful innovation projects. These findings were echoed in the research carried out to inform this resource. As part of a grant agreement with the European Commission to provide financial and technical support to emerging humanitarian innovations, and in line with our strategic aim to develop the sector’s skills and capabilities in humanitarian innovation, this resource aims to translate our own learning, along with learning from across the sector, into a practical, grounded guide for innovators working in humanitarian contexts. Building on our unique position in the sector, the Humanitarian Innovation Guide is designed to provide targeted support to individuals and organisations attempting to develop innovative solutions to the challenges facing humanitarian assistance, resulting in a more effective humanitarian response. The Guide is written with two audiences in mind: humanitarian practitioners who are seeking to develop a new approach to their work and want to apply an innovation lens to solving problems; and social entrepreneurs from outside the sector who have identified an opportunity to engage with the sector and need a humanitarian framework to contextualise their innovation plans. We also hope that it will be a useful resource for innovation managers who are tasked with supporting innovation in their agencies, labs or networks. As the first step-by-step guide to managing innovation in the humanitarian sector, we hope that its continued development will better enable individuals, organisations and the wider sector to: Plan the activities involved in an innovation process and systematise the management of innovation. Manage a successful innovation project and generate evidence for innovation. Ensure that innovations are developed in an ethical way, with full consideration of risks and responsibilities.

Human trafficking in South Asia: Assessing the effectiveness of interventions - Jensen, Charity; Oosterhoff, P.; Pocock, N. (FCDO, 2020)
This Rapid Evidence Assessment (REA) examines current evidence on the effectiveness of interventions to combat human trafficking in four South Asian countries (Bangladesh, India, Nepal, and Pakistan). This REA is being carried out as part of a wider assignment for the UK Department for International Development (DFID), with the overall objective of synthesising evidence on the effectiveness of interventions that tackle modern slavery in South Asia. Two REAs were conducted on different types of modern slavery, one on human trafficking for labour and sexual exploitation, and another on child labour (Idris et al., 2020). The research question for this REA is: ‘What has been the effect of interventions to combat and/or reduce sexual and labour exploitation in Bangladesh, Pakistan, India, and Nepal?’ Trafficking in persons is a form of ‘modern slavery’, which is an umbrella term for the variety of situations in which someone is forcibly controlled by an individual or group for the purpose of exploitation. The Global Slavery Index estimated that, on any given day in 2016, 40.3 million people were victims of modern slavery, including 24.9 million people in forced labour and 15.4 million people in forced marriage. Of the estimated almost 25 million people in modern slavery in Asia, 66% were exploited for labour (Global Slavery Index, 2018).

Human Learning Systems: A practical guide for the curious - Lowe, Toby; Padmanabhan, Chandrima; McCart, Des; McNeill, Karen; Brogan, Andy; Smith, Mark (Centre for Public Impact, 2022)
Our new guide provides practical advice to help any organisation working in public service apply the Human Learning Systems approach to their work. In doing so, they will be better equipped to explore, learn and respond to the unique strengths and needs of each person, family and community they serve.

Human-Centered, Systems-Minded Design - Both, Thomas (Stanford Social Innovation Review, 2018)
Both human-centered and systems-thinking methods fit within an effective design approach, and can work in conjunction to address social challenges.

How We Model Matters: A Manifesto for the Next Generation of Program Theorizing - Whynot, Jane; Lemire, Sebastian; Montague, Steve (Canadian Journal of Program Evaluation, 2019)
In this concluding article, grounded on the exemplary contributions contained in the preceding pages, the guest editors scale the proverbial soapbox and present a manifesto to guide the pursuit and advancement of the next generation of program theorizing. Formulating ten declarations for program theory development and examination, the modest hope of the authors is to motivate and inspire reflective evaluation practitioners to broaden their views, approaches, and techniques for future program theorizing.

How useful are RCTs in evaluating transparency and accountability projects? - Leavy, Jennifer (MAVC Working Paper, 2014)

How to Sharpen a Nonviolent Movement - McClennen, Sophia; Popovic, Srdja; Wright, Joseph (Journal of Democracy, 2023)
In the past three decades nonviolent social protest has become the most reliable path to democracy. However, not all nonviolent mobilization campaigns succeed. To examine why some nonviolent campaigns are more successful than others, we analyze the use of a particular type of activist campaign tactic, the "dilemma action." The dilemma action is a nonviolent civil-disobedience tactic that provokes a "response dilemma" for the target. Collecting original data on dilemma actions during nonviolent activist campaigns, we find that roughly one-third of mass nonviolent campaigns in the past century deploy this strategy. We theorize four mechanisms linking dilemma actions to nonviolent activist campaign success: facilitating group formation, delegitimizing opponents, reducing fear, and generating sympathetic media coverage. Finally, we assess whether dilemma actions increase campaign success rates, finding that dilemma actions are associated with an increase of 11–16 percent in activist-campaign success.

How to set up and manage an adaptive programme - Lessons from the Action on Climate Today (ACT) Programme - Cooke, Katherine (OPM, 2017)

How-To Note: Developing a Project Logic Model (and its Associated Theory of Change) - USAID (Program Cycle, 2017)
This How-To Note describes considerations for developing a project logic model, as well as steps for thinking through a more complete theory of change (TOC). A logic model is a graphic or visual depiction that summarizes key elements of a TOC, and it is often used as a facilitation tool during the design process. There are many types of logic models, including but not limited to logical frameworks (logframes), results chains, results frameworks, and local actor-oriented models, among others. The project logic model and its associated TOC are included in the Project Appraisal Document (PAD) that approves a project design (see ADS 201.3.3.13). While this How-To Note focuses on logic models at the project level, logic models are also used at the strategy level (specifically, results frameworks – see Box 1), and often at the activity level. The concepts and steps presented here are generally applicable to the process of developing logic models and TOCs throughout the Program Cycle.

How-To Note: Conduct a Data Quality Assessment - USAID (2017)

How to Monitor and Evaluate an Adaptive Programme: 7 Takeaways - Sikustahili, Gloria; Adkins, Julie; Makongo, Japhet; Milligan, Simon (From Poverty to Power, 2020)
Monitoring and Evaluation needs to be different to support the new generation of 'adaptive programmes' in aid. 4 M&E specialists in Tanzania explain how.

How to manage complexity: four lessons for DFID’s new Secretary of State - LearnAdapt (Medium, 2019)
Lessons for DFID in addressing complex problems without creating complicated, workload heavy programmes.

How to make theories of change more useful? - Aston, Thomas (Medium, 2021)
A fair amount has been written recently questioning the value added of theories of change. Have we gone through a hype cycle? Are they…

How to Make Sense of Weak Signals - Schoemaker, Paul J. H.; Day, George S. (MIT Sloan Management Review, 2009)
Keywords: IMPORTANT

How to Make ‘Cash Plus’ Work: Linking Cash Transfers to Services and Sectors - Roelen, Keetie; Devereux, Stephen; Abdulai, Abdul-Gafaru; Martorano, Bruno; Palermo, Tia; Ragno, Luigi Peter (UNICEF Office of Research, 2017)
The broad-ranging benefits of cash transfers are now widely recognized. However, the evidence base highlights that they often fall short in achieving longer-term and second-order impacts related to nutrition, learning outcomes and morbidity. In recognition of these limitations, several ‘cash plus’ initiatives have been introduced, whereby cash transfers are combined with one or more types of complementary support. This paper aims to identify key factors for successful implementation of these increasingly popular ‘cash plus’ programmes, based on (i) a review of the emerging evidence base of ‘cash plus’ interventions and (ii) an examination of three case studies, namely, Chile Solidario in Chile, IN-SCT in Ethiopia and LEAP in Ghana. The analysis was guided by a conceptual framework proposing a menu of ‘cash plus’ components. The assessment of three case studies indicated that effective implementation of ‘cash plus’ components has indeed contributed to greater impacts of the respective programmes. Such initiatives have thereby addressed some of the non-financial and structural barriers that poor people face and have reinforced the positive effects of cash transfer programmes. In design of such programmes, further attention should be paid to the constraints faced by the most vulnerable and how such constraints can be overcome. We conclude with recommendations regarding the provision of complementary support and cross-sectoral linkages based on lessons learned from the case studies. More research is still needed on the impact of the many variations of ‘cash plus’ programming, including evidence on the comparative roles of individual ‘plus’ components, as well as the knowledge, attitudes and behaviour pathways which influence these impacts.

How to make a multilayer pie chart in Excel - Karina Adcock (2021)
Create a multilevel donut chart in excel -------------------------------------------------------------------------------- #exceltips #exceltutorials #excelcharts SUBSCRIBE: https://goo.gl/c46YPs Microsoft Office 365, Beta Channel, Version 2104 --------------------------------------------------------------------------------- IF YOU LIKED THIS VIDEO YOU MAY ALSO LIKE: - Recreating a pie chart from a newspaper in PowerPoint    • How to make a pie...

How to do Process Tracing: A Method for Testing “How Change Happened” in Complex and Dynamic Settings - Lynn, Jewlya; Stachowiak, Sarah; Beyers, Jennifer (ORS Impact, 2022)
Process tracing is a causal methodology that can help people understand how a particular large-scale change actually happened within a complex dynamic environment. Much of the existing literature provides important information about the method; we wrote this brief to help more people operationalize the concepts and learn about practical steps for using this method more easily, with quality, and toward a more equitable world. This piece was written based on our experiences implementing process tracing when our experience showed that existing materials on the method had a lot more conceptual than practical information. We’ve approached this as people with some successful (and some unsuccessful) experience with the method itself, alongside deep experience in evaluating initiatives and strategies in complex and dynamic settings. We focus not on the Bayesian side of process tracing but rather on how this can be implemented in a way that’s more participatory and lifts up the experiences and wisdom of those closest to the work and the problems being tackled. We hope this contributes to and helps make more approachable the important work of political scientists and methodologists upon which this work sits.

How to do Adaptive Management in 15 easy steps – from a top new toolkit – FP2P - Green, Duncan (From Poverty to Power, 2021)

How to develop capacity in the international development sector - Prieto Martín, Pedro (CLARISSA, 2022)
In her acclaimed study of effective cross-organizational teamwork, Harvard Business School Professor Amy C. Edmonson concluded that “trying things that...

How to design and plan public engagement processes: a handbook - Faulkner, Wendy; Bynner, Claire (What Works Scotland, 2020)
There is a growing hunger for more, and more meaningful, citizen participation in decisions that affect our lives. Across the world, calls for open government, workplace democracy, community empowerment are gaining support, as are innovative developments in deliberative democracy. The current COVID-19 pandemic makes these calls more pressing than ever, given the deepening inequalities it has caused and the complex challenges of building a progressive road out of the crisis. So, now more than ever we need people capable of designing and planning public engagement processes that are empowering and worthwhile. Experienced practitioners know that, without considerable forethought, care and preparation, public engagement processes risk achieving little or, worse, alienating people so that they never engage (with you or anyone else) again. This Handbook seeks to deepen people’s skills in designing and planning effective public engagement processes, by providing a structured four-stage framework for tackling the task. It draws on the authors’ extensive practical experience of training and working with public engagement facilitators across sectors as well as international expertise. You may be a citizen, a community or public engagement practitioner, an elected or government representative, or some other sponsoring organisation or stakeholder. You may be new to this kind of work or experienced but wanting to review and improve your practice. Or you may be studying public participation in democratic processes. Wherever you are coming from, and whatever type of public engagement you are doing, this Handbook promises to be a useful addition to your toolbox.

How to design a monitoring and evaluation framework for a policy research project - Pasanen, Tiina; Shaxson, Louise (Methods Lab, 2016)
Policy research projects face a number of challenges: policy processes are complex, involve multiple actors and often feature a significant time-lag between research and what may or may not happen as a result of it. To complicate matters further, the scope and scale of policy research projects are increasingly moving away from single research studies towards multi-component, multi-site and multi-sector endeavours. These factors mean that developing an overarching monitoring and evaluation framework can be challenging. But it is not impossible. The guidance note aims to support the first steps in designing and structuring the M&E framework (that is, what aspects or areas of policy research projects to monitor and evaluate, why, when and how). It builds on an M&E framework for policy research projects developed and tested by the Research and Policy in Development (RAPID) programme of the Overseas Development Institute, and draws on case studies of how it has been used by RAPID and other research teams.

How to create an agile organization - survey - Salo, Olli; Ahlbäck, Karin; Fahrbach, Clemens; Murarka, Monica (McKinsey & Co., 2017)
Eighteen practices for organizational agility The survey asked respondents about a series of specific actions that underlie each of the 18 practices (9 of them stable, and 9 dynamic) of organizational agility; all of the practices are summarized in the table below. To rate respondents’ organizations, we asked how frequently their performance units engaged in each action that supports a given practice.

How to Build Movements with Cyclical Patterns in Mind - Non Profit News | Nonprofit Quarterly - Algoso, Dave; Guerzovich, Florencia; Gattoni, Soledad (Nonprofit Quarterly, 2023)
The world changes too much for anyone who is invested in social change work to imagine that this work is linear and predictable. Opportunities come and go, whether caused by a pandemic or political shifts. This much most social movement leaders and activists intuitively understand. But what can be done with this realization? How might movement groups better prepare for moments of opportunity? We want to explore how we can create the changes we want to see by responding to the changes that are outside our control.

How to Apply Agile Principles to International Development M&E - ICTworks (ICT Works, 2016)
We all want to be good at our jobs. We want to accomplish the things we set out to do. If we aren’t accomplishing them, we want to figure out why or try new solutions. The trend toward Adaptive M&E is exactly that: a desire to be better at our jobs. Similar trends exist in the software world (agile) and in manufacturing and start-ups (lean). But by any name, this process of seeking to improve is about speeding up decision-making and solution delivery by focusing on incremental, iterative planning and execution. I presented on agile with Monalisa Salib of USAID Learning Lab at MERL Tech 2016. I talked about creating software; she talked about creating evaluation tools for USAID missions, but we were describing the same basic process: Develop, Release, Reflect, and Adapt. You can see our slide deck for more details, but here are the key discussion takeaways that won’t show up there: 1: Eyes on the Prize Any effort should start with a clear definition of what you’re hoping to achieve.
Keywords: IMPORTANT

How should donors manage adaptively? Market Systems Development as a case study. - Itad (Itad, 2018)
Itad has recently completed a strategic evaluation for Sida to help them work through how they can best manage programmes that are adaptive and apply systems approaches - the conclusions from the evaluation about what funders need to do to manage adaptively are of broader relevance.

How Political Contexts Influence Education Systems: Patterns, Constraints, Entry Points - Levy, Brian (Research on Improving Systems of Education (RISE), 2022)
This paper synthesises the findings of a set of country studies commissioned by the RISE Programme to explore the influence of politics and power on education sector policymaking and implementation. The synthesis groups the countries into three political-institutional contexts: - Dominant contexts, where power is centred around a political leader and a hierarchical governance structure. As the Vietnam case details, top-down leadership potentially can provide a robust platform for improving learning outcomes. However, as the case studies of Ethiopia, Indonesia, Nigeria, and Tanzania illustrate, all-too-often dominant leaders’ goals vis-à-vis the education sector can veer in other directions. - In impersonal competitive contexts, a combination of strong formal institutions and effective processes of resolving disagreements can, on occasion, result in a shared commitment among powerful interests to improve learning outcomes—but in none of the case studies is this outcome evident. In Peru, substantial learning gains have been achieved despite messy top-level politics. But the Chilean, Indian, and South African case studies suggest that the all-too-common result of rule-boundedness plus unresolved political contestation over the education sector’s goals is some combination of exaggerated rule compliance and/or performative isomorphic mimicry. - Personalised competitive contexts (Bangladesh, Ghana, and Kenya for example) lack the seeming strengths of either their dominant or their impersonal competitive contexts; there are multiple politically-influential groups and multiple, competing goals—but no credible framework of rules to bring coherence either to political competition or to the education bureaucracy. The case studies show that political and institutional constraints can render ineffective many specialised sectoral interventions intended to improve learning outcomes. But they also point to the possibility that ‘soft governance’ entry points might open up some context-aligned opportunities for improving learning outcomes. In dominant contexts, the focus might usefully be on trying to influence the goals and strategies of top-level leadership. In impersonal competitive contexts, it might be on strengthening alliances between mission-oriented public officials and other developmentally-oriented stakeholders. In personalised competitive contexts, gains are more likely to come from the bottom-up—via a combination of local-level initiatives plus a broader effort to inculcate a shared sense among a country’s citizenry of ‘all for education’.

How INGOs are Doing Development Differently - Algoso, Dave (Care, IRC, Mercy Corps, Oxfam & World Vision, 2017)

How ICT4D Research Fails the Poor - Harris, Roger W. (Information Technology for Development, 2016)
Research can improve development policies and practices and funders increasingly require evidence of such socioeconomic impact from their investments. This article questions whether information and communication technologies for development (ICT4D) research conforms to the requirements for achieving socioeconomic impact. We report on a literature review of the impact of research in international development and a survey of ICT4D researchers who assessed the extent to which they follow practices for achieving socioeconomic impact. The findings suggest that while ICT4D researchers are interested in influencing both practice and policy, they are less inclined toward the activities that would make this happen, especially engaging with users of their research and communicating their findings to a wider audience. Their institutions do not provide incentives for researchers to adopt these practices. ICT4D researchers and their institutions should engage more closely with the users of their research through more and better communications with the public, especially through the use of information and communication technologies.
Keywords: ICT4D; Policy making; Practice; Research; impact

How Does the World Bank Build Citizen Engagement Commitments into Project Design? Results from Pilot Assessments in Mozambique, Myanmar, Nigeria, and Pakistan - Nadelman, Rachel; Le, Ha; Sah, Anjali (Working Paper 525, 2019)
How and to what degree is the World Bank putting its new institutional citizen engagement (CE) commitments into practice? This question guides an independent assessment that the Accountability Research Center (ARC) at American University has undertaken as part of the Institute of Development Studies-led Action for Empowerment and Accountability (A4EA) research programme’s investigation into how external actors can best support local processes of and conditions for empowerment and accountability. This report investigates the World Bank’s incorporation of CE into project design, the critical early stage of donor engagement. To accomplish this, ARC reviewed the World Bank’s fiscal year 2015–17 investment project portfolios for four A4EA priority countries, Mozambique, Myanmar, Nigeria, and Pakistan, which covers 57 projects that range from US$19 million to U$600 million. The analysis determines whether projects commit to seeking a strategic approach to CE, which involves combining multiple tactics so that the whole could be greater than the sum of the parts. This assessment of CE commitments is intended to help to inform possible national, civil society organisation strategies to monitor whether and how these commitments are actually implemented in practice.

How Does Participatory Action Research Generate Innovation? Findings from a Rapid Realist Review - Snijder, Mieke; Apgar, J. Marina (CLARISSA Emerging Evidence Report, 2021)
This Emerging Evidence Report shares evidence of how, for whom, and under what circumstances, Participatory Action Research (PAR) leads to innovative actions. A rapid realist review was undertaken to develop programme theories that explain how PAR generates innovation. The methodology included peer-reviewed and grey literature and moments of engagement with programme staff, such that their input supported the development and refinement of three resulting initial programme theories (IPTs) that we present in this report. Across all three IPTs, safe relational space, group facilitation, and the abilities of facilitators, are essential context and intervention components through which PAR can generate innovation. Implications from the three IPTs for evaluation design of the CLARISSA programme are identified and discussed. The report finishes with opportunities for the CLARISSA programme to start building an evidence base of how PAR works as an intervention modality, such as evidencing group-level conscientisation, the influence of intersecting inequalities, and influence of diverse perspectives coming together in a PAR process.

How Does Developing Enforcement Capacity Reduce Wildlife Crime? Increasing program effectiveness by understanding common assumptions - Price, Claire; Buff, Jesse; Peabody, Shawn; Present, Tess; Lauck, Liz (USAID, 2018)
"How Does Developing Enforcement Capacity Reduce Wildlife Crime?" summarizes findings from the literature around four key assumptions about capacity building for enforcement and prosecution. Using the experiences and evidence summarized in this brief, program designers and implementing partners should be able to increase the effectiveness and efficiency of their capacity building efforts.

How do we know what works? Interview with Prof. Michael Woolcock, Lead Social Scientist at the World Bank - Evans, Alice (2018)
Dr Alice Evans and leading experts discuss growth, governance, & gender inequalities. Alice is a Lecturer at King's College London, and Faculty Associate at the Harvard Kennedy School.

How do we know we are doing good work? - Sharp, Cathy; McLaughlin, Dot; Whitley, Janet; Lawson, Karen (Collective Leadership for Scotland, 2022)
Collective leadership feels timely and important in an uncertain, fast changing, and challenging world. This report comes at this heightened moment of urgency and appetite for renewal, bringing potential to do things differently in public services and communities. The opportunities and challenges of true collaboration-in-practice, in the absence of blueprints, mean that it has never been more necessary to change ways of working and foreground learning. As outcomes remain important, and time and resources are scarcer than ever, the approach of collective leadership makes the creation of impact a shared, conscious, and actionable choice. A pathway to ultimate impact at scale is co-created through dialogue about expectations and contributions, and by design, not assuming change will happen because we have good intentions. Collective Leadership for Scotland (CLfS) has a strong vision and enjoys continuing active interest, drawing together participants from a variety of agencies working in public services. People are looking for fresh thinking, space and time for reflection, connection with others, a chance to think about how to tackle difficulties, and to test out what it takes to do, and continue to do, the work of collaborative public service. These motivations are deepened and brought into sharper focus by the pandemic, with an added interest in developing skills in online facilitation. CLfS contributes to building a critical mass for system change, to help to sustain the ambitions of the Christie Commission and the delivery of the National Outcomes for Scotland. There remains further potential to realise wider and deeper impact amongst organisations, communities, and wider systems. The conclusions of this report are likely to have wider resonance beyond interests in the CLfS programmes. This report deepens understanding of some of the challenges of commissioning, convening, and the scope for deeper impact through building reflective and relational leadership practices. It also outlines social and experiential sensemaking and facilitation practices to strengthen the action inquiry approach as a deliberate learning strategy, building cultures that support new forms of collaborative inquiry and systemic action research.

How Do Donor-led Empowerment and Accountability Activities Take Scale into Account? Evidence from DFID Programmes in Contexts of Fragility, Conflict and Violence - Anderson, Colin; Fox, Jonathan; Gaventa, John (IDS, 2020)
Development donors invest significantly in governance reform, including in contexts characterised by conflict and fragility. However, there is relatively little comparative study of their change strategies, and little understanding of what works and why. This paper explores the strategies of six recent DFID-funded programmes in Mozambique, Myanmar, and Pakistan with empowerment and accountability aims. Document review and field interviews are used to analyse the application of multi-scalar or multi-level change strategies, since such approaches are hypothesised to potentially generate more leverage for public accountability reforms. Analysis suggests that these strategies can strengthen citizen ability to navigate governance systems to resolve problems and claim accountability, and can bolster pro-accountability coalitions’ internal solidarity and external legitimacy. Multi-level strategies also appear associated with establishing more significant pressure for reform than exclusively local or national approaches. Yet conventional project reporting focuses on counting activities and outputs rather than analysing the dynamic, interactive processes at work in these strategies, and few evaluations are publicly accessible. To fully understand what kinds of action strengthen citizen demands for accountability requires a more transparent and rigorous approach to learning from donor-led governance interventions.

How did China create “Directed Improvisation”? - Pritchett, Lant (Building State Capability, 2017)
written by Lant Pritchett Yuen-Yuen Ang, a Professor of Political Science at University of Michigan came to speak at Harvard the other day and I was lucky enough to hear her presentation.  Her most…
Keywords: IMPORTANT

How DFID learns - ICAI (Independent Commission for Aid Impact (ICAI), 2014)
Excellent learning is essential for UK aid to achieve maximum impact and value for money. We take learning to mean the extent to which DFID uses information and experience to influence its decisions. Each ICAI review assesses how well learning takes place. Our reports to date indicate a mixed performance. This review seeks to identify the way DFID learns and what inhibits it from doing so consistently. We drew on our reviews, assessed data from DFID’s own surveys and carried out interviews inside and outside the department. Review DFID generates considerable volumes of information, much of which, such as funded research, is publicly available. DFID does not clearly or consistently link this investment to how it can deliver better impact. We made five recommendations and gave an amber-red score. Findings DFID does not clearly identify how its investment in learning links to its performance and delivering better impact. DFID has the potential to be excellent at organisational learning if its best practices become common. DFID staff learn well as individuals. They are highly motivated and DFID provides opportunities and resources for them to learn. DFID is not yet, however, managing all the elements that contribute to how it learns as a single, integrated system. DFID does not review the costs, benefits and impact of learning. Insufficient priority is placed on learning during implementation. The emphasis on results can lead to a bias to the positive. Learning from both success and failure should be systematically encouraged. Recommendations DFID needs to focus on consistent and continuous organisational learning based on the experience of DFID, its partners and contractors and the measurement of its impact, in particular during the implementation phase of its activities. All DFID managers should be held accountable for conducting continuous reviews from which lessons are drawn about what works and where impact is actually being achieved for intended beneficiaries. All information commissioned and collected (such as annual reviews and evaluations) should be synthesised so that the relevant lessons are accessible and readily usable across the organisation. The focus must be on practical and easy-to-use information. Knowhow should be valued as much as knowledge. Staff need to be given more time to acquire experience in the field and share lessons about what works and does not work on the ground. DFID needs to continue to encourage a culture of free and full communication about what does and does not work. Staff should be encouraged always to base their decisions on evidence, without any bias to the positive.

How DFID can better manage complexity in development programming - Sharp, Samuel; Valters, Craig; Whitty, Brendan (ODI, 2019)
The United Kingdom’s (UK) Department for International Development (DFID) is an ambitious government department that is committed to reducing poverty and conflict overseas. Many of the issues on which DFID works are complex; whether focused on climate change, gender equality, health or other priorities, simple solutions rarely exist. And to tackle these complex challenges, DFID staff must interact with unpredictable systems of political, organisational and individual behaviours and incentives. There is a risk that complex problems spur more complicated programmes; that the complexity of development challenges is addressed through designing programmes with too many projects and implementers. While there may be valid reasons for this, too many of these complicated programmes will overburden staff. This briefing note is the outcome of an ongoing process within DFID to confront these issues and answer the question: how can DFID design and manage programmes to address complex development challenges without creating too much staff workload? Key messages DFID deals with complex problems, which require flexible systems to support testing, learning and adaptation. • Complex problems do not necessarily require workload-heavy delivery structures, but simpler approaches depend on delivery partners’ experience and competence. • However, programmes that tackle complex problems do require more hands-on engagement and face more workload from inflexible compliance requirements. We suggest that DFID and similar agencies: • Pay closer attention to delivery options in programme design, making use of existing options where possible and, where not, fostering local organisations through long-term investments. • Encourage programme designers to articulate how ambition matches resources and consider ‘good enough’ design. • Reduce the burden of compliance by cultivating partner autonomy, reassessing results and valuefor-money requirements and promoting more flexible contracting and procurement. • Plan and prioritise management resources across a portfolio of programmes to make sure they can be focused in the right areas, where the complexity of the problem requires greater engagement.

How Decent is Decent Work? Using SenseMaker to understand workers’ experiences - Mager, Franziska; Smith, Becca; Gujit, Irene (Oxfam, 2018)

How China Escaped the Poverty Trap - Ang, Yuen Yuen (Cornell University Press, 2016)
Before markets opened in 1978, China was an impoverished planned economy governed by a Maoist bureaucracy. In just three decades it evolved into the world's second-largest economy and is today guided by highly entrepreneurial bureaucrats. In How China Escaped the Poverty Trap, Yuen Yuen Ang explains this astonishing metamorphosis. Rather than insist that either strong institutions of good governance foster markets or that growth enables good governance, Ang lays out a new, dynamic framework for understanding development broadly. Successful development, she contends, is a coevolutionary process in which markets and governments mutually adapt.By mapping this coevolution, Ang reveals a startling conclusion: poor and weak countries can escape the poverty trap by first harnessing weak institutions―features that defy norms of good governance―to build markets. Further, she stresses that adaptive processes, though essential for development, do not automatically occur. Highlighting three universal roadblocks to adaptation, Ang identifies how Chinese reformers crafted enabling conditions for effective improvisation.How China Escaped the Poverty Trap offers the most complete synthesis to date of the numerous interacting forces that have shaped China’s dramatic makeover and the problems it faces today. Looking beyond China, Ang also traces the coevolutionary sequence of development in late medieval Europe, antebellum United States, and contemporary Nigeria, and finds surprising parallels among these otherwise disparate cases. Indispensable to all who care about development, this groundbreaking book challenges the convention of linear thinking and points to an alternative path out of poverty traps.
Keywords: IMPORTANT

How Change Happens - Green, Duncan (OUP Oxford, 2016)
Human society is full of would-be 'change agents', a restless mix of campaigners, lobbyists, and officials, both individuals and organizations, set on transforming the world. They want to improve public services, reform laws and regulations, guarantee human rights, get a fairer deal for those on the sharp end, achieve greater recognition for any number of issues, or simply be treated with respect. Striking then, that not many universities have a Department of Change Studies, to which social activists can turn for advice and inspiration. Instead, scholarly discussions of change are fragmented with few conversations crossing disciplinary boundaries, rarely making it onto the radars of those actively seeking change. This book bridges the gap between academia and practice, bringing together the best research from a range of academic disciplines and the evolving practical understanding of activists to explore the topic of social and political change. Drawing on many first-hand examples from the global experience of Oxfam, one of the world's largest social justice NGOs, as well as the author's insights from studying and working on international development, it tests ideas on How Change Happens and offers the latest thinking on what works to achieve progressive change. This is an open access title available under the terms of a CC BY-NC-ND 4.0 International licence. It is available as a free PDF download from OUP and selected open access locations.

How can we be more adaptive? AdaptScan identifies critical areas for improvement - Mercy Corps (Mercy Corps & IRC, 2017)
Keywords: IMPORTANT

How Big Things Get Done: The Surprising Factors Behind Every Successful Project, from Home Renovations to Space Exploration - Flyvbjerg, Bent; Gardner, Dan (Macmillan, 2023)
World expert Bent Flyvbjerg and bestselling author Dan Gardner reveal the secrets to successfully planning and delivering ambitious projects on any scale.Nothing is more inspiring than a big vision that becomes a triumphant new reality. Think of how Apple’s iPod went from a project with a single employee to an enormously successful product launch in eleven months. But such successes are the exception. Consider how London’s Crossrail project delivered five years late and billions over budget. More modest endeavours, whether launching a small business, organizing a conference, or just finishing a work project on time, also commonly fail. Why?Understanding what distinguishes the triumphs from the failures has been the life’s work of Oxford professor Bent Flyvbjerg. In How Big Things Get Done, he identifies the errors that lead projects to fail, and the research-based principles that will make yours succeed:- Understand your odds. If you don’t know them, you won’t win.- Plan slow, act fast. Getting to the action quick feels right. But it’s wrong.- Think right to left. Start with your goal, then identify the steps to get there.- Find your Lego. Big is best built from small.- Master the unknown unknowns. Most think they can’t, so they fail. Flyvbjerg shows how you can.Full of vivid examples ranging from the building of the Sydney Opera House to the making of the latest Pixar blockbusters, How Big Things Get Done reveals how to get any ambitious project done – on time and on budget.

How Beijing Commands: Grey, Black, and Red Directives from Deng to Xi - Ang, Yuen Yuen (The China Quarterly, 2022)

How Artifacts Afford: The Power and Politics of Everyday Things - Davis, Jenny L. (MIT Press, 2020)
Technologies are intrinsically social. They reflect human values and affect human behavior. The social dynamics of technology materialize through design features that shape how a technology functions and to what effect. The shaping effects of technology are represented in scholarly fields by the concept of “affordances.” Affordances are the ways design features enable and constrain user engagement and social action. This has been a central construct for designers and technology theorists since foundational statements on the topic from JJ Gibson and Don Norman in the 1970s and 80s. With the rise of digitization and widespread automation, “affordance” has entered common parlance and resurged within academic discourse and debate. Davis provides a conceptual update on affordance theory along with a cogent scaffold that shifts the orienting question from what technologies afford, to how technologies afford, for whom, and under what circumstances? “How Artifacts Afford” introduces the mechanisms and conditions framework of affordances in which technologies request, demand, encourage, discourage, refuse, and allow social action, varying across subjects and circumstances. Underlying this mechanisms and conditions framework is a sharp focus on the politics and power encoded in sociotechnical systems. In this timely theoretical reboot, Davis brings clarity to the affordance concept, situates the concept within a broader history of technology studies, and demonstrates how the mechanisms and conditions framework can serve as a transferrable tool of inquiry, critique, and (re)design.