Towards transformative social learning on the path to 1.5 degrees - Macintyre, Thomas; Lotz-Sisitka, Heila; Wals, Arjen; Vogel, Coleen; Tassone, Valentina (Current Opinion in Environmental Sustainability, 2018)

Rethinking Rigor - Increasing Credibility and Use - Lynn, Jewlya; Preskill, Hallie (Spark Policy Institute & FSG, 2016)
Evaluations of complex systems change strategies or adaptive, innovative programs cannot use the traditional “rigor” yardstick to measure quality. This paper proposes a new definition of rigor, one that applies in any setting, but particularly in complex, adaptive ones. Top Takeaways: 4 criteria for the new definition of rigor: - Quality of thinking - Credible and legitimate claims - Cultural context and responsiveness - Quality and value of the learning process Regardless of its other positive attributes, an evaluation of a complex, adaptive program that fails to take into account systems thinking will not be responsive to the needs of that program.

Real Time Monitoring and the New Information Technologies - Lucas, Henry; Batchelor, Simon; Berdou, Evangelia (IDS Bulletin, 2013)
Debates as to the potential role of new Information and Communication Technologies (ICTs) in monitoring the wellbeing of vulnerable groups is often bedevilled by the failure of two principal actors – social researchers and technical experts – to address the other’s concerns or even to use language that is comprehensible to the other side. The aim here is to unpick some of the technical language relevant in this context and provide a brief introductory guide to some aspects of the current, rapidly changing and highly diverse ICT environment.

Exploring the new world: practical insights for funding, commissioning and managing in complexity - Lowe, Toby; Plimmer, Dawn (Collaborate & Newcastle University, 2019)
The world is complex. If we want to contribute to creating positive social outcomes, we must learn to embrace this complexity. This is the New World that funders and commissioners are discovering: • People are complex: everyone’s life is different, everyone’s strengths and needs are different. • The issues we care about are complex: issues – like homelessness – are tangled and interdependent. • The systems that respond to these issues are complex: the range of people and organisations involved in creating ‘outcomes’ in the world are beyond the management control of any person or organisation. Building on the findings from our previous report, A Whole New World, we have spent the last 12 months working with a growing movement of funders, public sector commissioners, and organisations working on the ground to begin to explore this New World: to find examples of practice that will help people to navigate it effectively. This report explores the key features of their response: working in a way that is human, prioritises learning and takes a systems approach.

When Does the State Listen? - Loureiro, Miguel; Cassim, Aalia; Darko, Terence; Katera, Lucas; Salome, Nyambura (IDS Bulletin, 2016)

Reciprocity in International Volunteer Cooperation - Lough, Benjamin J. (Fredskorpset Norway, 2016)

Thinking and Working Politically: Lessons from FOSTER in Nigeria - Lopez Lucia, Elisa; Buckley, Joanna; Marquette, Heather; McCulloch, Neil (DLP Program, 2017)
The Facility for Oil Sector Transparency and Reform (FOSTER) was a £14 million programme that has helped Nigeria to transform its governance of the oil and gas industry. FOSTER ran from 2011 to mid-2016, and used an explicit ‘thinking and working politically’ (TWP) approach. It was funded by the UK Department for International Development (DFID) and managed by Oxford Policy Management (OPM). This paper seeks to identify the factors that drove – or constrained – FOSTER’s achievements, and asks what this can tell us about TWP, particularly in challenging political and sectoral contexts. FOSTER sought to help strengthen oversight and accountability in Nigeria’s oil sector. It aimed to support reformers within government institutions that ‘supply’ accountability (those governing how oil and gas revenues are collected and managed), and to support civil society organisations, parliament, the media and the Nigeria Extractive Industries Transparency Initiative to ‘demand’ reform. In addition, FOSTER commissioned a series of studies and provided media training to help broaden understanding of the sector and highlight the need for reform. This paper examines the outcomes from five ‘clusters’ of FOSTER interventions. The FOSTER team viewed the first three of these in the list below as successful, whereas the latter two did not deliver on expectations but offer important opportunities for learning: • Support to the Nigerian Extractive Industries Transparency Initiative • Support to demand-side actors to promote transparency and accountability in the oil sector • Support for the passage of the Petroleum Industry Bill • An oil spill-mapping social media project • Support to the Department of Petroleum Resources The analysis drew on 44 semi-structured interviews conducted during a month of fieldwork in Abuja and Lagos; on reviews of the programme’s monitoring, evaluation and learning frameworks; and on newspaper articles and grey literature on Nigeria’s oil sector.2

Livelihoods in the Za'atari Camp: Impact evaluation of Oxfam’s Cash for Work activities in the Za’atari camp (Jordan) - Lombardini, Simone; Mager, Franziska (http://hdl.handle.net/10546/620883, 2019)

You might not be as agile as you think you are - Lindpaintner, Julia; Rivera, Stephanie (18F, 2019)
The mandate to be agile is everywhere. But agile isn’t an on-off switch. It’s a skill and a mindset that is developed over time, through dedicated work, open teams, and lots (and lots) of practice

Are unmanned aircraft systems (UASs) the future of wildlife monitoring? A review of accomplishments and challenges - Linchant, Julie; Lisein, Jonathan; Semeki, Jean; Lejeune, Philippe; Vermeulen, Cédric (Mammal Review, 2015)
Regular monitoring of animal populations must be established to ensure wildlife protection, especially when pressure on animals is high. The recent development of drones or unmanned aircraft systems (UASs) opens new opportunities. UASs have several advantages, including providing data at high spatial and temporal resolution, providing systematic, permanent data, having low operational costs and being low-risk for the operators. However, UASs have some constraints, such as short flight endurance. We reviewed studies in which wildlife populations were monitored by using drones, described accomplishments to date and evaluated the range of possibilities UASs offer to provide new perspectives in future research. We focused on four main topics: 1) the available systems and sensors; 2) the types of survey plan and detection possibilities; 3) contributions towards anti-poaching surveillance; and 4) legislation and ethics. We found that small fixed-wing UASs are most commonly used because these aircraft provide a viable compromise between price, logistics and flight endurance. The sensors are typically electro-optic or infrared cameras, but there is the potential to develop and test new sensors. Despite various flight plan possibilities, mostly classical line transects have been employed, and it would be of great interest to test new methods to adapt to the limitations of UASs. Detection of many species is possible, but statistical approaches are unavailable if valid inventories of large mammals are the purpose. Contributions of UASs to anti-poaching surveillance are not yet well documented in the scientific literature, but initial studies indicate that this approach could make important contributions to conservation in the next few years. Finally, we conclude that one of the main factors impeding the use of UASs is legislation. Restrictions in the use of airspace prevent researchers from testing all possibilities, and adaptations to the relevant legislation will be necessary in future.
Keywords: detection; drone; survey; wildlife

Reflections on the Utilization-Focused Evaluation (UFE) Process - Lim, Yvonne; Mizumoto, Ann (Strengthening ICTD Research Capacity in Asia (SIRCA) Programme, 2010)
This presentation from the Strengthening ICTD Research Capacity in Asia (SIRCA) provides an overview of how UFE was used in their SIRCA programme. It was presented at the Evaluation Conclave 2010, New Delhi, India The key objectives of the program are to: Enhance research capacity in Asia through rigorous academic research Create a space for dialogue on ICT4D social science research issues in Asia Create linkages through a mentorship program Disseminate findings in publications and conferences Contents SIRCA Programme SIRCA Key Objectives SIRCA Evaluation UFE Learnings UFE Challenges Evaluation is over…but there’s a lasting outcome...

Playbook for innovation learning. 35 diagrams to support talking and thinking about learning for innovation - Leurs, Bas; Roberts, Isobel (Nesta, 2018)

The landscape of innovation approaches - Leurs, Bas (States of Change, 2018)
An overview of innovation methods and approaches we’ve come across in government innovation practice.

Steering E-Government Projects from Failure to Success: Using Design-Reality Gap Analysis as a Mid-Implementation Assessment Tool - Lessa, Lemma; Negash, Solomon; Belachew, Mesfin (Emerging Issues and Prospects in African E-Government:, 2014)
There are many e-government failures in developing countries. Most studies look at these after the event (post hoc), but this chapter takes an original approach to look mid-implementation (durante hoc) in order to provide recommendations for improvement. The authors chose a partial failure/partial success land management information system being implemented in one Ethiopian city. The project has made retrieval of land information quicker and simpler but is only partly implemented, and is still—on occasion—circumvented by public servants for personal gain. They used design-reality gap framework to understand why the project had partly failed. The authors used the design-reality gap analysis to propose an action plan that would help institutionalise the system, steering it from partial failure to success. They demonstrate the value of this framework as a tool for mid-implementation analysis of e-government projects. The authors recommend its usage on other ongoing e-government projects in developing countries.

Smart Risks: How small grants are helping to solve some of the world's biggest problems - Lentfer, Jennifer; Cothran, Tanya (Practical Action Publishing, 2017)
As never before, international aid is in the hands of ordinary people. Concerned citizens in wealthy countries are starting philanthropy groups, joining giving circles, and travelling internationally to lend support. Yet, they are torn between the feelings that 'something' must be done about global poverty and that foreign assistance is creating dependency and fueling corruption overseas.A growing community of international small grant-makers know how to find and fund effective grassroots initiatives. Compared to donor-controlled, large-scale, project-based international aid funding, small grant-makers use the concept of 'smart risks' to build upon existing human and social capital and to make a lasting changes in people's lives. Smart Risks brings together the wisdom of experts with wide-ranging experience within the development sector. Their contributions focus on five guiding question, such as 'who is a smart risk?' and 'what is your role in smart risks?' They include case studies, personal stories of lessons learned over time, provocative insights on power and privilege, and practical frameworks for choosing, investing in, and measuring the impact of grassroots organizations and movements. This book is essential reading for all those who wonder how their donations and work can make a difference in developing countries - from aid agency staff and policy makers, to globally engaged individuals.

The Patterning Instinct: A Cultural History of Humanity's Search for Meaning - Lent, Jeremy (Prometheus Books, 2017)
This fresh perspective on crucial questions of history identifies the root metaphors that cultures have used to construct meaning in their world. It offers a glimpse into the minds of a vast range of different peoples: early hunter-gatherers and farmers, ancient Egyptians, traditional Chinese sages, the founders of Christianity, trail-blazers of the Scientific Revolution, and those who constructed our modern consumer society. Taking the reader on an archaeological exploration of the mind, the author, an entrepreneur and sustainability leader, uses recent findings in cognitive science and systems theory to reveal the hidden layers of values that form today's cultural norms. Uprooting the tired cliches of the science-religion debate, he shows how medieval Christian rationalism acted as an incubator for scientific thought, which in turn shaped our modern vision of the conquest of nature. The author probes our current crisis of unsustainability and argues that it is not an inevitable result of human nature, but is culturally driven: a product of particular mental patterns that could conceivably be reshaped. By shining a light on our possible futures, the book foresees a coming struggle between two contrasting views of humanity: one driving to a technological endgame of artificially enhanced humans, the other enabling a sustainable future arising from our intrinsic connectedness with each other and the natural world. This struggle, it concludes, is one in which each of us will play a role through the meaning we choose to forge from the lives we lead.

Narrowing the climate information usability gap - Lemos, Maria Carmen; Kirchhoff, Christine J.; Ramprasad, Vijay (Nature Climate Change, 2012)
Climate-change-related risks pose serious threats to the management of a wide range of social, economic and ecological systems. Managing these risks requires knowledge-intensive adaptive management and policy-making actively informed by scientific knowledge, especially climate science1. However, potentially useful climate information often goes unused1,2. This suggests a gap between what scientists understand as useful information and what users recognize as usable in their decision-making. We propose a dynamic conceptual model to address this gap and highlight strategies to move information from useful to usable to reduce climate-related risks.

Transforming governance: how can technology help reshape democracy? - Leighninger, Matt (Institute of Development Studies, 2016)
Around the world, people are asking how we can make democracy work in new and better ways. We are frustrated by political systems in which voting is the only legitimate political act, concerned that many republics don’t have the strength or appeal to withstand authoritarian figures, and disillusioned by the inability of many countries to address the fundamental challenges of health, education and economic development. If we want to create democracies in which citizens have meaningful roles in shaping public decisions and solving public problems, we should be asking a number of questions about civic tech, including: • How can online tools best support new forms of democracy? • What are the examples of how this has happened? • What are some variables to consider in comparing these examples? • How can we learn from each other as we move forward? This background note has been developed to help democratic innovators explore these questions and examine how their work can provide answers.

Evaluating megaprojects: From the ‘iron triangle’ to network mapping - Lehtonen, Markku (Evaluation, 2014)
Evaluation literature has paid relatively little attention to the specific needs of evaluating large, complex industrial and infrastructure projects, often called ‘megaprojects’. The abundant megaproject governance literature, in turn, has largely focused on the so-called ‘megaproject pathologies’, i.e. the chronic budget overruns, and failure of such projects to keep to timetables and deliver the expected social and economic benefits. This article draws on these two strands of literature, identifies shortcomings, and suggests potential pathways towards an improved evaluation of megaprojects. To counterbalance the current overemphasis on relatively narrowly defined accountability as the main function of megaproject evaluation, and the narrow definition of project success in megaproject evaluation, the article argues that conceptualizing megaprojects as dynamic and evolving networks would provide a useful basis for the design of an evaluation approach better able to promote learning and to address the socio-economic aspects of megaprojects. A modified version of ‘network mapping’ is suggested as a possible framework for megaproject evaluation, with the exploration of the multiple accountability relationships as a central evaluation task, designed to reconcile learning and accountability as the central evaluation functions. The article highlights the role of evaluation as an ‘emergent’ property of spontaneous megaproject ‘governing’, and explores the challenges that this poses to the role of the evaluator.

Scenario-based strategizing: Advancing the applicability in strategists' teams - Lehr, Thomas; Lorenz, Ullrich; Willert, Markus; Rohrbeck, René (Technological Forecasting and Social Change, 2017)
For over 40years, scenarios have been promoted as a key technique for forming strategies in uncertain environments. However, many challenges remain. In this article, we discuss a novel approach designed to increase the applicability of scenario-based strategizing in top management teams. Drawing on behavioural strategy as a theoretical lens, we design a yardstick to study the impact of scenario-based strategizing. We then describe our approach, which includes developing scenarios and alternative strategies separately and supporting the strategy selection through an integrated assessment of the goal-based efficacy and robustness. To facilitate the collaborative strategizing in teams, we propose a matrix with robustness and efficacy as the two axes, which we call the Parmenides Matrix. We assess the impact of the novel approach by applying it in two cases, at a governmental agency (German Environmental Ministry) and a firm affected by disruptive change (Bosch, leading global supplier of technology and solutions).
Keywords: Behavioural strategy; Scenario-based strategizing; Scenarios; Strategic foresight; Uncertainty

Thinking and Working Politically: What does it mean, Why is it important and How do you do it? - Leftwich, Adrian (Politics, Leadership and Coalitions in Development: Policy Implications of the DLP Research Evidence, Research and Policy Workshop, 2011)
This paper suggests that working politically in a developmental context means directing attention and support to the agents of reform and development (leaders and organisations). This allows investment in the local processes that will resolve problems – such as problems of collective action – through the work of alliances and coalitions. Hence, it will drive the formation and consolidation of the locally appropriate, feasible and legitimate institutions that are most likely to advance development outcomes. The Developmental Leadership Program defines politics as the pervasive, unavoidable and necessary activities of conflict, negotiation and compromise involved in group decision-making about how resources are to be used, produced and distributed. Thinking politically means understanding that both political and technical dimensions are central to developmental outcomes. It also means: Understanding that ‘agency’ matters. That is, that people have the potential to change things, but always withhin the context of given institutional arrangements, which contain both constraints and opportunities. Leaders, organisations and followers think, strategise and attempt to resolve problems in different ways in the same contexts. Understanding leadership as a political process that mobilises people and resources in support of a goal: leaders seldom work on their own. Realising that overcoming collective action problems is a major challenge of development. Collective action problems occur when people with diverse (often competing) interests struggle to agree on an organisational arrangement from which they would all benefit. Understanding that coalitions (formal or informal) are a crucial political mechanism for the resolution of collective action problems. Paying attention to the detailed inner politics of regimes, sectors or issues (‘micro-politics’). This includes understanding who the players are, where they come from, their organisational affiliations, ideologies and interests and the political dynamics involved. (Many political analysis tools are inadequate for this level of detail.) Recognising that processes are as important as projects in development, and vary from context to context. Working politically in development means supporting, brokering, facilitating and aiding the emergence and practices of (public or private) developmental or reform leaderships, organisations, networks and coalitions at any level, and across all sectors. It means helping them to respond to, and work with, initiatives and requests from local individuals and groups. Working politically can also involve: Investing in the effectiveness of developmental coalitions by enhancing the political capacity of organisations in negotiation, advocacy, communication and the generation of constructive policy options. Rethinking higher educational support programmes so that they supplement a skills focus with strategies that help to build networks, and encourage the understanding of collective action problems and of the importance of providing public goods. Acquiring a deep and detailed knowledge of, and long-term exposure to, the country or issue concerned. Respectful and sensitive understanding of local political dynamics and cultural norms. Employing more social scientists and a well-trained, politically savvy workforce, both local and international, with the capacity to ‘read’ the politics. In particular, coalitions can help drive the endogenous politics of developmental reforms by: 1) achieving a specific policy goal; 2) opening up debate on a previously taboo issue; 3) deepening and strengthening the coalition’s internal organisation and relationships for future purposes; and 4) increasing the capacity of constituent organisations. It is also important to understand that: Developmental leaderships and coalitions often emerge in response to a critical juncture – a threat, challenge or danger – or a new opportunity. What matters is whether leaders have the knowledge, education, vision, prior experience and networks to seize such opportunities. The character and conditionality of funding by donors or supporters can make or break a coalition. Are tight conditions applied? Are funding arrangements transparent?

Before the Backlash, Let’s Redefine User-Centered Design - Lee, Panthea (Stanford Social Innovation Review, 2015)
We must better understand user-centered design’s limitations—not just its strengths—in the context of international development. And we must adapt it from its original uses designing commercial products to solving for social good.

Moving from Real-Time Data to Real-Time Programs - Lee, Panthea (Reboot, 2016)
How can we avoid drowning in data to actually make better decisions?
Keywords: IMPORTANT

Regional Healthcare Ecosystem Analyst for Healthcare Associated Infections - Lee, Bruce Y. (Grantome, 2018)
Understanding and preventing the spread of both endemic and emerging healthcare-associated infectious diseases throughout hospitals and nursing homes is a national priority. Our work has shown that the many disparate inpatient healthcare facilities in a region can form a complex healthcare ecosystem connected by both direct and indirect patient sharing allowing pathogens in one health care facility to readily spread to other facilities. Our goal is to further develop RHEA (Regional Healthcare Ecosystem Analyst) into a user-friendly software tool that decision makers (e.g., policy makers, funders, product developers and manufacturers, healthcare administrators, infection prevention specialists, researchers, and educators) can readily use to help healthcare ecosystems prevent and control the spread of an endemic pathogen, methicillin- resistant Staphylococcus aureus (MRSA), and an emerging pathogen, carbapenem-resistant Enterobacteriaceae (CRE). This next generation of RHEA will bring multiple innovations by: 1) further elucidating the interconnectedness of the ecosystem and showcasing the value of cooperation among facilities versus the current individual facility approach to infectious disease control, 2) incorporating new healthcare ecosystem responses for endemic MRSA and emerging CRE, 3) continuing our work integrating economic and operational models into a framework of infectious disease epidemiological models, 4) imbuing virtual patients with characteristics linked to MRSA and CRE transmission and outcome risk, 5) building a comprehensive """"""""virtual laboratory"""""""" to help address many existing and future healthcare ecosystem infectious disease questions, and 6) building a user-friendly modeling tool that decision makers can use. The project will continue our team's longstanding modeling work and developing computational tools for decision makers via three specific aims. First, completing Specific Aim 1 will expand RHEA by adding the following capabilities: i) integrated clinical outcome and economic models, ii) more extensive and detailed patient characteristics linked to changes in infection risk and costs, iii) expanded HAI control measures, and iv) stochastic and adaptive disease parameters to represent emerging and evolving diseases. Next, Specific Aim 2 will use our newly expanded RHEA framework to model a sample endemic pathogen, MRSA, and a sample emerging pathogen, CRE to identify optimal control strategies even when pathogen characteristics are evolving. Finally, Specific Aim 3 will involve developing a user-friendly interface for RHEA and deploying it as a healthcare ecosystem computational modeling tool that various stakeholders (e.g., policy makers, healthcare administrators, infection control specialists, funders, and product manufacturers) can readily use to make decisions regarding the control of healthcare-associated infections. Public Health Relevance Understanding and preventing the spread of healthcare-associated infectious diseases throughout hospitals and nursing homes is a national priority. Simulation models can serve as virtual laboratories to help identify best practice solutions for containing common [such as methicillin-resistant Staphylococcus aureus (MRSA)] and emerging [e.g., carbapenem-resistant Enterobacteriaceae (CRE)] causes of healthcare associated infections (HAIs). Our goal is to develop our software RHEA (Regional Healthcare Ecosystem Analyst) into a computational modeling tool that can be used directly by decision makers to identify, develop, and evaluate strategies and interventions to reduce HAIs across a large geographic region.

The role of social learning in adaptiveness: insights from water management - Lebel, Louis; Grothmann, Torsten; Siebenhüner, Bernd (International Environmental Agreements: Politics, Law and Economics, 2010)
The article introduces the notion of adaptiveness and discusses the role of social learning in it. Adaptiveness refers to the capacity of a social actor or social–ecological system to adapt in response to, or in anticipation of, changes in the environment. We explore arguments both from a theoretical perspective and through illustrations from case studies of water management in the Alps of Europe and Mekong in southeast Asia. We propose and illustrate that social learning processes are important for building adaptiveness in several ways and at different scales. Social learning can help cope with informational uncertainty; reduce normative uncertainty; build consensus on criteria for monitoring and evaluation; empower stakeholders to take adaptive actions; reduce conflicts and identify synergies between adaptations; and improve fairness of decisions and actions. Findings in the case studies provide some support for these generalizations but often with caveats related to diversity of stakeholder interests, levels of shared understanding versus contested knowledge and scale of coordination. For this reason, we suggest that future work pays greater attention to issues of agency, knowledge and scale: What strategies have individuals and organizations pursued in successful examples of social learning? How are the boundaries and interactions between science, policy and practice managed? How does social learning occur across spatial and temporal scales?
Keywords: Adaptation; European Alps; Fairness; Mekong River; Social learning; Uncertainty; Water management

How useful are RCTs in evaluating transparency and accountability projects? - Leavy, Jennifer (IDS, 2014)

An analysis of what CLA looks like in Development Programming - Learning Lab (USAID, 2017)

Collaborating, Learning, and Adapting (CLA). Framework and Maturity Matrix Overview - Learning Lab (USAID, 2016)

Collaborating, Learning, and Adapting. Framework & Key Concepts - Learning Lab (USAID, 2016)

Evidence Base for Collaborating, Learning, and Adapting: summary of the literature review (2016.08) - Learning Lab (USAID, 2016)
LEARN and USAID/PPL are managing an area of work known as Evidence Base for Collaborating, Learning, and Adapting (EB4CLA). The purpose of this work is to answer key learning questions:

Evidence Base for Collaborating, Learning, and Adapting: summary of the literature review (2017 update) - Learning Lab (USAID, 2017)
LEARN and USAID/PPL are managing an area of work known as Evidence Base for Collaborating, Learning, and Adapting (EB4CLA). The purpose of this work is to answer key learning questions:

Landscape Analysis of Learing Agendas: USAID/Washington and beyond - Learning Lab (USAID, 2017)
EXECUTIVE SUMMARY U.S. government agencies and development organizations around the world are increasingly recognizing and supporting learning activities— often informed by a learning agenda—as important tools for improving organizational effectiveness and efficiency. A learning agenda comprises a set of broad questions directly related to the work that an agency conducts; when answered, they enable the agency to work more effectively and efficiently, particularly pertaining to evaluation, evidence, and decisionmaking. This report surveys the landscape of learning agendas at USAID and beyond to inform the learning agenda initiative planned by the Office of Learning, Evaluation, and Research (LER) in the Bureau for Policy, Planning and Learning (PPL). Reporting on research conducted over a 6-month period (September 2016 to February 2017), this landscape analysis focuses on six documented, office-, bureau-, or initiative-wide learning agendas being used at USAID/Washington. It also considers 11 new or noteworthy learning initiatives at USAID and five learning efforts at other federal agencies. The research team interviewed 60 staff from 20 USAID offices and bureaus, as well as staff from five other federal agencies. (See Annexes 1 through IV for more information.) The team also convened two focus groups: one with staff in USAID/Washington who had recently returned from serving in Missions, and one with PPL staff who discussed that bureau’s learning activities. The report details the interviewees’ remarks on six topics:  Motivations behind their decisions to pursue a learning agenda, such as expectations of accountability, especially in response to leadership demands  The key benefits emerging from their learning agenda efforts, which have included identifying gaps in knowledge and evidence, and supporting other cultural and organizational change processes  The participatory and consultative strategies they used to engage with stakeholders, including engagement with Mission staff and inclusion of academics and outside experts  The learning activities and products related to their initiatives  Challenges and strategies on resources, dissemination, and utilization, including ways to update their learning agenda to ensure that it remains a “living document”  Recommendations they had for PPL and others considering embarking on a learning agenda initiative

LEARN Monitoring, Evaluation, Research, and Learning Plan - Learning Lab (USAID, 2016)
LEARN and USAID/PPL are managing an area of work known as Evidence Base for Collaborating, Learning, and Adapting (EB4CLA). The purpose of this work is to answer key learning questions:

Learning Lab - Collaborate, Learn and Adapt for better development outcomes - Learning Lab (USAID, 2013)
CLA is: a component of several missions' CDCSes. a conceptual framework for some principles and operational processes that can enable USAID to become a more effective learning organization and thereby a more effective development organization. an approach to facilitating local participation and capacity and promoting country-led development. For more information on CLA visit:

Two Tunes, One Dance: Keeping Programming Agile - Learning Lab (USAID Learning Lab, 2017)

How to manage complexity: four lessons for DFID’s new Secretary of State - LearnAdapt (Medium, 2019)
Lessons for DFID in addressing complex problems without creating complicated, workload heavy programmes.

Applying social learning where ‘business-as-usual’ solutions no longer work for complex problems and programs - Le Borgne, Ewen (CCSL Learning Brief, 2016)
Key messages • Social learning facilitates sharing and learning beyond individuals to networks and systems. Through a facilitated, iterative process of joint work, dialogue and reflection, new shared ways of knowing emerge that lead to changes in practice. • Social learning has real potential to unlock change and transform relationships between actors involved in complex programs and/or dealing with ‘wicked problems’. Adversely it is not advisable to pursue for simple initiatives. • Social learning offers many thematic and pragmatic entry points to be embedded in the CGIAR research programs around partnerships, innovation systems, monitoring and evaluation.

Agile Project Management For Dummies - Layton, Mark C. (John Wiley & Sons, 2012)
Be flexible and faster with Agile project management As mobile and web technologies continue to evolve rapidly, there is added pressure to develop and implement software projects in weeks instead of months. Agile Project Management For Dummies can make that happen. This is the first book to provide a simple, step–by–step guide to Agile Project Management approaches, tools, and techniques. With the fast pace of mobile and web technology development, software project development must keep pace; Agile Project Management enables developers to complete and implement projects more quickly and this book shows you how. Offers a practical context for understanding and applying Agile techniques, moving from theory into actual practice Explains when to use Agile and how to avoid common pitfalls Written by experts who know how to apply the principles in real–world situations Agile Project Management For Dummies enables you to understand and apply Agile principles for faster, more accurate development.

Scrum For Dummies - Layton, Mark C. (John Wiley & Sons, 2015)
Practice an agile form of management to stop wasting time and money Scrum For Dummies is an easy to use guide to managing the tricky transition from a traditional project management methodology to the new and most popular agile framework. As the most efficient, successful methodology for team project management, Scrum relies on transparency, flexibility, and fluidity to deliver a final product that fulfills the needs of all stakeholders. Written in easy–to–read Dummies style, this book walks you through the core principles of Scrum and provides a roadmap for tangible implementation. The vast majority of projects go over budget, and billions of dollars are wasted every year on overruns. Put a stop to this wasteful leakage by switching to a management style that keeps all participants informed, up–to–date, and accountable. Authored by a Certified Scrum Trainer, Mark Layton, Scrum For Dummies covers the key ideas and processes behind Scrum methodologies, and presents the inner workings of the plan in an engaging and accessible format. Topics include: The Scrum values, roles, artifacts, and activities that make up the principle of this methodology When and how best to use Scrum The differences between Scrum and other agile methodologies Using Scrum for IT, finance, construction, health care, and more The book also delves into the everyday use of Scrum, and how it can help you achieve your own personal goals outside of work. There′s a reason why scrum is quickly becoming the standard approach to project management it works! If you want to stop wasting time and start producing more effectively, Scrum For Dummies is the guide that will get you there.

Thinking and working politically: An introduction to key ideas, examples and further reading - Laws, Ed; Marquette, Heather (2018)

Thinking and working politically: Reviewing the evidence on the integration of politics into development practice over the past decade - Laws, Ed; Marquette, Heather (TWP Community of Practice, 2018)

Thinking and working politically in Somalia: A case study on the Somalia Stability Fund - Laws, Ed (TWP Coommunity of Practice and ODI, 2018)

Developmental evaluation: Bridging the gaps between proposal, program, and practice , Developmental evaluation: Bridging the gaps between proposal, program, and practice - Lawrence, Rachael B.; Rallis, Sharon F.; Davis, Laura C.; Harrington, Karen (Evaluation, 2018)
Developmental evaluation supports grant-funded initiatives seeking innovation and change. Programs born from aspirational grant language and plans often need guidance as they work toward creating workable models for social innovation. This article describes the challenge of designing and implementing complex programs and presents a case that illustrates how a program moves from proposal to practice. The Massachusetts Charter Public School Association Capacity Building Network is a complex intervention, funded by the US federal government, aimed at raising school capacity to serve students with disabilities and English language learners. Developmental evaluation served to bridge the gaps between an aspirational proposal, an ambitious and ambiguous program plan, and emerging practices to serve this population of students. Jointly reviewing our experience in this developmental evaluation, the evaluation team and a program director share important thematic lessons learned about the developmental evaluation approach., Developmental evaluation supports grant-funded initiatives seeking innovation and change. Programs born from aspirational grant language and plans often need guidance as they work toward creating workable models for social innovation. This article describes the challenge of designing and implementing complex programs and presents a case that illustrates how a program moves from proposal to practice. The Massachusetts Charter Public School Association Capacity Building Network is a complex intervention, funded by the US federal government, aimed at raising school capacity to serve students with disabilities and English language learners. Developmental evaluation served to bridge the gaps between an aspirational proposal, an ambitious and ambiguous program plan, and emerging practices to serve this population of students. Jointly reviewing our experience in this developmental evaluation, the evaluation team and a program director share important thematic lessons learned about the developmental evaluation approach.

Measuring Impact: A Learning Approach to Strengthening USAID Biodiversity Programs - Lauck, Liz (2014)

In the goldfish bowl: science and technology policy dialogues in a digital world - Latta, Susie; Mulcare, Charlotte; Zacharzewski, Anthony (Sciencewise, 2013)

Monday morning in Kigali: what do you do when you get off the plane? Practical guidance for PDIA practitioners - LASER (DFID-LASER Programme, 2016)
In order to help enhance the effectiveness of donors and development practitioners on the ground, LASER has produced a range of practical guidance and tools. These are primarily intended for the international development community engaged in designing and implementing investment climate programmes, though can also be used more widely by other stakeholders across sectors. General guidance and tools: Monday morning in Kigali January 2016 - what do you do when you get off the plane? Practical guidance for PDIA practitioners
Keywords: IMPORTANT; Practice

Politically smart approaches to donor investment climate programming. A Guidance Note - LASER (DFID-LASER Programme, 2016)
In order to help enhance the effectiveness of donors and development practitioners on the ground, LASER has produced a range of practical guidance and tools. These are primarily intended for the international development community engaged in designing and implementing investment climate programmes, though can also be used more widely by other stakeholders across sectors. General guidance and tools: Politically smart approaches to donor investment climate programming (and annexes) Revised February 2016 - sets out practical advice on how to adopt a politically smart (which requires being both ‘politically informed’ and ‘politically astute’) approach to programming. The annexes include a traffic light matrix for initial high level analysis; a problem diary template with examples; and an example of a flexible theory of change for adaptive, large scale programming
Keywords: Practice

You Cannot Go it Alone: Learning from Cooperative Relationships in Civil Society Budget Campaigns - Larsen, Jillian (IBP, 2016)
Keywords: IMPORTANT

Paradoxes and partnerships: a study of knowledge exploration and exploitation in international development programmes - Lannon, John; Walsh, John N. (Journal of Knowledge Management, 2019)
Purpose – This paper aims to look at how organisational partnerships balance knowledge exploration and exploitation in contexts that are rife with paradoxes. It draws on paradox theory to examine the partnership’s response to the explore-exploit relationship.

The Science of Using Science: Researching the Use of Research Evidence in Decision-Making - Langer, Laurenz; Tripney, Janice; Gough, David (EPPI-Centre, Social Science Research Unit, UCL Institute of Education, University College London, 2016)

Citizens Against Corruption: Report from the Front Line - Landell-Mills, Pierre (Matador, 2013)
Citizens Against Corruption: Report From The Front Line tells the story of how groups of courageous and dedicated citizens across the globe are taking direct action to root out corruption. It shows how people are no longer prepared to accept the predatory activities of dishonest officials and are challenging their scams. It draws on over 200 unique case studies that describe initiatives undertaken by 130 civil society organisations (CSOs) which engage directly with public agencies to stop the bribery and extortion that damages peoples' lives and obstructs social and economic progress. This book challenges the notion that, at best, civil society can only have a marginal impact on reducing corruption and argues that aid donors need to radically rethink their assistance for governance reform. Part 1 analyses the role citizens can play in fighting corruption and promoting good governance and briefly tells the story of the Partnership for Transparency Fund (PTF). Part 2 presents studies of India, Mongolia, Philippines, and Uganda - each with its unique history and distinctive circumstances - to illustrate activities undertaken by CSOs to root out corruption, including the tools and approaches that are being used to build pressure on corrupt public agencies to become transparent and accountable. Part 3 addresses key themes - strengthening the rule of law, putting in place effective national anti-corruption strategies and institutions, making public buying and selling honest, promoting grassroots monitoring of public expenditures and the provision of public services, mounting media campaigns to expose and defeat corruption, and empowering ordinary citizens to keep watch on what actually happens at the point of delivery of public services. Part 4 is a summary of lessons learnt and explores the potential, as well as the risks and limitations, of civic activism in a world where greed and dishonesty is the norm. Finally, the book explores the opportunities and dangers faced by aid donors in supporting local CSOs and charts a way forward. Citizens Against Corruption: Report From The Front Line will be of interest to staff working in CSOs and aid agencies, policy analysts and researchers concerned about corruption and poor governance.

Community-based monitoring of Indigenous food security in a changing climate: Global trends and future directions - Lam, Steven; Dodd, Warren; Skinner, Kelly; Papadopoulos, Andrew; Zivot, Chloe; Ford, James; Garcia, Patricia J.; Team, IHACC Research; Harper, Sherilee L. (Environmental Research Letters, 2019)
Climate change is expected to exacerbate existing food security challenges, especially in Indigenous communities worldwide. Community-based monitoring is considered a promising strategy to improve monitoring of, and local adaptation to climatic and environmental change. Yet, it is unclear how this approach can be applied in food security or Indigenous contexts. The objectives of this paper are to: 1) review and synthesize the published literature on community-based monitoring of Indigenous food security; and, 2) identify gaps and trends in these monitoring efforts in the context of climate change. Using a systematic search and screening process, we identified 86 published articles. To be included, articles had to be published in a journal, describe a community-based monitoring system, describe any aspect of food security, and explicitly mention an Indigenous community. Relevant articles were thematically analyzed to characterize elements of community-based monitoring in the context of climate change. Results show that the number of articles published over time was steady and increased more than two-fold within the last five years. The reviewed articles reported on monitoring mainly in North America (37%) and South America (28%). In general, monitoring was either collaborative with local communities (51%) or externally-driven (37%), and focused primarily on tracking wildlife (29%), followed by natural resources (16%), environmental change (15%), fisheries (13%), climate change (9%), or some combination of these topics (18%). This review provides an evidence-base on the uses, characteristics, and opportunities of community-based monitoring, to guide future food security monitoring efforts in the context of climate change.

Strategy Testing: An innovative approach to monitoring highly flexible aid programs - Ladner, Debra (The Asia Foundation, 2015)
The international development community has increasingly embraced the idea that finding durable solutions to complex development problems requires new ways of working that move beyond industry norms. This paper makes an important contribution to the current debate by outlining an innovative monitoring system called Strategy Testing (ST). This is the third paper in the Working Politically in Practice paper series, launched together with the Australian Department of Foreign Affairs and Trade.

Facilities deserve a place in development - Lacy, Jacqui de (Devpolicy Blog from the Development Policy Centre, 2017)
There are different ways to deliver aid programs, DFAT often uses facilities in its larger relationships, what are the rationales and risks behind this?

Introduction to Project Management - The Case of GIZ Projects - Lacroix, Eric J. (Khulna University, 2015)
In this course, we will try to understand the complexity and the structure of the management of a development project implemented by the GIZ for the German Development cooperation. We will first define the frame of management and project to enter in the map of two logics. Then, we will overfly the 5 success factors of Capacity WORKS, with concrete examples in annexe. It will bring us to the monitoring, the standard processes in GIZ cooperation projects, the basic tools for project implementation and the evaluation. The team building will allow us to enter in a specific aspect of project management.

Adaptive Management Leaders Launch Practical Adaptation Network (PAN) - Labs, Feedback (FeedbackLabs, 2016)
Great things can happen at the frontier of theory and practice. When Feedback Labs worked with USAID’s Global Development Lab to bring together leaders in adaptive management at the White House on June 15th, we were pleased that we were able to move past the ongoing conceptual conversations toward discussing what we could do in concrete terms to implement adaptive management in practice.

Announcement of CLA Learning Network Launch - Lab, Learning (USAID Learning Lab, 2016)
USAID’s Bureau for Policy, Planning and Learning (PPL), together with the Bureau for Economic Growth, Education, and Environment’s localworks program, is pleased to announce the launch of a Learning Network focused on building the evidence base for Collaborating, Learning and Adapting (CLA).

Definitions of Agile Software Development and Agility - Laanti, Maarit; Similä, Jouni; Abrahamsson, Pekka (Systems, Software and Services Process Improvement, 2013)
The Agile Manifesto and Agile Principles are typically referred to as the definitions of "agile" and "agility". However, many other definitions exist in the literature. Thus the different definitions provide interesting source for research. For each definition we examine where their emphasis is and compare that to the emphases found in the Agile Principles.

What is technopolitics? A conceptual schema for understanding politics in the digital age Doctoral Student on the Programme on Political Science New School for Social Research - Kurban, Can; Peña-Lopez, Ismael; Haberer, Maria (Revista de Internet, Derecho y Política, 2017)
In this article we seek to revisit what the term ‘technopolitical’ means for democratic politics in our age. We begin by tracing how the term was used and then transformed through various and conflicting adaptations of ICTs (Information and

Systems Change in a Polarized Country - Kramer, Mark R. (Stanford Social Innovation Review, 2017)
A growing number of US foundations are adopting practices based on systems change to achieve their goals in the current political environment.

Monitoring and Evaluation in the Development Sector - KPMG (KPMG International, 2014)

Managing Upward and Downward Accountability in an International Development Project - A Case Study of a World Bank Telecommunications Infrastructure Project in Benin - Kolker, Eva; Kulldorff, Catharina (Master's Thesis, Stockholm School of Economics, 2013)
Keywords: Downward accountability; Upward accountability

Thinking and Working Politically in Economic Development Programmes – Some Sprints and Stumbles from a DFID Programme in Kyrgyzstan - Koleros, Andrew; Rinnert, David (From Poverty to Power, 2019)
A DFID programme in Kyrgyzstan offers useful insights into how the Thinking and Working Politically approach can escape from its governance ghetto
Keywords: Case Study

Approaches for addressing complexity in programme theory: Experiences in applying the Actor-based Change (ABC) Framework to a variety of international development programmes and evaluations - Koleros, Andrew; Oldenbeuving, Mark (2018)

Using Actor-Based Theories Of Change to Conduct Robust Contribution Analysis in Complex Settings - Koleros, Andrew; Mayne, John (Canadian Journal of Program Evaluation, 2019)
The use of theories of change (ToCs) is a hallmark of sound evaluation practice. As interventions have become more complex, the development of ToCs that adequately unpack this complexity has become more challenging. Equally important is the development of evaluable ToCs, necessary for conducting robust theory-based evaluation approaches such as contribution analysis (CA). This article explores one approach to tackling these challenges through the use of nested actor-based ToCs using the case of an impact evaluation of a complex police-reform program in the Democratic Republic of Congo, describing how evaluable nested actor-based ToCs were built to structure the evaluation.
Keywords: Behavioural strategy; COM-B

Rethinking systemic change in practice - perspectives from NUTEC-MD in northern Uganda - Koleros, Andrew (BEAM Exchange, 2016)
Document description This document is currently being finalised and will be published shortly. Please try again soon. Recent research by The BEAM Exchange seeks to understand theoretical perspectives on how market systems approaches can contribute to inclusive economic development through systemic change. It produced three main insights. Economies are evolving systems, building on the mechanisms of variety creation, selection and amplification. Current economic performance, including aspects like the inclusiveness of growth and economic evolution, are shaped by the ability of a society to explore different options for institutional arrangements and adjust them over time. This process of evolution is complex. While some aspects can be designed and managed, others need to be explored through a process of learning and adjustment. This paper responds to these insights by providing a practitioner perspective through the lens of one programme: “Northern Uganda: Transforming the Economy through Climate Smart Agribusiness – Market Development (NUTEC-MD)”, implemented by Palladium Group. It begins with a brief introduction to the programme and key aspects of its design phase. It then provides a summary of the three main research insights, with reflections on their applicability for programme design based on the NUTEC-MD experience. Finally, it provides some conclusions for the wider practitioner community based on this case.

Beyond the Pioneer: Getting inclusive industries to scale - Koh, Harvey; Hedge, Nidhi; Karamchandani, Ashish (Deloitte Touche Tohmatsu India Private Ltd (DTTIPL), 2014)

Joint Programming in Conflict-Affected and Fragile States - Koenig, Sibylle; Brusset, Emery (Joint Programming - EU, 2019)
On the Joint Programming Practices from the EU in fragile settings

Changing humanitarian action? - Knox-Clarke, Paul (ALNAP/ODI, 2017)
We live in times of profound change. This has had a great impact on humanitarian needs, and the approaches taken to meet these needs. Changes in technology, ecology, politics, economics and demographics have shaped, and will continue to shape, humanitarian action. Many humanitarians and observers of humanitarian action have suggested that change initiatives in the sector have been unambitious and unsuccessful. Indeed, many people think that the humanitarian system is unable, or unwilling, to make the changes that are required to remain effective and relevant in a rapidly changing world. Following the World Humanitarian Summit many stakeholders have made commitments to significant changes. But can the system change? And if so, how? As a network which exists to support change and improvement, it seems appropriate that ALNAP meets to consider how change occurs in the humanitarian system, and how it can be done better. Find out more about the 31st Annual Meeting by reading the concept note, or by visiting alnap.org/31am.

A Whole New World - Funding and Commissioning in Complexity - Knight, Annabel Davidson; Lowe, Toby; Brossard, Marion; Wilson, Julie (Collaborate & Newcastle University, 2017)
Collaborate and Newcastle University Business School Publish Research into Complexity-Friendly Funding

Scaling Agile @ Spotify with Tribes, Squads, Chapters & Guilds - Kniberg, Henrik; Ivarsson, Anders (Spotify, 2012)

Agile – where are we at? - Kniberg, Henrik (2017)

Alignment at Scale - Kniberg, Henrik (2016)

Lean from the Trenches: Managing Large-Scale Projects with Kanban - Kniberg, Henrik (Pragmatic Bookshelf, 2011)
You know the Agile and Lean development buzzwords, you've read the books. But when systems need a serious overhaul, you need to see how it works in real life, with real situations and people. Lean from the Trenches is all about actual practice. Every key point is illustrated with a photo or diagram, and anecdotes bring you inside the project as you discover why and how one organization modernized its workplace in record time.Lean from the Trenches is all about actual practice.Find out how the Swedish police combined XP, Scrum, and Kanban in a 60-person project. From start to finish, you'll see how to deliver a successful product using Lean principles. We start with an organization in desperate need of a new way of doing things and finish with a group of sixty, all working in sync to develop a scalable, complex system. You'll walk through the project step by step, from customer engagement, to the daily "cocktail party," version control, bug tracking, and release. In this honest look at what works–and what doesn't–you'll find out how to:Make quality everyone's business, not just the testers.Keep everyone moving in the same direction without micromanagement.Use simple and powerful metrics to aid in planning and process improvement.Balance between low-level feature focus and high-level system focus.You'll be ready to jump into the trenches and streamline your own development process.

Scaling Agile @ LEGO and Spotify – my talk at EA träff - Kniberg, Henrik (Crisp, 2017)

Spotify Rhythm - how we get aligned - Kniberg, Henrik (AvailAgility, 2016)
Last month, Henrik Kniberg posted slides from a talk he gave at Agile Sverige on something called Spotify Rhythm - "Spotify’s current approach to getting aligned as a company". While looking through the material, it struck me that what he was describing was a form of Strategy Deployment. This interpretation is based purely on those slides - I haven't had a chance yet to explore this more deeply with Henrik or anyone else from Spotify. I hope I will do some day, but given that caveat, here's how I currently understand the approach in terms of the X-Matrix Model.

The unofficial SCRUM checklist - Kniberg, Henrik (CRISP, 2010)

Improving development aid design and evaluation: Plan for sailboats, not trains - Kleinfeld, Rachel (Carnegie Endowment for International Peace, 2015)
How do reforms that require political engagement differ from traditional technical reforms? Why is political engagement different, and what are the implications for design and evaluation? How should development programmes that engage politics be designed? And how can those who fund or implement such programmes evaluate whether their efforts are contributing to reform? This report …
Keywords: IMPORTANT

Lessons for Effective resilience programs: a case study of the RAIN program in Ethiopia - Kleiman, Shanti (Mercy Corps, 2013)
The RAIN program experience affirms the importance of multi-year and flexible funding as key program design features if progress in resilience building is to be supported in areas with high levels of structural and temporal vulnerability. These features enable management to respond effectively to changing circumstances in order to better meet the needs of communities and to create the necessary conditions for relief-to-development strategies to take hold. Finally, this study found that deliberate and effective coordination between donor agencies can ensure that development gains achieved during one program period are directly leveraged by subsequent programs, thereby increasing the effectiveness of resilience programs.

Time for a Donor Funding Charter? - kiwanja.net (Donor's Chapter, 2014)

Transformation, politics and implementation: smart implementation in governance programs - Kirsch, Renate; Siehl, Elke; Stockmayer, Albrecht (Nomos, 2017)
Working in environments characterised by a high degree of uncertainty, uncontrollability and unpredictability, development agents try to organise complex realities into manageable units. What principles influence the decision on adequate approaches and necessary steps? Through theoretical considerations and nine case studies, the GIZ traces implementation processes and identifies underlying guiding principles which provide the flexibility and adaptability that is necessary for acting in complex contexts. Main findings show that an adaptive and reflexive management structure is crucial for successful implementation. Quick iteration and tight feedback loops facilitate adaptation and reorientation. Contextsensitive knowledge and constant monitoring create a space for learning and innovation. A joint vision for the future which is used for orientation purposes and can be modified according to new findings and developments fosters fruitful cooperation.
OCLC: 1000398466

Guidelines for writing a case study on implementation (Book Project: Smart Implementation in Governance) - Kirsch, Renate (GIZ GmbH, 2015)

Building Democracy from Below: Lessons from Western Uganda - King, Sophie; Hickey, Sam (The Journal of Development Studies, 2016)
How to achieve democratisation in the neo-patrimonial and agrarian environments that predominate in sub-Saharan Africa continues to present a challenge for both development theory and practice. Drawing on intensive fieldwork in Western Uganda, this paper argues that Charles Tilly’s ‘democratisation as process’ provides us with the framework required to explain the ways in which particular kinds of association can advance democratisation from below. Moving beyond the current focus on how elite-bargaining and certain associational forms may contribute to liberal forms of democracy, this approach helps identify the intermediate mechanisms involved in building democracy from below, including the significance of challenging categorical inequalities, notably through the role of producer groups, and of building trust networks, cross-class alliances and synergistic relations between civil and political society. The evidence and mode of analysis deployed here help suggest alternative routes for supporting local efforts to build democracy from below in sub-Saharan Africa.
Keywords: FRUGAL

OPM’s approach to assessing Value for Money - King, Julian; OPM (Oxford Policy Management, 2018)
This document offers practical guidance for assessing value for money (VfM) in international development programmes. Since 2016, evaluation expert Julian King has been working with OPM to develop and deploy a robust approach to VfM assessment. The approach combines cutting-edge evaluation practice with concepts from economic evaluation to respond to donor requirements for accountability and good resource allocation, as well as to support reflection, learning, and adaptive management.

Bradford Hill Criteria for Causal Inference - King, Julian (2015)
We think we’re good at determining causality, but we suck at it One of the great challenges in evaluation is determining whether the results we’re seeing are because of the program we’re evaluating, some other influences out there in the big world, or random chance. At one level, this is an everyday, common sense task. As a species we’ve been making judgments about causation for a million years or so. Unfortunately, though, the way we are wired does not predispose us to logical thinking. We are inclined to be led astray by all sorts of biases and heuristics. Over time, the rocket science for dealing with causation has become more sophisticated – a key example being the experimental study design or randomised controlled trial (RCT). And our evidence base about what works has been enriched as a result. But deep down we’re still biased, heuristical beings and not very good at thinking things through. We’ve become so enthusiastic about experimental designs we’re a little inclined to think they are the only way to determine whether A causes B. Such a rigid view is no much use in the real world, where there are all sorts of ethical, conceptual, practical and economic barriers that mean we can’t always conduct RCTs. Even where technically possible, they are not necessarily the best tool for every job.

Value for Investment. A Practical Evaluation Theory - King, Julian (Kinnect Group, 2016)
I am a public policy consultant from Auckland, New Zealand. My practice specializes in evaluation and economic analysis. In this booklet I set out a model for evaluating value for investment (VFI) in social programs. The model defines VFI as an evaluative question about an economic problem. It uses explicit evaluative reasoning to provide a clear answer to the VFI question. Methods are matched to context, to provide the specific mix of evidence (economic and/or other) needed to support a wellreasoned, well-evidenced evaluative judgment.

Adaptive management of an environmental watering event to enhance native fish spawning and recruitment - King, A. J.; Ward, K. A.; O’connor, P.; Green, D.; Tonkin, Z.; Mahoney, J. (Freshwater Biology, 2010)
1. A common goal of many environmental flow regimes is to maintain and/or enhance the river’s native fish community by increasing the occurrence of successful spawning and recruitment events. However, our understanding of the flow requirements of the early life history of fish is often limited, and hence predicting their response to specific managed flow events is difficult. To overcome this uncertainty requires the use of adaptive management principles in the design, implementation, monitoring and adjustment of environmental flow regimes. 2. The Barmah-Millewa Forest, a large river red gum forest on the Murray River floodplain, south-east Australia, contains a wide variety of ephemeral and permanent aquatic habitats suitable for fish. Flow regulation of the Murray River has significantly altered the natural flood regime of the Forest. In an attempt to alleviate some of the effects of river regulation, the Forest’s water regime is highly managed using a variety of flow control structures and also receives targeted Environmental Water Allocations (EWA). In 2005, the largest environmental flow allocated to date in Australia was delivered at the Forest. 3. This study describes the adaptive management approach employed during the delivery of the 2005 EWA, which successfully achieved multiple ecological goals including enhanced native fish spawning and recruitment. Intensive monitoring of fish spawning and recruitment provided invaluable real-time and ongoing management input for optimising the delivery of environmental water to maximise ecological benefits at Barmah-Millewa Forest and other similar wetlands in the Murray-Darling Basin. 4. We discuss possible scenarios for the future application of environmental water and the need for environmental flow events and regimes to be conducted as rigorous, large-scale experiments within an adaptive management framework.
Keywords: floodplain river; regulated flows

Making politics work for development: harnessing transparency and citizen engagement - Khemani, Stuti; Ferraz, Claudio; Finan, Frederico S.; Johnson, Stephenson; Louise, Corinne; Abrahams, Scott David; Odugbemi, Adesinaola Michael; Dal Bó, Ernesto; Thapa, Dikshya (The World Bank, 2016)
Too often, government leaders fail to adopt and implement policies that they know are necessary for sustained economic development. They are encumbered by adverse political incentives, which prevent them from selecting good policies, and they run the risk of losing office should they try to do the right thing. Even when technically sound policies are selected by leaders, implementation can run into perverse behavioral norms among public officials and citizens, who seek to extract private benefits from the public sector. Such behavior might be supported by widespread beliefs that corruption is the norm. Even countries with low corruption and strong institutions experience problems of political incentives and behavior that prevent the public sector from solving shared problems. Ideological polarization among citizens and capture by special interests can lead to policy gridlock and the failure of the state to provide public goods, even in advanced economies. Even educated citizens can hold ideological beliefs about the role of public policy that lead them to deny technical evidence contrary to these beliefs. Too often, government leaders fail to adopt and implement policies that they know are necessary for sustained economic development. Political constraints can prevent leaders from following sound technical advice, even when leaders have the best of intentions. Making Politics Work for Development: Harnessing Transparency and Citizen Engagement focuses on two forces—citizen engagement and transparency—that hold the key to solving government failures by shaping how political markets function. In today’s participative world, citizens are not only queueing at voting booths, but are also taking to the streets and using modern communication technology to select, sanction, and pressure the leaders who wield power within government. This political engagement can function in highly nuanced ways even within the same formal institutional context and across the political spectrum, from autocracies to democracies. Political engagement becomes unhealthy when leaders are selected and sanctioned on the basis of their provision of private benefits rather than public goods, giving rise to a range of government failures. The solutions to these failures lie in fostering healthy political engagement within any institutional context, and not in circumventing or suppressing it. Transparency—citizen access to publicly available information about the actions of those in government and the consequences of these actions—can play a crucial role by nourishing political engagement. The report distills policy lessons for governments, international development partners, and civil society on how best to target transparency initiatives so that the provision of public goods becomes the focus of political contestation. Even so, unhealthy political engagement may persist. But to build institutions that are capable of tackling public goods problems, politics needs to be addressed and cannot be side-stepped. Targeted transparency is one way to move in the right direction: it complements everything else policy makers do and holds the potential to make politics work for development rather than against it. " This pathbreaking report places politics at the heart of the development dialogue—exactly where it belongs. It provides constructive ideas for harnessing the forces of transparency and citizen engagement in ways that are suited to diverse institutional contexts so that reform leaders can overcome political constraints to their countries’ development goals. " Asli Demirgüç-Kunt, Director of Research, Development Research Group, The World Bank "This book not only provides an authoritative statement of what we know about how to align political incentives with the interests of society, but it does so with an eye to making change happen even in the face of political opposition. The World Bank will never be the same again. " James Robinson, University Professor, Harris School of Public Policy, University of Chicago " A lesson for us at the World Bank also comes out of this research. We can do more…to work with our clients to diminish political constraints to achieving development goals…To do this we have to overcome the fear of talking about politics, and confront it as part of the challenge of development. That is what we are doing through this report. " Kaushik Basu, Senior Vice President and Chief Economist, The World Bank

Monitoring and Result Measurement for Adaptive Programming - How to Use Data to Manage a MSD Program: Lessons from PRISMA - Khan, Khaled; Seely, Kevin; Ridwan, Mustika; Mulya, Bodhiya (PRISMA, 2019)
Using monitoring data to improve interventions is harder than it seems. Decision-makers are often busy implementing activities, unclear about their roles in data collection and analysis, and uncertain what data matters most or when. PRISMA, an AUD77 million agricultural Market Systems Development (MSD) programme funded by DFAT Australia, has encountered these challenges. With the programme completing its first five year phase, this case study shares ten key lessons divided into three sections: shaping the culture, developing systems, and top management decisions. These lessons aim to help program, sector and intervention managers make better use of monitoring data to improve interventions.

Teams that Do Development Differently - Khan, Jehanzeb; Fisher, Annette (Global Policy Journal, 2017)

Constituent Voice: Technical Note 1 - Keystone Accountability (Keystone Accountability, 2014)

A market system by any other name would smell as sweet - Kessler, Adam; Conroy, Kevin (BEAM Exchange, 2019)
How does Doing Development Differently (DDD) and Problem Driven Iterative Adaption (PDIA) connect to core principles of the MSD approach?

Thinking and working with political settlements - Kelsall, Tim (ODI, 2016)
• In recent years, Political Settlements Analysis (PSA) has become increasingly influential in academic and policy circles • Despite its intuitive appeal, it seems difficult to use in practice • PSA has a natural affinity with Adaptive Development, Thinking and Working Politically, and Doing Development Differently approaches • By answering the simple diagnostic questions supplied here, development partners can identify the types of political settlements in which they work, and draw some broad operational implications

Inclusion in Making All Voices Count - Kelbert, Alexandra (Making All Voices Count, 2014)
Part of a sequenced learning process for MAVC's Research and Evidence Component, the summary of a thematic discussion led by researcher Evangelia Berdou.

Seeking balanced ownership in changing development cooperation relationships - Keijzer, Niels; Klingebiel, Stephan; Örnemark, Charlotte; Scholtes, Fabian (Expert Group for Aid Studies, 2018)
According to the Paris Declaration and the 2030 Agenda, ownership is a prerequisite for effective development cooperation. How can the principle of ownership be promoted in today’s complex development cooperation, in which the numbers of actors have increased? This is the subject of the Expert Group for Aid Studies report Seeking balanced ownership in changing development cooperation relationships. The report contains two country case studies – on Liberia and Rwanda – as well as interviews with the Swedish International Development Cooperation Agency (Sida) and the Ministry for Foreign Affairs, and studies on documents concerning ownership in a Swedish development cooperation context. The authors note that ownership remains relevant as a guiding principle in international development cooperation. The trend from country-to-country cooperation to various forms of support through UN bodies and specialised global funds has created new conditions and competing interests for ownership. An understanding of ownership and how it can be promoted in the complex reality of today needs to be thoroughly re-examined. The study recommends the following: 1. Starting a discussion within the OECD-DAC on effective development cooperation that has global ownership right up to the end of the process. 2. Establishing an international code of conduct in accordance with agreed ownership principles concerning development cooperation funding to and via UN bodies and global funds. 3. Sweden should formulate an explicit policy and approach for how to promote ownership in development cooperation that includes numerous partners.

Obliquity: Why Our Goals Are Best Achieved Indirectly - Kay, John (Penguin Books, 2010)
"John Kay tells a fast-paced detective story as he searches for the surprising secret to success...Brilliant." -Tim Harford, author of The Logic of Life In this revolutionary book, economist John Kay proves a notion that feels at once paradoxical and deeply commonsensical: the best way to achieve any complex or broadly defined goal, from happiness to preventing forest fires, is the indirect way. We can learn how to achieve our objectives only through a gradual process of risk taking and discovery-what Kay calls obliquity. The author traces this seemingly counterintuitive path to success as it manifests itself in nearly every aspect of life, including business, politics, sports, and more.

Why is it so hard for non-state actors to be heard? Inside Tanzania's education policies - Katera, Lucas (MAVC, 2015)
Lessons from policy in Ghana, Kenya, South Africa and Tanzania

Design reality gap issues within an ICT4D project: an assessment of Jigawa State Community Computer Center - Kanya, Rislana Abdulazeez; Good, Alice (2013)
This paper evaluates the Jigawa State Government Community Computer centre project using the design reality gap framework. The purpose of this was to analyse the shortfall between design expectations and implementation realities, in order to find out the current situation of the project. Furthermore to analyse whether it would meet the key stakeholder’s expectation. The Majority of Government ICT Projects is classified as either failure or partial failure. Our research will underpin a case study of Jigawa State Community Computer centre project. To support our argument we conducted a qualitative case study in which we conducted two interviews, and a survey to find out the current status of the project. Our findings indicated that the project can be classified as a partial failure because few of the centres, operating in some areas of the community, offered socio-economic advancement. Our results also indicated that the project design reality gap is quite significant. This gap occurred due to poor planning and implementation of the project. Our research reveals several challenges that could impact upon the successfulness of the project provide a foundation for further research and add to existing literature. The challenges associated with the project we identify include poor state of power supply, lack of community engagement during the project planning and implementation, lack of commitment from the Local Government Administration. Our research has potential in adding ICT4D literature, reveals how ICT4D project evaluation can be carried out using design reality gap framework and provides guideline for policy makers.

The water of Systems Change - Kania, John; Kramer, Mark; Senge, Peter (FSG, 2018)
Foundations involved in systems change can increase their odds for success by focusing on the least explicit but most powerful conditions for change, while also turning the lens on themselves. The Water of Systems Change aims to clarify what it means to shift these conditions. We offer the “inverted triangle” framework as an actionable model for funders and others interested in creating systems change, particularly those who are working to advance equity. Top Takeaways Systems change is about advancing equity by shifting the conditions that hold a problem in place. To fully embrace systems change, funders should be prepared to see how their own ways of thinking and acting must change as well. Shifts in system conditions are more likely to be sustained when working at three different levels of change: explicit, semi-explicit, and implicit.

The water of Systems Change: Action learning exercise - Kania, John; Kramer, Mark; Senge, Peter (FSG, 2018)
Based on the “inverted triangle” framework presented in The Water of Systems Change, this activity is designed to help individuals think systemically about social change, explore what is happening below the surface on issues they care about, and determine how they and their organizations can pursue large-scale change in a disciplined and holistic manner. The exercise is divided into 3 parts: Part I uses the “inverted pyramid” introduced in The Water of Systems Change to perform an external assessment of opportunities to make progress on the social or environmental issue you are focused on. Part II uses the same framework to consider internal conditions within yourself and your organization that should change in order for you to better support progress on your issue. Part III takes what was developed in Parts I and II and asks “What to do next?”

Collective Impact - Kania, John; Kramer, Mark (Stanford Social Innovation Review, 2011)
Large-scale social change requires broad cross-sector coordination, not the isolated intervention of individual organizations.

Embracing Emergence: How Collective Impact Addresses Complexity - Kania, John; Kramer, Mark (Stanford Social Innovation Review, 2013)
Collective impact is upending conventional wisdom on how we achieve social progress.

Facilitator's Guide to Participatory Decision-Making - Kaner, Sam (John Wiley & Sons, 2014)
Unleash the transformative power of face to face groups The third edition of this ground–breaking book continues to advance its mission to support groups to do their best thinking. It demonstrates that meetings can be much more than merely an occasion for solving a problem or creating a plan. Every well–facilitated meeting is also an opportunity to stretch and develop the perspectives of the individual members, thereby building the strength and capacity of the group as a whole. This fully updated edition of The Facilitator′s Guide to Participatory Decision–Making guides readers through the struggle and the satisfaction of putting participatory values into practice, helping them to fulfill the promise of effective group decision–making. With previous editions already embraced by business and community leaders and consulting professionals around the world, this new book is even more insightful and easy to use. New for this edition: 60 pages of brand new skills and tools Many new case examples Major expansion and reorganization of the advanced sections of the book. New chapter: Teaching A Group About Group Dynamics Doubled in size: Classic Facilitator Challenges. Substantially improved: Designing Realistic Agendas now three chapters, with wise, insightful answers to the most vexing questions about meeting design.

Leading Effectively in a VUCA Environment: A is for Ambiguity - Kail, Col Eric G. (Harvard Business Review, 2011)
This is the last in a series on the four aspects of VUCA, a framework used by the U.S. military to describe the environment in terms of volatility, uncertainty, complexity, and ambiguity. Diversity and global reach introduce ambiguity to the environment; therefore opportunities and challenges must be appreciated from multiple aspects, not just our own […]
Keywords: Leadership; Leading teams

Leading Effectively in a VUCA Environment: C is for Complexity - Kail, Col Eric G. (Harvard Business Review, 2010)
This is the third in a series on the four aspects of VUCA, a framework used by the U.S. military to describe the environment in terms of volatility, uncertainty, complexity, and ambiguity. Our complex environment demands a perspective that goes beyond viewing threats and opportunities as collective; we must see them as interactive. Leading through […]
Keywords: Leadership; Leadership development

Leading in a VUCA Environment: U is for Uncertainty - Kail, Col Eric G. (Harvard Business Review, 2010)
This post is part of an HBR Spotlight examining leadership lessons from the military. It’s the second in a series on the four aspects of VUCA, a framework used by the U.S. military to describe the environment in terms of volatility, uncertainty, complexity, and ambiguity. The frenetic pace of our environment, brought on by volatility, […]
Keywords: Leadership

Leading in a VUCA Environment: V Is for Volatility - Kail, Col Eric G. (Harvard Business Review, 2010)
This post is part of an HBR Spotlight examining leadership lessons from the military This is the first in a series on the four aspects of VUCA, a framework used by the U.S. military to describe the environment in terms of volatility, uncertainty, complexity, and ambiguity. Do challenges and opportunities that once took days or […]
Keywords: Leadership

A Movements Perspective on Transparency and Accountability - Joyce, Mary; Walker, Tom (Transparency & Accountability Initiative, 2015)
This Think Piece describes social movements pursuing government accountability and the challenges and opportunities to supporting them.

Mobilizing Accountability: A Learning Agenda for Grassroots Organizations and Social Movements Addressing State Accountability - Joyce, Mary; Halloran, Brendan (Transparency & Accountability Initiative, 2015)

Watering the Grassroots: A Strategy for Social Movement Support - Joyce, Mary (Transparency & Accountability Initiative, 2015)
In this third and final think piece exploring the role of grassroots organizations and movements for state accountability (find the previous pieces here and here), the author Mary Joyce, proposes new thinking about how funders and other external organizations can best support social movements. Funding and other support for popular organizations and movements is not straightforward, and there are potential risks and distortions involved. Interested supporters need to clearly identify and articulate these obstacles in their discussions with movement activists before pursuing and funding or other support activities. This think piece outlines several potential avenues of support: small, flexible grants; funding intermediary organizations; providing external consultants or researchers to work with movements; and other options as well. These suggestions provide ideas for funders and other organizations seeking to move beyond projects to supporting robust accountability ecosystems, in which grassroots organizations and movements play a critical role.

Introduction - Localising Governance: An Outlook on Research and Policy - Joshi, Anuradha; Schultze-Kraft, Markus (IDS Bulletin, 2014)

Reading the Local Context: A Causal Chain Approach to Social Accountability - Joshi, Anuradha (IDS Bulletin, 2014)
There is a general consensus that ‘context’ matters for development outcomes, yet we have little understanding of how exactly ‘context’ affects outcomes. This article focuses on the question of ‘context’ in social accountability (SA) initiatives by separating macro- and micro-contextual factors. On the macro side (country level), accountability processes need to take into account broad factors such as national histories of citizen–state engagement. On the micro side, local factors can drive the extent to which SA initiatives are successful, even within otherwise broadly similar national contexts. The article outlines the basic components of accountability and proposes a ‘causal chain'strategy to better understand the micro-context. This would allow existing evidence to be reorganised to assess the promise of existing and new initiatives by deconstructing the various mini-causal pathways (i.e. in the micro-context) and understanding the contextual conditions that make them work.
Keywords: IMPORTANT

Doing Anti-corruption Differently - Jorge (www.globalintegrity.org, 2016)
By Alan Hudson, Executive Director Corruption and how to tackle it is center-stage in London this week, with the spotlight brighter than ever as a result of the Panama Papers. This is welcome news. The Anti-Corruption Summit, hosted by the...

Systemic Design Principles for Complex Social Systems - Jones, Peter H. (Social Systems and Design, 2014)
Keywords: IMPORTANT

Doing Urban Development Differently - Jones, Harry; Adhikari, Bishnu (From Poverty to Power, 2017)
Guest post from Harry Jones and Bishnu Adhikari, both of Palladium on what urban aid and development can learn from the Doing Development Differently movement

A guide to monitoring and evaluating policy influence - Jones, Harry (ODI, 2011)

Taking responsibility for complexity: how implementation can achieve results in the face of complex problems - Jones, Harry (ODI, 2011)
OCLC: 837825712

Causality and attribution in market systems development - Jenal, Marcus; Liesner, Mollie (BEAM, 2017)
Resources that contain evidence of market systems interventions. Recently updated.

Adaptive Management - Jenal, Marcus; Cunningham, Shawn (Annual Reflection 2019, 2019)

The Future is a Choice: The Oxfam Framework and Guidance for Resilient Development - Jeans, Helen; Thomas, Sebastien; Castillo, Gina (Policy & Practice, 2016)
This guide provides a framework for Oxfam staff to design programmes and campaigns that contribute to resilient development. Oxfam defines resilience as ‘the ability of women and men to realize their rights and improve their well-being despite shocks, stresses

We Rise - Movement Building Reimagined - JASS (Just Associates, 2017)
In our virtual toolkit, We Rise: Movement Building Reimagined, we describe in detail four interconnected cycles of movement building – Rising Up, Building Up, Standing Up, and Shaking Up. At the heart of these cycles lies an analysis of how to challenge and transform power. Each cycle features key ideas, relevant tools, and practical tips from our work and activists in our network that movement builders around the world can learn from and adapt in their own work.

Social Design and Neocolonialism - Janzer, Cinnamon L.; Weinstein, Lauren S. (Design and Culture, 2014)
This article examines the current field of social design: its claims, practices, and methodologies. Findings discovered through qualitative research illuminate the current application of social design practices and offer critique around their use in the social sphere. This article argues that designers must be sensitive to a variety of complex social and cultural cues and structures or they risk contributing to, or practicing, design neocolonialism. The article offers two key theoretical suggestions to further the emerging field's progress. First, social design must shift its focus from one that is human-centered to one that is situation-centered. Second, it is imperative that social design develops a shared framework for understanding, executing, and evaluating its initiatives and interventions. Additionally, this article introduces a matrix to serve as an early iteration of a shared framework.
Keywords: Design Methodology; Design Thinking; Framework; Human-centered design; IMPORTANT; social design

Failing Forward: How CARE is focusing on what goes wrong to improve impact - Janoch, Emily (USAID LEARN, 2019)
CARE's Failing Forward initiative is sparking opportunities to showcase the ideas that don't work so we can spend more time implementing the ones that do. It's changing the conversation inside the organization, and leading to changes in the way we design and implement programs. It's also allowing us to make connections across a global portfolio of more than 900 projects, and with new and different partners to learn from their experience.

Failing Forward: How CARE is Focusing on What Goes Wrong to Improve Impact - Janoch, Emily (CARE, 2019)
CARE's Failing Forward initiative is sparking opportunities to showcase the ideas that don't work so we can spend more time implementing the ones that do. It's changing the conversation inside the organization, and leading to changes in the way we design and implement programs.

Managing Humanitarian Innovation: The cutting edge of aid - James, Eric; Taylor, Abigail (Practical Action Publishing, 2018)
The challenges facing humanitarian logistics are huge. Refugee camps present enormously challenging environments in which sudden spikes in demand, difficult to access locations, disruptions due to conflict or disasters, as well as normal supply chain problems are commonplace. This means that orders for medical and other supplies can take weeks and sometimes months to fulfil, severely impeding humanitarian operations. There is also a lack of or slow adoption of technology routinely used elsewhere. In addition, humanitarian logistics are also expensive. When customs clearance, transportation, storage, middlemen and administration are added in, the costs of basic items are often exorbitant. Managing Humanitarian Innovation presents a new approach that is beginning to transform the way humanitarian logistics are conducted. Innovation in logistics includes disrupting and improving supply chains through the use of technology, especially 3D printers, and engaging people to manage this approach. The book discusses what innovation is, and strategies for supporting it; it describes practical innovations and how they have been applied; and it outlines how innovation labs can be run. Finally it covers how to fund innovation and it suggests how humanitarian innovation might develop in the future. This book brings together the real experience of practitioners who have made innovation work. It is a collaborative work written by and for the community of people involved in humanitarian innovation, in particular in the making and manufacturing of humanitarian supplies. The book is full of practical and actionable points of value to the humanitarian community. Managing Humanitarian Innovation is essential reading for humanitarian practitioners as well as volunteers and others involved in humanitarian supplies provision. It is equally helpful to thought leaders, policy makers and educators.

Advancing Work with the Grain at USAID - Jacobstein, David (USAID Learning Lab, 2018)
In December 2017, I wrote a blog about some of the insights gained during a workshop on Context-Driven Adaptation, where many of our sharpest field officers shared the ways that they assessed and adapted to shifts in context to keep programming relevant and effective.

Context-Driven Adaptation (Overview) - Jacobstein, David (USAID Learning Lab, 2018)
CONTEXT-DRIVEN ADAPTATION COLLECTION

DRG Center practical tips to implement more context-adaptive programming - Jacobstein, David (#AdaptDev, 2018)
Hi #adaptdevers, The cross-sectoral programs team in the DRG Center have been working in support of ways that programming can be made more aware of, and responsive to, context considerations that have to do with incentives and relationships between different actors - often called power dynamics or political economy. Following several discussions with field folks, we were asked to come up with simple and practical tips that could help staff to implement more context-adaptive programming, or to better Work Politically to use TWP jargon. With assistance from many of our field staff and partners, we've put together three documents (to start) that have now been cleared to share publicly: • Tips on Making Your Solicitations Invite Context-Driven Adaptive Programming - suggestions spanning most sections of a typical solicitation to better weave in Thinking and Working Politically. I'm particularly excited that this document contains embedded links to excerpts from a set of solicitations that model good practice. You can also find a summary of all the excerpts from real solicitations, and links onward to the public posting of those solicitations on Fed Biz Ops or Grants.gov, here. • Tips on Power Dynamics and Theories of Change - suggestions relevant to those working on project designs and logic models. • Tips for Better Use of Advisory Councils - suggestions to set up better advisory bodies that help you to incorporate political economy more automatically into your programmatic adjustments. I hope that you'll find these practical and helpful! Feedback is always welcome. Best, David

Tips for Finding Unusual Allies and Building Innovative Alliances - Jacobstein, David (USAID Learning Lab, 2018)
One of the truisms of thinking and working politically (TWP) is that it requires looking differently at how stakeholders relate to a given development challenge or process, and building coalitions of the “right actors at the right time” who can drive forward progress while working with the grain of the context. While it’s easy to call for coalitions for change and diverse stakeholder engagement, identifying allies beyond those already seized with an issue, and finding ways to collaborate with stakeholders who may have different reasons for joining a coalition, is a challenging task. These are some suggested tips to improve working in that fashion.

An Adaptive Capacity Guide Book: assessing, building and evaluating the capacity of communities to adapt in a changing climate - Jacobs, B.; Nelson, R.; Kuruppu, N.; Leith, P. (University of Technology and University of Tasmania, 2015)
A capacity to adapt to change is essential for managing Australia’s natural resources. The individuals, communities and organisations who manage our natural resources all have an innate capacity to adapt to change. Changes in climate, markets and technology have shaped the way we adapt the management of natural resources in urban, rural and coastal landscapes. Some of these changes are predictable and easy to manage. Others are expected, but their timing and magnitude are uncertain. Whatever the future holds, this guide can be used to build our capacity to meet future change with confidence.

Three Approaches to Monitoring: Feedback Systems, Participatory Monitoring and Evaluation and Logical Frameworks - Jacobs, Alex; Barnett, Chris; Ponsford, Richard (IDS Bulletin, 2010)
This article compares key attributes, strengths and weaknesses of three different approaches to monitoring development interventions: the logical framework approach, participatory monitoring and evaluation (PM&E) and feedback systems. Academic and practitioner literature describes how logframes meet the needs of senior decision-makers to summarise, organise and compare projects. PM&E meets the needs of field staff to work sensitively with intended beneficiaries and support their learning and empowerment. Feedback systems appear to link the two, providing performance data for managers and creating incentives for implementing staff to focus on their intended beneficiaries. Feedback systems build on the rich heritage of PM&E and are compatible with logframes. They may help provide a manageable and effective approach to accountability that links the means and the ends of development interventions. Feedback systems are at an early stage of development. There is a lot to learn about how and where they work best.

Facilitating collaborative problem solving with human-centred design: the Making All Voices Count governance programme in 12 countries of Africa and Asia - Jackson, Carl (Knowledge Management for Development Journal, 2015)
Keywords: IMPORTANT

Redesigning Field Papers’ User Interface - Jacks, Lindsey (Cadasta, 2016)
For the past three months, I've been working with Cadasta and Stamen on the atlas creation pages of the Field Papers map annotation tool. The end result is now live on the Field Papers website. We took the four step “wizard” process for creating an atlas, combined it all into a single-page, and...
Keywords: IMPORTANT

How should donors manage adaptively? Market Systems Development as a case study. - Itad (Itad, 2018)
Itad has recently completed a strategic evaluation for Sida to help them work through how they can best manage programmes that are adaptive and apply systems approaches - the conclusions from the evaluation about what funders need to do to manage adaptively are of broader relevance.

ADAPT: Analysis Driven Agile Programming Techniques - IRC (International Rescue Committee (IRC), 2016)
A growing body of research indicates that aid agencies are most successful when able to operate flexibly, particularly in fragile environments. Yet our systems and tools are often too rigid to effectively address complex problems, and program incentives frequently undermine adaptation instead of supporting it. To drive improvements in impact we need to be better able to analyse the dynamics of a given situation, anticipate how these might evolve, and be sufficiently agile to adapt to changes in context and need.

Social network analysis handbook: connecting the dots in humanitarian programs - IRC (International Rescue Committee, 2016)
The following handbook is designed to provide a step by step guide to the application of Social Network Analysis for the IRC.
Keywords: IMPORTANT

Stakeholder and Social Network Analysis - Guidance Note - IRC (International Rescue Committee, 2019)
Stakeholder Analysis is used to identify the actors and relationships that influence project outcomes. This guidance, from IRC, can help you determine how to work and who to partner, coordinate or engage with in order to best achieve the outcome. It builds on existing stakeholder information and typically will include a participatory internal meeting or workshop.

M&E Universe - intrac (INTRAC, 2019)
The M&E Universe is a free, online resource developed by INTRAC to support development practitioners involved in monitoring and evaluation (M&E). It consists of a series of short papers (2-6 pages) on different subjects related to M&E. It can be explored through an online platform (intrac.org/universe) that is compatible with most web browsers. The M&E Universe is designed for M&E practitioners with different levels of experience and expertise in M&E, from those new to M&E who want an entry level into the subject to experienced practitioners wanting to broaden their knowledge. Initial contact with the Map will provide people with a starting point for understanding different aspects of M&E and how they link to each other. More experienced practitioners can browse the Map to identify more advanced subjects of interest, such as sampling methods, different forms of evaluation, organisational M&E systems and complex methodologies for data collection and analysis.

The M&E (Monitoring & Evaluation) Universe - INTRAC (INTRAC, 2019)
The M&E Universe is a free, online resource developed by INTRAC to support development practitioners involved in monitoring and evaluation (M&E). It consists of a series of short papers (2-6 pages) on different subjects related to M&E. To begin exploring the Universe right away, use the button below. To find out more, read on.

The Boda Boda Talk Talk Module - Internews (Internews & USAID, 2017)
Keywords: IMPORTANT

Introduction to International Futures - International Futures at the Pardee Center (International Futures Help System, 2016)
INTERNATIONAL FUTURES HELP SYSTEM Introduction to IFs Purposes Visual Representation of IFs Issues and Modules Quick Survey of IFs Issues and Modules IFs Background IFs Geographic Representation of the World IFs Time Horizon Instructional Use Acknowledgements Feedback Support for IFs Use Development Mode Features

From a last mile century to a first mile revolution: the future is OSLO - Indy Johar (Medium, 2013)
The Future is OSLO

Towards excellence: Policy and action research for sustainable development - iied (The International Institute for Environment and Development, 2012)

A ‘real-time’ and anthropological response to the Ebola crisis - IDS (IDS, 2017)
Impact Summary The Ebola epidemic that began in the Guinea-Sierra Leone-Liberia border region in December 2013 spread fast through the villages, cities and trade routes of this highly-peopled,...

An Upside Down View of Governance - IDS (Centre for the Future State, IDS, 2010)
Informal institutions and personalised relationships are usually seen as governance problems. However the research presented in this synthesis paper suggests that they can also be part of the solution...

Evaluation at IDRC - IDRC (IDRC, 2017)

The International Development Innovation Alliance - IDIA (R4D, 2017)
Brochure from the International Development Innovation Alliance

The field guide to human-centered design: design kit - IDEO (IDEO, 2015)
Keywords: Design; IMPORTANT; Methode

How to Apply Agile Principles to International Development M&E - ICTworks (ICT Works, 2016)
We all want to be good at our jobs. We want to accomplish the things we set out to do. If we aren’t accomplishing them, we want to figure out why or try new solutions. The trend toward Adaptive M&E is exactly that: a desire to be better at our jobs. Similar trends exist in the software world (agile) and in manufacturing and start-ups (lean). But by any name, this process of seeking to improve is about speeding up decision-making and solution delivery by focusing on incremental, iterative planning and execution. I presented on agile with Monalisa Salib of USAID Learning Lab at MERL Tech 2016. I talked about creating software; she talked about creating evaluation tools for USAID missions, but we were describing the same basic process: Develop, Release, Reflect, and Adapt. You can see our slide deck for more details, but here are the key discussion takeaways that won’t show up there: 1: Eyes on the Prize Any effort should start with a clear definition of what you’re hoping to achieve.
Keywords: IMPORTANT

Should the Principles of Digital Development be Agile? - ICTworks (ICT Works, 2016)
Recently, Abt Associates endorsed the “Principles of Digital Development.” These nine principles have been widely adopted by international development funders and practitioners to absorb and disseminate technology best practices in the field of international development. More than 50 organizations ranging from various offices in the United Nations and the U.S. Agency for International Development (USAID) down to niche technology providers have endorsed the principles. The principles are aimed at moving the field away from a disconnected series of technology pilots, each of which are largely ad hoc and duplicate many of the same lessons, and toward scalability and sustainability. Ann Mei Chang, the Executive Director of the U.S. Global Development Lab at USAID in her foreword to the recent report “From Principle to Practice: Implementing the Principles for Digital Development”, characterized the problem that these principles are trying to address as follows: “Pilots have failed to move

Enabling citizen-driven improvement of public services. Leveraging Technology to Strengthen Accountability in Nigerian Healthcare - ICT4SA (World Bank and Reboot, 2015)
Effective public service delivery begins with knowing whether the services offered are working as intended. We launched a system to enable citizen input on the delivery of public services.

Building a Learning Community in Liberia Through Partnerships at iCampus - iCampus (USAID LEARN, 2018)
Accountability Lab Liberia (ALab) and iLab Liberia established iCampus- a shared innovation, co-working and community space for organizations focusing on the intersection of technology, accountability and social change in Liberia. ALab implements DAI’s Learning activities at iCampus, and it is referred to as the Strategic Learning Partner of USAID Liberia Accountability and Voice Initiative (LAVI). LAVI is a five year USAID program with an overarching goal to strengthen multi-stakeholder partnerships to advocate for and monitor policy and accountability reforms. The iCampus CLA case scenario captures joint efforts of Accountability Lab Liberia, iLab Liberia and USAID LAVI, to ensure that learning and methodologies are shared and applied by development actors; address common capacity challenges that particularly hinder civil society from engaging in evidence-based and issues-based advocacy using various approaches, including network-building, creation of a cross-sectoral learning space- through collaboration and learning. In 2017, iCampus conducted a learning mapping survey to understand how organizations are learning in Liberia. The result indicated that frameworks and concepts of organizational learning are not yet well understood or used to guide strategic or programmatic practices, by either Liberian or international organizations. ALab, iLab and USAID LAVI then adopted a set of strategies, that led to the implementation of a CLA, enabling the establishment of the first multi-sectoral learning community in Liberia.

Achieving value for money through procurement. Part 2: DFID’s approach to value for money through tendering and contract management - A performance review - ICAI (Independent Commission for Aid Impact (ICAI), 2018)
Summary In 2016-17, the Department for International Development (DFID) spent £1.4 billion, or 14% of its budget, through commercial suppliers on contracts ranging from school construction to family planning services and the delivery of humanitarian aid. The quality of its procurement and contract management – how it engages and manages commercial firms to support the delivery of aid programmes on time, to budget and at the appropriate quality – is a key driver of value for money for UK aid. It is also a subject of considerable Parliamentary and public interest. In recent years, DFID has implemented a range of initiatives to strengthen its procurement practices and embed commercial capability across the department – including its 2017 Supplier Review, undertaken to address concerns about excessive profit-making by DFID suppliers. This review on achieving value for money through procurement (part 2) was published in September 2018. We awarded a green-amber score and made three recommendations to government. The follow-up to this review was published in July 2020, and rated the government’s response as ‘inadequate’, as a result of DFID’s failure to put in place a formal contract management regime, despite the risks this entails for programme results. We will return to this in the next follow-up in summer 2021. Review Our review found an appropriate overall approach to procurement with good performance in most areas of tendering, but significant weaknesses in contract management. We therefore awarded a green-amber score and made three recommendations to government. Findings Since 2015, DFID has progressed towards a more mature procurement approach. DFID’s tender process follows current EU legislation and UK government guidelines and cross-government peer reviews confirm improvements in DFID’s procurement approach. The Supplier Review lent momentum to the reforms but risks having unintended consequences. Poor consultation with suppliers has heightened the risk of unintended consequences. DFID is reviewing its business processes to protect aid recipients from sexual abuse and exploitation. DFID does not always choose the most appropriate procurement process but a new strategic sourcing process has resulted in stronger procurement planning. DFID has built up its commercial capability, but this will need to be an ongoing process. The contract management function in DFID is poorly defined and contracts are frequently amended or extended beyond their advertised length and values. Inception phases are often too short for adequate preparation and planning. Progress on flexible and adaptive programming will require more innovative approaches to tendering and contract management. Recommendations Before the next major revision of its supplier code and contracting terms, or future changes that may materially affect suppliers, DFID should conduct an effective consultation process with its supplier market, to ensure informed decisions and minimise the risks of unintended consequences. DFID should accelerate its timetable for acquiring a suitable management information system for procurement, to ensure that its commercial decisions are informed by data. DFID should instigate a formal contract management regime, underpinned by appropriate training and guidance and supported by a senior official responsible for contract management across the department. The new regime should include appropriate adaptive contract management techniques, to ensure that supplier accountability is balanced with the need for innovation and adaptive management in pursuit of development results.

DFID’s approach to delivering impact - ICAI (Independent Commission for Aid Impact (ICAI), 2015)
UK aid, at its best, makes a real and positive difference to the lives and livelihoods of poor people around the world. Ensuring the best possible performance across a large and multifaceted aid programme is, however, a complex management challenge. This report reviews ICAI’s previous 44 reports and looks at how well DFID ensures positive, long-term, transformative impact across its work.

DFID’s approach to value for money in programme and portfolio management - ICAI (Independent Commission for Aid Impact (ICAI), 2018)
ICAI published this review on DFID’s approach to value for money in February 2018, and as value for money is both a process and an outcome and cuts across all aspects of DFID’s operations, did not score this review. We made five recommendations and published a follow-up to this review in July 2019. All UK government departments are required to achieve value for money in their use of public funds. In recent years, DFID has been working to build value for money considerations further into its management processes and its relationships with implementers and multilateral partners, establishing itself as a global champion on value for money. Review This review was published in February. Though it was not rated, ICAI made five recommendations, and found that the Department for International Development’s approach to value for money was helping to make UK aid spending go further, but improvements are still needed. Findings This review found that DFID has strengthened its processes and systems for ensuring it gains maximum value for each pound spent, has taken swift remedial action to tackle under-performing programmes, and has become a strong global champion on value for money. The review also found that DFID has been diligent in its efforts to cut waste, detect fraud, and improve efficiency, and that this work is improving the return on the UK investment in aid. However, the review found that DFID’s approach was not adequately reporting and capturing results and value for money at the country portfolio level, or how programmes work together to deliver lasting impact, including reducing future dependency on aid. It also found that weakness in the annual review process could undermine DFID’s approach to value for money. It found that targets were frequently revised, and that there could be pressures for optimistic scoring of programmes. Recommendations Based on this review, we made the following five recommendations to help DFID improve its approach to value for money still further: DFID country offices should articulate cross-cutting value for money objectives at the country portfolio level, and should report periodically on progress at that level. Drawing on its experience with introducing adaptive programming, DFID should encourage programmes to experiment with different ways of delivering results more cost-effectively, particularly for more complex programming. DFID should ensure that principles of development effectiveness – such as ensuring partner country leadership, building national capacity and empowering beneficiaries – are more explicit in its value for money approach. Programmes should reflect these principles in their value for money frameworks, and where appropriate incorporate qualitative indicators of progress at that level. DFID should be more explicit about the assumptions underlying the economic case in its business cases, and ensure that these are taken into account in programme monitoring. Delivery plans should specify points in the programme cycle when the economic case should be fully reassessed. Senior responsible owners should also determine whether a reassessment is needed following material changes in the programme, results targets or context. Annual review scores should include an assessment of whether programmes are likely to achieve their intended outcomes in a cost-effective way. DFID should consider introducing further quality assurance into the setting and adjustment of logframe targets.

DFID’s partnerships with civil society organisations - A performance review - ICAI (Independent Commission for Aid Impact (ICAI), 2019)
DFID values civil society organisations (CSOs), but its funding and partnership practices do not fully support the long-term health of the civil society sector.

How DFID learns - ICAI (Independent Commission for Aid Impact (ICAI), 2014)
Excellent learning is essential for UK aid to achieve maximum impact and value for money. We take learning to mean the extent to which DFID uses information and experience to influence its decisions. Each ICAI review assesses how well learning takes place. Our reports to date indicate a mixed performance. This review seeks to identify the way DFID learns and what inhibits it from doing so consistently. We drew on our reviews, assessed data from DFID’s own surveys and carried out interviews inside and outside the department. Review DFID generates considerable volumes of information, much of which, such as funded research, is publicly available. DFID does not clearly or consistently link this investment to how it can deliver better impact. We made five recommendations and gave an amber-red score. Findings DFID does not clearly identify how its investment in learning links to its performance and delivering better impact. DFID has the potential to be excellent at organisational learning if its best practices become common. DFID staff learn well as individuals. They are highly motivated and DFID provides opportunities and resources for them to learn. DFID is not yet, however, managing all the elements that contribute to how it learns as a single, integrated system. DFID does not review the costs, benefits and impact of learning. Insufficient priority is placed on learning during implementation. The emphasis on results can lead to a bias to the positive. Learning from both success and failure should be systematically encouraged. Recommendations DFID needs to focus on consistent and continuous organisational learning based on the experience of DFID, its partners and contractors and the measurement of its impact, in particular during the implementation phase of its activities. All DFID managers should be held accountable for conducting continuous reviews from which lessons are drawn about what works and where impact is actually being achieved for intended beneficiaries. All information commissioned and collected (such as annual reviews and evaluations) should be synthesised so that the relevant lessons are accessible and readily usable across the organisation. The focus must be on practical and easy-to-use information. Knowhow should be valued as much as knowledge. Staff need to be given more time to acquire experience in the field and share lessons about what works and does not work on the ground. DFID needs to continue to encourage a culture of free and full communication about what does and does not work. Staff should be encouraged always to base their decisions on evidence, without any bias to the positive.

"That's how the light gets in": Making Change in Closing Political Environments - IBP (International Budget Partnership, 2017)
This collection of learning and reflection essays from the International Budget Partnership's 2016 Annual Report illustrate the multidimensional nature of budget work and democratic engagement. Read more.

Shoulder to Shoulder - Hymowitz, Dan (Tony Blair Africa Governance Initiative, 2016)

Participatory design with marginalized people in developing countries: Challenges and opportunities experienced in a field study in Cambodia - Hussain, Sofia; Sanders, Elizabeth B.-N.; Steinert, Martin (International Journal of Design, 2012)

Logics of Government Innovation and Reform Management in China - Husain, Lewis (STEPS centre, 2015)
Since the beginning of reforms in the late 1970s, China has developed rapidly, transforming itself into a middle-income country, raising hundreds of millions out of poverty and, latterly, developing broad-based social protection systems. The country’s approach to reform has been unorthodox, leading many to talk of a specific Chinese model of development. This paper analyses the role of innovation (chuangxin) and experimentation in the Chinese government repertoire and their contribution to management of change during the rapid, complex and interconnected reforms that China is undergoing. ‘Innovation’ is understood as the process of generation, putting into use, and spread, of new ideas. This contemporary focus on innovation is an extension of an older Chinese government attachment to sub-national initiative in policy formulation and development that goes back to the beginnings of the PRC and before. Central government backing for, and endorsement of, proactive agency on the part of sub-national governments responds to a belief that China is too large, and conditions around the country too diverse, to allow adoption of ‘one size fits all’ policy. Sub-national governments are expected to show initiative in adapting policy locally, and creating locally-useable policy solutions within the overall scope of central policy mandates/ paradigms. The paper argues that innovation by sub-national government is systemically embedded: while central government sets the policy agenda, local governments are frontline managers, and develop a range of policy practices. Differences in conditions between localities mean that multiple variant policy practices are often in circulation at any one time. While innovation is not quantifiable in the aggregate, there is much controlled experimentation, freewheeling innovation, and trial and error, all of which are part of a search for new policy fixes and institutional solutions. Many forms of policy transfer and learning are in evidence, including much central learning from sub-national models, as well as sub-national circulation of a range of innovative policy practices. While much government innovation is not ‘original’, and may be ‘inefficient’ or of little systemic usefulness, overall, the churn of government innovation remains valuable in underpinning systemic adaptation and reform. The paper situates the analysis of government innovation within a larger framework on the functioning of Chinese government and international literature on policy transfer, and outlines an agenda for future research on the structural bases of Chinese government innovation and its contribution to adaptive management.

Policy experimentation and innovation as a response to complexity in China’s management of health reforms - Husain, Lewis (Globalization and Health, 2017)
There are increasing criticisms of dominant models for scaling up health systems in developing countries and a recognition that approaches are needed that better take into account the complexity of health interventions. Since Reform and Opening in the late 1970s, Chinese government has managed complex, rapid and intersecting reforms across many policy areas. As with reforms in other policy areas, reform of the health system has been through a process of trial and error. There is increasing understanding of the importance of policy experimentation and innovation in many of China’s reforms; this article argues that these processes have been important in rebuilding China’s health system. While China’s current system still has many problems, progress is being made in developing a functioning system able to ensure broad population access. The article analyses Chinese thinking on policy experimentation and innovation and their use in management of complex reforms. It argues that China’s management of reform allows space for policy tailoring and innovation by sub-national governments under a broad agreement over the ends of reform, and that shared understandings of policy innovation, alongside informational infrastructures for the systemic propagation and codification of useful practices, provide a framework for managing change in complex environments and under conditions of uncertainty in which ‘what works’ is not knowable in advance. The article situates China’s use of experimentation and innovation in management of health system reform in relation to recent literature which applies complex systems thinking to global health, and concludes that there are lessons to be learnt from China’s approaches to managing complexity in development of health systems for the benefit of the poor.

Beyond Logframe: Critique, Variations and Alternatives - Hummelbrunner, Richard (Beyond Logframe; Using Systems Concepts in Evaluation, 2010)
Over the last decades, the Logical Framework Approach (LFA) has become universally known and has assumed a key role for planning and managing development interventions. LFA, however, is not uncontroversial and the approach has been subject to criticism, concerning both its theoretical foundations and practical use. Despite these criticisms LFA’s position has not been fundamentally weakened and while many donors acknowledge its limits and weaknesses, they maintain (some would say impose) its use as a planning and monitoring tool. This chapter reviews some of the experience gained with LFA and outlines major attempts to develop variations – or move beyond it altogether. The first section briefly describes the LFA concept and summarizes the main points of critique. Section 2 then explores some variations which have been developed in response to this critique and to improve LFA as a management tool. Section 3 proposes a systemic alternative to logframe and Section 4 outlines alternatives to LFA which have recently been introduced in German development aid.

What works for Social Accountability? Findings from DFID’s Macro Evaluation - Hughes, Claire (Itad, 2017)

Everyday Political Analysis - Hudson, David; Marquette, Heather; Waldock, Sam (Developmental Leadership Program, 2016)
This short note introduces a stripped-back political analysis framework designed to help frontline development practitioners make quick but politically-informed decisions. It aims to complement more in-depth political analysis by helping programming staff to develop the 'craft' of political thinking in a way that fits their everyday working practices. Everyday Political Analysis involves two steps: Understanding interests: What makes people tick? Understanding change: What space and capacity do people have to effect change? For each step five questions, accompanied by prompts, aim to help staff to conduct quick political analysis. The EPA framework can be used at any stage of the aid management cycle, and can help users to respond rapidly to unexpected change. We are keen to hear back from people on their experience of using EPA to help us adapt the framework. Was it useful (or not)? Do people tend to use just one or both steps? Are there missing statements or prompts that would improve the analysis? Please email us at info [at] dlprog.org.

Mind the gaps: What's missing in political economy analysis and why it matters - Hudson, David; Marquette, Heather (A Governance Practitioner’s Notebook: Alternative Ideas and Approaches, 2015)
The Governance Practitioner’s Notebook takes an unusual approach for the OECD-DAC Network on Governance (GovNet). It brings together a collection of specially written notes aimed at those who work as governance practitioners within development agencies. It does so, however, without attempting to offer definitive guidance – instead aiming to stimulate thinking and debate. To aid this process the book is centred on a fictional Governance Adviser. The Notebook’s format provides space for experts to speak on today’s governance issues: politics, public sector reform and stakeholder engagement. It encourages debate, charts the evolution of donor thinking, and highlights future challenges in the age of the Sustainable Development Goals. Each section introduces both technical issues and major areas of debate, providing ideas for future development support to institutional reform.
Keywords: IMPORTANT

Signal Left, Turn Right: Central Rhetoric and Local Reform in China - Huang, Haifeng (Political Research Quarterly, 2013)
How have local governments in China been able to break through central policy restrictions in a unitary and authoritarian political system? Why is China's official discourse in the reform era often so conservative and unfavorable to reform? The author argues the two issues are components of a signaling game between China's central government and local officials, in which local officials know that the center may be reformist, but the reformist center imitates the rhetoric of a conservative center to control the pace of local liberalization. The result is a gradualist reform of "signaling left, turning right," with glaring incongruity of speech and actions in the process.

Navigating by Judgment: Organizational Structure, Autonomy, and Country Context in Delivering Foreign Aid - Honig, Daniel (Harvard University, Graduate School of Arts & Sciences, 2015)
This dissertation examines when initiatives by International Development Organizations (IDOs) are more, and less, successful. The core argument is that allowing field-level agents to drive initiatives – what I call organizational Navigation by Judgment – will often be the most effective way to deliver aid. This inverts what a classical application of the principal agent model – the workhorse of studies of public management and bureaucracy – would predict, with better performance resulting from less control. In the delivery of foreign aid the costs of monitoring to the principal are often overshadowed by the deleterious effects of the monitoring itself. The core of the argument is that development implementation requires soft information, tacit knowledge, and flexibility that are crowded out by tight controls or an organizational navigation strategy focused on short term measurement and targets. As a result there are increasing returns to Navigation by Judgment in environments that are uncertain or difficult to understand from the outside and tasks where outputs are difficult to observe and/or poorly correlated with long term intervention goals. Insecure political authorizing environments which constrain the autonomy of IDOs prevent these organizations from Navigating by Judgment in situations where this is the best strategy. Empirically, this dissertation examines a cross-IDO dataset of projects (including over 14,000 projects over 50 years over 9 organizations), which I have assembled. It also examines eight cases of development interventions in Liberia and South Africa. These cases are matched pairs comparing the performance and navigation strategies of the US Agency for International Development (a low autonomy IDO) and the UK’s Department for International Development (a higher autonomy IDO) in capacity building and health sector interventions.
Keywords: IMPORTANT

When Reporting Undermines Performance: The Costs of Politically Constrained Organizational Autonomy in Foreign Aid Implementation - Honig, Daniel (International Organization, 2019)

The Limits of Accounting-Based Accountability in Education (and Far Beyond): Why More Accounting Will Rarely Solve Accountability Problems - Honig, Dan; Pritchett, Lant (Center for Global Development, 2019)
Accountability is rightly at the center of the conversation regarding how to improve governance systems, particularly health and education systems. But efforts to address accountability deficits often focus primarily on improving what can be counted and verified—what we term “accountingbased accountability.” We argue that introducing greater accounting-based accountability will only very rarely be the appropriate solution for addressing accountability problems. We illustrate this by exploring the role of Accountability ICT in (not) improving education system performance. Strengthening “real” accountability is not the same as improving data systems for observation and verification, and often attempts at the latter undermine the former. The development discourse’s frequent semantic misunderstanding of the term “accountability” has pernicious effects on system reform efforts and ultimately global welfare.

Making good on donors’ desire to Do Development Differently - Honig, Dan; Gulrajani, Nilima (Third World Quarterly, 2018)
AbstractForeign aid donors are increasingly focused on changing the way their development agencies function. This discourse has focused on desired qualities, including greater knowledge of local contextual realities, appropriate adaptation to context and greater flexibility to respond to changing circumstances. We argue that more attention needs to be devoted to the achievement of these qualities and turn to contingency theory to identify some under-exploited ways to ?do development differently?. The qualities sought by donors are emergent properties of complex organisational systems and will only be achieved through a micro-level and interlinked focus on the fundamentals of organisation.

Navigation by Judgment: Why and when Top Down Management of Foreign Aid Doesn't Work - Honig, Dan (Oxford University Press, 2018)
Foreign aid organizations collectively spend hundreds of billions of dollars annually, with mixed results. Part of the problem in these endeavors lies in their execution. When should foreign aid organizations empower actors on the front lines of delivery to guide aid interventions, and when should distant headquarters lead? In Navigation by Judgment, Dan Honig argues that high-quality implementation of foreign aid programs often requires contextual information that cannot be seen by those in distant headquarters. Tight controls and a focus on reaching pre-set measurable targets often prevent front-line workers from using skill, local knowledge, and creativity to solve problems in ways that maximize the impact of foreign aid. Drawing on a novel database of over 14,000 discrete development projects across nine aid agencies and eight paired case studies of development projects, Honig concludes that aid agencies will often benefit from giving field agents the authority to use their own judgments to guide aid delivery. This "navigation by judgment" is particularly valuable when environments are unpredictable and when accomplishing an aid program's goals is hard to accurately measure. Highlighting a crucial obstacle for effective global aid, Navigation by Judgment shows that the management of aid projects matters for aid effectiveness.
Google-Books-ID: GT5MDwAAQBAJ

Measuring Up: Evaluating the Impact of P/CVE Programs - Holmer, Georgia; Bauman, Peter (United States Institute of Peace, 2018)
This report considers the various conceptual and practical challenges in measuring the impact and value of programs designed to prevent and counter violent extremism (P/CVE). It examines potential solutions and emphasizes the significance of efforts to assess changes in attitudes, behaviors, and relationships. The report was developed in tandem with “Taking Stock: Analytic Tools for Understanding and Designing P/CVE Programs” and seeks to help advance more rigor and sustainability in P/CVE programming.

Network Weaver Handbook - Holley, June (Network Weaver, 2012)

Transformative Networks Are Multiscalar - Holley, June (NetworkWeaver, 2018)
This is an excerpt from the Network Weaver Handbook. I’ll be writing an update with my latest research and thinking on the topic in the coming weeks so stay tuned! June Holley How does tr…

Stop Trying to Save the World: Big ideas are destroying international development - Hobbes, Michael (New Republic, 2014)
Gives some examples of poorly designed interventions (e.g. The play pump)

The Futures Toolkit: Tools for Futures Thinking and Foresight Across UK Government - HM Government (2017)

Adaptive Management Practice in the UK Government - The MUVA case - HLS (Human Learning Systems, 2019)
Case study about the MUVA programme in Mozambique. (Maybe it "misses the point of AP which is not learning for learning. Is learning for impact. The word impact doesn’t even come up once!") Adaptive Management programming within the Foreign & Commonwealth Development Office demonstrates that the UK Government has examples of optimising for learning within its existing management practice. However, currently, the adaptive management practices are unhelpfully framed by an approach which limits both their effectiveness and scope. The programmes use learning as their metastrategy. They succeed in connecting practicebased learning with strategic learning, and make a shift towards reframing accountability as accountability for learning. This learning strategy is enabled by funding and contract management arrangements which prioritise learning. Both at macro-level of programme management and micro level of de-risking experimentation and enabling necessary failure by decoupling people’s job security from potential failure.

An introduction to the Learning Architecture - HLA (Humanitarian Leadership Academy, 2017)
The Learning Architecture is built on a flexible Learning Methodology and provides principles, technologies and behaviours of Scaffolded Social Learning.

Engaging Farmers in Climate Change Adaptation Planning: Assessing Intercropping as a Means to Support Farm Adaptive Capacity - Himanen, Sari J.; Mäkinen, Hanna; Rimhanen, Karoliina; Savikko, Riitta (Agriculture, 2016)
Agriculture is one of the most vulnerable and adaptation-prone sources of livelihood facing climate change. Joint adaptation planning by farmers and researchers can help develop practically feasible and environmentally and economically sound adaptation actions as well as encourage the proactive building of farm adaptive capacity. Here, the perceptions of Finnish farmers and rural stakeholders regarding intercropping, the cultivation of two or more crop genotypes together in time and space, as a means to prepare for climate change, were collected in an open workshop. Our aim was to identify the potentials and challenges associated with intercropping, its role as an adaptation strategy, and in farm adaptive capacity. Qualitative analysis revealed better yield security, increased nutrient and protein self-sufficiency, soil conservation and maintenance, reduced pathogen pressure and regulation of water dynamics as the main perceived potentials of intercropping. Potentials relating to the farm economy and environment were also recognized. The main challenges associated with intercropping were related to the lack of information on crop variety performance and optimal yielding in mixtures, industry and policy requirements for seed purity, more complicated crop management and harvesting, and the economic risks associated with experimenting with novel mixtures. Nitrogen-fixing legumes; deep-rooted species, such as lucerne (Medicago sativa L.); special crops, such as herbs in forage mixtures; and autumn-sown winter oilseeds and cereals were highlighted as the most promising intercrops. Because the recognized potentials relate to the safeguarding of field cropping from anticipated climate change and the associated weather variability, we conclude that intercropping can serve as one adaptation strategy to strengthen the adaptive capacity of Finnish farms. However, assuring markets and policies that allow the development of intercropping, performing experiments to assess the benefits and implement options in practice, and providing farmers and farm advisors with more knowledge on the method represent the critical prerequisites for the broader adoption of intercropping.
Keywords: Adaptation planning; Adaptive capacity; Climate change; ecological intensification; intercropping; yield security

Sensing and Cyberinfrastructure for Smarter Water Management: The Promise and Challenge of Ubiquity - Hill David; Kerkez Branko; Rasekh Amin; Ostfeld Avi; Minsker Barbara; Banks M. Katherine (Journal of Water Resources Planning and Management, 2014)

Adaptive Leadership: Accelerating Enterprise Agility - Highsmith, Jim (Addison-Wesley Professional., 2013)

Incorporating Geospatial Analysis into USAID Biodiversity Program Design - Higgins, Mark; Salafsky, Nick; Adeney, Marion; Petrova, Silvia (USAID, 2017)
Incorporating Geospatial Analysis into USAID Biodiversity Program Design is a biodiversity case example that describes the use of geospatial data and analysis for program design, including examples and lessons learned.

Understanding Social Accountability: Politics, Power and Building New Social Contracts - Hickey, Sam; King, Sophie (The Journal of Development Studies, 2016)
Calls to deepen levels of social accountability within social protection interventions need to be informed by the now extensive experience of promoting social accountability in developing countries. Drawing on a systematic review of over 90 social accountability interventions, including some involving social protection, this paper shows that politics and context are critical to shaping their success. We argue that the politics of social protection and of social accountability resonate strongly with the broader project of transforming state-society relations in developing countries. This requires a reconceptualisation of social accountability and social protection in terms of the broader development of ‘social contracts’, and that the current emphasis on promoting bottom-up forms of accountability needs to be balanced by efforts to strengthen and legitimise public authority in developing countries.

Monitoreo ciudadano en México: Participación ciudadana para mejorar la provisión de servicios públicos - Hevia, Felipe (CIDE, 2016)
Existe un amplio consenso sobre la importancia de los sistemas de monitoreo y evaluación para la mejora de políticas, programas y servicios públicos. Sin embargo, en la literatura especializada sorprende el escaso interés por analizar un tipo

Mentoring Programmes: Supporting Effective Technology Use in Transparency and Accountability Organisations - Herringshaw, Vanessa; Faith, Becky (Transparency & Accountability Initiative, 2015)
The global movement to hold governments and companies accountable is growing rapidly, and technology can play a vital role. Some actors harness this potential to brilliant effect. But many others waste precious money and staff time on technology that isn’t a good fit for their aims or capacity. Mentorships can be a really effective way …

Are you doing what’s needed to get the state to respond to its citizens? Or are you part of the problem? - Herringshaw, Vanessa (Making All Voices Count, 2017)
Three challenges from Making All Voices Count research on responsive governance

Leaving No One Behind in a Digital World - Hernandez, Kevin; Roberts, Tony (Institute of Development Studies, 2018)

Towards evidence-informed adaptive management - Hernandez, Kevin; Ramalingam, Ben; Wild, Leni (ODI/GLAM, 2019)
Development and humanitarian organisations seeking to be adaptive have emphasised the need to be transparent about complexity and uncertainty; to be honest about their inability to control what happens; and to design programmes that change over time to become more appropriate and relevant. At their heart, adaptive management approaches emphasise the ability to lean, 'unlearn' and adapt programming accordingly. The cornerstone of effective learning is the creation, gathering, accumulation, interpretation and use of data and evidence. This working paper provides development professionals with tools, strategies and ideas to help them use evidence for adaptive management in practical and evidence-informed ways. Key messages - Evidence is central to effective and rigorous adaptive management. However, despite this central importance, exactly how evidence has been used to inform decisions for adapting development and humanitarian programmes in the past remains unobservable to many. - There is a need to strengthen and document evidence-informed adaptive management. This working paper proposes a roadmap to do this. - Those seeking to use evidence for adaptive management will need to manage trade-offs between ensuring a rigorous, documented (and auditable) trail of evidence-informed actions, being pragmatic about the time and resources allocated to documentation and recognising that it may be necessary to proceed without rigorous evidence when it is unavailable.

HERMES (Highly Extensible Resource for Modeling Event-Driven Supply Chains) - HERMES (hermes.psc.edu, 2015)
Systems modeling is a tool for policymakers and program managers to capture all the direct and indirect effects of changes to a supply chain, identify sustainable solutions to the root causes of issues and save time, effort and resources in costly trial and error. Without systems modeling, evaluating the supply chain, identifying gaps, and implementing solutions can be insufficient, unsustainable and costly. Stock2 Vaccine supply chains are complex systems, comprising all the equipment, personnel, policies and processes needed to deliver a vaccine from its point of origin to the population. Understanding how the various components of a vaccine supply chain interact with each other is critical to evaluating supply chain function, identifying the root causes of issues and formulating sustainable solutions. HERMES (Highly Extensible Resource for Modeling Event-Driven Supply Chains) is a software program that allows users to generate a detailed computer simulation model of a supply chain

RAND Program Evaluation Toolkit for Countering Violent Extremism - Helmus, Todd; Matthews, Miriam; Ramchand, Rajeev; Beaghley, Sina; Stebbins, David; Kadlec, Amanda; Brown, Michael; Kofner, Aaron; Acosta, Joie (RAND Corporation, 2017)

Deliberation and Development: Rethinking the Role of Voice and Collective Action in Unequal Societies - Heller, Patrick; Rao, Vijayendra (World Bank Publications, 2015)
This book marries two fields that rarely converse with one another:deliberative democracy and development studies. The study ofdeliberation―which explores normative and practical questions aroundgroup-based decision making through discussion or debate―has emergedas a critical area of study over the past two decades. Concurrently, the fieldof development has seen a spurt of interest in community-led developmentand participation premised on the ability of groups to arrive at decisionsand manage resources via a process of discussion and debate. Despite thegrowing interest in both fields, they have rarely engaged with one another.This book, which brings together new essays by some of the leading scholarsin the field, deepens our understanding of participatory decision makingin developing countries while initiating a new field of study for scholarsof deliberation. In the process, it sheds light on how to best design andimplement policies to strengthen the role of participation in development.

Not everything that connects is a network - Hearn, Simon; Mendizabal, Enrique (ODI, 2011)
In the public policy context, networks have been predominant factors in policy formulation, innovation and global governance. While not a new phenomenon in the development landscape, networks are becoming increasingly prevalent. Donors, for example, are turning to networks to deliver aid interventions, NGOs are working through networks for collective advocacy and researchers collaborate across networks for greater policy influence. But are networks always the most appropriate vehicle? Where they are appropriate, how can we make the best use of them? This Background Note argues for a more rigorous understanding of their nature, particularly their value (and costs), and presents a revised Network Functions Approach as a model for rationalised investment in networks.

What is impact? - Hearn, Simon; Anne, Buffardi (2016)
• Impact is a multi-dimensional concept. Some definitions focus on very precise understandings of impact, while others cast a much broader net. • How impact is defined and used has a significant effect on the design, management and evaluation of development programmes. • Development programmes should hold explicit conversations with different stakeholders about how impact is used and understood, in order to come to a shared understanding. • There are six dimensions of impact that may help development programmes be clearer about what they mean.

Digital Principles into practice - HDIF (HDIF, 2018)

Adaptive management intentions with a reality of evaluation: Getting science back into policy - Hasselman, Lyndal (Environmental Science & Policy, 2017)
In Australia’s Murray-Darling Basin water reform has been contentious as government attempts to reconcile historical over allocation of water to irrigation with the use of water for environmental outcomes. However, in many aspects, scientific knowledge of the environment is either imperfect, incomplete or environmental responses are unpredictable, with this uncertainty preventing definitive policy and closure of political arguments. In response to uncertainty and knowledge gaps, adaptive management has been written into the legislation, along with provisions for periodic evaluation. This research ascertains how adaptive management is understood by policy makers, with this indicative of future implementation of adaptive management. The way in which adaptive management is constructed by policy makers is determined through legislation, public speeches, government reports and semi-structured interviews. The findings demonstrate that adaptive management has been subsumed by evaluation. The loss of adaptive management as a distinct concept is seen as a loss of science and discovery from the policy process, with the dominance of evaluation discussed as limiting innovation and reinforcing a ‘muddling through’ of policy.
Keywords: Accountability; Adaptive Management; Evaluation; Science; Uncertainty

Salt River Ecosystem Restoration Project - Adaptive Management Plan - Harvey, H.T. (Humboldt County Resource Conservation District, 2011)

Fostering Learning in Large Programmes and Portfolios: Emerging Lessons from Climate Change and Sustainable Development - Harvey, Blane; Pasanen, Tiina; Pollard, Alison; Raybould, Julia (Sustainability, 2017)
In ﬁelds like climate and development, where the challenges being addressed can be described as “wicked”, learning is key to successful programming. Useful practical and theoretical work is being undertaken to better understand the role of reﬂexive learning in bringing together different knowledge to address complex problems like climate change. Through a review of practical cases and learning theories commonly used in the areas of resilience, climate change adaptation and environmental management, this article: (i) reviews the theories that have shaped approaches to reﬂexive learning in large, highly-distributed climate change and resilience-building programmes for development; and (ii) conducts a comparative learning review of key challenges and lessons emerging from early efforts to promote and integrate reﬂexive learning processes in programmes of this nature. Using a case study approach, the authors focus on early efforts made in four large, inter-related (or nested) programmes to establish, integrate and sustain learning processes and systems. Eight themes emerged from the review and are considered from the perspective of learning programmes as emergent communities of practice. By investigating how these themes play out in the nested programming, the paper contributes to the limited existing body of evidence on learning in large climate change programmes and identiﬁes areas where future efforts might focus.

How ICT4D Research Fails the Poor - Harris, Roger W. (Information Technology for Development, 2016)
Research can improve development policies and practices and funders increasingly require evidence of such socioeconomic impact from their investments. This article questions whether information and communication technologies for development (ICT4D) research conforms to the requirements for achieving socioeconomic impact. We report on a literature review of the impact of research in international development and a survey of ICT4D researchers who assessed the extent to which they follow practices for achieving socioeconomic impact. The findings suggest that while ICT4D researchers are interested in influencing both practice and policy, they are less inclined toward the activities that would make this happen, especially engaging with users of their research and communicating their findings to a wider audience. Their institutions do not provide incentives for researchers to adopt these practices. ICT4D researchers and their institutions should engage more closely with the users of their research through more and better communications with the public, especially through the use of information and communication technologies.
Keywords: ICT4D; Policy making; Practice; Research; impact

Leather sector reform in Bangladesh - Harris, Dan (2016)
This paper examines the Asia Foundation’s efforts to support change in Bangladesh’s leather sector. Working closely with local partners, the Asia Foundation team has specifically supported efforts to move tanneries out of a dangerously polluted location to a modern industrial park that will improve compliance with health and environmental protection standards, and potentially lead to growth in the sector. At the time of release, this critical relocation has already begun. This case study lays out the real-time decisions and processes which drove the strategy and implementation of this project, providing useful insights into how politically astute and flexible programs can be successfully implemented. This case has emerged from an action research process, which was led by a researcher from the Overseas Development Institute (ODI) and conducted over the course of almost two years. By capturing and analyzing the experiences of the program team in Bangladesh, the paper intends to provide practical insights for others in the development community aiming to implement similar kinds of programming. This is the seventh paper in the DFAT-TAF Partnership Working Politically in Practice Paper Series released under the Australian Government Department of Foreign Affairs and Trade (DFAT) and The Asia Foundation (TAF) Partnership.