Constituent Voice: Technical Note 1 - Keystone Accountability (Keystone Accountability, 2014)

Teams that Do Development Differently - Khan, Jehanzeb; Fisher, Annette (Global Policy Journal, 2017)

Monitoring and Result Measurement for Adaptive Programming - How to Use Data to Manage a MSD Program: Lessons from PRISMA - Khan, Khaled; Seely, Kevin; Ridwan, Mustika; Mulya, Bodhiya (PRISMA, 2019)
Using monitoring data to improve interventions is harder than it seems. Decision-makers are often busy implementing activities, unclear about their roles in data collection and analysis, and uncertain what data matters most or when. PRISMA, an AUD77 million agricultural Market Systems Development (MSD) programme funded by DFAT Australia, has encountered these challenges. With the programme completing its first five year phase, this case study shares ten key lessons divided into three sections: shaping the culture, developing systems, and top management decisions. These lessons aim to help program, sector and intervention managers make better use of monitoring data to improve interventions.

Making politics work for development: harnessing transparency and citizen engagement - Khemani, Stuti; Ferraz, Claudio; Finan, Frederico S.; Johnson, Stephenson; Louise, Corinne; Abrahams, Scott David; Odugbemi, Adesinaola Michael; Dal Bó, Ernesto; Thapa, Dikshya (The World Bank, 2016)
Too often, government leaders fail to adopt and implement policies that they know are necessary for sustained economic development. They are encumbered by adverse political incentives, which prevent them from selecting good policies, and they run the risk of losing office should they try to do the right thing. Even when technically sound policies are selected by leaders, implementation can run into perverse behavioral norms among public officials and citizens, who seek to extract private benefits from the public sector. Such behavior might be supported by widespread beliefs that corruption is the norm. Even countries with low corruption and strong institutions experience problems of political incentives and behavior that prevent the public sector from solving shared problems. Ideological polarization among citizens and capture by special interests can lead to policy gridlock and the failure of the state to provide public goods, even in advanced economies. Even educated citizens can hold ideological beliefs about the role of public policy that lead them to deny technical evidence contrary to these beliefs. Too often, government leaders fail to adopt and implement policies that they know are necessary for sustained economic development. Political constraints can prevent leaders from following sound technical advice, even when leaders have the best of intentions. Making Politics Work for Development: Harnessing Transparency and Citizen Engagement focuses on two forces—citizen engagement and transparency—that hold the key to solving government failures by shaping how political markets function. In today’s participative world, citizens are not only queueing at voting booths, but are also taking to the streets and using modern communication technology to select, sanction, and pressure the leaders who wield power within government. This political engagement can function in highly nuanced ways even within the same formal institutional context and across the political spectrum, from autocracies to democracies. Political engagement becomes unhealthy when leaders are selected and sanctioned on the basis of their provision of private benefits rather than public goods, giving rise to a range of government failures. The solutions to these failures lie in fostering healthy political engagement within any institutional context, and not in circumventing or suppressing it. Transparency—citizen access to publicly available information about the actions of those in government and the consequences of these actions—can play a crucial role by nourishing political engagement. The report distills policy lessons for governments, international development partners, and civil society on how best to target transparency initiatives so that the provision of public goods becomes the focus of political contestation. Even so, unhealthy political engagement may persist. But to build institutions that are capable of tackling public goods problems, politics needs to be addressed and cannot be side-stepped. Targeted transparency is one way to move in the right direction: it complements everything else policy makers do and holds the potential to make politics work for development rather than against it. " This pathbreaking report places politics at the heart of the development dialogue—exactly where it belongs. It provides constructive ideas for harnessing the forces of transparency and citizen engagement in ways that are suited to diverse institutional contexts so that reform leaders can overcome political constraints to their countries’ development goals. " Asli Demirgüç-Kunt, Director of Research, Development Research Group, The World Bank "This book not only provides an authoritative statement of what we know about how to align political incentives with the interests of society, but it does so with an eye to making change happen even in the face of political opposition. The World Bank will never be the same again. " James Robinson, University Professor, Harris School of Public Policy, University of Chicago " A lesson for us at the World Bank also comes out of this research. We can do more…to work with our clients to diminish political constraints to achieving development goals…To do this we have to overcome the fear of talking about politics, and confront it as part of the challenge of development. That is what we are doing through this report. " Kaushik Basu, Senior Vice President and Chief Economist, The World Bank

Adaptive management of an environmental watering event to enhance native fish spawning and recruitment - King, A. J.; Ward, K. A.; O’connor, P.; Green, D.; Tonkin, Z.; Mahoney, J. (Freshwater Biology, 2010)
1. A common goal of many environmental flow regimes is to maintain and/or enhance the river’s native fish community by increasing the occurrence of successful spawning and recruitment events. However, our understanding of the flow requirements of the early life history of fish is often limited, and hence predicting their response to specific managed flow events is difficult. To overcome this uncertainty requires the use of adaptive management principles in the design, implementation, monitoring and adjustment of environmental flow regimes. 2. The Barmah-Millewa Forest, a large river red gum forest on the Murray River floodplain, south-east Australia, contains a wide variety of ephemeral and permanent aquatic habitats suitable for fish. Flow regulation of the Murray River has significantly altered the natural flood regime of the Forest. In an attempt to alleviate some of the effects of river regulation, the Forest’s water regime is highly managed using a variety of flow control structures and also receives targeted Environmental Water Allocations (EWA). In 2005, the largest environmental flow allocated to date in Australia was delivered at the Forest. 3. This study describes the adaptive management approach employed during the delivery of the 2005 EWA, which successfully achieved multiple ecological goals including enhanced native fish spawning and recruitment. Intensive monitoring of fish spawning and recruitment provided invaluable real-time and ongoing management input for optimising the delivery of environmental water to maximise ecological benefits at Barmah-Millewa Forest and other similar wetlands in the Murray-Darling Basin. 4. We discuss possible scenarios for the future application of environmental water and the need for environmental flow events and regimes to be conducted as rigorous, large-scale experiments within an adaptive management framework.
Keywords: floodplain river; regulated flows

Bradford Hill Criteria for Causal Inference - King, Julian (2015)
We think we’re good at determining causality, but we suck at it One of the great challenges in evaluation is determining whether the results we’re seeing are because of the program we’re evaluating, some other influences out there in the big world, or random chance. At one level, this is an everyday, common sense task. As a species we’ve been making judgments about causation for a million years or so. Unfortunately, though, the way we are wired does not predispose us to logical thinking. We are inclined to be led astray by all sorts of biases and heuristics. Over time, the rocket science for dealing with causation has become more sophisticated – a key example being the experimental study design or randomised controlled trial (RCT). And our evidence base about what works has been enriched as a result. But deep down we’re still biased, heuristical beings and not very good at thinking things through. We’ve become so enthusiastic about experimental designs we’re a little inclined to think they are the only way to determine whether A causes B. Such a rigid view is no much use in the real world, where there are all sorts of ethical, conceptual, practical and economic barriers that mean we can’t always conduct RCTs. Even where technically possible, they are not necessarily the best tool for every job.

Value for Investment. A Practical Evaluation Theory - King, Julian (Kinnect Group, 2016)
I am a public policy consultant from Auckland, New Zealand. My practice specializes in evaluation and economic analysis. In this booklet I set out a model for evaluating value for investment (VFI) in social programs. The model defines VFI as an evaluative question about an economic problem. It uses explicit evaluative reasoning to provide a clear answer to the VFI question. Methods are matched to context, to provide the specific mix of evidence (economic and/or other) needed to support a wellreasoned, well-evidenced evaluative judgment.

OPM’s approach to assessing Value for Money - King, Julian; OPM (Oxford Policy Management, 2018)
This document offers practical guidance for assessing value for money (VfM) in international development programmes. Since 2016, evaluation expert Julian King has been working with OPM to develop and deploy a robust approach to VfM assessment. The approach combines cutting-edge evaluation practice with concepts from economic evaluation to respond to donor requirements for accountability and good resource allocation, as well as to support reflection, learning, and adaptive management.

Building Democracy from Below: Lessons from Western Uganda - King, Sophie; Hickey, Sam (The Journal of Development Studies, 2016)
How to achieve democratisation in the neo-patrimonial and agrarian environments that predominate in sub-Saharan Africa continues to present a challenge for both development theory and practice. Drawing on intensive fieldwork in Western Uganda, this paper argues that Charles Tilly’s ‘democratisation as process’ provides us with the framework required to explain the ways in which particular kinds of association can advance democratisation from below. Moving beyond the current focus on how elite-bargaining and certain associational forms may contribute to liberal forms of democracy, this approach helps identify the intermediate mechanisms involved in building democracy from below, including the significance of challenging categorical inequalities, notably through the role of producer groups, and of building trust networks, cross-class alliances and synergistic relations between civil and political society. The evidence and mode of analysis deployed here help suggest alternative routes for supporting local efforts to build democracy from below in sub-Saharan Africa.
Keywords: FRUGAL

Guidelines for writing a case study on implementation (Book Project: Smart Implementation in Governance) - Kirsch, Renate (GIZ GmbH, 2015)

Transformation, politics and implementation: smart implementation in governance programs - Kirsch, Renate; Siehl, Elke; Stockmayer, Albrecht (Nomos, 2017)
Working in environments characterised by a high degree of uncertainty, uncontrollability and unpredictability, development agents try to organise complex realities into manageable units. What principles influence the decision on adequate approaches and necessary steps? Through theoretical considerations and nine case studies, the GIZ traces implementation processes and identifies underlying guiding principles which provide the flexibility and adaptability that is necessary for acting in complex contexts. Main findings show that an adaptive and reflexive management structure is crucial for successful implementation. Quick iteration and tight feedback loops facilitate adaptation and reorientation. Contextsensitive knowledge and constant monitoring create a space for learning and innovation. A joint vision for the future which is used for orientation purposes and can be modified according to new findings and developments fosters fruitful cooperation.
OCLC: 1000398466

Time for a Donor Funding Charter? - kiwanja.net (Donor's Chapter, 2014)

Lessons for Effective resilience programs: a case study of the RAIN program in Ethiopia - Kleiman, Shanti (Mercy Corps, 2013)
The RAIN program experience affirms the importance of multi-year and flexible funding as key program design features if progress in resilience building is to be supported in areas with high levels of structural and temporal vulnerability. These features enable management to respond effectively to changing circumstances in order to better meet the needs of communities and to create the necessary conditions for relief-to-development strategies to take hold. Finally, this study found that deliberate and effective coordination between donor agencies can ensure that development gains achieved during one program period are directly leveraged by subsequent programs, thereby increasing the effectiveness of resilience programs.

Improving development aid design and evaluation: Plan for sailboats, not trains - Kleinfeld, Rachel (Carnegie Endowment for International Peace, 2015)
How do reforms that require political engagement differ from traditional technical reforms? Why is political engagement different, and what are the implications for design and evaluation? How should development programmes that engage politics be designed? And how can those who fund or implement such programmes evaluate whether their efforts are contributing to reform? This report …
Keywords: IMPORTANT

Agile – where are we at? - Kniberg, Henrik (2017)

Alignment at Scale - Kniberg, Henrik (2016)

Lean from the Trenches: Managing Large-Scale Projects with Kanban - Kniberg, Henrik (Pragmatic Bookshelf, 2011)
You know the Agile and Lean development buzzwords, you've read the books. But when systems need a serious overhaul, you need to see how it works in real life, with real situations and people. Lean from the Trenches is all about actual practice. Every key point is illustrated with a photo or diagram, and anecdotes bring you inside the project as you discover why and how one organization modernized its workplace in record time.Lean from the Trenches is all about actual practice.Find out how the Swedish police combined XP, Scrum, and Kanban in a 60-person project. From start to finish, you'll see how to deliver a successful product using Lean principles. We start with an organization in desperate need of a new way of doing things and finish with a group of sixty, all working in sync to develop a scalable, complex system. You'll walk through the project step by step, from customer engagement, to the daily "cocktail party," version control, bug tracking, and release. In this honest look at what works–and what doesn't–you'll find out how to:Make quality everyone's business, not just the testers.Keep everyone moving in the same direction without micromanagement.Use simple and powerful metrics to aid in planning and process improvement.Balance between low-level feature focus and high-level system focus.You'll be ready to jump into the trenches and streamline your own development process.

Scaling Agile @ LEGO and Spotify – my talk at EA träff - Kniberg, Henrik (Crisp, 2017)

Spotify Rhythm - how we get aligned - Kniberg, Henrik (AvailAgility, 2016)
Last month, Henrik Kniberg posted slides from a talk he gave at Agile Sverige on something called Spotify Rhythm - "Spotify’s current approach to getting aligned as a company". While looking through the material, it struck me that what he was describing was a form of Strategy Deployment. This interpretation is based purely on those slides - I haven't had a chance yet to explore this more deeply with Henrik or anyone else from Spotify. I hope I will do some day, but given that caveat, here's how I currently understand the approach in terms of the X-Matrix Model.

The unofficial SCRUM checklist - Kniberg, Henrik (CRISP, 2010)

Scaling Agile @ Spotify with Tribes, Squads, Chapters & Guilds - Kniberg, Henrik; Ivarsson, Anders (Spotify, 2012)

A Whole New World - Funding and Commissioning in Complexity - Knight, Annabel Davidson; Lowe, Toby; Brossard, Marion; Wilson, Julie (Collaborate & Newcastle University, 2017)
Collaborate and Newcastle University Business School Publish Research into Complexity-Friendly Funding

Changing humanitarian action? - Knox-Clarke, Paul (ALNAP/ODI, 2017)
We live in times of profound change. This has had a great impact on humanitarian needs, and the approaches taken to meet these needs. Changes in technology, ecology, politics, economics and demographics have shaped, and will continue to shape, humanitarian action. Many humanitarians and observers of humanitarian action have suggested that change initiatives in the sector have been unambitious and unsuccessful. Indeed, many people think that the humanitarian system is unable, or unwilling, to make the changes that are required to remain effective and relevant in a rapidly changing world. Following the World Humanitarian Summit many stakeholders have made commitments to significant changes. But can the system change? And if so, how? As a network which exists to support change and improvement, it seems appropriate that ALNAP meets to consider how change occurs in the humanitarian system, and how it can be done better. Find out more about the 31st Annual Meeting by reading the concept note, or by visiting alnap.org/31am.

Joint Programming in Conflict-Affected and Fragile States - Koenig, Sibylle; Brusset, Emery (Joint Programming - EU, 2019)
On the Joint Programming Practices from the EU in fragile settings

Beyond the Pioneer: Getting inclusive industries to scale - Koh, Harvey; Hedge, Nidhi; Karamchandani, Ashish (Deloitte Touche Tohmatsu India Private Ltd (DTTIPL), 2014)

Rethinking systemic change in practice - perspectives from NUTEC-MD in northern Uganda - Koleros, Andrew (BEAM Exchange, 2016)
Document description This document is currently being finalised and will be published shortly. Please try again soon. Recent research by The BEAM Exchange seeks to understand theoretical perspectives on how market systems approaches can contribute to inclusive economic development through systemic change. It produced three main insights. Economies are evolving systems, building on the mechanisms of variety creation, selection and amplification. Current economic performance, including aspects like the inclusiveness of growth and economic evolution, are shaped by the ability of a society to explore different options for institutional arrangements and adjust them over time. This process of evolution is complex. While some aspects can be designed and managed, others need to be explored through a process of learning and adjustment. This paper responds to these insights by providing a practitioner perspective through the lens of one programme: “Northern Uganda: Transforming the Economy through Climate Smart Agribusiness – Market Development (NUTEC-MD)”, implemented by Palladium Group. It begins with a brief introduction to the programme and key aspects of its design phase. It then provides a summary of the three main research insights, with reflections on their applicability for programme design based on the NUTEC-MD experience. Finally, it provides some conclusions for the wider practitioner community based on this case.

Using Actor-Based Theories Of Change to Conduct Robust Contribution Analysis in Complex Settings - Koleros, Andrew; Mayne, John (Canadian Journal of Program Evaluation, 2019)
The use of theories of change (ToCs) is a hallmark of sound evaluation practice. As interventions have become more complex, the development of ToCs that adequately unpack this complexity has become more challenging. Equally important is the development of evaluable ToCs, necessary for conducting robust theory-based evaluation approaches such as contribution analysis (CA). This article explores one approach to tackling these challenges through the use of nested actor-based ToCs using the case of an impact evaluation of a complex police-reform program in the Democratic Republic of Congo, describing how evaluable nested actor-based ToCs were built to structure the evaluation.
Keywords: Behavioural strategy; COM-B

Approaches for addressing complexity in programme theory: Experiences in applying the Actor-based Change (ABC) Framework to a variety of international development programmes and evaluations - Koleros, Andrew; Oldenbeuving, Mark (2018)

Thinking and Working Politically in Economic Development Programmes – Some Sprints and Stumbles from a DFID Programme in Kyrgyzstan - Koleros, Andrew; Rinnert, David (From Poverty to Power, 2019)
A DFID programme in Kyrgyzstan offers useful insights into how the Thinking and Working Politically approach can escape from its governance ghetto
Keywords: Case Study

Managing Upward and Downward Accountability in an International Development Project - A Case Study of a World Bank Telecommunications Infrastructure Project in Benin - Kolker, Eva; Kulldorff, Catharina (Master's Thesis, Stockholm School of Economics, 2013)
Keywords: Downward accountability; Upward accountability

Monitoring and Evaluation in the Development Sector - KPMG (KPMG International, 2014)

Systems Change in a Polarized Country - Kramer, Mark R. (Stanford Social Innovation Review, 2017)
A growing number of US foundations are adopting practices based on systems change to achieve their goals in the current political environment.

What is technopolitics? A conceptual schema for understanding politics in the digital age Doctoral Student on the Programme on Political Science New School for Social Research - Kurban, Can; Peña-Lopez, Ismael; Haberer, Maria (Revista de Internet, Derecho y Política, 2017)
In this article we seek to revisit what the term ‘technopolitical’ means for democratic politics in our age. We begin by tracing how the term was used and then transformed through various and conflicting adaptations of ICTs (Information and

Definitions of Agile Software Development and Agility - Laanti, Maarit; Similä, Jouni; Abrahamsson, Pekka (Systems, Software and Services Process Improvement, 2013)
The Agile Manifesto and Agile Principles are typically referred to as the definitions of "agile" and "agility". However, many other definitions exist in the literature. Thus the different definitions provide interesting source for research. For each definition we examine where their emphasis is and compare that to the emphases found in the Agile Principles.

Announcement of CLA Learning Network Launch - Lab, Learning (USAID Learning Lab, 2016)
USAID’s Bureau for Policy, Planning and Learning (PPL), together with the Bureau for Economic Growth, Education, and Environment’s localworks program, is pleased to announce the launch of a Learning Network focused on building the evidence base for Collaborating, Learning and Adapting (CLA).

Adaptive Management Leaders Launch Practical Adaptation Network (PAN) - Labs, Feedback (FeedbackLabs, 2016)
Great things can happen at the frontier of theory and practice. When Feedback Labs worked with USAID’s Global Development Lab to bring together leaders in adaptive management at the White House on June 15th, we were pleased that we were able to move past the ongoing conceptual conversations toward discussing what we could do in concrete terms to implement adaptive management in practice.

Introduction to Project Management - The Case of GIZ Projects - Lacroix, Eric J. (Khulna University, 2015)
In this course, we will try to understand the complexity and the structure of the management of a development project implemented by the GIZ for the German Development cooperation. We will first define the frame of management and project to enter in the map of two logics. Then, we will overfly the 5 success factors of Capacity WORKS, with concrete examples in annexe. It will bring us to the monitoring, the standard processes in GIZ cooperation projects, the basic tools for project implementation and the evaluation. The team building will allow us to enter in a specific aspect of project management.

Facilities deserve a place in development - Lacy, Jacqui de (Devpolicy Blog from the Development Policy Centre, 2017)
There are different ways to deliver aid programs, DFAT often uses facilities in its larger relationships, what are the rationales and risks behind this?

Strategy Testing: An innovative approach to monitoring highly flexible aid programs - Ladner, Debra (The Asia Foundation, 2015)
The international development community has increasingly embraced the idea that finding durable solutions to complex development problems requires new ways of working that move beyond industry norms. This paper makes an important contribution to the current debate by outlining an innovative monitoring system called Strategy Testing (ST). This is the third paper in the Working Politically in Practice paper series, launched together with the Australian Department of Foreign Affairs and Trade.

Community-based monitoring of Indigenous food security in a changing climate: Global trends and future directions - Lam, Steven; Dodd, Warren; Skinner, Kelly; Papadopoulos, Andrew; Zivot, Chloe; Ford, James; Garcia, Patricia J.; Team, IHACC Research; Harper, Sherilee L. (Environmental Research Letters, 2019)
Climate change is expected to exacerbate existing food security challenges, especially in Indigenous communities worldwide. Community-based monitoring is considered a promising strategy to improve monitoring of, and local adaptation to climatic and environmental change. Yet, it is unclear how this approach can be applied in food security or Indigenous contexts. The objectives of this paper are to: 1) review and synthesize the published literature on community-based monitoring of Indigenous food security; and, 2) identify gaps and trends in these monitoring efforts in the context of climate change. Using a systematic search and screening process, we identified 86 published articles. To be included, articles had to be published in a journal, describe a community-based monitoring system, describe any aspect of food security, and explicitly mention an Indigenous community. Relevant articles were thematically analyzed to characterize elements of community-based monitoring in the context of climate change. Results show that the number of articles published over time was steady and increased more than two-fold within the last five years. The reviewed articles reported on monitoring mainly in North America (37%) and South America (28%). In general, monitoring was either collaborative with local communities (51%) or externally-driven (37%), and focused primarily on tracking wildlife (29%), followed by natural resources (16%), environmental change (15%), fisheries (13%), climate change (9%), or some combination of these topics (18%). This review provides an evidence-base on the uses, characteristics, and opportunities of community-based monitoring, to guide future food security monitoring efforts in the context of climate change.

Citizens Against Corruption: Report from the Front Line - Landell-Mills, Pierre (Matador, 2013)
Citizens Against Corruption: Report From The Front Line tells the story of how groups of courageous and dedicated citizens across the globe are taking direct action to root out corruption. It shows how people are no longer prepared to accept the predatory activities of dishonest officials and are challenging their scams. It draws on over 200 unique case studies that describe initiatives undertaken by 130 civil society organisations (CSOs) which engage directly with public agencies to stop the bribery and extortion that damages peoples' lives and obstructs social and economic progress. This book challenges the notion that, at best, civil society can only have a marginal impact on reducing corruption and argues that aid donors need to radically rethink their assistance for governance reform. Part 1 analyses the role citizens can play in fighting corruption and promoting good governance and briefly tells the story of the Partnership for Transparency Fund (PTF). Part 2 presents studies of India, Mongolia, Philippines, and Uganda - each with its unique history and distinctive circumstances - to illustrate activities undertaken by CSOs to root out corruption, including the tools and approaches that are being used to build pressure on corrupt public agencies to become transparent and accountable. Part 3 addresses key themes - strengthening the rule of law, putting in place effective national anti-corruption strategies and institutions, making public buying and selling honest, promoting grassroots monitoring of public expenditures and the provision of public services, mounting media campaigns to expose and defeat corruption, and empowering ordinary citizens to keep watch on what actually happens at the point of delivery of public services. Part 4 is a summary of lessons learnt and explores the potential, as well as the risks and limitations, of civic activism in a world where greed and dishonesty is the norm. Finally, the book explores the opportunities and dangers faced by aid donors in supporting local CSOs and charts a way forward. Citizens Against Corruption: Report From The Front Line will be of interest to staff working in CSOs and aid agencies, policy analysts and researchers concerned about corruption and poor governance.

The Science of Using Science: Researching the Use of Research Evidence in Decision-Making - Langer, Laurenz; Tripney, Janice; Gough, David (EPPI-Centre, Social Science Research Unit, UCL Institute of Education, University College London, 2016)

Paradoxes and partnerships: a study of knowledge exploration and exploitation in international development programmes - Lannon, John; Walsh, John N. (Journal of Knowledge Management, 2019)
Purpose – This paper aims to look at how organisational partnerships balance knowledge exploration and exploitation in contexts that are rife with paradoxes. It draws on paradox theory to examine the partnership’s response to the explore-exploit relationship.

You Cannot Go it Alone: Learning from Cooperative Relationships in Civil Society Budget Campaigns - Larsen, Jillian (IBP, 2016)
Keywords: IMPORTANT

Monday morning in Kigali: what do you do when you get off the plane? Practical guidance for PDIA practitioners - LASER (DFID-LASER Programme, 2016)
In order to help enhance the effectiveness of donors and development practitioners on the ground, LASER has produced a range of practical guidance and tools. These are primarily intended for the international development community engaged in designing and implementing investment climate programmes, though can also be used more widely by other stakeholders across sectors. General guidance and tools: Monday morning in Kigali January 2016 - what do you do when you get off the plane? Practical guidance for PDIA practitioners
Keywords: IMPORTANT; Practice

Politically smart approaches to donor investment climate programming. A Guidance Note - LASER (DFID-LASER Programme, 2016)
In order to help enhance the effectiveness of donors and development practitioners on the ground, LASER has produced a range of practical guidance and tools. These are primarily intended for the international development community engaged in designing and implementing investment climate programmes, though can also be used more widely by other stakeholders across sectors. General guidance and tools: Politically smart approaches to donor investment climate programming (and annexes) Revised February 2016 - sets out practical advice on how to adopt a politically smart (which requires being both ‘politically informed’ and ‘politically astute’) approach to programming. The annexes include a traffic light matrix for initial high level analysis; a problem diary template with examples; and an example of a flexible theory of change for adaptive, large scale programming
Keywords: Practice

In the goldfish bowl: science and technology policy dialogues in a digital world - Latta, Susie; Mulcare, Charlotte; Zacharzewski, Anthony (Sciencewise, 2013)

Measuring Impact: A Learning Approach to Strengthening USAID Biodiversity Programs - Lauck, Liz (2014)

Developmental evaluation: Bridging the gaps between proposal, program, and practice , Developmental evaluation: Bridging the gaps between proposal, program, and practice - Lawrence, Rachael B.; Rallis, Sharon F.; Davis, Laura C.; Harrington, Karen (Evaluation, 2018)
Developmental evaluation supports grant-funded initiatives seeking innovation and change. Programs born from aspirational grant language and plans often need guidance as they work toward creating workable models for social innovation. This article describes the challenge of designing and implementing complex programs and presents a case that illustrates how a program moves from proposal to practice. The Massachusetts Charter Public School Association Capacity Building Network is a complex intervention, funded by the US federal government, aimed at raising school capacity to serve students with disabilities and English language learners. Developmental evaluation served to bridge the gaps between an aspirational proposal, an ambitious and ambiguous program plan, and emerging practices to serve this population of students. Jointly reviewing our experience in this developmental evaluation, the evaluation team and a program director share important thematic lessons learned about the developmental evaluation approach., Developmental evaluation supports grant-funded initiatives seeking innovation and change. Programs born from aspirational grant language and plans often need guidance as they work toward creating workable models for social innovation. This article describes the challenge of designing and implementing complex programs and presents a case that illustrates how a program moves from proposal to practice. The Massachusetts Charter Public School Association Capacity Building Network is a complex intervention, funded by the US federal government, aimed at raising school capacity to serve students with disabilities and English language learners. Developmental evaluation served to bridge the gaps between an aspirational proposal, an ambitious and ambiguous program plan, and emerging practices to serve this population of students. Jointly reviewing our experience in this developmental evaluation, the evaluation team and a program director share important thematic lessons learned about the developmental evaluation approach.

Thinking and working politically in Somalia: A case study on the Somalia Stability Fund - Laws, Ed (TWP Coommunity of Practice and ODI, 2018)

Thinking and working politically: An introduction to key ideas, examples and further reading - Laws, Ed; Marquette, Heather (2018)

Thinking and working politically: Reviewing the evidence on the integration of politics into development practice over the past decade - Laws, Ed; Marquette, Heather (TWP Community of Practice, 2018)

Agile Project Management For Dummies - Layton, Mark C. (John Wiley & Sons, 2012)
Be flexible and faster with Agile project management As mobile and web technologies continue to evolve rapidly, there is added pressure to develop and implement software projects in weeks instead of months. Agile Project Management For Dummies can make that happen. This is the first book to provide a simple, step–by–step guide to Agile Project Management approaches, tools, and techniques. With the fast pace of mobile and web technology development, software project development must keep pace; Agile Project Management enables developers to complete and implement projects more quickly and this book shows you how. Offers a practical context for understanding and applying Agile techniques, moving from theory into actual practice Explains when to use Agile and how to avoid common pitfalls Written by experts who know how to apply the principles in real–world situations Agile Project Management For Dummies enables you to understand and apply Agile principles for faster, more accurate development.

Scrum For Dummies - Layton, Mark C. (John Wiley & Sons, 2015)
Practice an agile form of management to stop wasting time and money Scrum For Dummies is an easy to use guide to managing the tricky transition from a traditional project management methodology to the new and most popular agile framework. As the most efficient, successful methodology for team project management, Scrum relies on transparency, flexibility, and fluidity to deliver a final product that fulfills the needs of all stakeholders. Written in easy–to–read Dummies style, this book walks you through the core principles of Scrum and provides a roadmap for tangible implementation. The vast majority of projects go over budget, and billions of dollars are wasted every year on overruns. Put a stop to this wasteful leakage by switching to a management style that keeps all participants informed, up–to–date, and accountable. Authored by a Certified Scrum Trainer, Mark Layton, Scrum For Dummies covers the key ideas and processes behind Scrum methodologies, and presents the inner workings of the plan in an engaging and accessible format. Topics include: The Scrum values, roles, artifacts, and activities that make up the principle of this methodology When and how best to use Scrum The differences between Scrum and other agile methodologies Using Scrum for IT, finance, construction, health care, and more The book also delves into the everyday use of Scrum, and how it can help you achieve your own personal goals outside of work. There′s a reason why scrum is quickly becoming the standard approach to project management it works! If you want to stop wasting time and start producing more effectively, Scrum For Dummies is the guide that will get you there.

Applying social learning where ‘business-as-usual’ solutions no longer work for complex problems and programs - Le Borgne, Ewen (CCSL Learning Brief, 2016)
Key messages • Social learning facilitates sharing and learning beyond individuals to networks and systems. Through a facilitated, iterative process of joint work, dialogue and reflection, new shared ways of knowing emerge that lead to changes in practice. • Social learning has real potential to unlock change and transform relationships between actors involved in complex programs and/or dealing with ‘wicked problems’. Adversely it is not advisable to pursue for simple initiatives. • Social learning offers many thematic and pragmatic entry points to be embedded in the CGIAR research programs around partnerships, innovation systems, monitoring and evaluation.

How to manage complexity: four lessons for DFID’s new Secretary of State - LearnAdapt (Medium, 2019)
Lessons for DFID in addressing complex problems without creating complicated, workload heavy programmes.

An analysis of what CLA looks like in Development Programming - Learning Lab (USAID, 2017)

Collaborating, Learning, and Adapting (CLA). Framework and Maturity Matrix Overview - Learning Lab (USAID, 2016)

Collaborating, Learning, and Adapting. Framework & Key Concepts - Learning Lab (USAID, 2016)

Evidence Base for Collaborating, Learning, and Adapting: summary of the literature review (2016.08) - Learning Lab (USAID, 2016)
LEARN and USAID/PPL are managing an area of work known as Evidence Base for Collaborating, Learning, and Adapting (EB4CLA). The purpose of this work is to answer key learning questions:

Evidence Base for Collaborating, Learning, and Adapting: summary of the literature review (2017 update) - Learning Lab (USAID, 2017)
LEARN and USAID/PPL are managing an area of work known as Evidence Base for Collaborating, Learning, and Adapting (EB4CLA). The purpose of this work is to answer key learning questions:

Landscape Analysis of Learing Agendas: USAID/Washington and beyond - Learning Lab (USAID, 2017)
EXECUTIVE SUMMARY U.S. government agencies and development organizations around the world are increasingly recognizing and supporting learning activities— often informed by a learning agenda—as important tools for improving organizational effectiveness and efficiency. A learning agenda comprises a set of broad questions directly related to the work that an agency conducts; when answered, they enable the agency to work more effectively and efficiently, particularly pertaining to evaluation, evidence, and decisionmaking. This report surveys the landscape of learning agendas at USAID and beyond to inform the learning agenda initiative planned by the Office of Learning, Evaluation, and Research (LER) in the Bureau for Policy, Planning and Learning (PPL). Reporting on research conducted over a 6-month period (September 2016 to February 2017), this landscape analysis focuses on six documented, office-, bureau-, or initiative-wide learning agendas being used at USAID/Washington. It also considers 11 new or noteworthy learning initiatives at USAID and five learning efforts at other federal agencies. The research team interviewed 60 staff from 20 USAID offices and bureaus, as well as staff from five other federal agencies. (See Annexes 1 through IV for more information.) The team also convened two focus groups: one with staff in USAID/Washington who had recently returned from serving in Missions, and one with PPL staff who discussed that bureau’s learning activities. The report details the interviewees’ remarks on six topics:  Motivations behind their decisions to pursue a learning agenda, such as expectations of accountability, especially in response to leadership demands  The key benefits emerging from their learning agenda efforts, which have included identifying gaps in knowledge and evidence, and supporting other cultural and organizational change processes  The participatory and consultative strategies they used to engage with stakeholders, including engagement with Mission staff and inclusion of academics and outside experts  The learning activities and products related to their initiatives  Challenges and strategies on resources, dissemination, and utilization, including ways to update their learning agenda to ensure that it remains a “living document”  Recommendations they had for PPL and others considering embarking on a learning agenda initiative

LEARN Monitoring, Evaluation, Research, and Learning Plan - Learning Lab (USAID, 2016)
LEARN and USAID/PPL are managing an area of work known as Evidence Base for Collaborating, Learning, and Adapting (EB4CLA). The purpose of this work is to answer key learning questions:

Learning Lab - Collaborate, Learn and Adapt for better development outcomes - Learning Lab (USAID, 2013)
CLA is: a component of several missions' CDCSes. a conceptual framework for some principles and operational processes that can enable USAID to become a more effective learning organization and thereby a more effective development organization. an approach to facilitating local participation and capacity and promoting country-led development. For more information on CLA visit:

Two Tunes, One Dance: Keeping Programming Agile - Learning Lab (USAID Learning Lab, 2017)

How useful are RCTs in evaluating transparency and accountability projects? - Leavy, Jennifer (IDS, 2014)

The role of social learning in adaptiveness: insights from water management - Lebel, Louis; Grothmann, Torsten; Siebenhüner, Bernd (International Environmental Agreements: Politics, Law and Economics, 2010)
The article introduces the notion of adaptiveness and discusses the role of social learning in it. Adaptiveness refers to the capacity of a social actor or social–ecological system to adapt in response to, or in anticipation of, changes in the environment. We explore arguments both from a theoretical perspective and through illustrations from case studies of water management in the Alps of Europe and Mekong in southeast Asia. We propose and illustrate that social learning processes are important for building adaptiveness in several ways and at different scales. Social learning can help cope with informational uncertainty; reduce normative uncertainty; build consensus on criteria for monitoring and evaluation; empower stakeholders to take adaptive actions; reduce conflicts and identify synergies between adaptations; and improve fairness of decisions and actions. Findings in the case studies provide some support for these generalizations but often with caveats related to diversity of stakeholder interests, levels of shared understanding versus contested knowledge and scale of coordination. For this reason, we suggest that future work pays greater attention to issues of agency, knowledge and scale: What strategies have individuals and organizations pursued in successful examples of social learning? How are the boundaries and interactions between science, policy and practice managed? How does social learning occur across spatial and temporal scales?
Keywords: Adaptation; European Alps; Fairness; Mekong River; Social learning; Uncertainty; Water management

Regional Healthcare Ecosystem Analyst for Healthcare Associated Infections - Lee, Bruce Y. (Grantome, 2018)
Understanding and preventing the spread of both endemic and emerging healthcare-associated infectious diseases throughout hospitals and nursing homes is a national priority. Our work has shown that the many disparate inpatient healthcare facilities in a region can form a complex healthcare ecosystem connected by both direct and indirect patient sharing allowing pathogens in one health care facility to readily spread to other facilities. Our goal is to further develop RHEA (Regional Healthcare Ecosystem Analyst) into a user-friendly software tool that decision makers (e.g., policy makers, funders, product developers and manufacturers, healthcare administrators, infection prevention specialists, researchers, and educators) can readily use to help healthcare ecosystems prevent and control the spread of an endemic pathogen, methicillin- resistant Staphylococcus aureus (MRSA), and an emerging pathogen, carbapenem-resistant Enterobacteriaceae (CRE). This next generation of RHEA will bring multiple innovations by: 1) further elucidating the interconnectedness of the ecosystem and showcasing the value of cooperation among facilities versus the current individual facility approach to infectious disease control, 2) incorporating new healthcare ecosystem responses for endemic MRSA and emerging CRE, 3) continuing our work integrating economic and operational models into a framework of infectious disease epidemiological models, 4) imbuing virtual patients with characteristics linked to MRSA and CRE transmission and outcome risk, 5) building a comprehensive """"""""virtual laboratory"""""""" to help address many existing and future healthcare ecosystem infectious disease questions, and 6) building a user-friendly modeling tool that decision makers can use. The project will continue our team's longstanding modeling work and developing computational tools for decision makers via three specific aims. First, completing Specific Aim 1 will expand RHEA by adding the following capabilities: i) integrated clinical outcome and economic models, ii) more extensive and detailed patient characteristics linked to changes in infection risk and costs, iii) expanded HAI control measures, and iv) stochastic and adaptive disease parameters to represent emerging and evolving diseases. Next, Specific Aim 2 will use our newly expanded RHEA framework to model a sample endemic pathogen, MRSA, and a sample emerging pathogen, CRE to identify optimal control strategies even when pathogen characteristics are evolving. Finally, Specific Aim 3 will involve developing a user-friendly interface for RHEA and deploying it as a healthcare ecosystem computational modeling tool that various stakeholders (e.g., policy makers, healthcare administrators, infection control specialists, funders, and product manufacturers) can readily use to make decisions regarding the control of healthcare-associated infections. Public Health Relevance Understanding and preventing the spread of healthcare-associated infectious diseases throughout hospitals and nursing homes is a national priority. Simulation models can serve as virtual laboratories to help identify best practice solutions for containing common [such as methicillin-resistant Staphylococcus aureus (MRSA)] and emerging [e.g., carbapenem-resistant Enterobacteriaceae (CRE)] causes of healthcare associated infections (HAIs). Our goal is to develop our software RHEA (Regional Healthcare Ecosystem Analyst) into a computational modeling tool that can be used directly by decision makers to identify, develop, and evaluate strategies and interventions to reduce HAIs across a large geographic region.

Before the Backlash, Let’s Redefine User-Centered Design - Lee, Panthea (Stanford Social Innovation Review, 2015)
We must better understand user-centered design’s limitations—not just its strengths—in the context of international development. And we must adapt it from its original uses designing commercial products to solving for social good.

Moving from Real-Time Data to Real-Time Programs - Lee, Panthea (Reboot, 2016)
How can we avoid drowning in data to actually make better decisions?
Keywords: IMPORTANT

Thinking and Working Politically: What does it mean, Why is it important and How do you do it? - Leftwich, Adrian (Politics, Leadership and Coalitions in Development: Policy Implications of the DLP Research Evidence, Research and Policy Workshop, 2011)
This paper suggests that working politically in a developmental context means directing attention and support to the agents of reform and development (leaders and organisations). This allows investment in the local processes that will resolve problems – such as problems of collective action – through the work of alliances and coalitions. Hence, it will drive the formation and consolidation of the locally appropriate, feasible and legitimate institutions that are most likely to advance development outcomes. The Developmental Leadership Program defines politics as the pervasive, unavoidable and necessary activities of conflict, negotiation and compromise involved in group decision-making about how resources are to be used, produced and distributed. Thinking politically means understanding that both political and technical dimensions are central to developmental outcomes. It also means: Understanding that ‘agency’ matters. That is, that people have the potential to change things, but always withhin the context of given institutional arrangements, which contain both constraints and opportunities. Leaders, organisations and followers think, strategise and attempt to resolve problems in different ways in the same contexts. Understanding leadership as a political process that mobilises people and resources in support of a goal: leaders seldom work on their own. Realising that overcoming collective action problems is a major challenge of development. Collective action problems occur when people with diverse (often competing) interests struggle to agree on an organisational arrangement from which they would all benefit. Understanding that coalitions (formal or informal) are a crucial political mechanism for the resolution of collective action problems. Paying attention to the detailed inner politics of regimes, sectors or issues (‘micro-politics’). This includes understanding who the players are, where they come from, their organisational affiliations, ideologies and interests and the political dynamics involved. (Many political analysis tools are inadequate for this level of detail.) Recognising that processes are as important as projects in development, and vary from context to context. Working politically in development means supporting, brokering, facilitating and aiding the emergence and practices of (public or private) developmental or reform leaderships, organisations, networks and coalitions at any level, and across all sectors. It means helping them to respond to, and work with, initiatives and requests from local individuals and groups. Working politically can also involve: Investing in the effectiveness of developmental coalitions by enhancing the political capacity of organisations in negotiation, advocacy, communication and the generation of constructive policy options. Rethinking higher educational support programmes so that they supplement a skills focus with strategies that help to build networks, and encourage the understanding of collective action problems and of the importance of providing public goods. Acquiring a deep and detailed knowledge of, and long-term exposure to, the country or issue concerned. Respectful and sensitive understanding of local political dynamics and cultural norms. Employing more social scientists and a well-trained, politically savvy workforce, both local and international, with the capacity to ‘read’ the politics. In particular, coalitions can help drive the endogenous politics of developmental reforms by: 1) achieving a specific policy goal; 2) opening up debate on a previously taboo issue; 3) deepening and strengthening the coalition’s internal organisation and relationships for future purposes; and 4) increasing the capacity of constituent organisations. It is also important to understand that: Developmental leaderships and coalitions often emerge in response to a critical juncture – a threat, challenge or danger – or a new opportunity. What matters is whether leaders have the knowledge, education, vision, prior experience and networks to seize such opportunities. The character and conditionality of funding by donors or supporters can make or break a coalition. Are tight conditions applied? Are funding arrangements transparent?

Scenario-based strategizing: Advancing the applicability in strategists' teams - Lehr, Thomas; Lorenz, Ullrich; Willert, Markus; Rohrbeck, René (Technological Forecasting and Social Change, 2017)
For over 40years, scenarios have been promoted as a key technique for forming strategies in uncertain environments. However, many challenges remain. In this article, we discuss a novel approach designed to increase the applicability of scenario-based strategizing in top management teams. Drawing on behavioural strategy as a theoretical lens, we design a yardstick to study the impact of scenario-based strategizing. We then describe our approach, which includes developing scenarios and alternative strategies separately and supporting the strategy selection through an integrated assessment of the goal-based efficacy and robustness. To facilitate the collaborative strategizing in teams, we propose a matrix with robustness and efficacy as the two axes, which we call the Parmenides Matrix. We assess the impact of the novel approach by applying it in two cases, at a governmental agency (German Environmental Ministry) and a firm affected by disruptive change (Bosch, leading global supplier of technology and solutions).
Keywords: Behavioural strategy; Scenario-based strategizing; Scenarios; Strategic foresight; Uncertainty

Evaluating megaprojects: From the ‘iron triangle’ to network mapping - Lehtonen, Markku (Evaluation, 2014)
Evaluation literature has paid relatively little attention to the specific needs of evaluating large, complex industrial and infrastructure projects, often called ‘megaprojects’. The abundant megaproject governance literature, in turn, has largely focused on the so-called ‘megaproject pathologies’, i.e. the chronic budget overruns, and failure of such projects to keep to timetables and deliver the expected social and economic benefits. This article draws on these two strands of literature, identifies shortcomings, and suggests potential pathways towards an improved evaluation of megaprojects. To counterbalance the current overemphasis on relatively narrowly defined accountability as the main function of megaproject evaluation, and the narrow definition of project success in megaproject evaluation, the article argues that conceptualizing megaprojects as dynamic and evolving networks would provide a useful basis for the design of an evaluation approach better able to promote learning and to address the socio-economic aspects of megaprojects. A modified version of ‘network mapping’ is suggested as a possible framework for megaproject evaluation, with the exploration of the multiple accountability relationships as a central evaluation task, designed to reconcile learning and accountability as the central evaluation functions. The article highlights the role of evaluation as an ‘emergent’ property of spontaneous megaproject ‘governing’, and explores the challenges that this poses to the role of the evaluator.

Transforming governance: how can technology help reshape democracy? - Leighninger, Matt (Institute of Development Studies, 2016)
Around the world, people are asking how we can make democracy work in new and better ways. We are frustrated by political systems in which voting is the only legitimate political act, concerned that many republics don’t have the strength or appeal to withstand authoritarian figures, and disillusioned by the inability of many countries to address the fundamental challenges of health, education and economic development. If we want to create democracies in which citizens have meaningful roles in shaping public decisions and solving public problems, we should be asking a number of questions about civic tech, including: • How can online tools best support new forms of democracy? • What are the examples of how this has happened? • What are some variables to consider in comparing these examples? • How can we learn from each other as we move forward? This background note has been developed to help democratic innovators explore these questions and examine how their work can provide answers.

Narrowing the climate information usability gap - Lemos, Maria Carmen; Kirchhoff, Christine J.; Ramprasad, Vijay (Nature Climate Change, 2012)
Climate-change-related risks pose serious threats to the management of a wide range of social, economic and ecological systems. Managing these risks requires knowledge-intensive adaptive management and policy-making actively informed by scientific knowledge, especially climate science1. However, potentially useful climate information often goes unused1,2. This suggests a gap between what scientists understand as useful information and what users recognize as usable in their decision-making. We propose a dynamic conceptual model to address this gap and highlight strategies to move information from useful to usable to reduce climate-related risks.

The Patterning Instinct: A Cultural History of Humanity's Search for Meaning - Lent, Jeremy (Prometheus Books, 2017)
This fresh perspective on crucial questions of history identifies the root metaphors that cultures have used to construct meaning in their world. It offers a glimpse into the minds of a vast range of different peoples: early hunter-gatherers and farmers, ancient Egyptians, traditional Chinese sages, the founders of Christianity, trail-blazers of the Scientific Revolution, and those who constructed our modern consumer society. Taking the reader on an archaeological exploration of the mind, the author, an entrepreneur and sustainability leader, uses recent findings in cognitive science and systems theory to reveal the hidden layers of values that form today's cultural norms. Uprooting the tired cliches of the science-religion debate, he shows how medieval Christian rationalism acted as an incubator for scientific thought, which in turn shaped our modern vision of the conquest of nature. The author probes our current crisis of unsustainability and argues that it is not an inevitable result of human nature, but is culturally driven: a product of particular mental patterns that could conceivably be reshaped. By shining a light on our possible futures, the book foresees a coming struggle between two contrasting views of humanity: one driving to a technological endgame of artificially enhanced humans, the other enabling a sustainable future arising from our intrinsic connectedness with each other and the natural world. This struggle, it concludes, is one in which each of us will play a role through the meaning we choose to forge from the lives we lead.

Smart Risks: How small grants are helping to solve some of the world's biggest problems - Lentfer, Jennifer; Cothran, Tanya (Practical Action Publishing, 2017)
As never before, international aid is in the hands of ordinary people. Concerned citizens in wealthy countries are starting philanthropy groups, joining giving circles, and travelling internationally to lend support. Yet, they are torn between the feelings that 'something' must be done about global poverty and that foreign assistance is creating dependency and fueling corruption overseas.A growing community of international small grant-makers know how to find and fund effective grassroots initiatives. Compared to donor-controlled, large-scale, project-based international aid funding, small grant-makers use the concept of 'smart risks' to build upon existing human and social capital and to make a lasting changes in people's lives. Smart Risks brings together the wisdom of experts with wide-ranging experience within the development sector. Their contributions focus on five guiding question, such as 'who is a smart risk?' and 'what is your role in smart risks?' They include case studies, personal stories of lessons learned over time, provocative insights on power and privilege, and practical frameworks for choosing, investing in, and measuring the impact of grassroots organizations and movements. This book is essential reading for all those who wonder how their donations and work can make a difference in developing countries - from aid agency staff and policy makers, to globally engaged individuals.

Steering E-Government Projects from Failure to Success: Using Design-Reality Gap Analysis as a Mid-Implementation Assessment Tool - Lessa, Lemma; Negash, Solomon; Belachew, Mesfin (Emerging Issues and Prospects in African E-Government:, 2014)
There are many e-government failures in developing countries. Most studies look at these after the event (post hoc), but this chapter takes an original approach to look mid-implementation (durante hoc) in order to provide recommendations for improvement. The authors chose a partial failure/partial success land management information system being implemented in one Ethiopian city. The project has made retrieval of land information quicker and simpler but is only partly implemented, and is still—on occasion—circumvented by public servants for personal gain. They used design-reality gap framework to understand why the project had partly failed. The authors used the design-reality gap analysis to propose an action plan that would help institutionalise the system, steering it from partial failure to success. They demonstrate the value of this framework as a tool for mid-implementation analysis of e-government projects. The authors recommend its usage on other ongoing e-government projects in developing countries.

The landscape of innovation approaches - Leurs, Bas (States of Change, 2018)
An overview of innovation methods and approaches we’ve come across in government innovation practice.

Playbook for innovation learning. 35 diagrams to support talking and thinking about learning for innovation - Leurs, Bas; Roberts, Isobel (Nesta, 2018)

Reflections on the Utilization-Focused Evaluation (UFE) Process - Lim, Yvonne; Mizumoto, Ann (Strengthening ICTD Research Capacity in Asia (SIRCA) Programme, 2010)
This presentation from the Strengthening ICTD Research Capacity in Asia (SIRCA) provides an overview of how UFE was used in their SIRCA programme. It was presented at the Evaluation Conclave 2010, New Delhi, India The key objectives of the program are to: Enhance research capacity in Asia through rigorous academic research Create a space for dialogue on ICT4D social science research issues in Asia Create linkages through a mentorship program Disseminate findings in publications and conferences Contents SIRCA Programme SIRCA Key Objectives SIRCA Evaluation UFE Learnings UFE Challenges Evaluation is over…but there’s a lasting outcome...

Are unmanned aircraft systems (UASs) the future of wildlife monitoring? A review of accomplishments and challenges - Linchant, Julie; Lisein, Jonathan; Semeki, Jean; Lejeune, Philippe; Vermeulen, Cédric (Mammal Review, 2015)
Regular monitoring of animal populations must be established to ensure wildlife protection, especially when pressure on animals is high. The recent development of drones or unmanned aircraft systems (UASs) opens new opportunities. UASs have several advantages, including providing data at high spatial and temporal resolution, providing systematic, permanent data, having low operational costs and being low-risk for the operators. However, UASs have some constraints, such as short flight endurance. We reviewed studies in which wildlife populations were monitored by using drones, described accomplishments to date and evaluated the range of possibilities UASs offer to provide new perspectives in future research. We focused on four main topics: 1) the available systems and sensors; 2) the types of survey plan and detection possibilities; 3) contributions towards anti-poaching surveillance; and 4) legislation and ethics. We found that small fixed-wing UASs are most commonly used because these aircraft provide a viable compromise between price, logistics and flight endurance. The sensors are typically electro-optic or infrared cameras, but there is the potential to develop and test new sensors. Despite various flight plan possibilities, mostly classical line transects have been employed, and it would be of great interest to test new methods to adapt to the limitations of UASs. Detection of many species is possible, but statistical approaches are unavailable if valid inventories of large mammals are the purpose. Contributions of UASs to anti-poaching surveillance are not yet well documented in the scientific literature, but initial studies indicate that this approach could make important contributions to conservation in the next few years. Finally, we conclude that one of the main factors impeding the use of UASs is legislation. Restrictions in the use of airspace prevent researchers from testing all possibilities, and adaptations to the relevant legislation will be necessary in future.
Keywords: detection; drone; survey; wildlife

You might not be as agile as you think you are - Lindpaintner, Julia; Rivera, Stephanie (18F, 2019)
The mandate to be agile is everywhere. But agile isn’t an on-off switch. It’s a skill and a mindset that is developed over time, through dedicated work, open teams, and lots (and lots) of practice

Livelihoods in the Za'atari Camp: Impact evaluation of Oxfam’s Cash for Work activities in the Za’atari camp (Jordan) - Lombardini, Simone; Mager, Franziska (http://hdl.handle.net/10546/620883, 2019)

Thinking and Working Politically: Lessons from FOSTER in Nigeria - Lopez Lucia, Elisa; Buckley, Joanna; Marquette, Heather; McCulloch, Neil (DLP Program, 2017)
The Facility for Oil Sector Transparency and Reform (FOSTER) was a £14 million programme that has helped Nigeria to transform its governance of the oil and gas industry. FOSTER ran from 2011 to mid-2016, and used an explicit ‘thinking and working politically’ (TWP) approach. It was funded by the UK Department for International Development (DFID) and managed by Oxford Policy Management (OPM). This paper seeks to identify the factors that drove – or constrained – FOSTER’s achievements, and asks what this can tell us about TWP, particularly in challenging political and sectoral contexts. FOSTER sought to help strengthen oversight and accountability in Nigeria’s oil sector. It aimed to support reformers within government institutions that ‘supply’ accountability (those governing how oil and gas revenues are collected and managed), and to support civil society organisations, parliament, the media and the Nigeria Extractive Industries Transparency Initiative to ‘demand’ reform. In addition, FOSTER commissioned a series of studies and provided media training to help broaden understanding of the sector and highlight the need for reform. This paper examines the outcomes from five ‘clusters’ of FOSTER interventions. The FOSTER team viewed the first three of these in the list below as successful, whereas the latter two did not deliver on expectations but offer important opportunities for learning: • Support to the Nigerian Extractive Industries Transparency Initiative • Support to demand-side actors to promote transparency and accountability in the oil sector • Support for the passage of the Petroleum Industry Bill • An oil spill-mapping social media project • Support to the Department of Petroleum Resources The analysis drew on 44 semi-structured interviews conducted during a month of fieldwork in Abuja and Lagos; on reviews of the programme’s monitoring, evaluation and learning frameworks; and on newspaper articles and grey literature on Nigeria’s oil sector.2

Reciprocity in International Volunteer Cooperation - Lough, Benjamin J. (Fredskorpset Norway, 2016)

When Does the State Listen? - Loureiro, Miguel; Cassim, Aalia; Darko, Terence; Katera, Lucas; Salome, Nyambura (IDS Bulletin, 2016)

Exploring the new world: practical insights for funding, commissioning and managing in complexity - Lowe, Toby; Plimmer, Dawn (Collaborate & Newcastle University, 2019)
The world is complex. If we want to contribute to creating positive social outcomes, we must learn to embrace this complexity. This is the New World that funders and commissioners are discovering: • People are complex: everyone’s life is different, everyone’s strengths and needs are different. • The issues we care about are complex: issues – like homelessness – are tangled and interdependent. • The systems that respond to these issues are complex: the range of people and organisations involved in creating ‘outcomes’ in the world are beyond the management control of any person or organisation. Building on the findings from our previous report, A Whole New World, we have spent the last 12 months working with a growing movement of funders, public sector commissioners, and organisations working on the ground to begin to explore this New World: to find examples of practice that will help people to navigate it effectively. This report explores the key features of their response: working in a way that is human, prioritises learning and takes a systems approach.

Real Time Monitoring and the New Information Technologies - Lucas, Henry; Batchelor, Simon; Berdou, Evangelia (IDS Bulletin, 2013)
Debates as to the potential role of new Information and Communication Technologies (ICTs) in monitoring the wellbeing of vulnerable groups is often bedevilled by the failure of two principal actors – social researchers and technical experts – to address the other’s concerns or even to use language that is comprehensible to the other side. The aim here is to unpick some of the technical language relevant in this context and provide a brief introductory guide to some aspects of the current, rapidly changing and highly diverse ICT environment.

Rethinking Rigor - Increasing Credibility and Use - Lynn, Jewlya; Preskill, Hallie (Spark Policy Institute & FSG, 2016)
Evaluations of complex systems change strategies or adaptive, innovative programs cannot use the traditional “rigor” yardstick to measure quality. This paper proposes a new definition of rigor, one that applies in any setting, but particularly in complex, adaptive ones. Top Takeaways: 4 criteria for the new definition of rigor: - Quality of thinking - Credible and legitimate claims - Cultural context and responsiveness - Quality and value of the learning process Regardless of its other positive attributes, an evaluation of a complex, adaptive program that fails to take into account systems thinking will not be responsive to the needs of that program.

Towards transformative social learning on the path to 1.5 degrees - Macintyre, Thomas; Lotz-Sisitka, Heila; Wals, Arjen; Vogel, Coleen; Tassone, Valentina (Current Opinion in Environmental Sustainability, 2018)

What is a Theory of Change? Really. - Mack, Katelyn (FSG, 2015)
Recently thousands of evaluators came together in Chicago to celebrate the growing field, share exemplary practices, and to push our collective thinking on how evaluation responds to the complexity of social change efforts.

Impact evaluation for portfolio programmes on policy influence: Reflections on the Indonesian Poverty Reduction Support Facility - Mackenzie, Jessica; Hearn, Simon (Methods Lab, 2016)
• Donors are increasingly using portfolio-based programmes that embrace ‘good failure’ and adaptive, political programming. • However, measuring the impact of these programmes is challenging, especially for those working on policy influence and building country systems; not only do you need to measure the positive and negative impact of the overall portfolio, but also the different pathways tested. • Programmes, therefore, need a light-touch monitoring and evaluation system that allows it to remain flexible. • Good practice examples of portfolio-based programmes present six strategies to evaluate impact: 1. Develop appropriate logic models 2. Collect observational data throughout implementation 3. Develop stories of change or case studies 4. Understand causal relationships without a counterfactual 5. Purposefully select which activities to study 6. Be explicit about how impact will be valued across the portfolio. • These strategies are only useful if monitoring and evaluation is placed at the centre of programme decision-making.

Adaptive Management in Practice: a case study on the Prospects program - Maclay, Chris (Mercy Corps, 2016)
Recognising that aid and development programming takes place in complex contexts, Mercy Corps is increasingly seeking to understand how best to manage programs which iterate, adapt and respond to the consistently evolving settings in which we work. This brief Practice Paper provides some examples of what adaptive management looks like in practice on the Prospects youth employment program in Liberia. It does not seek to function as a manual or set of guidelines, but simply provides some practical examples and insights into how a youth employment program governed by principles of adaptive management operates.

Management not models: adaptability, responsiveness, and a few lessons from football - Maclay, Christopher (Development in Practice, 2015)
Despite a swathe of critiques of logframes and other blueprint approaches to development over the last 30 years, most aid infrastructure continues to concentrate on the design and subsequent implementation of closed models. This article does not propose an alternative to blueprints, but challenges the inflexibility of their implementation, which is inadequate given the complex nature of social change. It proposes a supplementary management and learning approach which enables implementers to be dynamic, adaptive, and responsive to problems and opportunities. Emphasising the role of donors, the paper presents a case study of one donor-led programme in Bangladesh doing just this.
Publisher: Routledge _eprint: https://doi.org/10.1080/09614524.2015.983460

The Appearance of Accountability: Communication Technologies and Power Asymmetries in Humanitarian Aid and Disaster Recovery - Madianou, Mirca; Ong, Jonathan Corpus; Longboan, Liezel; Cornelio, Jayeel S. (Journal of Communication, 2016)
New communication technologies are celebrated for their potential to improve the accountability of humanitarian agencies. The response to Typhoon Haiyan in 2013 represents the most systematic implementation of “accountability to affected people” initiatives. Drawing on a year-long ethnography of the Haiyan recovery and 139 interviews with humanitarian workers and affected people, the article reveals a narrow interpretation of accountability as feedback that is increasingly captured through mobile phones. We observe that the digitized collection of feedback is not fed back to disaster-affected communities, but is directed to donors as evidence of “impact.” Rather than improving accountability to affected people, digitized feedback mechanisms sustained humanitarianism's power asymmetries.
Keywords: Accountability; Audit; Communication for Development; Disasters; Ethnography; ICT4D; Mobile phones; Participatory Communication; SMS; Texting; humanitarianism

Implementation of the first adaptive management plan for a European migratory waterbird population: The case of the Svalbard pink-footed goose Anser brachyrhynchus - Madsen, Jesper; Williams, James Henty; Johnson, Fred A.; Tombre, Ingunn M.; Dereliev, Sergey; Kuijken, Eckhart (Ambio, 2017)
An International Species Management Plan for the Svalbard population of the pink-footed goose was adopted under the Agreement on the Conservation of African-Eurasian Migratory Waterbirds in 2012, the first case of adaptive management of a migratory waterbird population in Europe. An international working group (including statutory agencies, NGO representatives and experts) agreed on objectives and actions to maintain the population in favourable conservation status, while accounting for biodiversity, economic and recreational interests. Agreements include setting a population target to reduce agricultural conflicts and avoid tundra degradation, and using hunting in some range states to maintain stable population size. As part of the adaptive management procedures, adjustment to harvest is made annually subject to population status. This has required streamlining of monitoring and assessment activities. Three years after implementation, indicators suggest the attainment of management results. Dialogue, consensus-building and engagement among stakeholders represent the major process achievements.
Keywords: Adaptive harvest management; Human–wildlife conflict; Population target; Stakeholder involvement; Structured decision-making; Tundra degradation

The good and the ‘not so good’ of our experiences with SenseMaker - Mager, Franziska (Oxfam Views & Voices, 2019)
When we purchased a license for the SenseMaker research method in early 2017 (a proprietary data collection and analysis software), the excitement in our more “geeky” teams was palpable. SenseMaker ... Read More

How Decent is Decent Work? Using SenseMaker to understand workers’ experiences - Mager, Franziska; Smith, Becca; Gujit, Irene (Oxfam, 2018)

Wheeling in the Trojan Mice - Mahendra, Jackie (Stanford Social Innovation Review, 2016)
One way to make risk-taking more palatable for social change organizations is to run small, light, nimble experiments––tests not built to win wars, but rather to quickly infiltrate new territory, attack new problems, and inform future tactics.

Improving the Measurement of Civic Space - Malena, Carmen (Transparency & Accountability Initiative, 2015)
‘Civic space’ – i.e. the freedom and means to speak, access information, associate, organise, and participate in public decision-making – is essential to the healthy functioning and development of any society and a precondition for accountable governance and social justice. When civic space is restricted, human and civil rights are denied, government accountability is jeopardised, …

Localizing Development : Does Participation Work? - Mansuri, Ghazala; Rao, Vijayendra (Washington, DC: World Bank, 2013)
The Policy Research Report Localizing Development: Does Participation Work? brings analytical rigor to a field that has been the subject of intense debate and advocacy, and billions of dollars in development aid. It briefly reviews the history of participatory development and argues that its two modalities, community-based development and local decentralization, should be treated under the broader unifying umbrella of local development. It suggests that a distinction between organic participation (endogenous efforts by civic activists to bring about change) and induced participation (large-scale efforts to engineer participation at the local level via projects) is key, and focuses on the challenges of inducing participation. The report provides a conceptual framework for thinking about participatory development and then uses this framework to conduct a comprehensive review of the literature. The framework develops the concept of “civil society failure” and explains its interaction with government and market failures. It argues that participatory development, which is often viewed as a mechanism for bypassing market and government failures by ”harnessing” civic capacity, ought to be seen instead as a mechanism that, if done right, could help to repair important civil society failures. It distills literature from anthropology, economics, sociology, and political science to outline the challenges for effective policy in this area, looking at issues such as the uncertainty of trajectories of change, the importance of context, the role of elite capture and control, the challenge of collective action, and the role of the state. The review of the evidence looks at a variety of issues: the impact of participatory projects on inclusion, civic capacity, and social cohesion; on key development outcomes, such as income, poverty, and inequality; on public service delivery; and on the quality of local public goods. It draws on the evidence to suggest several recommendations for policy, emphasizing the key role of learning-by-doing. It then reviews participatory projects funded by the World Bank and finds the majority lacking in several arenas – particularly in paying attention to context and in creating effective monitoring and evaluation systems that allow for learning.

Case study: Embedding reform and exiting: LASER’s application of the hourglass approach to achieve sustainable results - Manuel, Clare (DFID-LASER Programme, 2016)
This case study describes how LASER has gone about enabling systemic change and sustainable uptake of reforms that address complex institutional problems in Kenya, Rwanda, Sierra Leone, Somaliland and Uganda. In each of these countries LASER has designed-in a sustainable approach from the start based on: (i) local ownership and leadership of reforms based on developing country (rather than donor) priorities; (ii) use of country (rather than donor programme) systems; and (iii) an understanding that the role of the donor / development practitioner is to support (rather than buy) reform. The case study uses LASER’s hour glass methodology, illustrated with examples from LASER interventions, to show how these principles guide LASER operations every step of the way.
Keywords: IMPORTANT; Practice

Delivering institutional reform at scale: Problem-driven approaches supported by adaptive programming - Manuel, Clare (DFID-LASER Programme, 2016)
LASER synthesis papers aim to help donors and other stakeholders better understand why and how to approach investment climate reform programming differently. The papers reflect emerging best practice and lessons learnt on what works and what does not work in doing development differently. The papers have been peer-reviewed by experts in the field including senior advisers at DFID, World Bank, IFC and the Donor Committee for Enterprise Development (amongst others). Second synthesis paper - Delivering institutional reform at scale: problem-driven approaches supported by adaptive programming February 2016 Drawing on our experience on the ground, this peer-reviewed paper suggests how problem driven approaches, supported by adaptive programme management can be implemented at scale in relation to donor programming aimed at institutional reform and improving state capability.
Keywords: IMPORTANT

Forget the money: De-linking technical assistance - Manuel, Clare (DFID-LASER Programme, 2016)

Investment Climate Reform: Doing it Differently - Manuel, Clare (DFID-LASER Programme, 2015)
LASER synthesis papers aim to help donors and other stakeholders better understand why and how to approach investment climate reform programming differently. The papers reflect emerging best practice and lessons learnt on what works and what does not work in doing development differently. The papers have been peer-reviewed by experts in the field including senior advisers at DFID, World Bank, IFC and the Donor Committee for Enterprise Development (amongst others). First synthesis paper - Investment climate reform: doing it differently June 2015 Drawing on our experience in taking a problem-focused approach to investment climate reform, we discuss in this peer-reviewed paper emerging lessons and reflections on what works, both in recent literature and in practical experience.

Analysis of the factors affecting the sustainability of ICT4D initiatives - Marais, Mario (IDIA2011 Conference Proceedings, 2011)

ICT4D and Sustainability - Marais, Mario (The International Encyclopedia of Digital Communication and Society, 2015)

Who is ICT innovation for? Challenges to existing theories of innovation, a Kenyan Case Study - Marchant, Eleanor (University of Pennsylvania, 2015)
Keywords: IMPORTANT

What we’re missing by not getting our TWP alphabet straight - Marquette, Heather (From Poverty to Power, 2019)
Heather Marquette grapples with aid's alphabet soup, and explains why DDD, TWP, PDIA etc are different and why that matters

Small-scale farmers in a 1.5°C future: The importance of local social dynamics as an enabling factor for implementation and scaling of climate-smart agriculture - Martinez-Baron, Deissy; Orjuela, Guillermo; Renzoni, Giampiero; Loboguerrero Rodríguez, Ana María; Prager, Steven D (Sustainability governance and transformation 2018, 2018)
Climate-smart agriculture (CSA) has the potential to help farmers implement both adaptation and mitigation practices. The mitigation aspect of CSA is often not considered by farmers due to a high discount rate and, as such, adaptation is usually the priority concern. This review article offers perspective on this issue and highlights two key gaps in the literature: (i) understanding of factors related to the uptake of adaptation practices with co-benefits for mitigation and, (ii) the role of social networks to better enable rapid, widespread implementation of CSA, the latter being critical to bringing CSA to scale. The systematic review treated literature on synergies between adaptation, mitigation and social networks in the rural sector, as well as case studies illustrating the importance of social networks in climate change interventions when addressing synergies in adaptation and mitigation. We find that additional research is required that explicitly focuses on how social networks and social capital may be harnessed to hasten the adoption and uptake of highly synergistic CSA practices. This will facilitate both adaptation in the near term and contribute to mitigation at scale, allowing small-scale farmers to both benefit from and contribute to a 1.5°C future.

Q&A: Complexity-Aware Planning for Stabilization Programming - Martins, Christy (DAI - Checkpoint, 2018)

The origins, development, and application of Qualitative Comparative Analysis: the first 25 years - Marx, Axel; Rihoux, Benoît; Ragin, Charles (European Political Science Review, 2014)
A quarter century ago, in 1987, Charles C. Ragin published The Comparative Method, introducing a new method to the social sciences called Qualitative Comparative Analysis (QCA). QCA is a comparative case-oriented research approach and collection of techniques based on set theory and Boolean algebra, which aims to combine some of the strengths of qualitative and quantitative research methods. Since its launch in 1987, QCA has been applied extensively in the social sciences. This review essay first sketches the origins of the ideas behind QCA. Next, the main features of the method, as presented in The Comparative Method, are introduced. A third part focuses on the early applications. A fourth part presents early criticisms and subsequent innovations. A fifth part then focuses on an era of further expansion in political science and presents some of the main applications in the discipline. In doing so, this paper seeks to provide insights and references into the origin and development of QCA, a non-technical introduction to its main features, the path travelled so far, and the diversification of applications.

Innovating for pro-poor services: why politics matter - Mason, Nathaniel; Doczi, Julian; Cummings, Clare (2016)
This report addresses how politics matter for innovations. How politically smart approaches can help deliver access to services.

Local Empowerment Through Rapid Results - Matta, Nadim; Morgan, Peter (Stanford Social Innovation Review, 2011)
Why local ownership and commitment are the exception in most development efforts—and what development professionals can do about this problem.

Supporting users with the OutNav approash - Matter of Focus (2019)
This report has been generated in OutNav, using the theory-based approach to evaluation pioneered by Matter of Focus. Example of a report from the tool, explaining OutNav approach

Learning, Adaptation & Change: the future of Making All Voices Count - MAVC (Making All Voices Count, 2014)
Learning, Adaptation & Change: what Making All Voices Count has learned since September 2013 and how the programme will adapt and change in the future.

Developing and Using Useful ToCs - Mayne, John (2018)
Developing useful theories of change (ToCs) for anintervention, especially complex interventions, is not straightforward nor something done in a couple of hourswith limited effort. Agreement is needed on a number of basic concepts and terms, key challenges need to be addressed, and there are numerous issues that need to be considered.Butthe effort is worth the investment of resources and time.Theory-based evaluation approaches need good ToCs.Some of the ideas here are discussed in the context of agricultural research for nutrition and health interventions by Mayne and Johnson (2015) (10) Developing and Using Useful ToCs. Available from: https://www.researchgate.net/publication/323868372_Developing_and_Using_Useful_ToCs [accessed Jun 13 2018].

Mayne18-Developing Useful ToCs REV3 - Mayne, John (2019)
An update on the previous September 2018 uploaded article

The COM-B Theory of Change Mode - v.5 - Mayne, John (Palladium, 2019)
ResearchGate is a network dedicated to science and research. Connect, collaborate and discover scientific publications, jobs and conferences. All for free.

Theory of Change Analysis: Building Robust Theories of Change - Mayne, John (Canadian Journal of Program Evaluation, 2017)
Models for theories of change vary widely as do how they are used. What constitutes a good or robust theory of change has not been discussed much. This article sets out and discusses criteria for robust theories of change. As well, it discusses how these criteria can be used to undertake a vigorous assessment of a theory of change. A solid analysis of a theory of change can be extremely useful, both for designing or assessing the designs of an intervention as well as for the design of monitoring regimes and evaluations. The article concludes with a discussion about carrying out a theory of change analysis and an example.

Useful Theory of Change Models - Mayne, John (Canadian Journal of Program Evaluation, 2015)
Although theories of change are frequently discussed in the evaluation literature and there is general agreement on what a theory of change is conceptually, there is actually little agreement beyond the big picture of just what a theory of change comprises, what it shows, how it can be represented, and how it can be used. This article outlines models for theories of change and their development that have proven quite useful for both straightforward and more complex interventions. The models are intuitive, flexible, and well-defined in terms of their components, and they link directly to rigorous models of causality. The models provide a structured framework for developing useful theories of change and analyzing the intervention they represent.

Using evidence to influence policy: Oxfam’s experience - Mayne, Ruth; Green, Duncan; Guijt, Irene; Walsh, Martin; English, Richard; Cairney, Paul (Palgrave Communications, 2018)
Policymaking is rarely ‘evidence-based’. Rather, policy can only be strongly evidence-informed if its advocates act effectively. Policy theories suggest that they can do so by learning the rules of political systems, and by forming relationships and networks with key actors to build up enough knowledge of their environment and trust from their audience. This knowledge allows them to craft effective inﬂuencing strategies, such as to tell a persuasive and timely story about an urgent policy problem and its most feasible solution. Empirical case studies help explain when, how, and why such strategies work in context. If analysed carefully, they can provide transferable lessons for researchers and advocates that are seeking to inform or inﬂuence policymaking. Oxfam Great Britain has become an experienced and effective advocate of evidence-informed policy change, offering lessons for building effective action. In this article, we combine insights from policy studies with speciﬁc case studies of Oxfam campaigns to describe four ways to promote the uptake of research evidence in policy: (1) learn how policymaking works, (2) design evidence to maximise its inﬂuence on speciﬁc audiences, (3) design and use additional inﬂuencing strategies such as insider persuasion or outsider pressure, and adapt the presentation of evidence and inﬂuencing strategies to the changing context, and (4) embrace trial and error. The supply of evidence is one important but insufﬁcient part of this story.

Collaborative geomatics and the Mushkegowuk Cree First Nations: Fostering adaptive capacity for community-based sub-arctic natural resource management - McCarthy, Daniel D. P.; Whitelaw, Graham S.; Anderson, Scott; Cowan, Donald; McGarry, Fred; Robins, Anthony; Gardner, Holly L.; Barbeau, Christine D.; Charania, Nadia A.; General, Zachariah; Liedtke, Jeff; Sutherland, Celine; et al. (Geoforum, 2012)
The remote First Nation (FN) communities of the Mushkegowuk Territory on the west coast of James Bay, Ontario, Canada are currently facing increased development pressures and the imposition of a government land use planning process. The land use planning process is mandated in the Far North Act (received Royal Assent on September 23, 2010). There is a need for capacity enhancement for community-based natural resource planning and management in the Territory. A number of frameworks are emerging for addressing change brought on by resource development and building resilience to such change at the community level. Among these include the concept of adaptive capacity. In collaboration with FN community leaders, we explored the use of “collaborative geomatics” tools to foster adaptive capacity. Our action research suggests that collaborative geomatics technologies should enhance the Mushkegowuk First Nations’ adaptive capacity to address environmental and policy change by allowing them to collect and manage data collaboratively (e.g., traditional environmental knowledge, western science) to create opportunities for innovative community development, including natural resource development and management.
Keywords: Adaptive capacity; Collaborative geomatics; Community development; Cree communities; Land use plans

Team of Teams: New Rules of Engagement for a Complex World - McChrystal, General Stanley; Silverman, David; Collins, Tantum; Fussell, Chris (Portfolio Penguin, 2015)
As commander of Joint Special Operations Command (JSOC), General Stanley McChrystal discarded a century of management wisdom and pivoted from a pursuit of mechanical efficiency to organic adaptability. In this book, he shows how any organization can make the same transition to act like a team of teams - where small groups combine the freedom to experiment with a relentless drive to share their experience.Drawing on a wealth of evidence from his military career and sources as diverse as hospital emergency rooms and NASA's space program, McChrystal frames the existential challenge facing today's organizations, and presents a compelling, effective solution.

Why Lean Enterprise Transformation is Hard - McClure, Dan (ThoughtWorks, 2015)

Engineering Complex Scaled Up Innovations in the Humanitarian and Development Sector - McClure, Dan; Gray, Ian (ThoughtWorks, 2015)

Managing the Journey to Scale Up Innovation in the Humanitarian and Development Sector - McClure, Dan; Gray, Ian (ThoughtWorks, 2015)

Scaling Assessment Map: An Evolving Tool Supporting Innovation Scale Up - McClure, Dan; Gray, Ian (ThoughtWorks, 2016)
Nearly three years ago we wrote about the “Missing Middle” in the innovation lifecycle[i], a gap that kept successful pilot programs from reaching the goal of replication and optimization in multiple contexts. Since then, scaling humanitarian innovation has received a great deal of attention from the sector, with a number of new initiatives specifically focused on the scaling challenge.

Scaling: Innovations Missing Middle - McClure, Dan; Gray, Ian (ThoughtWorks, 2015)

Thinking and Working Politically: Learning from practice. Overview to Special Issue - McCulloch, Neil; Piron, Laure-Hélène (Development Policy Review, 2019)
Over the last 15 years, a set of ideas now referred to as “thinking and working politically” (TWP) has coalesced into a “second orthodoxy” about how to take context into account when implementing development interventions. This approach stresses the importance of obtaining a better understanding of the local context (“thinking politically”) in order to support local actors to bring about sustainable developmental change (“working politically”). However, the evidence base to justify this new approach remains thin, despite a growing number of programmes which purport to be implementing it. Officials in development agencies struggle with putting it into practice and it is unclear how TWP differs—or not—from similar approaches, such as Problem Driven Iterative Adaptation (PDIA) and Doing Development Differently (DDD). This Special Issue sheds light on what TWP means in practice by examining a set of initiatives undertaken by both development partners and government departments in Nigeria, the Occupied Palestinian Territories, China and India. This overview article outlines, in brief, each of the Special Issue's four papers and then draws out five lessons—for funders and for practitioners—from across all the papers. Our five lessons are: (1) the fundamental importance of undertaking political economy analysis (PEA) to adapt programmes to their contexts; (2) the importance of having a realistic level of ambition for interventions; (3) the need to support local ownership—not just “agreement ownership” (between a donor agency and government) or local “management ownership” of the programme, but critically “driver ownership” by generating trust with the key local actors driving change; (4) the need for a more effective set of tools for measuring results in complex programmes that attempt to achieve improvements in long-run governance; and, (5) that although the political economy of donors is often seen as a barrier to applying TWP, the articles show how much can be done with a TWP approach if the analysis takes into account the political economy of donors as well as that of the local context. We conclude with a set of operational recommendations for donors and implementors, as well as suggestions of avenues for further research.
Keywords: Adaptation; Development programmes; Political economy analysis; Reform space; thinking and working politically

COUNT - Understanding the challenge of government responsiveness - McGee, Rosemary (MAVC and IDS, 2014)

Power, Violence, Citizenship and Agency - McGee, Rosemary (IDS Bulletin, 2014)

Something’s Stopping All Voices From Counting… - McGee, Rosemary (Making All Voices Count, 2014)
An outline of Making All Voices Count's Research & Evidence component led by the Institute of Development Studies.

Learning study on 'the users' in Technology for Transparency and Accountability initiatives: Assumptions and realities - McGee, Rosemary; Carlitz, Ruth (IDS, 2013)

Appropriating technology for accountability: messages from Making All Voices Count - McGee, Rosemary; Edwards, Duncan; Hudson, Hannah; Anderson, Colin; Feruglio, Francesca (IDS, 2018)
Making All Voices Count was a programme designed to solve the ‘grand challenge’ of creating more effective democratic governance and accountability around the world. It used funding from four donors to support the development and spread of innovative ideas for solving governance problems – many of them involving tools and platforms based on mobile phone and web technologies. Between 2013 and 2017, the programme made grants for innovation and scaling projects that aimed to amplify the voices of citizens and enable governments to listen and respond. It also conducted research and issued research grants to explore the roles that technology can play in securing responsive, accountable government and building an evidence base. This synthesis report reviews the Making All Voices Count’s four-and-a-half years of operational experience and learning. It shares 14 key messages on the roles technologies can play in enabling citizen voice and accountable and responsive governance. These messages are presented in four sections: (1) Applying technologies as technical fixes to solve service delivery problems; (2) Applying technologies to broader, systemic governance challenges ; (3) Applying technologies to build the foundations of democratic and accountable governance systems; (4) Applying technologies for the public ‘bad’, when tech can be dangerous for democracy. The tech optimism of the era in which the programme was conceived can now be reappraised from the better-informed vantage point of hindsight. Making All Voices Count’s wealth of diverse and grounded experience and documentation provides an evidence base that should enable a more sober and mature position of tech realism as the field of tech for accountable governance continues to evolve.

Outcome Measurement in Local Governance Programmes: a Power Dimension - McGee, Rosemary; Pettit, Jethro (IDS, 2013)

Power, Empowerment and Social Change - McGee, Rosemary; Pettit, Jethro (2019)
This book uncovers how power operates around the world, and how it can be resisted or transformed through empowered collective action and social leadership. The stakes have never been higher. Recent years have seen a rapid escalation of inequalities, the rise of new global powers and corporate interests, increasing impunity of human rights violations, suppression of civil society, and a re-shaping of democratic processes by post-truth, populist and nationalist politics. Rather than looking at power through the lenses of agency or structure alone, this book views power and empowerment as complex and multidimensional societal processes, defined by pervasive social norms, conditions, constraints and opportunities. Bridging theory and practice, the book explores real-world applications using a selection of frameworks, tools, case studies, examples, resources and reflections from experience to support actors to analyse their positioning and align themselves with progressive social forces. Compiled with social change practitioners, students and scholars in mind, Power, Empowerment and Social Change is the perfect volume for anyone involved in politics, international development, sociology, human rights and environmental justice who is looking for fresh insights for transforming power in favour of relatively less powerful people.

From ‘Feedback Loops’ to ‘Responsive Governance’ - McGee, Rosie (Making All Voices Count, 2014)
Part of a sequenced learning process for MAVC's Research and Evidence Component, the summary of a thematic discussion led by researcher Rosemary McGee.

Introduction: Opening Governance – Change, Continuity and Conceptual Ambiguity - McGee, Rosie; Edwards, Duncan (IDS Bulletin, 2016)

Shifting Power? Assessing the Impact of Transparency and Accountability Initiatives - McGee, Rosie; Gaventa, John (IDS, 2011)
This paper arises from a review of the impact and effectiveness of transparency and accountability initiatives which gathered and analysed existing evidence, discussed how it could be improved, and ev...

Lessons from a trial of the Success Case Method - McGuinness, Liz (Better Evaluation, 2017)
The Success Case Method approach is useful for documenting stories of impact and for understanding the factors that help or hinder impact. It is particularly useful for uncovering the contextual forces that influence impact. Originally designed for evaluating corporate training programs, the Success Case Method is now being applied to other programs including international development interventions. Last year, I provided technical assistance to a pilot of the Success Case Method as part of the USAID-funded Complexity-Aware M&E Trials.

Evaluation Building Blocks: A Guide - McKegg, K.; Oakden, J.; Wehipeihana, N.; King, Julian (Kinnect Group, 2018)
This guide presents the Kinnect Group’s approach to evaluation. Developed through ten years of collaborative work, it has been well tested. While there are many other guides to evaluation and different ways to do it, our approach emphasises the place of evaluative reasoning in evaluation. The guide draws on the work of many evaluation theorists, as well as our practice-based body of knowledge. We hope that using the building blocks as explained in the guide will help you in your endeavour to do credible and useful evaluation. We find this approach works for us. Our clients tell us it gives them meaningful and insightful findings that they can use to take action. Our view to intellectual property is simple. What you read is yours to use. We just ask that you cite the guide when you draw from it. For those of you who engage with this guide and use it in your practice, we look forward to hearing from you. We are particularly interested in feedback where you find aspects of the guide work well for you. In that way we can all continue to build and evolve our practice.

Adaptability: the art of winning in an age of uncertainty - McKeown, Max (Kogan Page, 2012)
Keywords: Adaptability (Psychology); Success

Scaling Impact: Innovation for the Public Good - McLean, Robert; Gargani, John (Routledge, 2019)
Scaling Impact introduces a new and practical approach to scaling the positive impacts of research and innovation. Inspired by leading scientific and entrepreneurial innovators from across Africa, Asia, the Caribbean, Latin America, and the Middle East, this book presents a synthesis of unrivalled diversity and grounded ingenuity. The result is a different perspective on how to achieve impact that matters, and an important challenge to the predominant more-is-better paradigm of scaling. For organisations and individuals working to change the world for the better, scaling impact is a common goal and a well-founded aim. The world is changing rapidly, and seemingly intractable problems like environmental degradation or accelerating inequality press us to do better for each other and our environment as a global community. Challenges like these appear to demand a significant scale of action, and here the authors argue that a more creative and critical approach to scaling is both possible and essential. To encourage uptake and co-development, the authors present actionable principles that can help organisations and innovators design, manage, and evaluate scaling strategies. Scaling Impact is essential reading for development and innovation practitioners and professionals, but also for researchers, students, evaluators, and policymakers with a desire to spark meaningful change.
Google-Books-ID: 9X6YDwAAQBAJ
Keywords: Developing & Emerging Countries

Political economy analysis: Topic Guide - Mcloughlin, Claire (GSDRC, University of Birmingham, 2014)
Political economy analysis (PEA) aims to situate development interventions within an understanding of the prevailing political and economic processes in society – specifically, the incentives, relationships, and distribution and contestation of power between different groups and individuals. Such an analysis can support more politically feasible and therefore more effective development strategies by setting realistic expectations …

Demanding Good Governance: Lessons from Social Accountability Initiatives in Africa - McNeil, Mary; Malena, Carmen (World Bank Publications, 2010)
Accountability is the cornerstone of good governance. Unless public officials can be held to account, then critical benefits associated with good governance, such as social justice, poverty reduction and development remain elusive. The impacts of non-responsive and unaccountable governance are perhaps most harshly felt by the citizens of Africa, where corruption and governance failures are broadly acknowledged as a principal obstacle to the achievement Over the past decade, a range of social accountability practices―such as participatory budgeting, independent budget analysis, participatory monitoring of public expenditure and citizen evaluation of public services have been experimented with in many Africa countries. Their outcomes and lessons have, thus far, received little attend and documentation. This volume aims to make a contribution towards filling this gap by describing and analyzing a selection of social accountability initiatives from seven Sub-Saharan countries.

The effect of government responsiveness on future political participation - Mellon, Andrew Jonathan; Sjoberg, Fredrik Matias; Peixoto, Tiago Carneiro (The World Bank, 2015)
What effect does government responsiveness have on political participation? Since the 1940s political scientists have used attitudinal measures of perceived efficacy to explain participation. More recent work has focused on underlying genetic factors that condition citizen engagement. The authors develop a ‘calculus of participation’ that incorporates objective efficacy, the extent to which an individual’s participation actually has an impact, and test the model against behavioral data from FixMyStreet.com (n=399,364). The authors find that a successful first experience using FixMyStreet.com (e.g., reporting a pothole and having it fixed) is associated with a 54 percent increase in the probability of an individual submitting a second report. The authors also show that the experience of government responsiveness to the first report submitted has predictive power over all future report submissions. The findings highlight the importance of government responsiveness for fostering an active citizenry, while demonstrating the value of incidentally collected data to examine participatory behavior at the individual level.

The Alignment, Interest and Influence Matrix (AIIM) guidance note - Mendizabal, Enrique (ODI/RAPID, 2010)
In 2007, on the eve of a workshop to introduce a new version of the RAPID approach to DFID policy teams, Enrique Mendizabal and Ben Ramalingam created the Alignment, Interest and Influence Matrix (AIIM), a stakeholder analysis tool that not only helps to identify key stakeholders, but also suggests a possible course of action towards them.

Adaptive Management Self-assessment tool - mercy Corps (Mercy Corps, 2016)
The Adaptive Management self-assessment tool has been designed to help teams assess the extent to which they have a supportive environment for adaptive management within their country program. The self-assessment tool helps you think about five different areas that have been identified as important for supporting adaptive management: 1. Culture & leadership 2. Dynamic teams 3. Appropriate analysis 4. Responsive implementation & operations 5. Enabling environment (for example donor funding and relationships)

Adaptive Management Tools: Concept Notes System - Mercy Corps (Mercy Corps, 2015)
Mercy Corps finds adaptive management is supported by four different but interconnected elements: Culture, People & Skills, Tools & Systems, and Enabling Environment. These elements are discussed in the context of one of Mercy Corps’ complex programmes in pastoral Ethiopia.

Agility and Evolution. How Mercy Corps Adapts at the Organizational Level - Mercy Corps (2017)
How Mercy Corps Adapts at the Organizational Level

How can we be more adaptive? AdaptScan identifies critical areas for improvement - Mercy Corps (Mercy Corps & IRC, 2017)
Keywords: IMPORTANT

Managing Complexity: Adaptive Management at Mercy Corps - Mercy Corps (2015)
Managing Complexity: Adaptive management at Mercy Corps

Webinar: Operationalizing Adaptive Management: What it takes. Why it matters. - Mercy Corps (Mercy Corps, 2015)
Development actors increasingly agree that managing programs adaptively – especially complex interventions – can improve their effectiveness. A growing body of evidence supports this claim. But what does adaptive management look like in practice? What does it require of managers and donors to make happen? How can we reconfigure incentives and success metrics to support adaptation, while remaining compliant?

Guidance on tasks and deliverables for different evaluation phases - Methods Lab (2015)
This tool describes the five key phases of evaluation, from planning and design, to implementation and communication of results. It provides a list of the main tasks and deliverables for each phase, intended for use by anyone managing an impact evaluation. This tool was developed by Irene Guijt, Simon Hearn, Tiina Pasanen and Patricia Rogers for use in Methods Lab projects. It follows to some extent the BetterEvaluation Rainbow Framework.

Guiding questions to help narrow the scope of an evaluation - Methods Lab (2015)
Time and budget constraints can mean that programmes are not able to assess all possible evaluation questions; this is especially true for multi-component or multi-site programmes operating in challenging environments. This tool identifies areas of enquiry to help programmes prioritise the number of questions and measurement indicators used. This tool was developed by Anne Buffardi for use in in Methods Lab projects.

Report template on integrating impact into an existing monitoring and evaluation system - Methods Lab (2015)
Many development programme staff will commission an impact evaluation towards the end of a project or programme, only to find that the monitoring system did not provide adequate data about implementation, context, baselines or interim results. This tool provides a template outline for a report making recommendations on how to integrate a focus on impact into a programme’s existing monitoring and evaluation system, as the programme moves into a new phase. This template was developed by Anne Buffardi and Tiina Pasanen for use in Methods Lab projects.

Report templates for evaluability assessment - Methods Lab (2015)
An evaluability assessment aims to assess the extent to which, and how best, a project can be evaluated in a reliable and credible fashion. These templates are intended to help anyone conducting an evaluability assessment to structure the final report. This tool was developed by Anne Buffardi and Bronwen McDonald for use in Methods Lab projects. It accompanies The Methods Lab publication ‘Evaluability assessment for impact evaluation: guidance, checklists and decision support’.

Sample agendas for an evaluability assessment stakeholder workshop - Methods Lab (2015)
An evaluability assessment aims to assess the extent to which, and how best, an intervention can be evaluated in a reliable and credible fashion. These sample agendas are intended for people convening key stakeholders (such as project implementation staff and managers, donors and government officials) to discuss the purpose and scope of an impact evaluation and to identify key evaluation questions. This tool was developed by Bronwen McDonald, Anne Buffardi and Irene Guijt for use in Methods Lab projects. It accompanies the Methods Lab publication ‘Evaluability assessment for impact evaluation: guidance, checklists and decision support’.

Sample criteria to select case studies for evaluation - Methods Lab (2018)
Time and budget constraints often mean that organisations are unable to evaluate all of their programmes, and large programmes, operating in multiple locations, are unable to evaluate all project sites. This tool introduces two sets of criteria to support evaluators and programme managers to select case studies or programmes for evaluation: i) information about how relevant or feasible evaluation is for individual programmes, and ii) across the overall portfolio, strategic thinking around what types of cases are most important to understand. This tool was developed by Anne Buffardi, Irene Guijt, Simon Hearn and Tiina Pasanen for use in The Methods Lab projects.

Sample interview questions for evaluability assessment - Methods Lab (2015)

Template concept note for an impact evaluation - Methods Lab (2015)

Sustainability and Value through Improved Decision-making - Meyer, Isabel; Marais, Mario (Designing and implementing an Information and Communication Technology for Rural Education Development (ICT4RED) initiative in a resource-constrained environment: Nciba school district, Eastern Cape, South Africa, 2014)

Design for Sustainability: Countering the Drivers of Unsustainability in Development Projects - Meyer, Isabel; Marais, Mario Alphonso (The Journal of Community Informatics, 2015)
Development projects aim to make a difference in communities. Funders often require that the intervention needs to last, or that it needs to effect change that will last, over an extended period of time. In short, a sustainable difference needs to be made and this is an important measure of success. However, there are inherent drivers in the combined system of donors and beneficiaries that counter sustainability. This article explores these drivers, and identifies project design elements that need to be in place in order to promote sustainability by countering the drivers. This approach is applied to an education project, and implications for ICT4D projects are developed.
Keywords: Development; Project design; Systems Approaches; sustainability

The behaviour change wheel: A new method for characterising and designing behaviour change interventions - Michie, Susan; van Stralen, Maartje M; West, Robert (Implementation Science : IS, 2011)
Background Improving the design and implementation of evidence-based practice depends on successful behaviour change interventions. This requires an appropriate method for characterising interventions and linking them to an analysis of the targeted behaviour. There exists a plethora of frameworks of behaviour change interventions, but it is not clear how well they serve this purpose. This paper evaluates these frameworks, and develops and evaluates a new framework aimed at overcoming their limitations. Methods A systematic search of electronic databases and consultation with behaviour change experts were used to identify frameworks of behaviour change interventions. These were evaluated according to three criteria: comprehensiveness, coherence, and a clear link to an overarching model of behaviour. A new framework was developed to meet these criteria. The reliability with which it could be applied was examined in two domains of behaviour change: tobacco control and obesity. Results Nineteen frameworks were identified covering nine intervention functions and seven policy categories that could enable those interventions. None of the frameworks reviewed covered the full range of intervention functions or policies, and only a minority met the criteria of coherence or linkage to a model of behaviour. At the centre of a proposed new framework is a 'behaviour system' involving three essential conditions: capability, opportunity, and motivation (what we term the 'COM-B system'). This forms the hub of a 'behaviour change wheel' (BCW) around which are positioned the nine intervention functions aimed at addressing deficits in one or more of these conditions; around this are placed seven categories of policy that could enable those interventions to occur. The BCW was used reliably to characterise interventions within the English Department of Health's 2010 tobacco control strategy and the National Institute of Health and Clinical Excellence's guidance on reducing obesity. Conclusions Interventions and policies to change behaviour can be usefully characterised by means of a BCW comprising: a 'behaviour system' at the hub, encircled by intervention functions and then by policy categories. Research is needed to establish how far the BCW can lead to more efficient design of effective interventions.

Building a Learning Culture – The case of the Market Development Facility in Fiji - Miehlbradt, Alexandra (The Donor Committee for Enterprise Development, 2015)
Keywords: Case Report

Buzzing Communities: How to build bigger, better, and more active online communities - Millington, Richard (Feverbee, 2012)
How to Build Bigger, Better, and More Active Online CommunitiesBuzzing Communities cuts through the fluff to offer a clear process for creating thriving online communities. This book combines a century of proven science, dozens of real-life examples, practical tips, and trusted community-building methods. This step-by-step guide includes a lifecycle for tracking your progress and a framework for managing your organization's community efforts. This Book Will Help You to Understand what the members of your community really want. Dramatically increase the number of newcomers that become regulars. Avoid the mistakes most organizations make when they try to build online communities. Develop a fantastic, user-friendly website for your members. Grow your online community to critical mass and beyond Keep members engaged and active in your community. Measure the community's return on investment and explain the benefits to your organization.

The Indispensable Community: Why Some Brand Communities Thrive When Others Perish - Millington, Richard (Feverbee, 2018)
How to Build Bigger, Better, and More Active Online CommunitiesBuzzing Communities cuts through the fluff to offer a clear process for creating thriving online communities. This book combines a century of proven science, dozens of real-life examples, practical tips, and trusted community-building methods. This step-by-step guide includes a lifecycle for tracking your progress and a framework for managing your organization's community efforts. This Book Will Help You to Understand what the members of your community really want. Dramatically increase the number of newcomers that become regulars. Avoid the mistakes most organizations make when they try to build online communities. Develop a fantastic, user-friendly website for your members. Grow your online community to critical mass and beyond Keep members engaged and active in your community. Measure the community's return on investment and explain the benefits to your organization.

‘You Have to Raise a Fist!’: Seeing and Speaking to the State in South Africa - Mills, Elizabeth (IDS Bulletin, 2016)

Evidence to Action: Research to Address Illegal Wildlife Trade - Milner-Gulland, E. J.; Cugniere, Laure; Hinsley, Amy; Phelps, Jacob; Rolfe, Michael 't Sas; Veríssimo, Diogo (2018)
Tools and expertise to improve the evidence base for national and international Illegal Wildlife Trade policy already exist but are underutilised. Tapping into these resources would produce substantive benefits for wildlife conservation and associated sectors, enabling governments to better meet their obligations under the Sustainable Development Goals and international biodiversity conventions. This can be achieved through enhanced funding support for inter-sectoral research collaborations, engaging researchers in priority setting and programme design, increasing developing country research capacity and engaging researchers and community voices in policy processes. This briefing, addressed to policy makers and practitioners, is part of the 2018 Evidence to Action: Research to Address Illegal Wildlife Trade event programme, organised by five of the UK’s most active IWT research institutions, to support the London 2018 IWT Conference.

(Mis)communicating climate change? Why online adaptation databases may fail to catalyze adaptation action - Mitchell, Carrie L.; Burch, Sarah L.; Driscoll, Patrick A. (Wiley Interdisciplinary Reviews: Climate Change, 2016)
Over the last decade a plethora of action-oriented research projects has been conducted in developing countries, exploring how to effectively adapt to the anticipated impacts of climate change. Many intergovernmental agencies and development organizations have chosen to disseminate their research results via online databases. It is unclear, however, whether these databases are useful in terms of actual adaptation planning and implementation. A systematic review of online databases has found at least 64 databases and tools online related to climate change adaptation. Despite the abundance of databases, this analysis reveals that the existing body of online databases generally lack the structure and mechanics to identify, extract, and synthesize both effective and ineffective climate change adaptation practices, projects, programs, and policies. Even relatively basic information, such as identification of projects’ projected versus actual costs is absent, which are crucial decision-making criteria particularly in developing country contexts where resource constraints are significant. In this paper we evaluate these online tools with a focus on identifying features that potentially could contribute to knowledge sharing and successful exchange of climate change adaptation projects and practices within a developing country context. We conclude the paper with recommendations for how to improve efforts to communicate climate change research, such as more nuanced needs assessments of potential users of databases. WIREs Clim Change 2016, 7:600–613. doi: 10.1002/wcc.401 This article is categorized under: Vulnerability and Adaptation to Climate Change > Institutions for Adaptation Climate and Development > Knowledge and Action in Development Social Status of Climate Change Knowledge > Knowledge and Practice

Using elements of DCED Standards for CLA - Mitra, Bilash; Jalil, Mohammad Muaz (2018)
Introduction used in the DCED-BEAM seminar in Nairobi

Quality Flaws: Issues and Challenges in Software Development - Mohan, P.; Shankar, A. Udaya; JayaSriDevi, K. (Computer Engineering and Intelligent Systems, 2012)
A statement “Prevention is better than cure” for illnesses in medical sciences also applies to the software development life cycle in terms of software defects. A defect is a deviation from actual functionality of the application in terms of the correctness and completeness of the specification of the customer requirements. Defective software fails to meet its customer requirements leading to the development of applications with poor quality. Quality is a top priority in every enterprise these days. Organizations struggle in a treadmill race to deliver quality software to stay ahead with new technology, deal with accumulated development backlogs, handle customer issues as software teams work as hard as they can make their organizations stay alive and competitive in the market place. Software companies face an immense pressure to virtually release a bug-free product or a software package. The culture of an organization is a critical success factor in the efforts of process improvement. The paper aims at assessing quality as a function for monitoring and measuring the strength of development processes and any successful application development enterprise requires an unambiguous understanding of customer expectation and maximizing participation of customers in the development activities thereby ensuring that people involved in development activities do the right thing and do the thing right for delivering high quality software . Keywords: Software development, process improvement, software defect, bug-free product, software package

Building intentional networks that drive impact - Mohr, Jeff (In Too Deep, 2016)
These days everyone is familiar with some type of network — whether that’s their professional network on LinkedIn, their social network on…

Building intentional networks that drive impact (part 2) - Mohr, Jeff (In Too Deep, 2016)
This is part 2 of our series on building intentional networks. Make sure you’ve read part 1 before diving into this article!

EPE Week: Lee-Anne Molony on Collaborative Outcomes Reporting - Molony, L A (AEA365 a Tip-a-day by and for Evaluators, 2013)
This AEA365 blog, written by Lee-Anne Molony a Principal Consultant at Clear Horizon, provides a brief overview on Collaborative Outcomes Reporting (COR).

Lifestyle politics and the concept of political participation - Moor, Joost de (Acta Politica, 2017)
Van Deth’s comprehensive ‘conceptual map of political participation’ has reinstated a lively debate about the concept of political participation, and provides some compelling solutions to it. However, an important question that has been raised is whether van Deth’s map actually achieves its main goal of unambiguously identifying and classifying emerging, complex types of participation, like online political activism – or lifestyle politics. To contribute to this debate, this article aims to evaluate the usefulness of van Deth’s approach for the analysis of lifestyle politics. Such an evaluation requires a clear classification of lifestyle politics. This, however, is still missing from the literature. The second aim of this article, therefore, is to identify and classify different types of lifestyle politics. On the basis of a literature review, this article argues that lifestyle politics are often enacted throughout different private, public and institutional arenas, and that they are often targeted at various social, economic and political actors at once. Applying van Deth’s conceptual map to these empirical realities, then, suggests that it cannot always account for their complexity sufficiently. Therefore, this article proposes a modification of van Deth’s framework that increases its usefulness for analyzing emerging, complex political participation repertoires.

Adaptive Leadership in Development course - Moran, Mark; Curth-Bibb, Jodie; Grice, Tim; Glavey, Sarah (University of Queensland, 2017)

Embracing the Chaotic: Cynefin and Humanitarian Response - Morealtitude (WanderLust, 2010)
Note: Many thanks to Dave Snowden for his willingness to comment on this article prior to release Because I’m always a little behind the eight-ball, a friend of mine* recently introduced me to the …

Six Simple Rules: How to Manage Complexity without Getting Complicated - Morieux, Yves; Tollman, Peter (Harvard Business Review Press, 2014)
New tools for managing complexityDoes your organization manage complexity by making things more complicated? If so, you are not alone.According to The Boston Consulting Group’s fascinating Complexity Index, business complexity has increased sixfold during the past sixty years. And, all the while, organizational complicatedness—that is, the number of structures, processes, committees, decision-making forums, and systems—has increased by a whopping factor of thirty-five. In their attempt to respond to the increasingly complex performance requirements they face, company leaders have created an organizational labyrinth that makes it more and more difficult to improve productivity and to pursue innovation. It also disengages and demotivates the workforce.Clearly it’s time for leaders to stop trying to manage complexity with their traditional tools and instead better leverage employees' intelligence. This book shows you how and explains the implications for designing and leading organizations.The way to manage complexity, the authors argue, is neither with the hard solutions of another era nor with the soft solutions—such as team building and feel-good “people initiatives”—that often follow in their wake. Based on social sciences (notably economics, game theory, and organizational sociology) and The Boston Consulting Group’s work with more than five hundred companies in more than forty countries and in various industries, authors Yves Morieux and Peter Tollman recommend six simple rules to manage complexity without getting complicated.Showing why the rules work and how to put them into practice, Morieux and Tollman give managers a much-needed tool to reinvigorate people in the face of seemingly endless complexity. Included are detailed examples from companies that have achieved a multiplicative effect on performance by using them.It’s time to manage complexity better. Employ these six simple rules to foster autonomy and cooperation and to effectively handle business complexity. As a result, you will improve productivity, innovate more, reengage your workforce, and seize opportunities to create competitive advantage.
Keywords: Complexity; Design Thinking

Assumption-aware tools and agency; an interrogation of the primary artifacts of the program evaluation and design profession in working with complex evaluands and complex contexts - Morrow, Nathan; Nkwake, Apollo M. (Evaluation and Program Planning, 2016)
Like artisans in a professional guild, we evaluators create tools to suit our ever evolving practice. The tools we use as evaluators are the primary artifacts of our profession, reflect our practice and embody an amalgamation of paradigms and assumptions. With the increasing shifts in evaluation purposes from judging program worth to understanding how programs work, the evaluator’s role is changing to that of facilitating stakeholders in a learning process. This involves clarifying purposes and choices, as well as unearthing critical assumptions. In such a role, evaluators become major tool-users and begin to innovate with small refinements or produce completely new tools to fit a specific challenge or context. We interrogate the form and function of 12 tools used by evaluators when working with complex evaluands and complex contexts. The form is described in terms of traditional qualitative techniques and particular characteristics of the elements, use and presentation of each tool. Then the function of each tool is analyzed with respect to articulating assumptions and affecting the agency of evaluators and stakeholders in complex contexts.
Keywords: Agency; Assumption-aware; Complex context; Complex programs; Participatory approaches; Program design; Program evaluation; Program tools; Theory-based

Conclusion: Agency in the face of complexity and the future of assumption-aware evaluation practice - Morrow, Nathan; Nkwake, Apollo M. (Evaluation and Program Planning, 2016)
This final chapter in the volume pulls together common themes from the diverse set of articles by a group of eight authors in this issue, and presents some reflections on the next steps for improving the ways in which evaluators work with assumptions. Collectively, the authors provide a broad overview of existing and emerging approaches to the articulation and use of assumptions in evaluation theory and practice. The authors reiterate the rationale and key terminology as a common basis for working with assumption in program design and evaluation. They highlight some useful concepts and categorizations to promote more rigorous treatment of assumptions in evaluation. A three-tier framework for fostering agency for assumption-aware evaluation practice is proposed-agency for themselves (evaluators); agency for others (stakeholders); and agency for standards and principles.
Keywords: Agency; Complexity

Learning to make all voices count: Lessons and reflection on localising the Open Government Partnership - Moses, Michael (2017)
This report reviews the evidence from Learning to Make All Voices Count (L-MAVC), a programme funded by Making All Voices Count and implemented in collaboration with Global Integrity. L-MAVC intended to support six Making All Voices Count grantees, working in five countries, in co-creating and applying a participatory, learning-centred, and adaptive approach to strengthening citizen engagement in governance processes in their contexts, including with respect to the Open Government Partnership (OGP). Two overarching sets of lessons emerge from the experiences of L-MAVC grantees. First, supporting citizen engagement and government accountability in subnational contexts, and localising the OGP in ways that matter to citizens, is not straightforward. Doing so successfully entails engaging with, navigating and shaping political and power dynamics in those contexts, and iteratively adapting to emerging lessons and challenges. Second, the effectiveness of adaptive ways of working depends in part on the extent to which they offer opportunities for cross-context peer learning, support the regular collection and use of data, and are themselves adaptive. These lessons have implications for the broader community of actors working to support governance reform, including the OGP and its partners, donors and multilateral institutions, and practitioners and policy-makers. The evidence from L-MAVC suggests that if these actors are to contribute more effectively to reforms that affect citizens’ lives, substantial changes – with respect to the nature of support provided to domestic stakeholders and to grant-making practices – may be warranted

Rapid experiments with a purpose - Moses, Michael (BEAM Exchange, 2017)
New insights, opinions and perspectives on market systems development, from experts and practitioners.
Keywords: IMPORTANT

Learning how to go local: Lessons from six learning journeys for the Open Government Partnership - Moses, Michael; Soal, Sue (2017)
This brief reviews the evidence from Learning to Make All Voices Count (L-MAVC), a programme funded by Making All Voices Count, and implemented in collaboration with Global Integrity. L-MAVC intended to support six Making All Voices Count grantees, working in five countries, in co-creating and applying a participatory, learning-centred, and adaptive approach to strengthening citizen engagement in governance processes in their contexts, including with respect to the Open Government Partnership (OGP). The evidence from L-MAVC suggests that supporting citizen engagement with, and use of, OGP, and improving the extent to which OGP commitments are shaped by and matter to citizens in subnational districts, is not straightforward. Findings suggest that efforts to broaden and deepen citizen engagement with OGP, including at subnational levels, may be more effective when combined with support that helps local OGP champions iteratively learn and adapt, and discover and apply localisation models that fit best in their contexts. OGP and its partners may strengthen the impact of the initiative, and indeed, the impact of those working to leverage OGP at and below country level, by making structured learning support more available to local reformers. Targeted advocacy, focused on institutionalising collaborative OGP processes, and on linking subnational action with National Action Plans (NAPs), may also be useful.

Learning to Make All Voices Count: Lessons for OGP, donors, and practitioners - Moses, Michael; Soal, Sue (2017)
The Open Government Partnership (OGP), donors and multilaterals, and social accountability practitioners across the world are among various constituencies attempting to harness and actualise emerging insights about the nature of successful governance reform. But each of these groups faces challenges as they do so. This brief reviews the evidence from Learning to Make All Voices Count (L-MAVC), a programme funded by Making All Voices Count, and implemented in collaboration with Global Integrity. L-MAVC intended to support six Making All Voices Count grantees, working in five countries, in co-creating and applying a participatory, learning-centred, and adaptive approach to strengthening citizen engagement in governance processes in their contexts, including with respect to the Open Government Partnership (OGP). Two sets of lessons emerge from the experience of L-MAVC. First, supporting citizen engagement and government accountability in subnational contexts, and localising OGP in ways that matter to citizens, is not straightforward. Doing so successfully entails engaging with, navigating and shaping political and power dynamics in those contexts, and iteratively adapting to emerging lessons and challenges. Second, the effectiveness of adaptive ways of working depends in part on the extent to which they offer opportunities for cross-context peer learning, support the regular collection and use of data, and are themselves adaptive. These lessons have implications for the broader community of actors working to support governance reform, including OGP and its partners, donors and multilateral institutions, and practitioners and policy-makers. If these actors are to contribute more effectively to reforms that affect citizens’ lives, substantial changes – with respect to the nature of support provided to domestic stakeholders, grant-making practices, and practitioner approaches – may be warranted.

Supporting local learning and adaptation: understanding the effectiveness of adaptive processes - Moses, Michael; Soal, Sue (2017)
This brief reviews the evidence from Learning to Make All Voices Count (L-MAVC), a programme funded by Making All Voices Count, and implemented in collaboration with Global Integrity. L-MAVC intended to support six Making All Voices Count grantees, working in five countries, in co-creating and applying a participatory, learning-centred, and adaptive approach to strengthening citizen engagement in governance processes in their contexts, including with respect to the Open Government Partnership (OGP).

Supporting the policy environment for economic development (SPEED+) - Strategic Review Report - MSI (USAID, 2019)
Donor-funded policy reform has a long history in Mozambique, with United States Agency for International Development (USAID) efforts dating to the mid-1990s. Many laws and regulations adopted during the past quarter century are the consequence of these efforts. And yet, even with several years of robust economic growth, Mozambique has not experienced the broad economic transformation that policy reforms can trigger: per capita income in 2017 was $519 and more than 80 percent of the country lived on less than two dollars per day. The country ranks 180 out of 189 on the Human Development Index and 135 out of 180 on the World Bank’s Doing Business Index. Supporting the Policy Environment for Economic Development (SPEED+), a $37 million, four-year, USAID-funded program, represents the latest iteration of USAID’s policy reform efforts. SPEED+ began in August 2016 and is scheduled to run through August 2020. As the program passed the midway point, USAID commissioned Management Systems International (MSI) to conduct a strategic review (SR) of the SPEED+ program, with the objectives of advising on: • how to maximize the impact of SPEED+ during its final 18 months; • what type of follow-on program USAID should consider; and • what broader lessons can be drawn from SPEED+’s experience in Mozambique.

Collective intelligence and achieving the Sustainable Development Goals - Mulgan, Geoff (nesta, 2018)
Collective intelligence and achieving the Sustainable Development Goals

Systems Innovation - Discussion Paper - Mulgan, Geoff; Leadbeater, Charlie (NESTA, 2013)
Introduction Over the past few years there has been growing interest in systemic innovation. We are defining this as an interconnected set of innovations, where each influences the other, with innovation both in the parts of the system and in the ways in which they interconnect. Yet rather than simply theorising, we want to make this practical. We want to explore the potential of systemic innovation to help tackle some of the key challenges the UK currently faces, from supporting an ageing population to tackling unemployment. We would also like to open up the discussion, to engage with the wide and diverse range of experts already working this space to help sharpen up thinking about systemic innovation and influence practical work to advance it. About this paper The two essays contained within this paper are intended to contribute to this debate. The first paper by Geoff Mulgan addresses a number of questions about systemic – or ‘joined–up’ – innovation, asking what it means to truly transform a system, encompassing the means, methods, and actions needed to realise its potential. The second paper from Charlie Leadbeater argues that companies, governments, cities, and entire societies need to move from seeing innovation in products and services as a source of competitive advantage, to focussing on innovation with entire systems. Our next steps: helping make systemic innovation useful and useable This report is just the start. We want to work with academics, practitioners, policymakers, and others in the field, to help realise the great potential of connecting and joining up innovative products, services and processes so that the whole is more than the parts. Over the coming months we will be building upon the rich and diverse literature available (we have start collating this as an annex to this paper), as well as practitioner experience, to ensure we understand systems more rigorously, as well as the skills, capabilities, methods and means needed to help them change for the better.

Grounded Theory Method in HCI and CSCW - Muller, Michael J; Kogan, Sandra (IBM Center for Social Software, 2010)

Six things that help grant-makers learn and adapt - Murray, Aoife (Itad, 2017)
There’s an emerging body of literature identifying key strategies that can both improve learning and enable adaptive management amongst grant-makers. We recently reviewed a host of publications from eight grant-making organisations. Those organisations have diverse aims and approaches but we’ve identified six common themes that stand out: Strong leadership and facilitation enables successful learning and …

The Promise of Lean Experimentation - Murray, Peter; Ma, Steve (Stanford Social Innovation Review, 2015)
By adopting a model from business, nonprofit organizations can launch, test, and implement new programs and services more efficiently. Includes magazine extras.
Keywords: IMPORTANT

The open book of social innovation - Murray, Robin; Caulier-Grice, Julie; Mulgan, Geoff (Young Foundation & NESTA, 2010)

An analysis of factors influencing success of ICT4D projects: a case study of the Schools Computerisation Programme in Mashonaland West Province, Zimbabwe. - Musiyandaka, Donna; Ranga, Gideon; Kiwa, Jacqueline Fungai (The Journal of Community Informatics, 2013)
Keywords: ICT4D programmes; success factors

Addressing challenges in communicating adaptation practices to smallholder farmers in Kenya through a radio intervention - Mwaniki, Fiona Nyawira; Gichuki, Charity; Mwangi, Maina; Mburia, Pamela; Wandago, Benson (Journal of Agriculture and Environment for International Development (JAEID), 2017)

TICTeC 2018 - The Making All Voices Count programme: new lessons about donor-funded civic tech - mySociety (2018)
Keywords: Accountability; Civic Tech; IDS; TICTeC; transparency

How Does the World Bank Build Citizen Engagement Commitments into Project Design? Results from Pilot Assessments in Mozambique, Myanmar, Nigeria, and Pakistan - Nadelman, Rachel; Le, Ha; Sah, Anjali (IDS, 2019)
How and to what degree is the World Bank putting its new institutional citizen engagement (CE) commitments into practice? This question guides an independent assessment that the Accountability Research Center (ARC) at American University has undertaken as part of the Institute of Development Studies-led Action for Empowerment and Accountability (A4EA) research programme’s investigation into how external actors can best support local processes of and conditions for empowerment and accountability. This report investigates the World Bank’s incorporation of CE into project design, the critical early stage of donor engagement. To accomplish this, ARC reviewed the World Bank’s fiscal year 2015–17 investment project portfolios for four A4EA priority countries, Mozambique, Myanmar, Nigeria, and Pakistan, which covers 57 projects that range from US$19 million to U$600 million. The analysis determines whether projects commit to seeking a strategic approach to CE, which involves combining multiple tactics so that the whole could be greater than the sum of the parts. This assessment of CE commitments is intended to help to inform possible national, civil society organisation strategies to monitor whether and how these commitments are actually implemented in practice.