Tips for Finding Unusual Allies and Building Innovative Alliances - Jacobstein, David (USAID Learning Lab, 2018)
One of the truisms of thinking and working politically (TWP) is that it requires looking differently at how stakeholders relate to a given development challenge or process, and building coalitions of the “right actors at the right time” who can drive forward progress while working with the grain of the context. While it’s easy to call for coalitions for change and diverse stakeholder engagement, identifying allies beyond those already seized with an issue, and finding ways to collaborate with stakeholders who may have different reasons for joining a coalition, is a challenging task. These are some suggested tips to improve working in that fashion.

Tips for Conducting a Gender Analysis at the Activity or Project Level - Cozzarelli, Cathy (USAID, 2010)
I. What is gender analysis? II. Relevant sections of the ADS III. Process – What should you do to collect the information you need to conduct a gender analysis at the activity or project level? IV. What questions should you ask in the context of doing your gender analysis? - Access - Knowledge, Beliefs, and Perceptions - Practices and Participation - Time and Space - Legal Rights and Status - Power and Decision-making IV. What should you do after you ask these questions?

Tiny Tools - Measuring Change in Communities and Groups - Causemann, Bernward; Gohl, Eberhard; Brenner, Verena (Impact+, 2012)
Introduction to the Overview: Tiny Tools Why “Tiny Tools” for assessing change? Currently, change is mostly assessed by NGO staff or external experts. The vision of this paper is that communities assess and reflect change themselves and make use of that reflection with appropriate tools. All the tools presented here are relatively quick and easy to learn (therefore “tiny”). With Tiny Tools we can assess change in one session. They can therefore be used where there are not baselines. They are structured and systematic, and they are all widely tested: Experience shows that these tools lead to new insights, mobilise enthusiasm and increase the capacity of communities to bring about further change. The Tiny Tools are in line with what Participatory Rural Appraisal (PRA) wanted to achieve. Many are slight variations of PRA tools. For a detailed description of concepts, see the NGO-IDEAs Impact Toolbox (www.ngo-ideas.net/impact_toolbox) and the NGO-IDEAs Manual Self-Effectiveness (www.ngo-ideas.net/monitoring_self_effectiveness). The tools are designed to visualise change, but also enable communities to reflect on the reasons of change or verify assessments. They may be implemented once or continuously over time. We know that the time of community members is precious, and limited. Therefore all Tiny Tools can be performed in a relatively short session, provided facilitators (it could be field staff or project officers) are experienced – and the community knows and trusts them. The amount of time spent on the application of the tools may however be prolonged according to the needs of a community or NGO. All of these tools are easy to learn for a facilitator experienced in participatory processes. Which tool should be introduced to which community? It is typically the decision of a development organisation (or external experts) which tools they want to introduce into a community. The staff need to assess which tool will lead to learning and action. It could also be that the staff realise aspects of change that they do not understand well enough. These tools are good for exploring change that we have not planned for and not anticipated. They are also good for exploring change in a context where we have no prior information. Communities are the best experts for their situation, but we emphasise that the tools should be used in ways that benefit and empower the communities or individuals participating. The tool implementations should lead to consequences on the grassroots as well as the NGO level. All Tiny Tools can be integrated into PIAR, the Analysis tool in the NGO-IDEAs Impact Toolbox. Also, the Tiny Tools can help to prepare for the application of the Toolbox tools. They help to make people aware of changes that can be observed. The following box gives some hints how Tiny Tools relate to the Impact Toolbox tools, and to what extent they help to attribute change to development interventions.

Timely evaluation in international development - Webster, Jayne; Exley, Josephine; Copestake, James; Davies, Rick; Hargreaves, James (Journal of Development Effectiveness, 2018)
Impact and process evaluations are increasingly used in international development; however they are generally retrospective in outlook. A more timely approach to evaluation aims to identify necessary, feasible and effective changes during a programme or intervention’s lifetime. This paper aims to identify, categorise, describe and critically appraise methods to support more timely evaluation in international development. Potential methods were identified through scoping seminar, public symposium, targeted review of the literature, and the authors’ own experiences and opinions. Findings from the different data sources were reviewed collectively by the author group and triangulated to develop an analytical framework. We identified four purposes of timely evaluation for international development, and critiqued the use of approaches against four dimensions of timeliness and flexibility. Whilst we found significant interest in more timely approaches to evaluation in international development, there was a dearth of published empirical evidence upon which to base strong recommendations. There is significant potential for timely evaluation to improve international development outcomes. New approaches to mixing and adapting existing methods, together with new technologies offer increased potential. Research is needed to provide an empirical evidence base upon which to further develop the application, across sectors and contexts, of timely evaluation in international development.
Keywords: Adaptive learning; Outcome evaluation; Programme improvement; impact evaluation

Time to Listen: Hearing People on the Receiving End of International Aid - Anderson, Mary B.; Brown, Dayna; Jean, Isabella (CDA Collaborative Learning Projects, 2012)
Does the way international assistance is organized make sense? Is it working as we mean it to? This book approaches these questions through the experiences of people living on the receiving side of international assistance. It reports on the ideas, insights, and analyses of almost 6,000 people across 20 countries where international aid has been provided. From such a range of locations and people, one might expect vastly different ideas and opinions. However, remarkably consistent patterns and common judgments emerged. In the midst of difference, there was striking unanimity and consistency about the processes and the effects of the international aid system. Using their words, their experiences, and their ideas, this book describes why the cumulative impacts of international aid efforts have not met expectations. It describes a way forward to make changes that, according to those on the receiving end, will lead to more effective and lasting results.

Time to let go: remaking humanitarian action for the modern era - Bennett, Christina (ODI, 2016)
As the international humanitarian system faces a crisis of legitimacy, the Humanitarian Policy Group’s landmark report proposes a new model of humanitarian action.

Time for a Donor Funding Charter? - kiwanja.net (Donor's Chapter, 2014)

TICTeC 2018 - The Making All Voices Count programme: new lessons about donor-funded civic tech - mySociety (2018)
Keywords: Accountability; Civic Tech; IDS; TICTeC; transparency

Three out of Four Practical Lessons about right fitting MEL for Additive Effects - Guerzovich, Florencia (Medium, 2023)
This is a series about Monitoring, Evaluating and Learning (MEL) whether sets of interventions/portfolios are adding more together than each one would produce on their own. In post 1, I pointed to coherence, the new OECD-DAC evaluation criteria as a way to bridge the ambition of bringing bigger change with the MEL world. In post 2, I shared 3 of 4 practical lessons I’ve learned in experimenting with MEL systems and exercises that focus explicitly on interactions of interventions/portfolios. In the third post, I bring Paul Pierson’s groundbreaking argument for social science to MEL. Paraphrasing, most contemporary MEL takes a “snapshot” view of interventions and portfolios, distorting their effects and meaning by ripping them from their temporal context. Instead, we should place in time interventions/portfolios with the ambition to add more than the sum of the part by constructing MEL systems looking at “moving pictures” rather than taking snapshots.

Three Approaches to Monitoring: Feedback Systems, Participatory Monitoring and Evaluation and Logical Frameworks - Jacobs, Alex; Barnett, Chris; Ponsford, Richard (IDS Bulletin, 2010)
This article compares key attributes, strengths and weaknesses of three different approaches to monitoring development interventions: the logical framework approach, participatory monitoring and evaluation (PM&E) and feedback systems. Academic and practitioner literature describes how logframes meet the needs of senior decision-makers to summarise, organise and compare projects. PM&E meets the needs of field staff to work sensitively with intended beneficiaries and support their learning and empowerment. Feedback systems appear to link the two, providing performance data for managers and creating incentives for implementing staff to focus on their intended beneficiaries. Feedback systems build on the rich heritage of PM&E and are compatible with logframes. They may help provide a manageable and effective approach to accountability that links the means and the ends of development interventions. Feedback systems are at an early stage of development. There is a lot to learn about how and where they work best.

Thoughts on the use of hypotheses in adaptive management - Sparkman, Timothy (BEAM Exchange, 2015)
New insights, opinions and perspectives on market systems development, from experts and practitioners.

This startup uses machine learning and satellite imagery to predict crop yields - Brokaw, Alex (The Verge, 2016)
Mark Johnson wants to beat the United States Department of Agriculture at its own game: predicting yields of America's crops. The USDA puts boots on the ground, deploying hundreds of workers to...

Thinking Tools Studio - Waters Center (Waters Center for Systems Thinking, 2021)
Tools to help you Think

Thinking in Systems: A Primer - Meadows, Donella H. (Chelsea Green Publishing, 2008)
In the years following her role as the lead author of the international bestseller, Limits to Growth—the first book to show the consequences of unchecked growth on a finite planet— Donella Meadows remained a pioneer of environmental and social analysis until her untimely death in 2001.Thinking in Systems, is a concise and crucial book offering insight for problem solving on scales ranging from the personal to the global. Edited by the Sustainability Institute’s Diana Wright, this essential primer brings systems thinking out of the realm of computers and equations and into the tangible world, showing readers how to develop the systems-thinking skills that thought leaders across the globe consider critical for 21st-century life.Some of the biggest problems facing the world—war, hunger, poverty, and environmental degradation—are essentially system failures. They cannot be solved by fixing one piece in isolation from the others, because even seemingly minor details have enormous power to undermine the best efforts of too-narrow thinking.While readers will learn the conceptual tools and methods of systems thinking, the heart of the book is grander than methodology. Donella Meadows was known as much for nurturing positive outcomes as she was for delving into the science behind global dilemmas. She reminds readers to pay attention to what is important, not just what is quantifiable, to stay humble, and to stay a learner.In a world growing ever more complicated, crowded, and interdependent, Thinking in Systems helps readers avoid confusion and helplessness, the first step toward finding proactive and effective solutions.

Thinking big: How to use theory of change for systems change - Abercrombie, Rob; Boswell, Katie; Thomasoo, Rosanna (NPC, 2018)
We think that, applied well, theory of change can support charities and funders to take a systemic approach to their work. This report identifies five common pitfalls that organisations fall into when using theory of change, and walks through five rules of thumb that will help organisations to use the approach to tackle complex problems. We think that, applied well, theory of change can support charities and funders to take a systemic approach to their work. This report identifies five common pitfalls that organisations fall into when using theory of change, and walks through five rules of thumb that will help organisations to use the approach to tackle complex problems.

Thinking and working with political settlements - Kelsall, Tim (ODI, 2016)
• In recent years, Political Settlements Analysis (PSA) has become increasingly influential in academic and policy circles • Despite its intuitive appeal, it seems difficult to use in practice • PSA has a natural affinity with Adaptive Development, Thinking and Working Politically, and Doing Development Differently approaches • By answering the simple diagnostic questions supplied here, development partners can identify the types of political settlements in which they work, and draw some broad operational implications

Thinking and Working Politically (Yangon, October 2016) - British Council (British Council Myanmar, 2017)
On 3-4 October 2016, British Council, Pyoe Pin, The Asia Foundation and UK DFID co-hosted a two day conference on ‘Thinking and Working Politically’ (TWP) for more effective and sustainable development assistance. The success or failure of development programmes is, in many – if not most – cases, determined by domestic politics within countries, rather than by the technical elegance of programme design by external donors. The event brought together international donors, implementing agencies and local partners. Participants compared experiences on what has worked, where and why – both in Myanmar, and across the world including case studies from Sudan, Zambia and the Philippines. Throughout the conference, participants familiarised themselves with politically smart development approaches and what it means to think and work politically in Myanmar. This has laid foundations for greater collaboration on TWP to help meet Myanmar’s critical development challenges.

Thinking and working politically with technology: State of the art meets art of the state - Thampi, Gopa; Nixon, Nicola (From Poverty to Power, 2020)
Based on its work in Sri Lanka, The Asia Foundation argues for greater attention to the local political dynamics into which digital solutions are introduced

Thinking and working politically: What have we learned since 2013? – FP2P - Green, Duncan (From Poverty to Power, 2022)
It’s always a red letter day when a new paper from Graham Teskey drops. His most recent is Thinking and working politically: What have we learned since 2013? For those that don’t know him, Graham is a consummate insider-outsider within the aid sector – long stints at DFID (UK), DFAT (Australia) and now Abt (Management Consultants). From this vantage point he has been one of the leading proponents of ‘thinking and working politically’, always ready to call out the hand-wavey academics and demand some practical lessons, please. This paper is part biography of an idea, setting out the timeline, moments and key documents and policy wins in the evolution of TWP (which seems to have involved a lot of seminars that I missed due to Oxfam’s meagre travel budget). The other part is, to be honest, a bit of a lament – a study in ‘Why Change Hasn’t Happened’, because TWP has ‘got lost in the maelstrom’ of the wider, largely negative, changes in the aid sector. Overall, it’s a brilliant summary, and one I’ll be recommending to my increasingly long-suffering activism students….

Thinking and working politically: What have we learned since 2013 - Teskey, Graham (TWP Community of Practice, 2021)
The Thinking and Working Politically (TWP) Community of Practice (CoP) was established at a small meeting tacked on at the end of a meeting of Governance Advisers working for the United Kingdom’s Department of International Development (DFID) on South and South-East Asian countries, held in Delhi in November 2013. Since then, a number of meetings have been held throughout the world, each addressing different issues; ‘TWP’ has entered the lexicon of mainstream development; the CoP has expanded to more than 300 people; a Washington DC chapter has been established; and the International CoP has been granted modest funding from DFID’s successor, the Foreign, Commonwealth and Development Office (FCDO) and from Australia’s Department of Foreign Affairs and Trade (DFAT). It is legitimate to ask, however, what has been achieved operationally: how have the ideas underpinning TWP affected operational practice? This short paper traces the evolution of the idea and practice of TWP from 2013 to late 2021, and identifies what we have learned. What has been successful, and what has not? I asked in 2017 whether TWP had become a second orthodoxy (Teskey, 2017). Did this represent hubris or was 2017 in some ways the apogee of what might rather grandly be called the TWP ‘movement’?

Thinking and Working Politically: What does it mean, Why is it important and How do you do it? - Leftwich, Adrian (DLP, 2011)
This paper suggests that working politically in a developmental context means directing attention and support to the agents of reform and development (leaders and organisations). This allows investment in the local processes that will resolve problems – such as problems of collective action – through the work of alliances and coalitions. Hence, it will drive the formation and consolidation of the locally appropriate, feasible and legitimate institutions that are most likely to advance development outcomes. The Developmental Leadership Program defines politics as the pervasive, unavoidable and necessary activities of conflict, negotiation and compromise involved in group decision-making about how resources are to be used, produced and distributed. Thinking politically means understanding that both political and technical dimensions are central to developmental outcomes. It also means: Understanding that ‘agency’ matters. That is, that people have the potential to change things, but always withhin the context of given institutional arrangements, which contain both constraints and opportunities. Leaders, organisations and followers think, strategise and attempt to resolve problems in different ways in the same contexts. Understanding leadership as a political process that mobilises people and resources in support of a goal: leaders seldom work on their own. Realising that overcoming collective action problems is a major challenge of development. Collective action problems occur when people with diverse (often competing) interests struggle to agree on an organisational arrangement from which they would all benefit. Understanding that coalitions (formal or informal) are a crucial political mechanism for the resolution of collective action problems. Paying attention to the detailed inner politics of regimes, sectors or issues (‘micro-politics’). This includes understanding who the players are, where they come from, their organisational affiliations, ideologies and interests and the political dynamics involved. (Many political analysis tools are inadequate for this level of detail.) Recognising that processes are as important as projects in development, and vary from context to context. Working politically in development means supporting, brokering, facilitating and aiding the emergence and practices of (public or private) developmental or reform leaderships, organisations, networks and coalitions at any level, and across all sectors. It means helping them to respond to, and work with, initiatives and requests from local individuals and groups. Working politically can also involve: Investing in the effectiveness of developmental coalitions by enhancing the political capacity of organisations in negotiation, advocacy, communication and the generation of constructive policy options. Rethinking higher educational support programmes so that they supplement a skills focus with strategies that help to build networks, and encourage the understanding of collective action problems and of the importance of providing public goods. Acquiring a deep and detailed knowledge of, and long-term exposure to, the country or issue concerned. Respectful and sensitive understanding of local political dynamics and cultural norms. Employing more social scientists and a well-trained, politically savvy workforce, both local and international, with the capacity to ‘read’ the politics. In particular, coalitions can help drive the endogenous politics of developmental reforms by: 1) achieving a specific policy goal; 2) opening up debate on a previously taboo issue; 3) deepening and strengthening the coalition’s internal organisation and relationships for future purposes; and 4) increasing the capacity of constituent organisations. It is also important to understand that: Developmental leaderships and coalitions often emerge in response to a critical juncture – a threat, challenge or danger – or a new opportunity. What matters is whether leaders have the knowledge, education, vision, prior experience and networks to seize such opportunities. The character and conditionality of funding by donors or supporters can make or break a coalition. Are tight conditions applied? Are funding arrangements transparent?

Thinking and Working politically to support developmental leadership and coalitions: The Pacific Leadership Program - Denney, Lisa; McLaren, Rebecca (Research Paper, 2016)

Thinking and Working Politically through Applied Political Economy Analysis. A guide for practitioners - Rocha Menocal, Alina; Cassidy, Marc; Swift, Sarah; Jacobstein, David; Rothblum, Corinne; Tservil, Ilona (USAID, 2018)
Thinking and Working Politically (TWP) through Applied Political Economy Analysis (PEA). A guide for practitioners Have you ever done everything right in a development program — followed every technical best practice — but still missed the mark? When this happens, it often relates to factors in the context beyond any external development actor’s ability to control.

Thinking and working politically: Reviewing the evidence on the integration of politics into development practice over the past decade - Laws, Ed; Marquette, Heather (TWP Community of Practice, 2018)

Thinking and Working Politically: Professional Development Reading Pack - Booth, David (GSDRC Applied Knowledge services, 2015)

Thinking and Working Politically on Health Systems Resilience: Learning from the experience of Cameroon, Nepal and South Africa during COVID-19 - Williams, Gareth (TWP Community of Practice, 2022)

Thinking and Working Politically: Lessons from FOSTER in Nigeria - Lopez Lucia, Elisa; Buckley, Joanna; Marquette, Heather; McCulloch, Neil (Research Paper, 2017)
The Facility for Oil Sector Transparency and Reform (FOSTER) was a £14 million programme that has helped Nigeria to transform its governance of the oil and gas industry. FOSTER ran from 2011 to mid-2016, and used an explicit ‘thinking and working politically’ (TWP) approach. It was funded by the UK Department for International Development (DFID) and managed by Oxford Policy Management (OPM). This paper seeks to identify the factors that drove – or constrained – FOSTER’s achievements, and asks what this can tell us about TWP, particularly in challenging political and sectoral contexts. FOSTER sought to help strengthen oversight and accountability in Nigeria’s oil sector. It aimed to support reformers within government institutions that ‘supply’ accountability (those governing how oil and gas revenues are collected and managed), and to support civil society organisations, parliament, the media and the Nigeria Extractive Industries Transparency Initiative to ‘demand’ reform. In addition, FOSTER commissioned a series of studies and provided media training to help broaden understanding of the sector and highlight the need for reform. This paper examines the outcomes from five ‘clusters’ of FOSTER interventions. The FOSTER team viewed the first three of these in the list below as successful, whereas the latter two did not deliver on expectations but offer important opportunities for learning: • Support to the Nigerian Extractive Industries Transparency Initiative • Support to demand-side actors to promote transparency and accountability in the oil sector • Support for the passage of the Petroleum Industry Bill • An oil spill-mapping social media project • Support to the Department of Petroleum Resources The analysis drew on 44 semi-structured interviews conducted during a month of fieldwork in Abuja and Lagos; on reviews of the programme’s monitoring, evaluation and learning frameworks; and on newspaper articles and grey literature on Nigeria’s oil sector.2

Thinking and Working Politically: Learning from practice. Overview to Special Issue - McCulloch, Neil; Piron, Laure-Hélène (Development Policy Review, 2019)
Over the last 15 years, a set of ideas now referred to as “thinking and working politically” (TWP) has coalesced into a “second orthodoxy” about how to take context into account when implementing development interventions. This approach stresses the importance of obtaining a better understanding of the local context (“thinking politically”) in order to support local actors to bring about sustainable developmental change (“working politically”). However, the evidence base to justify this new approach remains thin, despite a growing number of programmes which purport to be implementing it. Officials in development agencies struggle with putting it into practice and it is unclear how TWP differs—or not—from similar approaches, such as Problem Driven Iterative Adaptation (PDIA) and Doing Development Differently (DDD). This Special Issue sheds light on what TWP means in practice by examining a set of initiatives undertaken by both development partners and government departments in Nigeria, the Occupied Palestinian Territories, China and India. This overview article outlines, in brief, each of the Special Issue's four papers and then draws out five lessons—for funders and for practitioners—from across all the papers. Our five lessons are: (1) the fundamental importance of undertaking political economy analysis (PEA) to adapt programmes to their contexts; (2) the importance of having a realistic level of ambition for interventions; (3) the need to support local ownership—not just “agreement ownership” (between a donor agency and government) or local “management ownership” of the programme, but critically “driver ownership” by generating trust with the key local actors driving change; (4) the need for a more effective set of tools for measuring results in complex programmes that attempt to achieve improvements in long-run governance; and, (5) that although the political economy of donors is often seen as a barrier to applying TWP, the articles show how much can be done with a TWP approach if the analysis takes into account the political economy of donors as well as that of the local context. We conclude with a set of operational recommendations for donors and implementors, as well as suggestions of avenues for further research.
Keywords: Adaptation; Development programmes; Political economy analysis; Reform space; thinking and working politically

Thinking and working politically in the transparency and accountability field - Halloran, Brendan (Transparency & Accountability Initiative, 2014)

Thinking and Working Politically in the Land Sector in Mekong Region - Burns, Tony; Ingalls, Micah; Rickersey, Kate (FIG Congress 2022, 2022)
In recent decades, the World Bank and many bilateral development partners have provided funding to support land administration reform. Traditional land administration reform projects focus on the economic and technical design of interventions based on a library of best practice, commonly avoiding the “messy politics” typically involved in land governance. Experience and lessons from land administration reform initiatives have been documented and a recurrent theme is that many projects fail to create effective, transformative change and gain the critical mass, and the community participation, necessary to ensure the sustainability of land administration reform. Over the last decade there have been concerted efforts to develop more politically informed ways of thinking and working using a range of methodologies referred to, variously, as Thinking and Working Politicallyi (TWP), Problem Driven Iterative Adaptation (PDIA) and Doing Development Differently (DDD). There is little evidence that these different approaches have been applied in the land sector.

Thinking and working politically in Somalia: A case study on the Somalia Stability Fund - Laws, Ed (TWP Coommunity of Practice and ODI, 2018)

Thinking and working politically in large, multi-sector Facilities: lessons to date - Teskey, Graham; Tyrrel, Lavinia (Governance Working Paper 2, 2017)

Thinking and Working Politically in Economic Development Programmes – Some Sprints and Stumbles from a DFID Programme in Kyrgyzstan - Koleros, Andrew; Rinnert, David (From Poverty to Power, 2019)
A DFID programme in Kyrgyzstan offers useful insights into how the Thinking and Working Politically approach can escape from its governance ghetto
Keywords: Case Study

Thinking and Working Politically in development - Coalitions for Change in The Philippines - Sidel, John T.; Faustino, Jaime (The Asia Foundation, 2020)
The Asia Foundation and the Australian Embassy in the Philippines today released a new publication, Thinking and Working Politically in Development: Coalitions for Change in the Philippines. Written by London School of Economics and Political Science Professor John T. Sidel and The Asia Foundation’s Jaime Faustino, the book examines the first phase of the Coalitions for Change program (2012-2018) and the contributions to key development policy reforms in the Philippines. The book is a rigorous treatment of the Coalitions for Change program’s transformative policy reforms—alongside lessons from its failures—across diverse policy arenas and in a wide variety of cities and provinces. The chapters are organized thematically: excise tax reform (Chapter 2), land governance reform (Chapter 3), education (Chapter 4), electoral reform (Chapter 5), disaster risk reduction and management (Chapter 6), and subnational governance reform and conflict resolution in Mindanao (Chapter 7). The co-authors together combine an independent, academic perspective on the program’s impacts (Sidel) with a front-row view of doing policy reform in the Philippines – both its political and technical dimensions (Faustino). Based on the empirical research and comparative analysis undertaken by the authors, the book articulates – and substantiates – a strong set of arguments that help to explain the program’s mixed pattern of achievements and disappointments. Overall, the book concludes that the seven-year program achieved significant and sustainable impact using problem-driven, adaptive, and iterative approaches to developmental change. The authors assert the program was at the forefront of notable development approaches: aid effectiveness and development around thinking and working politically, doing development differently, and adaptive programming. Graham Teskey, an early advocate of ‘thinking and working politically’ explores how development agencies can replicate the conditions for success in his Afterword. With illustrative case studies and analyses, the book provides valuable lessons for policymakers, scholars, bilateral agencies, think-tanks, and anyone interested in successfully maneuvering the shifting dimensions of development in the Philippines and elsewhere.

Thinking and Working Politically: from theory building to building an evidence base - Dasandi, Niheer; Marquette, Heather; Robinson, Mark (Research Paper, 2016)
This paper discusses the steps required to build a robust evidence base for 'thinking and working politically' (TWP) in development. It argues that better understanding what works, when and why is an important step in moving TWP into mainstream development programming. The paper reviews the existing evidence base on TWP, building on this and on other literature on public sector reform and 'pockets of effectiveness' to suggest research questions, case study selection criteria, and a four-level analytical framework: 1) political context; 2) sector; 3) organisation; and 4) individual. The framework aims to help build a 'rigorous enough' evidence base to show whether and how TWP happens and whether or not it influences the effectiveness of programme implementation and outcomes. The paper also calls for more focus on gender issues, and on different – and often more fragile – political contexts.
Keywords: IMPORTANT

Thinking and Working Politically – Are We Seeing the Emergence of a Second Orthodoxy? - Teskey, Graham (Governance Working Paper 1, 2017)
There now is a persuasive volume of evidence that demonstrates that capacity and technical knowledge alone are insufficient to change deeply entrenched political interests and bureaucratic norms. These critiques demonstrate that an understanding of power asymmetries is frequently the critical missing ingredient in project design and implementation. Many eminent thinkers have looked at the difference between success and failure in development, and all point to the primacy of domestic politics. This point has not been lost on development agencies and some have tried to provoke greater attention to the role that politics plays. However, this recognition is yet to pass into the mainstream of development practice. Despite the slow but sure accretion of this knowledge the international community seems to be wedded to doing development traditionally. The purpose of this paper is to consider the extent to which a ‘second orthodoxy’ is slowly emerging which can stand alongside, and in some cases may supplant, the ‘first orthodoxy’ of the traditional project framework. Care has to be taken in making this argument, as there is certainly no consensus within the development community on its importance, and even among advocates, there are slightly differing interpretations of what this second orthodoxy looks like. Further, it is not absolutely clear that the two orthodoxies can co-exist. The paper does not call for any ‘paradigm shift’ in how development practitioners conceptualise programs and projects, nor does it demand that the project framework be scrapped; the former would be impossible and the latter undesirable. Equally readers will find no claims that Doing Development Differently or ‘Thinking and Working Politically’ will always and everywhere guarantee better development outcomes. Rather, the paper seeks to summarise how the two orthodoxies differ, where the second orthodoxy now stands, and propose how it can be taken forward in practical terms.

Thinking and working politically: An introduction to key ideas, examples and further reading - Laws, Ed; Marquette, Heather (TWP Community of Practice, 2018)

“There’s no money for that.” Three Ways to Resource Collaborating, Learning, and Adapting - Salib, Monalisa (USAID Learning Lab, 2016)
This blog is the third in an ongoing series exploring the components of USAID's CLA Framework. Here is the first blog on organizational culture and the second on effective learning.

Theory of Change Workbook: A Step-by-Step Process for Developing or Strengthening Theories of Change - Salib, Monalisa (USAID, 2022)
While over time theories of change have become synonymous with simple if/then statements, a strong theory of change should actually be a much more detailed, context-specific articulation of how we *theorize* change will happen under a program.

Theory of Change Thinking in Practice - van Es, Marjan; Guijt, Irene; Vogel, Isabel (2015)
Want to know better how your interventions can contribute to change? A Theory of Change (ToC) approach helps in deepening your understanding - and that of your partners - of how you collectively think change happens and what the effect will be of your intervention. Not only does it show what political, social, economic, and/or cultural factors are in play, it also clarifies your assumptions. Once a ToC has been developed, it can be used to continually reflect on it in ways that allow for adaptation and checking of assumptions of your intervention. This user friendly guideline helps you to use a Theory of Change approach. Theories of change are the ideas and beliefs people have – consciously or not – about why and how the world and people change. How people perceive and understand change and the world around them is infused by their underlying beliefs about life, human nature and society. They are deep drivers of people’s behaviour and of the choices they make. Social change processes are complex and characterised by non-linear feedback loops: our own actions interact with those of others and a myriad of influencing factors. This triggers reactions that cannot be foreseen and makes outcomes of change interventions unpredictable. Given these uncertainties, how can we plan strategically and sensibly? How can social change initiatives move forward in emerging change processes in a flexible way, while remaining focused on the goal? In this context of complexity, Hivos has found a theory of change (ToC) approach useful in guiding its strategic thinking and action, as well as its collaborative efforts with others. As it fosters critical questioning of all aspects of change interventions and supports adaptive planning and management in response to diverse and quickly changing contexts. It contributes to the quality and transparency of strategic thinking, and therefore to personal, organisational and social learning. This guide builds on the experiences of Hivos working with a ToC approach. It is a practical guide for Hivos staff in applying a Theory of Change approach, but is also very useful for others working on social change such as social entrepreneurs and innovators. This guide builds on the work of a ToC Learning Group initiated by Hivos and comprising of staff of the Centre for Development Innovation (CDI) of Wageningen University and Research Centre and of experts Iñigo Retolaza Eguren, Isabel Vogel and Irene Guijt. For current thinking and work on the use of Theory of Change thinking in complex change processes, see http://www.theoryofchange.nl

Theory of change software - Better Evaluation (2023)
There are a number of options when it comes to using software to help create a logic model. These range from generic word processing tools (Word, Powerpoint, or their Google Doc or Mac equivalents), to software that has been specifically tailored for visualising Theories of Change, like TOCO or Miradi. You should consider what resources you have to invest in software, both in terms of cost and in time to learn and use the features. If you only have a short timeframe and have simple needs, then a basic tool may suit you better than some of the more complex software available. It's important to investigate a few options and see what is going to be best for you.

Theory of change in ten steps - Noble, James (NPC, 2019)

Theory of Change in complex Research for Development programmes: challenges and solutions from the Global Challenges Research Fund - Chapman, Sarah; Boodhoo, Adiilah; Duffy, Carren; Goodman, Suki; Michalopoulou, Maria (The European Journal of Development Research, 2023)
The United Kingdom Research and Innovation (UKRI) Global Challenges Research Fund (GCRF) aimed to address global challenges to achieve the United Nations (UN) Sustainable Development Goals through 12 interdisciplinary research hubs. This research documents key lessons learned around working with Theory of Change (ToC) to guide Monitoring, Evaluation and Learning (MEL) within these complex research for development hubs. Interviews and document reviews were conducted in ten of the research hubs. The results revealed that only one hub invested in an explicit visual system mapping approach, and that funder timelines, budget constraints and issues with capacity and expertise limited the application of these approaches across all hubs. In contrast, many hubs attempted to deal with visual complexity by means of ether constructing multiple, nested ToCs, or a conscious simplification of complexity through reducing their ToC towards a straightforward and uncomplicated chain model or spherical model. While the former approach had some value, most hubs struggled to find capacity to support the full articulation of nested ToCs. In contrast, the latter approach resulted in ToCs which lacked detail or mechanism articulation, but which nevertheless were often ‘fit for purpose’ in ensuring effective communication and coherence across diverse stakeholders and sub-projects. We conclude that in instances where the reporting, funding and management cycles of complex research for development programmes cannot be adapted to properly support learning-based approaches to ToC development, imposing simplicity in the ToC might be fit for purpose. This might also be preferable to more complex visual approaches that are only partially realised.

Theory of Change: From novice to master changemaker - Changeroo (2020)
Theory of Change is more than just a tool or instrument. It is a mindset! A mindset to optimise impact management. As the cornerstone of impact management it is indispensable to any purpose-driven organisation targeting social or environmental value creation. It offers you the cornerstone of a learning approach toward change and impact. A way to build a mindset and organisational culture of critical reflection, co-creation with stakeholders and constant analysis of what works, why, for whom and under what circumstances. Are you ready to take impact management to the next level with the help of Theory of Change? We offer you the premier online course to learn everything about this approach.

Theory of Change Analysis: Building Robust Theories of Change - Mayne, John (Canadian Journal of Program Evaluation, 2017)
Models for theories of change vary widely as do how they are used. What constitutes a good or robust theory of change has not been discussed much. This article sets out and discusses criteria for robust theories of change. As well, it discusses how these criteria can be used to undertake a vigorous assessment of a theory of change. A solid analysis of a theory of change can be extremely useful, both for designing or assessing the designs of an intervention as well as for the design of monitoring regimes and evaluations. The article concludes with a discussion about carrying out a theory of change analysis and an example.

Theory of Change - Rogers, Patricia (Methodological Briefs: Impact Evaluation, 2014)

Theory of Action: Creating Craddle to Career Proof Points - Strive Together (Strive Together, 2014)
StriveTogether’s Theory of Action provides a framework for improving educational outcomes and ensuring a community transforms how it serves children.

Theory-Based Approaches to Evaluation: Concepts and Practices - Treasury Board of Canada Secretariat (Government of Canada, 2021)
This document introduces some of the key concepts of theory-based approaches to evaluation. It is hoped that readers will be encouraged by the information and advice provided in this document and will explore the use (e.g., through pilot evaluations) of theory-based approaches to evaluation in a federal setting. To support this, Sections 1.0 to 8.0 of the document describe the general application of theory-based approaches to evaluation, and Sections 9.0 and 10.0 discuss the potential application of theory-based approaches to a range of federal programs. This document is neither an exhaustive training program in theory-based evaluation nor a step-by-step guide to undertaking a theory-based evaluation. Evaluators who wish to integrate theory-based approaches into their practices are encouraged to pursue additional readings (including those referenced in this document) and, as appropriate, to seek additional support in undertaking a theory-based evaluation.

Theory amidst complexity – using process tracing in ex-post evaluations - Krueger, Kate; Wright, Molly (New Directions for Evaluation, 2022)
Evaluators who take a complexity-aware approach must consider tradeoffs related to theoretical parsimony, falsifiability, and measurement validity. These tradeoffs may be particularly pronounced with ex-post evaluation designs in which program theory development and monitoring frameworks are often completed before the evaluator is engaged. In this chapter, we argue that theory-based evaluation (TBE) approaches can address unique ex-post evaluation challenges that complexity-aware evaluation (CAE) alone cannot, and that these two sets of approaches are complimentary. We will outline strategies that evaluators may use to conduct rigorous ex-post evaluations of democracy, human rights, and governance (DRG) interventions that merge CAE's inductive approaches with a theory-testing structure. It will illustrate these strategies with two case studies of ex-post evaluation using process tracing (PT).

Theories of Change: time for a radical approach to learning in development - Valters, Craig (ODI, 2015)
The Theory of Change approach demands a radical shift towards more and better learning in development thinking and practice, creating a productive and much-needed space for critical reflection.

Theories of change in international development: Communication, learning, or accountability? - Valters, Craig (JSRP Paper 17, 2014)

Theories of Change for Promoting Empowerment and Accountability in Fragile and Conflict-Affected Settings - Green, Duncan (IDS Working Paper, 2017)
This paper explores the current state of thinking among a range of aid actors (multilaterals, bilateral, applied scholars and international non-governmental organisations) on how to promote empowerment and accountability in fragile, conflict and violence affected settings. It seeks to identify trends, gaps and weaknesses in that thinking, and propose research questions and hypotheses to test. Three underlying sources of confusion are identified that are hindering progress on both understanding empowerment and accountability in fragile, conflict and violence affected settings, and taking helpful action to promote it. They are: Theory of endogenous change (e.g. on how empowerment and accountability arise in situ) versus the theory of action of an external intervention; Fragility versus conflict: there is no clear justification for combining these different aspects into a single category; and Empowerment versus accountability: donor analysis and practice has been overwhelmingly weighted towards accountability, exhibiting limited understanding or interest in the nature of power.
Keywords: A4EA; External actors; Participation

The White Man's Burden: Why the West's Efforts to Aid the Rest Have Done So Much Ill and So Little: Why the West's Efforts to Aid the Rest Have Done So Much Ill and So Little Good - Easterly, William (Oxford University Press, 2007)
We are all aware of the extreme hunger and poverty that afflict the world's poor. We hear the facts, see the images on television, buy the T-shirt and are moved as individuals and governments to dig deep into our pockets. Yet what happens to all this aid? Why after 50 years and $2.3 trillion are there still children dying for lack of twelve cents medicine? Why are there so many people still living on less than $1 a day without clean water, food, sanitation, shelter, education or medicine? In The White Man's Burden William Easterly, acclaimed author and former economist at the World Bank, addresses these twin tragedies head on. While recognising the energy and compassion behind the campaign to make poverty history he argues urgently and powerfully that grand plans and good intentions are a part of the problem not the solution. Giving aid is not enough, we must ensure that it reaches the people who need it most and the only way to make this happens is through accountability and by learning from past experiences. Without claiming to have all the answers, William Easterly chastises the complacent and patronising attitude of the West that attempts to impose solutions from above. In this book, which is by turns angry, moving, irreverent but always rigorous, he calls on each and everyone of us to take responsibility, whether donors, aid workers or ordinary citizens, so that more aid reaches the people it is supposed to help, the mother who cannot feed her children, the little girl who has to collect firewood rather than go to school, the father who cannot work because he has been crippled by war.

The Whistler principles to accelerate innovation for development impact - G7 (G7, 2018)
The Whistler principles to accelerate innovation for development impact : 2018 G7 Summit – Canada 2018 G7 Presidency – Charlevoix, Quebec

The water of Systems Change: Action learning exercise - Kania, John; Kramer, Mark; Senge, Peter (FSG, 2018)
Based on the “inverted triangle” framework presented in The Water of Systems Change, this activity is designed to help individuals think systemically about social change, explore what is happening below the surface on issues they care about, and determine how they and their organizations can pursue large-scale change in a disciplined and holistic manner. The exercise is divided into 3 parts: Part I uses the “inverted pyramid” introduced in The Water of Systems Change to perform an external assessment of opportunities to make progress on the social or environmental issue you are focused on. Part II uses the same framework to consider internal conditions within yourself and your organization that should change in order for you to better support progress on your issue. Part III takes what was developed in Parts I and II and asks “What to do next?”

The water of Systems Change - Kania, John; Kramer, Mark; Senge, Peter (FSG, 2018)
Foundations involved in systems change can increase their odds for success by focusing on the least explicit but most powerful conditions for change, while also turning the lens on themselves. The Water of Systems Change aims to clarify what it means to shift these conditions. We offer the “inverted triangle” framework as an actionable model for funders and others interested in creating systems change, particularly those who are working to advance equity. Top Takeaways Systems change is about advancing equity by shifting the conditions that hold a problem in place. To fully embrace systems change, funders should be prepared to see how their own ways of thinking and acting must change as well. Shifts in system conditions are more likely to be sustained when working at three different levels of change: explicit, semi-explicit, and implicit.

The Use and Abuse of the Logical Framework Approach: A Review of International Development NGOs' Experiences - Bakewell, Oliver; Garbutt, Anne (Sida, 2005)
The logical framework approach (LFA) has come to play a central role in the planning and management of development interventions over the last twenty years. Although the logical framework has become universally known, it is far from universally liked. It has been the subject of much criticism over the years, concerning both the theoretical basis of the approach, and the way it is applied in practice. In this review, we have attempted to take stock of the current views of international development NGOs on the LFA and the ways in which they use it.

The usability of climate information in sub-national planning in India, Kenya and Uganda: the role of social learning and intermediary organisations - Fisher, Susannah; Dodman, David; Epp, Marissa Van; Garside, Ben (Climatic Change, 2018)
Abstract Research on using climate information has often focused on the interaction between users and producers and the technical fit of information for real decision-making. However, due to resource and capacity constraints within both user and producer communities, this approach will not always be feasible or indeed necessary depending on the decisions at hand. These contexts have been relatively under-explored by scholars, and this paper provides an original empirical contribution using three case studies of sub-national governments in India, Kenya and Uganda. In the paper, we analyse how social learning supports changing the usability of climate information and the role of intermediary organisations in these processes. Firstly, the paper shows that intermediaries often choose to build the commitment to project aims rather than using climate information as an entry point to working on climate change, and this allows them to instigate challenging learning processes. Secondly, there are barriers to iterative processes and critical reflection with government stakeholders but these processes can gain traction when built into institutional practices such as formal M&E processes. Lastly, social learning can broaden the framing of climate change from a single sector issue to a multi-sectoral one. We conclude by arguing that bringing together scholarship on social learning with that on the usability of climate information can deepen understanding of the dynamic context in which the information becomes usable. The evidence from the case studies shows that learning processes can alter this context across scales.

The unofficial SCRUM checklist - Kniberg, Henrik (CRISP, 2010)

The UNDP Accelerator Labs enter a year of maturity: let a thousand flowers bloom! - Annual report 2022 - UNDP accelerator labs (UNDP, 2022)
The UNDP Accelerator Labs were designed as an agile and dynamic Network to allow communication and information transfer between 91 Accelerator Labs in 115 countries, and with the global innovation ecosystem, UNDP as a whole, and thousands of partners including grassroots innovators and their communities. The accumulated knowledge of this Network creates new pathways to the solutions that hold the key to sustainable development problems. What it looked like and how it unfolded last year will be illuminated in this annual report: The UNDP Accelerator Labs enter a year of maturity: let a thousand flowers bloom!

The Truth of the Work: Theories of Change in a changing world - Reeler, Doug; van Blerk, Rubert (The Community Development Resource Association, 2017)

The Toyota Way: 14 Management Principles from the World's Greatest Manufacturer - Liker, Jeffrey K. (McGraw-Hill, 2004)
How to speed up business processes, improve quality, and cut costs in any industryIn factories around the world, Toyota consistently makes the highest-quality cars with the fewest defects of any competing manufacturer, while using fewer man-hours, less on-hand inventory, and half the floor space of its competitors. The Toyota Way is the first book for a general audience that explains the management principles and business philosophy behind Toyota's worldwide reputation for quality and reliability.Complete with profiles of organizations that have successfully adopted Toyota's principles, this book shows managers in every industry how to improve business processes by:Eliminating wasted time and resources Building quality into workplace systems Finding low-cost but reliable alternatives to expensive new technology Producing in small quantities Turning every employee into a quality control inspector

The Systems Work of Social Change: How to Harness Connection, Context, and Power to Cultivate Deep and Enduring Change - Rayner, Cynthia; Bonnici, François (OUP Oxford, 2021)
The issues of poverty, inequality, racial justice, and climate change have never been more pressing or paralyzing. Current approaches to social change, which rely on industrial models of production and power to "solve" social problems, are not helping. In fact, they are designed to entrench the status quo. In The Systems Work of Social Change, Cynthia Rayner and François Bonnici draw on two hundred years of history and a treasure trove of stories of committed social changemakers to uncover principles and practices for social change that radically depart from these approaches. Rather than delivering "solutions," these principles and practices focus on the process of change itself. Through rich storytelling and lucid analysis, Rayner and Bonnici show that connection, context, and power sit at the heart of the change process, ensuring broader agency for people and communities to create social systems that are responsive and representative in a rapidly changing world. Simple yet profound, this book distills a timely set of lessons for practitioners, leaders, scholars, and policymakers.

The Success Case Method: A Simple Evaluation Tool to Identify Critical Success Factors and Program Impa - Bell, Catherine; McDonalds, Diane (2006 Australian Evaluation Society International Conference, 2006)
Identification and reporting of critical success factors and program impact in an efficient, yet comprehensive manner is an inherent difficulty facing many evaluators of large-scale evaluations. This paper details how two evaluators encountered such problems in the initial review of a large-scale initiative and then successfully addressed these issues through the application of the Success Case Method in a subsequent evaluation of the same program. The Success Case Method is a down-to-earth evaluation tool that can be used for: finding out what is working and what is not, which also provides accurate and trustworthy information that can be used to make timely decisions (Brinkerhoff, 2003, p.3). This paper reports on the advantages of applying this approach to the evaluation of the Primary Welfare Officer Initiative (PWOI), a program that aims to improve the capacity of schools to support students at risk of disengagement and who are not achieving their educational potential.

The struggle for organisational change: how the ActionAid Accountability, Learning and Planning System emerged - Scott-Villiers, Patta (Policy & Practice, 2002)
Change is driven not only by good ideas, but also by disagreement and frustration. This article takes the reader through a selective organisational history of the British NGO ActionAid from 1998 to 2001, looking at events and changes that had a bearing on the

The Soul in the Computer: The Story of a Corporate Revolutionary - Waugh, Barbara (Inner Ocean Publishing, 2001)
When Barbara Waugh joined the Hewlett-Packard Corporation in the mid-80's, this 60's radical encountered a company with a benign but topdown leadership. As she progressed from recruiting manager to world change manager, she used a set of radical tools to transform its corporate culture and to help realize the true potential of The HP Way.

The Social Realities of Knowledge for Development - Georgalakis, James; Jessani, Nasreen; Oronje, Rose; Ramalingam, Ben (IDS, 2017)
This edited collection of peer-reviewed papers explores critical challenges faced by organisations and individuals involved in evidence-informed development through a diverse set of case studies and t...

The Secret Sauce of Development Professionals: Tools for Assessing TOR Potential to Source Scalable Learning Interventions - Barton, Adam (Research on Improving Systems of Education (RISE), 2023)
Terms of reference (TORs) play an outsized role in driving scalable educational programming. These procurement documents shape, constrain, and signal programme priorities and possibilities. Successful funders and implementers across the globe hold rich processual knowledge about this documentation, which they use to draft and assess TORs. This project explores such best-practice knowledge around TOR review, seeking to support the design and implementation of educational programmes that can improve learning at scale in developing contexts.

The Scrum Guide - Schwaber, Ken; Sutherland, Jeff (scrum.org, 2016)

The Science of Using Science: Researching the Use of Research Evidence in Decision-Making - Langer, Laurenz; Tripney, Janice; Gough, David (EPPI-Centre, Social Science Research Unit, UCL Institute of Education, University College London, 2016)

The Science in Adaptive Management - Ripley, Matt; Jaccard, Sabine (ILO, 2016)
‘Adaptive management’ is all the rage in international development circles. But to avoid yet another buzzword – we need to learn from the experience of natural resource science.
Keywords: IMPORTANT

The SAVI programme in Nigeria: Towards politically smart, locally led devlopment - Booth, David; Chambers, Victoria (ODI, 2014)
 More examples are needed of aid programming that works by being responsive to country realities: politically smart, problem-driven and locally led  DFID’s SAVI programme has revealed a hitherto untapped potential for change leading to better development results at state level in Nigeria  SAVI provides low-profile support to state-level organisations and partnerships, building their capacity to engage constructively with government  It avoid the pitfalls of a donor-driven approach by ‘taking the money off the table’  This illustrates the power of facilitated multi-stakeholder engagement and the disadvantages of seeing this in terms of ‘supply side’ and ‘demand side’ governance  The set-up of the DFID suite of state-level programmes, with separately managed sector support and ‘governance’ initiatives, has limited realisation of the potential  Key enabling conditions were that DFID provided space for an experience-based design process and permitted tangible results to be judged retrospectively, not pre-programmed

The Samaritan's Dilemma: The Political Economy of Development Aid - Gibson, Clark C.; Andersson, Krister; Ostrom, Elinor; Shivakumar, Sujai (Oxford University Press, 2005)
What's wrong with foreign aid? Many policymakers, aid practitioners, and scholars have called into question its ability to increase economic growth, alleviate poverty, or promote social development. At the macro level, only tenuous links between development aid and improved living conditions have been found. At the micro level, only a few programs outlast donor support and even fewer appear to achieve lasting improvements. The authors of this book argue that much of aid's failure is related to the institutions that structure its delivery. These institutions govern the complex relationships between the main actors in the aid delivery system and often generate a series of perverse incentives that promote inefficient and unsustainable outcomes. In their analysis, the authors apply the theoretical insights of the new institutional economics to several settings. First, they investigate the institutions of Sida, the Swedish aid agency, to analyze how that aid agency's institutions can produce incentives inimical to desired outcomes, contrary to the desires of its own staff. Second, the authors use cases from India, a country with low aid dependence, and Zambia, a country with high aid dependence, to explore how institutions on the ground in recipient countries also mediate the effectiveness of aid. Throughout the book, the authors offer suggestions about how to improve aid's effectiveness. These suggestions include how to structure evaluations in order to improve outcomes, how to employ agency staff to gain from their on-the-ground experience, and how to engage stakeholders as "owners" in the design, resource mobilization, learning, and evaluation processes of development assistance programs.

The role of social learning in adaptiveness: insights from water management - Lebel, Louis; Grothmann, Torsten; Siebenhüner, Bernd (International Environmental Agreements: Politics, Law and Economics, 2010)
The article introduces the notion of adaptiveness and discusses the role of social learning in it. Adaptiveness refers to the capacity of a social actor or social–ecological system to adapt in response to, or in anticipation of, changes in the environment. We explore arguments both from a theoretical perspective and through illustrations from case studies of water management in the Alps of Europe and Mekong in southeast Asia. We propose and illustrate that social learning processes are important for building adaptiveness in several ways and at different scales. Social learning can help cope with informational uncertainty; reduce normative uncertainty; build consensus on criteria for monitoring and evaluation; empower stakeholders to take adaptive actions; reduce conflicts and identify synergies between adaptations; and improve fairness of decisions and actions. Findings in the case studies provide some support for these generalizations but often with caveats related to diversity of stakeholder interests, levels of shared understanding versus contested knowledge and scale of coordination. For this reason, we suggest that future work pays greater attention to issues of agency, knowledge and scale: What strategies have individuals and organizations pursued in successful examples of social learning? How are the boundaries and interactions between science, policy and practice managed? How does social learning occur across spatial and temporal scales?
Keywords: Adaptation; European Alps; Fairness; Mekong River; Social learning; Uncertainty; Water management

The role of research and learning in adaptive programming - Babon, Andrea; Denney, Lisa (Devpolicy Blog from the Development Policy Centre, 2018)
Andrea Babon and Lisa Denney explore how learning partners - a common feature of aid programs - can operate and feed into programs.

The Role of Outcome Mapping in Developing a Rural Telemedicine System - Tucker, William; Blake, Edwin (University of the Western Cape, 2008)
We describe the use of Outcome Mapping to guide the design of a rural telemedicine consultation system in South Africa. While Outcome Mapping was not primarily intended to guide design, we show that it tied in well with a cyclical participatory design method for an Information and Communication Technology for Development project

The Role of External Actors in Supporting Social and Political Action towards Empowerment and Accountability with a Focus on Fragile, Conflict- and Violence-Affected Settings - Christie, Angela; Burge, Richard (IDS Working Paper 503, 2017)
This paper explores the role and experience of external actors, particularly donors, in supporting social and political action in fragile, conflict and violence affected settings. Evidence is distilled from a wide range of synthesised sources to generate relevant findings and questions in relation to what we know and what we don’t. Included among the source material is a 2016 macro-evaluation of DFID’s empowerment and accountability (E&A) programmes which examined over 50 DFID funded projects. Themes which emerge relate to: how external actors need to think about the context and work politically; who are the most appropriate social and political actors to support in E&A; whether a direct or indirect approach to support for E&A achieves more tangible outcomes; whether external actors should move beyond short-term tools and tactics focused on one-sided engagement; and whether programmes should be designed around more strategic, multi-faceted interventions. The paper concludes with identifying a number of gaps in the evidence which are translated into a range of questions which could potentially inform the Action for Empowerment and Accountability (A4EA) research programme.

The road to results: designing and conducting effective development evaluations - Imas, Morra; G, Linda; Rist, Ray C. (The World Bank, 2009)
The analytical, conceptual, and political framework of development is changing dramatically. The new development agenda calls for broader understandings of sectors, countries, development strategies, and policies. It emphasizes learning and continuous feedback at all phases of the development cycle. As the development agenda grows in scope and complexity, development evaluation follows suit. Development evaluator are moving away from traditional implementation and output-focused evaluation models toward results-based evaluation models, as the development community calls for results and embraces the millennium development goals. As the development community shifts its focus away from projects in order to comprehensively address country challenges, development evaluators are seeking methods with which to assess results at the country, sector, theme, policy, and even global levels. As the development community recognizes the importance of not only a comprehensive but also a coordinated approach to developing country challenges and emphasizes partnerships, development evaluators are increasingly engaged in joint evaluations. These joint evaluations, while advantageous in many respects, add to the complexity of development evaluation (OECD 2006). Additionally, development evaluators increasingly face the measurement challenge of determining the performance of an individual development organization in this broader context and of identifying its contribution. This text is intended as a tool for use in building development evaluation capacity. It aims to help development evaluators think about and explore the new evaluation architecture and especially to design and conduct evaluations that focus on results in meeting the challenges of development.

The road to adaptive management: knowledge, leadership, culture and rules - Byrne, Karri Goeldner; Sparkman, Timothy; Fowler, Ben (The BEAM Exchange, 2016)
Keywords: IMPORTANT; Practice

The rise of the randomistas: on the experimental turn in international aid - Donovan, Kevin P. (Economy and Society, 2018)
In recent years, the use of experimental methodologies has emerged as a central means of evaluating international aid interventions. Today, proponents of randomized control trials (so-called randomistas) are among the most influential of development experts. This paper examines the growth of this thought collective, analysing how uncertainty has become a central concern of development institutions. It demonstrates that transformations within the aid industry – including the influence of evidence-based policy, the economization of development and the retreat from macro-planning – created the conditions of possibility for experimentation. Within this field, the randomistas adeptly pursued a variety of rhetorical, affective, methodological and organizational strategies that emphasized the lack of credible knowledge within aid and the ability of experiments to rectify the situation. Importantly, they have insisted on the moral worth of experimentation; indeed, the experimental ethic has been proposed as the way to change the spirit of development. Through causal certitude, they propose to reduce human suffering. The rise of experimentation has not, however, eliminated accusations of uncertainty; rather, it has redistributed the means through which knowledge about development is considered credible.
Keywords: Development; Evidence; Experimentation; aid; uncertainty

The relationship between adaptive management of social-ecological systems and law: a systematic review - Frohlich, Miguel F.; Jacobson, Chris; Fidelman, Pedro; Smith, Timothy F. (Ecology and Society, 2018)
Adaptive management has been considered a valuable approach for managing social-ecological systems involving high levels of complexity and uncertainty. However, many obstacles still hamper its implementation. Law is often seen as a barrier for moving adaptive management beyond theory, although there has been no synthesis on the challenges of legal constraints or how to overcome them. We contribute to filling this knowledge gap by providing a systematic review of the peer-reviewed literature on the relationship between adaptive management and law in relation to social-ecological systems. We analyze how the scholarship defines the concept of adaptive management, identifies the legal barriers to adaptive management, and the legal strategies suggested for enabling this approach. Research efforts in this domain are still highly geographically concentrated in the United States of America, unveiling gaps concerning the analysis of other legal jurisdictions. Overall, our results show that more flexible legal frameworks can allow for adaptive management without undermining the role of law in providing stability to social interactions. Achieving this balance will likely require the reform of existing laws, regulations, and other legal instruments. Legal reforms can facilitate the emergence of adaptive governance, with the potential to support not only adaptive management implementation but also to make law itself more adaptive.

The Relational Work of Systems Change - Millgan, Katherine; Zerda, Juanita; Kania, John (Stanford Social Innovation Review, 2022)
Collective impact efforts must prioritize working together in more relational ways to find systemic solutions to social problems. Sometimes we lose sight of a simple truth about systems: They are made up of people. Despite all of the frameworks and tools at our disposal and all of our learning as a field of practice, purely technical, rational approaches to systems change will not make much of a dent in shifting power or altering our most deeply held beliefs. If most collective impact efforts fall short of supporting people to change in fundamentally consciousness-altering ways, then, the system they are a part of will not significantly change either. However, over the past two decades, the prevailing view among many funders, board members, and institutional leaders has been that only quantifiable and predetermined outcomes can create impact. But if the interrelated, devastating, and deepening crises and divisions over the past two years have taught us anything, it is that complex, adaptive problems defy tidy logic models and reductive technical solutions. It is time to invest our collective energy in more relational and emergent approaches to transforming systems.

The Realities of Community Based Natural Resource Management and Biodiversity Conservation in Sub-Saharan Africa - DeGeorges, Paul Andre; Reilly, Brian Kevin (Sustainability, 2009)
This is an historic overview of conservation in Sub-Saharan Africa from pre-colonial times through the present. It demonstrates that Africans practiced conservation that was ignored by the colonial powers. The colonial market economy combined with the human and livestock population explosion of the 21st century are the major factors contributing to the demise of wildlife and critical habitat. Unique insight is provided into the economics of a representative safari company, something that has not been readily available to Community Based Natural Resources Management (CBNRM) practitioners. Modern attempts at sharing benefits from conservation with rural communities will fail due to the low rural resource to population ratio regardless of the model, combined with the uneven distribution of profits from safari hunting that drives most CBNRM programs, unless these ratios are changed. Low household incomes from CBNRM are unlikely to change attitudes of rural dwellers towards Western approaches to conservation. Communities must sustainably manage their natural areas as "green factories" for the multitude of natural resources they contain as a means of maximizing employment and thus household incomes, as well as meeting the often overlooked socio-cultural ties to wildlife and other natural resources, which may be as important as direct material benefits in assuring conservation of wildlife and its habitat. For CBNRM to be successful in the long-term, full devolution of ownership over land and natural resources must take place. In addition, as a means of relieving pressure on the rural resource base, this will require an urbanization process that creates a middleclass, as opposed to the current slums that form the majority of Africa‘s cities, through industrialization that transforms the unique natural resources of the subcontinent (e.g., strategic minerals, petroleum, wildlife, hardwoods, fisheries, wild medicines, agricultural products, etc.) in Africa.
Keywords: Development; conservation; industrialization; population; wildlife

The Rapid Evaluation, Action, and Learning (REAL) Approach: A toolkit to measure and refine changes and interventions in health campaigns - PATH (PATH, 2019)
Evaluative Tools for Improving Campaign Effectiveness Public health campaigns aim to control disease or deliver essential health services and products through time-limited and periodic channels. Many countries use campaigns to augment or replace routine service delivery, to target certain populations, or to accelerate progress towards coverage targets. The Root Cause Analysis and Rapid Evaluation, Action, and Learning toolkits present a systematic but flexible approach to identifying the root causes of campaign bottlenecks and then designing, testing, and refining solutions to optimize potential impact. These toolkits respond to a growing need for “fit-for-purpose” rapid-testing, adaptive learning approaches to evaluation and the need for a culture shift toward iterative adaptation and improvement that integrates measurement and evidence-informed decision-making into daily practice. The comprehensive package of toolkits, in addition to the individual Root Cause Analysis toolkit and Rapid Evaluation, Action, and Learning toolkit are available below.

The Radical How - Greenway, Andrew; Loosemore, Tom (Nesta and Public Digital, 2024)
Any mission-focused government should be well equipped to define, from day one, what outcomes it wants to bring about. But radically changing what the government does is only part of the challenge. We also need to change how government does things. The usual methods, we argue in this paper, are too prone to failure and delay. There’s a different approach to public service organisation, one based on multidisciplinary teams, starting with citizen needs, and scaling iteratively by testing assumptions. We’ve been arguing in favour of it for years now, and the more it gets used, the more we see success and timely delivery. We think taking a new approach makes it possible to shift government from an organisation of programmes and projects, to one of missions and services. It offers even constrained administrations an opportunity to improve their chances of delivering outcomes, reducing risk, saving money, and rebuilding public trust. The Radical How in a nutshell The struggles and shortcomings of delivering in government are well rehearsed. Many of the root causes that make it tough have been restated several times over several decades. But what to do? We believe the government can and should change how it delivers, by: organising around multidisciplinary teams embracing incremental, feedback-driven iteration focusing more on outcomes. The Radical How is a change of mindset as much as a change in organisation. It promotes methods and processes that have been shown to work, multiple times, at scale. They are the default ways of working for many of the world’s most successful companies. However, the occasions where they have been deployed are rare in government. These occasions have come about thanks to exceptional leaders, exceptional circumstances, or both. We think they’d make a big difference if they became the norm, rather than the exception. We also think that without them, mission oriented government will not become a reality. New policy ideas will remain just that, rather than translating into profound improvements to society. Central to this approach is the widespread adoption of internet-era ways of working. This paper explains both those and our thinking in more detail, with reference to real examples.

The Qualitative Impact Assessment Protocol (QUIP) - Copestake, James; Remnant, Fiona (CDS Briefing Paper, 2015)
This brief presents an overview of the QUIP in three steps: the background to the QUIP and its main aims; the data collection and analysis methodology; and QUIP in the context of other approaches to evaluation. Each section can be read independently, depending on time available.

The Promise of Lean Experimentation - Murray, Peter; Ma, Steve (Stanford Social Innovation Review, 2015)
By adopting a model from business, nonprofit organizations can launch, test, and implement new programs and services more efficiently. Includes magazine extras.
Keywords: IMPORTANT

The Principle of the Malevolent Hiding Hand; or, the Planning Fallacy Writ Large - Flyvbjerg, Bent; Sunstein, Cass R. (Soocial Research, 2016)
We identify and document a new principle of economic behavior: the principle of the Malevolent Hiding Hand. In a famous discussion, Albert Hirschman celebrated the Hiding Hand, which he saw as a benevolent mechanism by which unrealistically optimistic planners embark on unexpectedly challenging plans, only to be rescued by human ingenuity, which they could not anticipate, but which ultimately led to success, principally in the form of unexpectedly high net benefits. Studying eleven projects, Hirschman suggested that the Hiding Hand is a general phenomenon. But the Benevolent Hiding Hand has an evil twin, the Malevolent Hiding Hand, which blinds excessively optimistic planners not only to unexpectedly high costs but also to unexpectedly low net benefits. Studying a much larger sample than Hirschman did, we find that the Malevolent Hiding Hand is common and that the phenomenon that Hirschman identified is rare. This sobering finding suggests that Hirschman’s phenomenon is a special case; it attests to the pervasiveness of the planning fallacy, writ very large. One implication involves the continuing need to de-bias decisions and decision support tools like cost-benefit analysis; another is that accountability for decision makers, planners, and forecasters is required for such de-biasing to be effective and lasting.
Keywords: Behavioral economics; Cost-benefit analysis; Hiding hand; Planning fallacy

The precautionary principle: protecting public health, the environment and the future of our children - World Health Organization (World Health Organization, Regional Office for Europe, 2004)

The power of positive deviance - Marsh, David R; Schroeder, Dirk G; Dearden, Kirk A; Sternin, Jerry; Sternin, Monique (BMJ : British Medical Journal, 2004)
Identifying individuals with better outcome than their peers (positive deviance) and enabling communities to adopt the behaviours that explain the improved outcome are powerful methods of producing change

The Power of Positive Deviance - Pascale, Richard; Sternin, Jerry; Sternin, Monique (Harvard Business Press, 2010)

The Politics of Uncertainty : Challenges of Transformation - Scoones, Ian; Stirling, Andy; Stirling, Andy (Routledge, 2020)
Why is uncertainty so important to politics today? To explore the underlying reasons, issues and challenges, this book’s chapters address finance and banking,

The politics of public sector performance: pockets of effectiveness in developing countries - Roll, Michael (Routledge research in comparative politics, 2014)

The politics of legal empowerment: Legal mobilisation strategies and implications for development - Domingo, Pilar; O'Neil, Tam (ODI, 2014)
 Legal mobilisation can improve the lives of poor or marginalised people by: o contributing to pro-poor change in policy, law and regulation of service delivery across different sectors; o advancing the realisation of rights, and achieving redress for rights violations; o contesting unjust and illegal practices of resource allocation and power relations, including in relation to land and natural resources; o enabling citizens to exercise social accountability through legal action.  The outcomes of legal empowerment of the poor are not politically neutral and need to be understood within broader social and political environments;  Better coordination between justice, sector and governance interventions will maximise the development and social impact of international support for legal empowerment.

The Politics of Evidence: From Evidence-based Policy to the Good Governance of Evidence - Parkhurst, Justin (Taylor & Francis, 2017)
The Open Access version of this book, available at http://www.tandfebooks.com/, has been made available under a Creative Commons Attribution-Non Commercial-No Derivatives 3.0 license. There has been an enormous increase in interest in the use of evidence for public policymaking, but the vast majority of work on the subject has failed to engage with the political nature of decision making and how this influences the ways in which evidence will be used (or misused) within political areas. This book provides new insights into the nature of political bias with regards to evidence and critically considers what an ‘improved’ use of evidence would look like from a policymaking perspective. Part I describes the great potential for evidence to help achieve social goals, as well as the challenges raised by the political nature of policymaking. It explores the concern of evidence advocates that political interests drive the misuse or manipulation of evidence, as well as counter-concerns of critical policy scholars about how appeals to ‘evidence-based policy’ can depoliticise political debates. Both concerns reflect forms of bias – the first representing technical bias, whereby evidence use violates principles of scientific best practice, and the second representing issue bias in how appeals to evidence can shift political debates to particular questions or marginalise policy-relevant social concerns. Part II then draws on the fields of policy studies and cognitive psychology to understand the origins and mechanisms of both forms of bias in relation to political interests and values. It illustrates how such biases are not only common, but can be much more predictable once we recognise their origins and manifestations in policy arenas. Finally, Part III discusses ways to move forward for those seeking to improve the use of evidence in public policymaking. It explores what constitutes ‘good evidence for policy’, as well as the ‘good use of evidence’ within policy processes, and considers how to build evidence-advisory institutions that embed key principles of both scientific good practice and democratic representation. Taken as a whole, the approach promoted is termed the ‘good governance of evidence’ – a concept that represents the use of rigorous, systematic and technically valid pieces of evidence within decision-making processes that are representative of, and accountable to, populations served.
Keywords: Public policy; Social Policy; Social Services & Welfare

The politics of evidence: from evidence-based policy to the good governance of evidence - Parkhurst, Justin O. (Routledge studies in governance and public policy, 2017)
Introduction -- Evidence-based policymaking : an important first step, and the need to take the next -- Bias and the politics of evidence -- The overt politics of evidence : bias and the pursuit of political interests -- The subtle politics of evidence - the cognitive-political origins of bias -- What is "good evidence for policy"? From hierarchies to appropriate evidence -- What is the "good use of evidence" for policy? -- From evidence-based policy to the good governance of evidence

The Politics of Evidence and Results in International Development: Playing the Game to Change the Rules? - Eyben, Rosalind; Guijt, Irene; Roche, Chris; Shutt, Cathy (Practical Action Publishing, 2015)
Understanding and demonstrating the effectiveness of efforts to improve the lives of those living in poverty is an essential part of international development practice. But who decides what counts as good or credible evidence? Can the drive to measure results do justice to and promote transformational change change that challenges the power relations that produce and reproduce inequality, injustice and the non-fulfillment of human rights? The Politics of Evidence in International Development provides a critical examination of the results agenda, with practical strategies for rendering it more helpful in supporting transformative development. The book deconstructs the origins and concepts of the results and evidence agendas employed in international development. It describes with concrete examples the current effects and consequences of the agenda, and goes on to outline a range of strategies used by individuals and organizations to resist, adapt or comply with the useful and problematic demands for results-oriented measurement and evidence of value for money."

The political economy of pre-trial detention: Indonesia case study - Domingo, Pilar; Sudaryono, Leopold (ODI, 2016)

The Patterns of Possibility - How to Recast Relationships to Create Healthier Systems and Better Outcomes - Winhall, Jennie; Leadbeater, Charles (The Rockwool Foundation, 2022)
In Building Better Systems, we introduced four keys to unlock system innovation: purpose and power, relationships and resource flows. These four keys make up a set. Systems are often hard to change because power, relationships, and resource flows are locked together in a reinforcing pattern to serve the system’s current purpose. Systems start to change fundamentally when this pattern is disrupted and opened up so that a new configuration can emerge, serving a new purpose. In this article series we delve deeper into these four keys and provide practical advice on how they can be put to use. This article is about relationships. Systems are defined by the patterns of interactions between their parts: their relationships. Those interactions generate the outcomes of the system as a whole. Transforming the outcomes of a system requires remaking its relationships and then unlocking the other keys to system innovation: purpose, power and resources. This shift in relationships allows all those in the system to learn faster, to be more creative. System innovators redesign the relationships in the system to allow dramatically enhanced learning across the system, and thereby generate far better outcomes.

The Patterning Instinct: A Cultural History of Humanity's Search for Meaning - Lent, Jeremy (Prometheus Books, 2017)
This fresh perspective on crucial questions of history identifies the root metaphors that cultures have used to construct meaning in their world. It offers a glimpse into the minds of a vast range of different peoples: early hunter-gatherers and farmers, ancient Egyptians, traditional Chinese sages, the founders of Christianity, trail-blazers of the Scientific Revolution, and those who constructed our modern consumer society. Taking the reader on an archaeological exploration of the mind, the author, an entrepreneur and sustainability leader, uses recent findings in cognitive science and systems theory to reveal the hidden layers of values that form today's cultural norms. Uprooting the tired cliches of the science-religion debate, he shows how medieval Christian rationalism acted as an incubator for scientific thought, which in turn shaped our modern vision of the conquest of nature. The author probes our current crisis of unsustainability and argues that it is not an inevitable result of human nature, but is culturally driven: a product of particular mental patterns that could conceivably be reshaped. By shining a light on our possible futures, the book foresees a coming struggle between two contrasting views of humanity: one driving to a technological endgame of artificially enhanced humans, the other enabling a sustainable future arising from our intrinsic connectedness with each other and the natural world. This struggle, it concludes, is one in which each of us will play a role through the meaning we choose to forge from the lives we lead.

The origins, development, and application of Qualitative Comparative Analysis: the first 25 years - Marx, Axel; Rihoux, Benoît; Ragin, Charles (European Political Science Review, 2014)
A quarter century ago, in 1987, Charles C. Ragin published The Comparative Method, introducing a new method to the social sciences called Qualitative Comparative Analysis (QCA). QCA is a comparative case-oriented research approach and collection of techniques based on set theory and Boolean algebra, which aims to combine some of the strengths of qualitative and quantitative research methods. Since its launch in 1987, QCA has been applied extensively in the social sciences. This review essay first sketches the origins of the ideas behind QCA. Next, the main features of the method, as presented in The Comparative Method, are introduced. A third part focuses on the early applications. A fourth part presents early criticisms and subsequent innovations. A fifth part then focuses on an era of further expansion in political science and presents some of the main applications in the discipline. In doing so, this paper seeks to provide insights and references into the origin and development of QCA, a non-technical introduction to its main features, the path travelled so far, and the diversification of applications.

The Operational Guide - for the making markets work for the poor (M4P) approach (Second Edition) - The Springfield Centre (SDC & DFID, 2015)
In 2008, SDC and DFID published three documents aimed at improving the understanding and use of the Making Markets Work for the Poor (M4P) approach: the M4P Synthesis, M4P Perspectives and M4P Operational Guide. Since then the field has grown, diversified and, importantly, learned much more. A second edition was commissioned to capture that learning, maintain the momentum and realise the ambition that development can still 'do better'. The second edition provides an accessible resource to help practitioners put the market systems development approach into practice. It explains the key principles and frameworks which guide effective intervention in – and development of – market systems. It addresses common challenges with examples of good practice based on practitioner experience. Who is it for? The Operational Guide is for people whose job entails trying to make market systems work better for poor women and men. These people include: Individuals currently involved in funding or implementing the approach. Development agencies wishing to incorporate market systems thinking and practice in their work. National stakeholders that wish to play a more strategic and catalytic role within market systems. What is new? Application, application, application! Whilst the key principles and frameworks will be familiar, the advice on their operational application – from start to finish – has been significantly bolstered Enhanced guidance on facilitation. Greater emphasis on what constitutes good facilitation practice, building on a wealth of practitioner experience More real-life examples. The Operational Guide is laced with examples from programmes past and present, working in a diverse array of systems Peer learning focus. Direct insights from practitioners, highlighting 'bumps in the road' and how to avoid them. The Guide aims to provide an accessible operational resource to help practitioners put the market systems development approach into practice. It explains the key principles and frameworks which guide the process of effective intervention in – and development of – market systems, addressing common challenges with examples of good practice based on practitioner experience. HOW SHOULD IT BE USED? The Guide explores, sequentially, the key elements of the implementation process: strategy, diagnosis, vision, intervention, measurement and management. It is not intended to be read from cover to cover; readers can go directly to the chapter most relevant to their needs without having read preceding chapters. However each chapter does build upon the preceding one and may refer to other chapters. THE GUIDE IS STRUCTURED AS FOLLOWS: INTRODUCTION Overview of the objectives, structure and format of the Guide CONTEXT A reminder of what market systems development means 1. STRATEGY Core principles and framework for setting programme strategy 2. DIAGNOSIS Core principles and framework for diagnosing system constraints 3. VISION Core principles and frameworks for defining and planning intervention 4. INTERVENTION Core principles and framework to guide effective intervention 5. MEASUREMENT Core principles and framework for measuring results 6. MANAGEMENT Key considerations in managing market systems development programmes GLOSSARY Definition of key terms used in market systems development

The open book of social innovation - Murray, Robin; Caulier-Grice, Julie; Mulgan, Geoff (Young Foundation & NESTA, 2010)

The NGO-Academia Interface: Realising the shared potential - Green, Duncan (The Social Realities of Knowledge for Development, 2017)
This edited collection of peer-reviewed papers explores critical challenges faced by organisations and individuals involved in evidence-informed development through a diverse set of case studies and t...

The new dynamics of strategy: Sense-making in a complex and complicated world - Kurtz, C.F.; Snowden, Dave (IBM Systems Journal, 2003)
Keywords: IMPORTANT

The New Development Economics: We Shall Experiment, but How Shall We Learn? - Rodrik, Dani (HKS Working Paper No. RWP08-055, 2008)
Development economics is split between macro-development economists - who focus on economic growth, international trade, and fiscal/macro policies - and micro-development economists - who study microfinance, education, health, and other social programs. Recently there has been substantial convergence in the policy mindset exhibited by micro evaluation enthusiasts, on the one hand, and growth diagnosticians, on the other. At the same time, the randomized evaluation revolution has led to an accentuation of the methodological divergence between the two camps. Overcoming the split requires changes on both sides. Macrodevelopment economists need to recognize the distinct advantages of the experimental approach and adopt the policy mindset of the randomized evaluation enthusiasts. Micro-development economists, for their part, have to recognize that the utility of randomized evaluations is restricted by the narrow and limited scope of their application. As the Chinese example illustrates, extending the experimental mindset to the domain of economy-wide reforms is not just possible, it has already been practiced with resounding success in the most important development experience of our generation.
Keywords: Economics; Finance; Health Care; International Development; International Economics; International Trade; Macroeconomics; Microeconomics; Social Policy; Welfare

The MSP Tool Guide: Sixty tools to facilitate Multi-Stakeholder Partnerships - Brouwer, Herman; Brouwers, Jan (CDI, Wageningen University and Research, 2016)
What is ‘The MSP Tool Guide’ all about? This compilation of 60 tools is an companion to The MSP Guide, the Wageningen University & Research CDI resource on how to design and facilitate effective multi-stakeholder partnerships. At the request of many readers we have compiled them into one document to enable easy storing and sharing. These tools are available in summarized version in the MSP Guide in Chapter 6. The detailed versions on how to use the tool, and when to use it, are available on the portal www.mspguide.org/tools-and-methods. The content of this portal is compiled in this Tool Guide.

The MSP Guide: How to Design and Facilitate Multi-Stakeholder Partnerships - Brouwer, Herman; Woodhill, Jim; Hemmati, Minu; Verhoosel, Karèn; van Vugt, Simone (Practical Action Publishing, 2016)
In recent years, multi-stakeholder partnerships (MSPs) have become popular for tackling the complex challenges of sustainable development. This guide provides a practical framework for the design and facilitation of these collaborative processes that work across the boundaries of business, government, civil society and science. The guide links the underlying rationale for multistakeholder partnerships, with a clear four phase process model, a set of seven core principles, key ideas for facilitation and 60 participatory tools for analysis, planning and decision making. The guide has been written for those directly involved in MSPs – as a stakeholder, leader, facilitator or funder – to provide both the conceptual foundations and practical tools that underpin successful partnerships. What’s inside draws on the direct experience of staff from the Wageningen Centre of Development Innovation (WCDI), at Wageningen University & Research, in supporting MSP processes in many countries around the world. The guide also compiles the ideas and materials behind WCDI’s annual three week international course on facilitating MSPs and social learning. This work has been inspired by the motivation and passion that comes when people dare to “walk in each other’s shoes” to find new paths toward shared ambitions for the future.

The 'Most Significant Change' (MSC) Technique - Davies, Rick; Dart, Jess (CARE International, 2005)
This publication is aimed at organisations, community groups, students and academics who wish to use MSC to help monitor and evaluate their social change programs and projects, or to learn more about how it can be used. The technique is applicable in many different sectors, including agriculture, education and health, and especially in development programs. It is also applicable to many different cultural contexts. MSC has been used in a wide variety of countries by a range of organisations. By 2004, MSC had been used both by NGOs and governments in Africa, Asia, Latin America, Europe and Australasia.

The Methods Lab evaluation toolkit - ODI (2016)
The Methods Lab develops and tests flexible approaches to impact evaluation for interventions that are harder to evaluate because of their complexity. This toolkit brings together analysis, guidance and templates for anyone: planning an impact evaluation designing a monitoring and evaluation system working in a consortium or managing a portfolio of projects

The M&E (Monitoring & Evaluation) Universe - INTRAC (INTRAC, 2019)
The M&E Universe is a free, online resource developed by INTRAC to support development practitioners involved in monitoring and evaluation (M&E). It consists of a series of short papers (2-6 pages) on different subjects related to M&E. To begin exploring the Universe right away, use the button below. To find out more, read on.

The Long and Short of It: Responding to immediate needs while pursuing long-term goals - Pett, Jamie (LearnAdapt, 2020)
How can we balance our need to respond to a crisis with our long-term goals for systemic change?

The Limits of Institutional Reform in Development: Changing Rules for Realistic Solutions - Andrews, Matt (Cambridge University Press, 2013)
Institutional reforms are common across the globe. Think of efforts to build new governments in Afghanistan and Iraq; or decades worth of interventions intended to improve fiscal management, reduce corruption or introduce efficient public sector service delivery in African countries.These reforms often have limited results, however. They lead to new laws that are not properly implemented, and new organizations that have poor capacities and fail to function as needed. In this book, Matt Andrews explains why reform results are frequently limited and suggests ways to overcome these limits. In the first half of the book, Andrews argues that reforms fail to make governments better when they are introduced as signals to gain short-term support--from donors and others. Reforms as signals introduce unrealistic best practices that do not fit developing country contexts and are not considered relevant by implementing agents. The result is a set of new forms that do not function properly. Andrews uses examples to prove this point, ranging from efforts to introduce fiscal rules in Argentina to reforms aimed at international accounting standard adoption in many African countries, and anti corruption interventions in Malawi and Uganda. In the second half of the book, Andrews notes that there are instances where reforms are not being introduced as signals, and are having more of an impact on government effectiveness. Examples include local government reforms in Rwanda, anti corruption initiatives in Indonesia, and a variety of initiatives ranging from results based management to civil service modernization and internal control regime adoption in governments like Kenya, Kosovo and Afghanistan. Andrews uses these examples to discuss ways in which reforms can actually provide realistic solutions to governance challenges in developing countries. Lessons from these experiences suggest that reform limits can be overcome by focusing interventions on problem solving, and promoting incremental and localized processes to find solutions, involving multiple agents who can authorize and implement reforms.

The limits of agile - can we apply it to policy making? - Ollerhead, Lisa (2015)
Bringing new policy tools and techniques to the UK Government

The Limits of Accounting-Based Accountability in Education (and Far Beyond): Why More Accounting Will Rarely Solve Accountability Problems - Honig, Dan; Pritchett, Lant (Center for Global Development, 2019)
Accountability is rightly at the center of the conversation regarding how to improve governance systems, particularly health and education systems. But efforts to address accountability deficits often focus primarily on improving what can be counted and verified—what we term “accountingbased accountability.” We argue that introducing greater accounting-based accountability will only very rarely be the appropriate solution for addressing accountability problems. We illustrate this by exploring the role of Accountability ICT in (not) improving education system performance. Strengthening “real” accountability is not the same as improving data systems for observation and verification, and often attempts at the latter undermine the former. The development discourse’s frequent semantic misunderstanding of the term “accountability” has pernicious effects on system reform efforts and ultimately global welfare.

The Learning Power of Listening - Guijt, Irene; Gottret, Maria Veronica; Hanchar, Anna; Deprez, Steff; Muckenhirn, Rita (PRACTICAL ACTION PUBLISHING, 2022)
Steff had the pleasure to co-author the first SenseMaker Practitioner Guide with a group of friends and colleagues supported and published by Oxfam and CRS. This practical guide is for those who wish to use SenseMaker to conduct assessments, monitor progress, and undertake evaluations or research. Drawing on more than a decade of experience, the authors share dozens of examples from international development, providing practical tips and ideas for context-specific adaptations. They show how the method can be used to for difficult-to-measure outcomes related to poverty reduction, social justice, peacebuilding, resilience, gender norms, behavior change, governance and environmental management. ​ SenseMaker is a unique participatory method of inquiry that encourages and enables novel insights not obtained from conventional quantitative and quantitative and qualitative methods. It is action-oriented and, therefore, well-suited for people needing data- informed insights for adaptive management. "Writing this guide together with Irene, Veronica, Anna and Rita was an enormous learning process in itself and has further shaped our thinking and practice. We hope it will support first-time and experienced users to enhance their practice and that it will inspire people to explore and innovate further with the method."

The Last 10 Per Cent: Why the World Needs a Leaner, More Innovative and Pragmatic Development Sector, Today - Harper, Erica (Routledge India, 2023)
Criticism that the development sector has not delivered in terms of eliminating extreme poverty, fast-tracking growth and preventing conflict, is neither new nor surprising. In fact, it may be the one thing that scholars, donors and practitioners agree on. While many of these concerns are valid, this book makes a case that the sector is closer to unlocking the gates to more effective and efficient development outcomes than is popularly believed. Specifically, it argues that by overturning a few myths, making better use of evidence and employing some different rules, practitioners, policy specialists and donors can foster the changes in the development architecture that are needed to reach the 10 percent of the world’s population still living in extreme poverty.Engaging, provocative and clear sighted, the book provides insight into interventions around democratic governance, refugee response, counterterrorism, gender mainstreaming, environmental protection and private sector engagement. It is instructive reading for professionals across the development sector, think tanks and NGOs.

The landscape of innovation approaches - Leurs, Bas (States of Change, 2018)
An overview of innovation methods and approaches we’ve come across in government innovation practice.

The Knowledge-Creating Company - Nonaka, Ikujiro (Harvard Business Review, 2007)
Editor’s Note: This 1991 article helped popularize the notion of “tacit” knowledge—the valuable and highly subjective insights and intuitions that are difficult to capture and share because people carry them in their heads. Years later, the piece can still startle a reader with its views of organizations and of the types of knowledge that inform […]
Keywords: Creativity; Innovation; Product development; Research & development

The journey from rhetoric to reality: participatory evaluation in a development context - Chouinard, Jill Anne; Cousins, J. Bradley (Educational Assessment, Evaluation and Accountability, 2015)
In this paper, we focus on participatory evaluation in the context of international development and specifically on the emerging empirical knowledge base. In a prior review and critique of research on participatory evaluation (Cousins and Chouinard 2012), we examined 121 studies, with only 21 (17 %) situated in development contexts. However, the circumstances and challenges for international development and for development evaluation are distinct from those found in developed countries and therefore warrant separate consideration. To provide a more focused and detailed understanding of participatory evaluation in international development contexts, in this paper we augment our initial sample to a total of 40 studies on participatory evaluation in development published over the past 16.5 years. Based on an analysis of this research and related theoretical and conceptual contributions we identify and discuss eight emergent themes: multiplicity of relationships, consequences of stakeholder selection, characterization of participation, contextual complexity, methodological requirements, cultural influence, politics and power and learning and capacity building. We conclude with some reflections on an agenda for research.

The interplay between social learning and adaptive capacity in climate change adaptation: A systematic review - Phuong, Thi Hong Le; Biesbroek, G. Robbert; Wals, Arjen E.J. (NJAS - Wageningen Journal of Life Sciences, 2017)
Successful implementation climate change adaptation depends to a large extent on the capabilities of individuals, organizations, and communities to create and mobilize the adaptive capacity (AC) of their socio-ecological system. Creating and mobilizing AC is a continuous process that requires social learning (SL). Although rich with empirical cases, the literature theorizing and empirically investigating the relationship between AC and SL is highly fragmented. This paper aims to critically examine the peer-reviewed literature that focusses on SL and AC in the context of climate change adaptation (CCA). Special attention is paid to the interplay between the two. Understanding this interplay can help improve our understanding of how CCA takes place in practice and advances theoretical debates on CCA. Systematic review methods are used to analyse 43 papers (1997–2016). Our findings reveal three perspectives that each play an important role in different contexts: an AC-focused perspective, a SL-focused perspective, and a hybrid perspective. These differences in conceptualizations of the relationship between SL and AC may seem trivial at first, but they have consequences for the design of learning-based interventions aimed at helping communities respond to climate change. It appears that such interventions need to be preceded by an analysis of the climate change context in order to decide whether to emphasize AC, SL or both simultaneously.
Keywords: Adaptive capacity; Climate change adaptation; Social learning; Systematic review

The Internet and Democracy Building in Lusophone African Countries - Salgado, Dr Susana (Ashgate Publishing, Ltd., 2014)
This timely book fills an important gap in the literature on the influence of the Internet and new media in Portuguese speaking African countries. Based on extensive field work throughout the region the author examines the influence of the Internet in the transition to democracy in Africa, and asks whether there are new possibilities for popular activism to emerge from evolving communication environments and media systems.The book analyses the different forms of democracy, the concept of development, and addresses the debate about the relationship between democracy and development and explores the influence of the media in the democratization process, the promises that digital media bring to this process and to development and the implications of the African digital divide. In certain countries in this region democracy and independent news media are in their infancy but are starting to take hold, giving an excellent opportunity to observe the dynamics of civil society and the influence of increased freedom, new voting powers and new media in particular. The book offers important insights into the roles and functions that the media in general, and the Internet in particular, can perform in the creation of a more democratic society, as well as in empowering and educating citizens in democratic values.
Keywords: Business & Economics / Industries / Computers & Information Technology; History / Africa / General; Political Science / Political Ideologies / Democracy

The International Development Innovation Alliance - IDIA (R4D, 2017)
Brochure from the International Development Innovation Alliance

The Innovative Power of Positive Deviance - Goldstein, Jeffrey; Hazy, James; Lichtenstein, Benyamin B. (Complexity and the Nexus of Leadership, 2010)

The Indispensable Community: Why Some Brand Communities Thrive When Others Perish - Millington, Richard (Feverbee, 2018)
How to Build Bigger, Better, and More Active Online CommunitiesBuzzing Communities cuts through the fluff to offer a clear process for creating thriving online communities. This book combines a century of proven science, dozens of real-life examples, practical tips, and trusted community-building methods. This step-by-step guide includes a lifecycle for tracking your progress and a framework for managing your organization's community efforts. This Book Will Help You to Understand what the members of your community really want. Dramatically increase the number of newcomers that become regulars. Avoid the mistakes most organizations make when they try to build online communities. Develop a fantastic, user-friendly website for your members. Grow your online community to critical mass and beyond Keep members engaged and active in your community. Measure the community's return on investment and explain the benefits to your organization.

The Implications of Complexity for Development - Barder, Owen (2012)
In this lecture, adapted from his May 2012 Kapuściński Lecture, Owen Barder explores the implications of complexity theory for development policy. He explains how traditional economic models have tried and failed to understand why some countries have managed to improve living standards while other countries have not.
Keywords: IMPORTANT

The Impact of Transparency and Accountability Initiatives - Gaventa, John; McGee, Rosemary (Development Policy Review, 2013)

The high cost of accurate knowledge - Sutcliffe, Kathleen M.; Weber, Klaus (Harvard Business Review, 2003)
Many business thinkers believe it's the role of senior managers to scan the external environment to monitor contingencies and constraints, and to use that precise knowledge to modify the company's strategy and design. As these thinkers see it, managers need accurate and abundant information to carry out that role. According to that logic, it makes sense to invest heavily in systems for collecting and organizing competitive information. Another school of pundits contends that, since today's complex information often isn't precise anyway, it's not worth going overboard with such investments. In other words, it's not the accuracy and abundance of information that should matter most to top executives--rather, it's how that information is interpreted. After all, the role of senior managers isn't just to make decisions; it's to set direction and motivate others in the face of ambiguities and conflicting demands. Top executives must interpret information and communicate those interpretations--they must manage meaning more than they must manage information. So which of these competing views is the right one? Research conducted by academics Sutcliffe and Weber found that how accurate senior executives are about their competitive environments is indeed less important for strategy and corresponding organizational changes than the way in which they interpret information about their environments. Investments in shaping those interpretations, therefore, may create a more durable competitive advantage than investments in obtaining and organizing more information. And what kinds of interpretations are most closely linked with high performance? Their research suggests that high performers respond positively to opportunities, yet they aren't overconfident in their abilities to take advantage of those opportunities.
Keywords: Administrative Personnel; Data Collection; Decision Making, Organizational; Economic Competition; Information Management; Investments; Marketing; Organizational Innovation; United States

The Hidden Life of Theories of Change - Green, Duncan (From Poverty to Power, 2020)
A smart new report explores how a good idea - theories of change - is distorted by the way it is implemented in the aid sector

The Hidden Life of Theories of Change - Ho, Wenny; Tamas, Peter; van Wessel, Margit (Hivos, 2020)
Theory of Change is thought to be very useful for learning and adaptive management of complex interventions such as advocacy. Nevertheless, the use of Theory of Change is also under critique. One common criticism is that Theory of Change is often used as a framework that fixes agreements rather than as a living, guiding tool that helps reflection and adaptation. However, while such criticism stresses forms of control, little research has looked at the way Theory of Change and advocacy practice relate. This is a pertinent issue considering that formally agreed Theories of Change and realities on the ground can be very different. This raises questions: Do advocates work in ways different from what Theory of Change states, and if so, how, and why? How does the way they strategize relate to formal Theories of Change? With what implications? In this brief, we explore these more hidden aspects of the life of Theories of Change.

The Haves and the Have Nots: Civic Technologies and the Pathways to Government Responsiveness - Mellon, Jonathan; Peixoto, Tiago C; Sjoberg, Fredrik M (Policy Research Working Paper, 2022)
“Civic tech” broadly refers to the use of digital technologies to support a range of citizen engagement processes. From allowing individuals to report problems to local government to enabling the crowdsourcing of national legislation, civic tech aims to promote better policies and services – while contributing to more inclusive democratic institutions. But could civic tech affect public issues in a way that benefits some and excludes others? Over the decades, the question of who participates in and who is excluded from participation mediated by technology has been the focus of both civic tech critics and proponents. The latter tend to argue that, by enabling citizens to participate without constraints of time and distance, civic tech facilitates the participation of those who usually abstain from engaging with public issues, leading to more inclusive processes. Critics argue that, given the existing digital divide, unequal access to technology will tend to empower the already empowered, further deepening societal differences. Yet both critics and proponents do tend to share an intuitive assumption: the socio-economic profile of who participates is the primary determinant of who benefits from digitally mediated civic participation. For instance, if more men participate, outcomes will favor male preferences, and if more young people participate, outcomes will be more aligned with the concerns of the youth. In a new paper, we show that the link between the demographics of those participating through digital channels, and the beneficiaries of the participation process, is not necessarily as straightforward as commonly assumed. We review four civic tech cases where data allow us to trace the full participatory chain through: the initial digital divide the participant’s demographics the demands made through the process the policy outcomes We examine online voting in the Brazilian state of Rio Grande do Sul’s participatory budgeting process, the local problem reporting platform Fix My Street (FMS) in the United Kingdom, Iceland’s online crowdsourced constitution process, and the global petitioning platform Change.org. Counterintuitive findings Change.org has been used by nearly half a billion people around the globe. Using a dataset of 3.9 million signers of online petitions in 132 countries, we examine the number of successful petitions and assess whether petitions created by women have more success than those submitted by men. Our analysis shows that, even if women create fewer online petitions than men, their petitions are more likely to be successful. All else equal, when online petitions have an impact on government policy, the agenda being implemented is much closer to the issues women choose to focus on. In Rio Grande do Sul’s digital participatory budgeting (PB), we show that despite important demographic differences between online and offline voters, these inequalities do not affect which types of projects are selected for funding – a consequence of PB’s unique institutional design, which favors redistributive effects. In fact, of all the cases analyzed, none reflect the standard assumption that inequalities in who participates translate directly into inequalities in who benefits from the policy outcomes. Our results suggest that the socio-economic profile of participants predicts only in part who benefits from civic tech. Just as important to policy outcomes is how the platform translates civic participation into policy demands, and how the government responds to those demands. While civic tech practitioners pay a lot of attention to design from a technological perspective, our findings highlight the importance of considering how civic tech platforms function as political institutions that encourage certain types of behavior while discouraging others. Civic tech, it seems, is not inherently good nor bad for democratic institutions. Instead, its effect is a combination of who participates on digital platforms and the choices of platform designers and governments.

The guiding logics and principles for designing emergent transdisciplinary research processes: learning experiences and reflections from a transdisciplinary urban case study in Enkanini informal settlement, South Africa - van Breda, John; Swilling, Mark (Sustainability Science, 2019)
Transdisciplinarity is not a new science per se, but a new methodology for doing science with society. A particular challenge in doing science with society is the engagement with non-academic actors to enable joint problem formulation, analysis and transformation. How this is achieved differs between contexts. The premise of this paper is that transdisciplinary research (TDR) methodologies designed for developed world contexts cannot merely be replicated and transferred to developing world contexts. Thus a new approach is needed for conducting TDR in contexts characterised by high levels of complexity, conflict and social fluidity. To that end, this paper introduces a new approach to TDR titled emergent transdisciplinary design research (ETDR). A core element of this approach is that the research process is designed as it unfolds, that is, it transforms as it emerges from and within the fluid context. The ETDR outlined in this paper emerged through a case study in the informal settlement (slum) of Enkanini in Stellenbosch, South Africa. This case study demonstrates the context from and within which the ETDR approach and identifies a set of guiding logics that can be used to guide ETDR approaches in other contexts. The study demonstrates that the new logics and guiding principles were not simply derived from the TDR literature, but rather emerged from constant interacting dynamics between theory and practice. Learning how to co-design the research process through co-producing transformative knowledge and then implementing strategic interventions to bring about incremental social change is key to theory development in ways that are informed by local contextual dynamics. There are, however, risks when undertaking such TDR processes such as under-valuing disciplinary knowledge, transferring risks onto a society, and suppressing ‘truth-to-power’.

The Governance of Climate Change Adaptation Through Urban Policy Experiments - Chu, Eric K. (Environmental Policy and Governance, 2016)
Climate change is increasingly posing risks to infrastructure and public services in cities across the global South. Building on ideas of policy experimentation at the nexus of institutional and transition theories, this paper assesses six climate change adaptation experiments across the cities of Surat, Indore and Bhubaneswar in India to uncover the politics behind how experiments are conceived of, implemented, and supported in light of local development needs. Through employing both embedded and cross-case comparative methods, I argue that policy experiments are often framed around achieving tangible urban economic benefits and maximizing specific project complementarities, which allow emerging adaptation priorities access to established policy directives and funding streams. However, I conclude that despite being arenas for testing new ideas, quantifying climate and development co-benefits, and engaging private and civil society actors, adaptation policy experiments must be coherent with urban political economic contexts in order for them to affect sustained, equitable and transformative programmatic change. Copyright © 2016 John Wiley & Sons, Ltd and ERP Environment
Keywords: Climate change adaptation; India; Policy experiments; urban governance; urban planning

The good and the ‘not so good’ of our experiences with SenseMaker - Mager, Franziska (Oxfam Views & Voices, 2019)
When we purchased a license for the SenseMaker research method in early 2017 (a proprietary data collection and analysis software), the excitement in our more “geeky” teams was palpable. SenseMaker ... Read More

The Global Wildlife Program - Knowledge Platform - 2016-2018 - WB (The World Bank, 2018)

The Generalizability Puzzle - Bates, Mary Ann; Glennerster, Rachel (Stanford Social Innovation Review, 2017)
The practice of using rigorous scientific evaluations to study solutions to global poverty is relatively young. Although researchers continue to advance our knowledge of the mechanisms at work, confusion about their role and value persists. Having evidence from specific studies is fine and good, but for policy makers, the point is not simply to understand poverty, but to eliminate it. Do decisions always need to be informed by evidence from the local context? What potential and limits do randomized controlled trials have for improving our knowledge and finding effective answers? Two leaders in anti-poverty research—J-PAL and IPA—dispel some of the myths about their field. In this article, authors from J-PAL argue that rigorous impact evaluations tell us a lot about the world, not just the particular contexts in which they are conducted. Access to this article made possible by MIT.

The Futures Toolkit: Tools for Futures Thinking and Foresight Across UK Government - HM Government (2017)

The Future of Development: “Make Happen” with Portfolios of Options - CHÔRA Foundation (CHÔRA Foundation, 2021)
This Green Paper intends to review key elements of the problem that Development actors will confront as a new decade opens up ahead of us. It will articulate a solution that we believe should become an inherent feature of Development programs and initiatives. This is the outcome of an intense period of experiences and reflections in the Development space across different geographies and institutional mandates and activities, during which the Foundation has collaborated with institutions such as the UNDP and Grand Challenges Canada. At the heart of our collaborations is a Strategic Innovation and System Transformation Framework, with its associated concepts, working definitions, processes, tools and people. Sourced from CHÔRA Foundation’s knowledge and practice assets, this is a capability we intend to make relevant, customise, scale up and distribute to our partners and stakeholders. We are looking to create with them a space that offers the world a transformational capability. Central to this capability we see a distinctive and robust practice: the design and dynamic management of Portfolios of Strategic Innovation and System Transformation Options. These Portfolios are unique, context relevant, embedded mechanisms for learning, sensemaking and problem solving that social systems leverage to have an impact on themselves and their problems, and to induce the transformations that are necessary to them. It is our view that Portfolios of Options are the most effective means by which human social systems can supply themselves with budgets of possibility that ensure choice and create opportunity. They will also support pragmatic evolutionary outcomes and enable resilience.

The Future is a Choice: The Oxfam Framework and Guidance for Resilient Development - Jeans, Helen; Thomas, Sebastien; Castillo, Gina (Policy & Practice, 2016)
This guide provides a framework for Oxfam staff to design programmes and campaigns that contribute to resilient development. Oxfam defines resilience as ‘the ability of women and men to realize their rights and improve their well-being despite shocks, stresses

The five trademarks of agile organizations - Wouter Aghina; Karin Ahlbäck; Aaron De Smet; Clemens Fahrbach; Christopher Handscomb; Gerald Lackey; Michael Lurie; Monica Murarka; Olli Salo; Elizabeth Seem; Jannik Woxholth (McKinsey anc Company, 2017)
Our experience and research demonstrate that successful agile organizations consistently exhibit the five trademarks described in this article. The trademarks include a network of teams within a people-centered culture that operates in rapid learning and fast decision cycles which are enabled by technology, and a common purpose that co-creates value for all stakeholders. These trademarks complement the findings from The McKinsey Global Survey Results: How to create an agile organization.

The field guide to human-centered design: design kit - IDEO (IDEO, 2015)
Keywords: Design; IMPORTANT; Methode

The fashion for agile management is spreading - The Economist (The Economist, 2018)
Executives need to be a cross between Spider-Man and Simone Biles

The fascinating world of unconscious bias and development policy - d’Almeida, André Corrêa; Grossi, Amanda Sue (The Guardian, 2016)
In the last few years scientists have exposed thinking patterns that may skew our decision-making. How can we counter these biases in humanitarian work?
Keywords: Academic experts; Higher Education Network; Neuroscience; Psychology; education; higher education

The Fallacy of Beneficial Ignorance: A Test of Hirschman's Hiding Hand - Flyvbjerg, Bent (World Development, 2016)
Albert O. Hirschman's principle of the Hiding Hand stands stronger and more celebrated today than ever. The principle states that ignorance is good in planning,
Keywords: Behavioral economics; Development; Hiding hand; Ignorance; Management

The ethical limits of bungee research in ICTD - Dearden, Andrew; Tucker, William D. (2015 IEEE International Symposium on Technology and Society, 2015)
Research in ICTD is difficult because engineers with technical expertise are separated from the challenges that they are trying to address by large physical distances and significant social differences. To overcome these challenges, much research involves occasional short visits by external researchers to developing regions to investigate problems and generate ideas which are then developed back at the engineers' home base before further return visits for deployment and evaluation. This paper highlights the ethical limitations of this `bungee research', and reflects on our experiences in evolving more fruitful research practices. We argue that relying on bungee research as a primary model of research engagement is unethical, and we suggest some minimal conditions that are necessary, but not sufficient, for such visits to be ethically defensible in ICTD research.

The era of development mutants - Quaggiotto, Giulio (Nesta, 2016)
If you were looking for the cutting edge of the development sector, where would you go these days?

The effect of government responsiveness on future political participation - Mellon, Andrew Jonathan; Sjoberg, Fredrik Matias; Peixoto, Tiago Carneiro (The World Bank, 2015)
What effect does government responsiveness have on political participation? Since the 1940s political scientists have used attitudinal measures of perceived efficacy to explain participation. More recent work has focused on underlying genetic factors that condition citizen engagement. The authors develop a ‘calculus of participation’ that incorporates objective efficacy, the extent to which an individual’s participation actually has an impact, and test the model against behavioral data from FixMyStreet.com (n=399,364). The authors find that a successful first experience using FixMyStreet.com (e.g., reporting a pothole and having it fixed) is associated with a 54 percent increase in the probability of an individual submitting a second report. The authors also show that the experience of government responsiveness to the first report submitted has predictive power over all future report submissions. The findings highlight the importance of government responsiveness for fostering an active citizenry, while demonstrating the value of incidentally collected data to examine participatory behavior at the individual level.

The Dynamics of Team Learning: Harmony and Rhythm in Teamwork Arrangements for Innovation - Harvey, Jean-François; Cromwell, Johnathan R.; Johnson, Kevin J.; Edmondson, Amy C. (Administrative Science Quarterly, 2023)
Innovation teams must navigate inherent tensions between different learning activities to produce high levels of performance. Yet, we know little about how teams combine these activities—notably reflexive, experimental, vicarious, and contextual learning—most effectively over time. In this article, we integrate research on teamwork episodes with insights from music theory to develop a new theoretical perspective on team dynamics, which explains how team activities can produce harmony, dissonance, or rhythm in teamwork arrangements that lead to either positive or negative effects on overall performance. We first tested our theory in a field study using longitudinal data from 102 innovation teams at a Fortune Global 500 company; then, we replicated and elaborated our theory in a study of 61 MBA project teams at an elite North American university. Results show that some learning activities can occur within the same teamwork episode to have harmonious positive effects on team performance, while other activities combine to have dissonant negative effects when occurring in the same episode. We argue that dissonant activities must be spread across teamwork episodes to help teams achieve a positive rhythm of team learning over time. Our findings contribute to theory on team dynamics, team learning, and ambidexterity.

The Doing Development Different Manifesto - DDD Community (DDD Community, 2014)
Statement from the October 2014 ‘Doing Development Differently’ workshop Too many development initiatives have limited impact. Schools are built but children do not learn. Clinics are built but sic…

The direction of evolution: The rise of cooperative organization - Stewart, John E. (Biosystems, 2014)
Two great trends are evident in the evolution of life on Earth: towards increasing diversification and towards increasing integration. Diversification has spread living processes across the planet, progressively increasing the range of environments and free energy sources exploited by life. Integration has proceeded through a stepwise process in which living entities at one level are integrated into cooperative groups that become larger-scale entities at the next level, and so on, producing cooperative organizations of increasing scale (for example, cooperative groups of simple cells gave rise to the more complex eukaryote cells, groups of these gave rise to multi-cellular organisms, and cooperative groups of these organisms produced animal societies). The trend towards increasing integration has continued during human evolution with the progressive increase in the scale of human groups and societies. The trends towards increasing diversification and integration are both driven by selection. An understanding of the trajectory and causal drivers of the trends suggests that they are likely to culminate in the emergence of a global entity. This entity would emerge from the integration of the living processes, matter, energy and technology of the planet into a global cooperative organization. Such an integration of the results of previous diversifications would enable the global entity to exploit the widest possible range of resources across the varied circumstances of the planet. This paper demonstrates that it's case for directionality meets the tests and criticisms that have proven fatal to previous claims for directionality in evolution.
Keywords: Direction of evolution; Evolution of a global entity; Evolution of cooperation; Evolutionary progress; Major evolutionary transitions

The Dilemmas of Citizen Inclusion in Urban Planning and Governance to Enable a 1.5 °C Climate Change Scenario - Chu, Eric; Schenk, Todd; Patterson, James (Urban Planning, 2018)
Cities around the world are facilitating ambitious and inclusive action on climate change by adopting participatory and collaborative planning approaches. However, given the major political, spatial, and scalar interdependencies involved, the extent to which these planning tools equip cities to realise 1.5 °C climate change scenarios is unclear. This article draws upon emerging knowledge in the fields of urban planning and urban climate governance to explore complementary insights into how cities can pursue ambitious and inclusive climate action to realise 1.5 °C climate change scenarios. We observe that urban planning scholarship is often under-appreciated in urban climate governance research, while conversely, promising urban planning tools and approaches can be limited by the contested realities of urban climate governance. By thematically reviewing diverse examples of urban climate action across the globe, we identify three key categories of planning dilemmas: institutional heterogeneity, scalar mismatch, and equity and justice concerns. We argue that lessons from urban planning and urban climate governance scholarship should be integrated to better understand how cities can realise 1.5 °C climate change scenarios in practice.

The Difference Learning Makes - Factors that enable and inhibit adaptive programming - Gray, Stephen; Carl, Andy (Christian Aid, 2022)
Executive Summary When Christian Aid (CA) Ireland devised its multi-country and multi-year Irish Aid funded Programme Grant II (2017-2022), they opted to move away from a linear programme management approach and to explore an adaptive one. Across seven countries: Angola, Colombia, El Salvador, Guatemala, Israel and the occupied Palestinian territory, Sierra Leone, and Zimbabwe, CA and partner organisations support marginalised communities to realise their rights, reduce violence and address gender inequality. Since 2019, Adapt Peacebuilding has accompanied CA Ireland, CA country teams and partner organisations as they experimented with using a deliberate adaptive approach. The authors were also asked to follow up on an initial study by CA Ireland and Overseas Development Institute in 2018, which described the rationale for adopting this new approach and included early lessons from its first year of implementation. The aim of this study is to help deepen CA Ireland, CA country teams’ and partners’ understanding of (a) whether their application of adaptive programming has resulted in better development outcomes, and (b) how they can better understand the factors that enabled or inhibited the effectiveness of using this approach. Over the past three years, this study has found evidence and multiple examples that show adaptive programming contributed to better development outcomes. The main reasons cited were that these were made possible both from improvements to programming strategies based on proactive reflection and learning, as well as those that stem from the reactive capacity of adaptive programmes to change course in response to unanticipated changes in operating conditions. This study found that adaptive programming has enabled better development practice where organisations are enhancing their skills to better respond and be flexible to contextual challenges. 72% of partners surveyed described adaptive programming as the most useful approach to programme management that they have used. The programme approach has meant that CA and partner staff were better able to explore the significance of change in the context and their contributions to them. It also enabled spaces for meaningful engagement with communities in learning and programme planning processes and encouraged opportunities for experimentation in programming. The study also found that adaptive programming has supported flexible delivery. This led to better outcomes that would not have been possible were the programme not able to make flexible adjustments. The main focus has been the analysis of nine factors that can determine the effectiveness and impact (or otherwise) of using an adaptive approach, flagging important issues for understanding. These factors are identified as: 1) Leadership; 2) Organisational culture; 3) Conceptual understanding; 4) Staff capacities; 5) Partnership approaches; 6) Participation; 7) Methods and tools; 8) Administrative procedures; and 9) The operating context. Together these can provide an analytical framework for assessing an organisation’s ‘adaptive scope’, which can be used as a tool for better understanding an organisation’s potential to generate improved development outcomes via adaptive programming and how to strengthen them. The study concludes with several recommendations for CA Ireland, all of which have relevance for a broader community of donors and implementing organisations interested in the potential of adaptive programming.

The Design of Everyday Things, revised and expanded edition - Norman, Donald A. (MIT Press, 2013)
Even the smartest among us can feel inept as we try to figure out the shower control in a hotel or attempt to navigate an unfamiliar television set or stove. When The Design of Everyday Things was published in 1988, cognitive scientist Don Norman provocatively proposed that the fault lies not in ourselves, but in design that ignores the needs and psychology of people. Fully revised to keep the timeless principles of psychology up to date with ever-changing new technologies, The Design of Everyday Things is a powerful appeal for good design, and a reminder of how -- and why -- some products satisfy while others only disappoint.

The Debate about RCTs in Development is over. We won. They lost. - Pritchett, Lant (DRi Seminar, 2018)
There has been a debate in development economics over the last 20 years as some claimed the use of RCTs as a tool for independent impact evaluation would significantly improve development practice and hence development. While right about the methodological claims about the superiority of randomization to produce cleaner estimates of the LATE (local average treatment effect) of projects and programs, this, in and of itself, does not change development practice. All of the five claims needed to sustain a positive model in which RCT/IIE has a major positive impact are demonstrably false. The proponents of RCTs have responded to losing the first round decisively by changing significantly both their claims and their practice.

The curious case of the realist trial: Methodological oxymoron or unicorn? - Nielsen, Steffen Bohni; Jaspers, Sofie Østergaard; Lemire, Sebastian (Evaluation, 2023)
Realist evaluation and experimental designs are both well-established approaches to evaluation. Over the past 10 years, realist trials—evaluations purposefully combining realist evaluation and experimental designs—have emerged. Informed by a comprehensive review of published realist trials, this article examines to what extent and how realist trials align with quality standards for realist evaluations and randomized controlled trials and to what extent and how the realist and trial aspects of realist trials are integrated. We identified only few examples that met high-quality standards for both experimental and realist studies and that merged the two designs.

The context v intervention 2x2 | From Poverty to Power - Green, Duncan (From Poverty to Power, 2016)
Lots of discussion on my US trip around the strengths/weaknesses of the context v intervention 2x2 that suggests particular theories of change acc to situation
Keywords: IMPORTANT

The COM-B Theory of Change Mode - v.5 - Mayne, John (Palladium, 2019)
ResearchGate is a network dedicated to science and research. Connect, collaborate and discover scientific publications, jobs and conferences. All for free.

The collaborative exploration of alternative futures: A different approach to Theories of Change - CEDIL programme (2022)
ParEvo is a web application that enables the collaborative construction and exploration of a range of alternative futures: likely and unlikely, desirable and undesirable. These are described in the form of a branching narrative structure, developed over a series of iterations involving the interactions of a group of participants. These detailed storylines about the future contrast with optimistic, skeletal and largely singular views of the future found in diagrammatic ToCs often encountered by evaluators. This webinar will describe a recent ParEvo exercise implemented by the Centre for the Study of Existential Risk (CSER) in Cambridge. In this exercise 11 international experts explored ideas about how global risks associated with biotechnology research could be managed, and mismanaged, in the coming four years. Including how these alternative futures were evaluated by participants and the CSER facilitators. Issues to be discussed by the panel, and others, include comparisons with other representations of Theories of Change and other approaches to the exploration of alternative futures, described variously as scenario planning, futures or foresight work. Speakers: Rick Davies, Lara Mani Tom Hobson An overview of the app can be found here: https://mscinnovations.wordpress.com/ The app website is here: https://parevo.org/

The Clash of the Counter-bureaucracy and Development - Natsios, Andrew (The Center for Global Development, 2010)
In this essay, Andrew Natsios gives a first-hand account of what he finds most hinders USAID—layers of bureaucracy that misguide and derail development work.

The Causal Mechanism Claim in Evaluation: Does the Prophecy Fulfill? - Schmitt, Johannes (New Directions for Evaluation, 2020)
Despite increased discussions in the community and a common understanding about the virtue of mechanism-based explanation, little is known about the true benefits and challenges of applying causal mechanism analysis in practice. This chapter aims to introduce the reader to the topic of causal mechanisms and synthesize significant findings on this special issue. It begins by laying out definitions and concepts of causal mechanisms in evaluation literature and proposes a two-way classification of causal mechanisms along which the chapters to this issue are structured. The chapter continues by introducing the Causal Mechanism Claim and elaborates on how analyzing causal mechanisms is expected to increase policy relevance and causal capacity in evaluations. Drawing on this issue's rich corpus of firsthand practical experience, this introduction synthesizes key lessons that support or contradict the Causal Mechanism Claim. We find that both parts of the claim—increased policy relevance and strengthened causal capacity—are supported by the authors' experiences as bundled in this issue. However, we also identify challenges related to cross-cutting issues such as communication and practical applicability and point to the importance of method integration.

The case for thinking and working politically. The implications of 'doing development differently' - DLP (Research Paper, 2014)
This paper discusses the steps required to build a robust evidence base for 'thinking and working politically' (TWP) in development. It argues that better understanding what works, when and why is an important step in moving TWP into mainstream development programming. The paper reviews the existing evidence base on TWP, building on this and on other literature on public sector reform and 'pockets of effectiveness' to suggest research questions, case study selection criteria, and a four-level analytical framework: 1) political context; 2) sector; 3) organisation; and 4) individual. The framework aims to help build a 'rigorous enough' evidence base to show whether and how TWP happens and whether or not it influences the effectiveness of programme implementation and outcomes. The paper also calls for more focus on gender issues, and on different – and often more fragile – political contexts.

The Case for an Adaptive Approach to Empowerment and Accountability Programming in Fragile Settings: Synthesis report - Christie, Angela; Green, Duncan (Action for Empowerment and Accountability Research Programme, 2019)
Fragile, conflict and violence-affected settings (FCVAS) are messy and ambiguous contexts in which to plan and implement development initiatives. To work there, external actors are increasingly adopting an adaptive approach to empowerment and accountability (E&A) programming, whatever the setting. This means using a compass rather than map, where real-time political economy analysis (PEA) in relation to context and programme monitoring and evidence-informed learning in relation to intervention are used in combination and in shorter-than-usual planning cycles to maintain and adapt strategic direction. This paper brings together three case studies of large Department for International Development (DFID) governance projects in Myanmar, Nigeria and Tanzania.
Keywords: A4EA; Adaptive Development; Economy; Fishery

The Boda Boda Talk Talk Module - Internews (Learning Collection, 2017)
Keywords: IMPORTANT

The Blind Man and the Elephant: Analysing the Local State in China - Saich, Tony (On the Roots of Growth and Crisis: Capitalism, State and Society in East Asia, 2002)

The Big Con: How the Consulting Industry Weakens our Businesses, Infantilizes our Governments and Warps our Economies - Mazzucato, Mariana; Collington, Rosie (Allen Lane, 2023)
There is an entrenched relationship between the consulting industry and the way business and government are managed today which must change.Mariana Mazzucato and Rosie Collington show that our economies' reliance on companies such as McKinsey, Boston Consulting Group, Bain & Company, PwC, Deloitte, KPMG and EY stunts innovation, obfuscates corporate and political accountability and impedes our collective mission of halting climate breakdown.The 'Big Con' describes the confidence trick the consulting industry performs in contracts with hollowed-out and risk-averse governments and shareholder value-maximizing firms. It grew from the 1980s and 1990s in the wake of reforms by both the neoliberal right and Third Way progressives, and it thrives on the ills of modern capitalism, from financialization and privatization to the climate crisis. It is possible because of the unique power that big consultancies wield through extensive contracts and networks - as advisors, legitimators and outsourcers - and the illusion that they are objective sources of expertise and capacity. To make matters worse, our best and brightest graduates are often redirected away from public service into consulting. In all these ways, the Big Con weakens our businesses, infantilizes our governments and warps our economies.Mazzucato and Collington expertly debunk the myth that consultancies always add value to the economy. With a wealth of original research, they argue brilliantly for investment and collective intelligence within all organizations and communities, and for a new system in which public and private sectors work innovatively for the common good. We must recalibrate the role of consultants and rebuild economies and governments that are fit for purpose.

The behaviour change wheel: A new method for characterising and designing behaviour change interventions - Michie, Susan; van Stralen, Maartje M; West, Robert (Implementation Science : IS, 2011)
Background Improving the design and implementation of evidence-based practice depends on successful behaviour change interventions. This requires an appropriate method for characterising interventions and linking them to an analysis of the targeted behaviour. There exists a plethora of frameworks of behaviour change interventions, but it is not clear how well they serve this purpose. This paper evaluates these frameworks, and develops and evaluates a new framework aimed at overcoming their limitations. Methods A systematic search of electronic databases and consultation with behaviour change experts were used to identify frameworks of behaviour change interventions. These were evaluated according to three criteria: comprehensiveness, coherence, and a clear link to an overarching model of behaviour. A new framework was developed to meet these criteria. The reliability with which it could be applied was examined in two domains of behaviour change: tobacco control and obesity. Results Nineteen frameworks were identified covering nine intervention functions and seven policy categories that could enable those interventions. None of the frameworks reviewed covered the full range of intervention functions or policies, and only a minority met the criteria of coherence or linkage to a model of behaviour. At the centre of a proposed new framework is a 'behaviour system' involving three essential conditions: capability, opportunity, and motivation (what we term the 'COM-B system'). This forms the hub of a 'behaviour change wheel' (BCW) around which are positioned the nine intervention functions aimed at addressing deficits in one or more of these conditions; around this are placed seven categories of policy that could enable those interventions to occur. The BCW was used reliably to characterise interventions within the English Department of Health's 2010 tobacco control strategy and the National Institute of Health and Clinical Excellence's guidance on reducing obesity. Conclusions Interventions and policies to change behaviour can be usefully characterised by means of a BCW comprising: a 'behaviour system' at the hub, encircled by intervention functions and then by policy categories. Research is needed to establish how far the BCW can lead to more efficient design of effective interventions.

The Beginner’s Guide to Political Economy Analysis (PEA) - Whaites, Alan (National School of Government International, 2017)
Over the last two decades aid agencies and academics have been on a journey of lesson learning and adaptation in relation to `politics.’ This journey has been driven by a determination to improve impact in all areas of development, but for some time it was particularly associated with work on public sector reform. Now, however, there is an increasing expectation that Political Economy Analysis (PEA) should be part and parcel of designing and implementing any programme or activity (and a brief history of the meandering journey of development actors on PEA can be found in The Policy Practice’s Briefing Paper 11 – see below). DFID in the UK is fairly typical among large development organisations in running an excellent course on political economy analysis, complete with 200 pages of resources and various online videos and case studies (and this type of course is recommended for those who want to take their exploration of PEA further). Even so, PEA is not just for those who have `done the course and bought the T-shirt,’ it is something that can be absorbed and implemented quickly by everybody. Indeed, the growth of interest in PEA is a reminder that this can look like a complex and daunting field and so this guide aims to offer an entry-point for all those who want to use PEA in their own work. In doing so, this guide borrows from the best materials that are available while also adapting some approaches by incorporating wider ideas on politics and institutions. This guide affirms that there should never be an official `orthodoxy’ for PEA and so the emphasis here is on questions, prompts and ideas to help thinking and practice. There is also an attempt to clarify jargon wherever needed, while recognising that The Policy Practice (TPP) and the Overseas Development Institute (ODI) have produced a more complete glossary of PEA terminology. The note will instead focus on `the essentials’ of PEA as they relate to the following questions:  Why do we do political economy analysis, and what is it?  What kinds of issues and ingredients are often included in a PEA?  How do we make sense of the different varieties of PEA?  What tools are out there to help us conduct a PEA?  What is thinking and working politically?

The Art of Scaling Deep - Research in Summary - Fraser, Tatiana (The Systems Sanctuary, 2023)
Over the last 15 years the concept of scale has become a foundational part of the apparatus of the social and environmental change sector. A business mindset of growth has been seamlessly transferred to the social and environmental problems we are collectively trying to shift in the world. Scaling up, (influencing policy) has been considered the strategic pathway to systems change. Scaling out (spreading new models) is seen as a pathway to success. The allure of these scaling theories lies, in part, in their tangibility, and the easy way in which they can be measured. However this focus on growth has shifted our attention away from a series of messy truths. Sometimes bigger isn't better. Endless growth is not sustainable and our urgency to try to fix the problem and seek solutions may be part of the crisis we are in. One unintended consequence of this has been that another type of scale has been devalued and as a result, under-resourced. It’s a scale that values the slow steady work of deepening relationships. It recognizes the significance of context, building connections that bridge diverse communities and it prioritizes inner work and healing as integral components of the scaling process. We call this type of scale ‘Scaling Deep’ and we believe that adequately supporting it, and funding it, holds the greatest potential for long lasting systemic change. The purpose of this research has been to delve deeper into the art and craft of Scaling Deep. Ultimately, our goal is for it to become firmly ingrained within the recognized realm of social change, alongside the well-established concepts of scaling up and scaling out. We want practitioners who are Scaling Deep to be able to harness the wisdom and power of this work and to talk about it openly, with confidence and credibility. We want understanding of this approach to flourish and evolve and for it to be appropriately celebrated and supported. We want decision-makers to be informed and inspired by the principles and practices of scaling deep. For it to be embedded in theories of change as an essential component of decision-making processes within the wider change discourse. Importantly we want leaders who are Scaling Deep to have access to sufficient resources and to receive the care from the field that they need to thrive. We would like to see organisations that have the power to invest, to align their efforts with the profound impact that scaling deep aspires to cultivate in the world. Before we begin, let us be crystal clear. We are not opposed to scaling up and out as strategies for change. Innovation and scaling what is working is part of how we evolve as humanity. As social entrepreneurs ourselves, we have both done this twice over. We value it and we know it’s important. We recognize these are strategies for creating widespread impact and effecting positive change. Our intention here is not to dismiss or undermine the value of scaling up and out, but rather to encourage a broader and more holistic perspective that includes other dimensions of scale. There is a need to understand how the different scaling approaches can work together, rather than seeing them as hierarchical and disconnected. Our ultimate goal is to equip the change sector with a more inclusive, expansive, and powerful approach to tackling the myriad challenges we face, by exploring the potential of Scaling Deep as a transformational strategy for systems change.

The Art of Community: Building the New Age of Participation - Bacon, Jono (O'Reilly Media, 2012)
Online communities provide a wide range of opportunities for supporting a cause, marketing a product or service, or building open source software. The Art of Community helps you recruit members, motivate them, and manage them as active participants. Author Jono Bacon offers experiences and observations from his 14-year effort to build and manage communities, including his current position as manager for Ubuntu.Discover how your community can become a reliable support network, a valuable source of new ideas, and a powerful marketing force. This expanded edition shows you how to keep community projects on track, make use of social media, and organize collaborative events. Interviews with 12 community management leaders, including Linus Torvalds, Tim O’Reilly, and Mike Shinoda, provide useful insights.Develop specific objectives and goals for building your communityBuild processes to help contributors perform tasks, work together, and share successesProvide tools and infrastructure that enable members to work quicklyCreate buzz around your community to get more people involvedHarness social media to broadcast information, collaborate, and get feedbackUse several techniques to track progress on community goalsIdentify and manage conflict, such as dealing with divisive personalities

The Art of Agile Development - Shore, James; Warden, Shane (O'Reilly Media, 2007)
The Art of Agile Development contains practical guidance for anyone considering or applying agile development for building valuable software. Plenty of books describe what agile development is or why it helps software projects succeed, but very few combine information for developers, managers, testers, and customers into a single package that they can apply directly. This book provides no-nonsense advice on agile planning, development, delivery, and management taken from the authors' many years of experience with Extreme Programming (XP). You get a gestalt view of the agile development process, including comprehensive guidance for non-technical readers and hands-on technical practices for developers and testers. The Art of Agile Development gives you clear answers to questions such as: How can we adopt agile development? Do we really need to pair program? What metrics should we report? What if I can't get my customer to participate? How much documentation should we write? When do we design and architect? As a non-developer, how should I work with my agile team? Where is my product roadmap? How does QA fit in? The book teaches you how to adopt XP practices, describes each practice in detail, then discusses principles that will allow you to modify XP and create your own agile method. In particular, this book tackles the difficult aspects of agile development: the need for cooperation and trust among team members. Whether you're currently part of an agile team, working with an agile team, or interested in agile development, this book provides the practical tips you need to start practicing agile development. As your experience grows, the book will grow with you, providing exercises and information that will teach you first to understand the rules of agile development, break them, and ultimately abandon rules altogether as you master the art of agile development."Jim Shore and Shane Warden expertly explain the practices and benefits of Extreme Programming. They offer advice from their real-world experiences in leading teams. They answer questions about the practices and show contraindications - ways that a practice may be mis-applied. They offer alternatives you can try if there are impediments to applying a practice, such as the lack of an on-site customer.--Ken Pugh, Author of Jolt Award Winner, Prefactoring "I will leave a copy of this book with every team I visit."--Brian Marick, Exampler Consulting
Keywords: IMPORTANT

The Art and Craft of Bricolage in Evaluation - Aston, Thomas; Apgar, Marina (CDI Practice Paper, 2022)
This CDI Practice Paper by Tom Aston and Marina Apgar makes the case for ‘bricolage’ in complexity-aware and qualitative evaluation methods. It provides a framework based on a review of 33 methods to support evaluators to be more intentional about bricolage and to combine the component parts of relevant methods more effectively. It discusses two cases from practice to illustrate the value added of taking a more intentional approach. It further argues that navigating different forms of power is a critical skill for bricolage, and that doing so can help to ensure rigour.

The Appearance of Accountability: Communication Technologies and Power Asymmetries in Humanitarian Aid and Disaster Recovery - Madianou, Mirca; Ong, Jonathan Corpus; Longboan, Liezel; Cornelio, Jayeel S. (Journal of Communication, 2016)
New communication technologies are celebrated for their potential to improve the accountability of humanitarian agencies. The response to Typhoon Haiyan in 2013 represents the most systematic implementation of “accountability to affected people” initiatives. Drawing on a year-long ethnography of the Haiyan recovery and 139 interviews with humanitarian workers and affected people, the article reveals a narrow interpretation of accountability as feedback that is increasingly captured through mobile phones. We observe that the digitized collection of feedback is not fed back to disaster-affected communities, but is directed to donors as evidence of “impact.” Rather than improving accountability to affected people, digitized feedback mechanisms sustained humanitarianism's power asymmetries.
Keywords: Accountability; Audit; Communication for Development; Disasters; Ethnography; ICT4D; Mobile phones; Participatory Communication; SMS; Texting; humanitarianism

The Answer is 42. On Data, Information and Knowledge - Bours, Dennis (Earth-Eval, 2015)
A recent discussion with some colleagues on the differences between data, knowledge and information made me realize that there still is a lot of confusion when it comes to the use of terms; confusion that goes well beyond my earlier blog post on indicators, measures and metrics.

The Alignment, Interest and Influence Matrix (AIIM) guidance note - Mendizabal, Enrique (ODI/RAPID, 2010)
In 2007, on the eve of a workshop to introduce a new version of the RAPID approach to DFID policy teams, Enrique Mendizabal and Ben Ramalingam created the Alignment, Interest and Influence Matrix (AIIM), a stakeholder analysis tool that not only helps to identify key stakeholders, but also suggests a possible course of action towards them.

The Aid Chain: Coercion and Commitment in Development NGOs - Wallace, Tina; Bornstein, Lisa; Chapman, Jennifer (Practical Action, 2007)
Significant proportions of aid already flow through the non-governmental sector, but questions are increasingly being asked about the role of NGOs and whether they can deliver on their ambitious claims. This study examines conditionality and mutual commitment between international aid donors and recipient NGOs, North and South. Fieldwork and case study material from Uganda and South Africa are used to support the authors’ contention that the fast changing aid sector has--in the context of a dynamic policy environment--encouraged the mainstreaming of a managerial approach that does not admit of any analysis of power relations or cultural diversity. This increasing--essentially technical-- definition of the roles of NGOs has worked to limit the extent of the very development that the organizations were initially established to promote.

The Advocacy Strategy Framework. A tool for articulating an advocacy theory of change - Coffman, Julia; Beer, Tanya (Center for Evaluation Innovation, 2015)

The adoption of innovation in international development organisations: lessons for development co-operation - Kumpf, Benjamin; Jhunjhunwala, Parnika (OECD Development Co-operation Working Papers, 2023)
Addressing 21st century development challenges requires investments in innovation, including the use of new approaches and technologies. Currently, many development organisations prioritise investments in isolated innovation pilots that leverage a specific approach or technology rather than pursuing a strategic approach to expand the organisation’s toolbox with innovations that have proven their comparative advantage over what is currently used. This Working Paper addresses this challenge of adopting innovations. How can development organisations institutionalise a new way of working, bringing what was once novel to the core of how business is done? Analysing successful adoption efforts across five DAC agencies, the paper lays out a proposed process for the adoption of innovations. The paper features five case-studies and concludes with a set of lessons and recommendations for policy makers on innovation management generally, and adoption of innovation in particular.

The Adaptive Management System for the Tasmanian Wilderness World Heritage Area — Linking Management Planning with Effectiveness Evaluation - Jones, Glenys (Adaptive Environmental Management, 2009)
This paper provides a 30 year retrospective on the development of the adaptive management system for the Tasmanian Wilderness World Heritage Area (Australia). It describes the historical background, key influences and stages that paved the way to establishment of adaptive management. It outlines how effectiveness monitoring, evaluation and reporting are integrated with the management plan for the Area to establish an ongoing adaptive management cycle. The chapter presents figures and tools for adaptive management, including 5 useful questions for guiding the integration of effectiveness monitoring, evaluation and reporting into management plans and programs. Strengths and weaknesses of the adaptive management system are discussed. Key lessons and insights distilled from this experience are offered, including the importance of planned monitoring of management effectiveness; the role of stakeholder assessments; and the factors that can assist in sustaining longterm strategic programs despite ongoing institutional change. The chapter concludes with suggestions for fostering an enabling environment for adaptive management.
Keywords: Adaptive Management; Management Intent; Reserve Management; World Heritage

The Actor-Based Change Framework: A Pragmatic Approach to Developing Program Theory for Interventions in Complex Systems - Koleros, Andrew; Mulkerne, Sean; Oldenbeuving, Mark; Stein, Danielle (American Journal of Evaluation, 2020)
Despite a wide body of literature on the importance of program theory and the need to tackle complexity to improve international development programming, the use of program theory to underpin interventions aimed at facilitating change in complex systems remains a challenge for many program practitioners. The actor-based change framework offers a pragmatic approach to address these challenges, integrating concepts and frameworks drawn from complexity science and behavioral change literature to develop robust program theory for complex interventions. This article presents the conceptual framework for the approach and describes how it has been applied in practice on an evaluation of a security and justice program in Nepal. It concludes with a discussion of the strengths and weaknesses of the approach in practice and how it can be applied more widely to improve program theory for interventions in complex systems.

The 5 Rs Framework in the program cycle - USAID (Program Cycle, 2016)
USAID’s Program Cycle Operational Policy (ADS 201) provides guidance to missions and other operating units on how to implement the Program Cycle. A key principle of the Program Cycle is to “Promote Sustainability through Local Ownership.” The purpose of this Technical Note is to describe the “5Rs Framework”, a practical methodology for supporting sustainability and local ownership in projects and activities through ongoing attention to local actors and local systems. This Note is rooted in USAID’s 2014 Local Systems Framework paper, which establishes that achieving sustained improvement in development results depends on the contributions of multiple and interconnected local actors. That document also states that USAID needs to improve its systems practice if it is to engage local actors and strengthen local systems more effectively and thus realize sustained results more consistently. The 5Rs Framework, also introduced in the Local Systems Framework, is intended as a simple and practical tool to promote good systems practice. The 5Rs Framework highlights five key dimensions of systems: Results, Roles, Relationships, Rules and Resources. Collectively these 5Rs can serve as a lens for assessing local systems and a guide for identifying and monitoring interventions designed to strengthen them. This Technical Note is divided in two parts. The first part provides an introduction to the 5Rs Framework and the systems practice from which it emerges. The second part demonstrates how systems practice can be embedded in the Program Cycle by continuously applying the 5Rs, especially to the design, implementation, and monitoring of USAID projects and their accompanying activities.

The 2017 Reader on Results Measurement. An introduction to the DCED Standard - DCED (DCED, 2017)

The 2015 State of Scrum Report: How the world is applying the most popular Agile approach to projects - Scrum Alliance (Scrum Alliance, 2015)

"That's how the light gets in": Making Change in Closing Political Environments - IBP (International Budget Partnership, 2017)
This collection of learning and reflection essays from the International Budget Partnership's 2016 Annual Report illustrate the multidimensional nature of budget work and democratic engagement. Read more.

Testing the Waters: A Qualitative Comparative Analysis of the Factors Affecting Success in Rendering Water Services Sustainable Based on ICT Reporting - Welle, Katharina; Williams, Jennifer; Pearce, Joseph; Befani, Barbara (MAVC, 2015)
This research conducted by WaterAid, Itad and IRC aims to understand the factors that facilitate and inhibit the success of ICT-based reporting to improve rural water supply sustainability.

Test It and They Might Come: Improving the Uptake of Digital Tools in Transparency and Accountability Initiatives - Wilson, Christopher; de Lanerolle, Indra (IDS Bulletin, 2016)
Keywords: IMPORTANT

Ten years of Outcome Mapping adaptations and support - Smith, Richard; Mauremootoo, John; Rassmann, Kornelia (OM Resources: Key Community Documents, 2012)
An analysis of how and where Outcome Mapping has been applied, how users have experienced OM and the support options available and required for its use. This research was commissioned by the OMLC Stewards.

Ten Frontier Technologies for International Development - Ramalingam, Ben; Hernandez, Kevin; Prieto Martin, Pedro; Faith, Becky (IDS, 2016)
As new technologies and digital business models reshape economies and disrupt incumbencies, interest has surged in the potential of novel frontier technologies to also contribute to positive changes in international development and humanitarian contexts. Widespread adoption of new technologies is acknowledged as centrally important to achieving the United Nations Sustainable Development Goals by 2030. But while frontier technologies can rapidly address large-scale economic, social or political challenges, they can also involve the displacement of existing technologies and carry considerable uncertainty and risk. Although there have been significant wins bringing the benefits of new technologies to poor consumers through examples such as mobile money or off-grid solar energy, there are many other areas where the applications may not yet have been developed into viable market solutions, or where opportunities have not yet been taken up in development practice.

Template concept note for an impact evaluation - Methods Lab (2015)

Technology for Democracy in Development: Lessons from Seven Case Studies - Fung, Archon; Gilman, Hollie Russon; Shkabatur, Jennifer (Deliberation and Development: Rethinking the Role of Voice and Collective Action in Unequal Societies, 2015)

Technical challenges in the application of adaptive management - Williams, Byron K.; Brown, Eleanor D. (Biological Conservation, 2016)
Adaptive management is an approach for simultaneously managing and learning about natural resources, by acknowledging uncertainty and seeking to reduce it through the process of management itself. Adaptive decision making can be applied to pressing issues in conservation biology such as species reintroduction, disease and invasive species control, and habitat restoration, as well as to management of natural resources in general. After briefly outlining a framework and process for adaptive management, we focus on an overview of the key technical issues related to problem framing and the ability of resource managers to learn from their experience. These technical issues include the treatment of uncertainty and its propagation over time; nonstationarity in long-term environmental trends; the applicability of adaptive management across scales; requirements for models and management alternatives that promote learning; the value of the information produced with adaptive management; the challenge to management of uncertainty and surprise; and institutional (social) learning. To accommodate these and other challenges that are now coming into focus, the learning-based approach of adaptive management will need to be adjusted and expanded in the future.
Keywords: Adaptive Management; Learning; Nonstationarity; Resilience; Uncertainty; Value of information

Technical assistance: a practical account of the challenges in design and implementation - Nastase, Alexandra; Rajan, Alok; French, Ben; Bhattacharya, Debarshi (Gates Open Research, 2021)
Technical assistance is provided to country governments as part of international development programmes to support policymaking or strengthen state capability. This article presents the conceptual evolution of ‘technical assistance’ linked to capacity development, starting with programmes aiming exclusively to enhance individual capacity in the 1950s to 1970s and progressing to complex systems approaches in the past ten years. It also presents some of the frequent challenges in designing and implementing technical assistance, drawing from the existing literature and the authors’ experience in international development. The article summarises the latest thinking about delivering more effective development, including the adaptive management practices and the initiatives to strengthen evidence about what works. Finally, we complement this article with a follow-up open letter reflecting on the current policy options and opportunities for change.

Teams that Do Development Differently - Khan, Jehanzeb; Fisher, Annette (Global Policy Journal, 2017)

Teaming: how organizations learn, innovate, and compete in the knowledge economy - Edmondson, Amy C. (Jossey-Bass, 2012)
New breakthrough thinking in organizational learning, leadership, and change Continuous improvement, understanding complex systems, and promoting innovation are all part of the landscape of learning challenges today's companies face. Amy Edmondson shows that organizations thrive, or fail to thrive, based on how well the small groups within those organizations work. In most organizations, the work that produces value for customers is carried out by teams, and increasingly, by flexible team-like entities. The pace of change and the fluidity of most work structures means that it's not really about creating effective teams anymore, but instead about leading effective teaming. Teaming shows that organizations learn when the flexible, fluid collaborations they encompass are able to learn. The problem is teams, and other dynamic groups, don't learn naturally. Edmondson outlines the factors that prevent them from doing so, such as interpersonal fear, irrational beliefs about failure, groupthink, problematic power dynamics, and information hoarding. With Teaming, leaders can shape these factors by encouraging reflection, creating psychological safety, and overcoming defensive interpersonal dynamics that inhibit the sharing of ideas. Further, they can use practical management strategies to help organizations realize the benefits inherent in both success and failure. Presents a clear explanation of practical management concepts for increasing learning capability for business results Introduces a framework that clarifies how learning processes must be altered for different kinds of work Explains how Collaborative Learning works, and gives tips for how to do it well Includes case-study research on Intermountain healthcare, Prudential, GM, Toyota, IDEO, the IRS, and both Cincinnati and Minneapolis Children's Hospitals, among others Based on years of research, this book shows how leaders can make organizational learning happen by building teams that learn.

Team of Teams: New Rules of Engagement for a Complex World - McChrystal, General Stanley; Silverman, David; Collins, Tantum; Fussell, Chris (Portfolio Penguin, 2015)
As commander of Joint Special Operations Command (JSOC), General Stanley McChrystal discarded a century of management wisdom and pivoted from a pursuit of mechanical efficiency to organic adaptability. In this book, he shows how any organization can make the same transition to act like a team of teams - where small groups combine the freedom to experiment with a relentless drive to share their experience.Drawing on a wealth of evidence from his military career and sources as diverse as hospital emergency rooms and NASA's space program, McChrystal frames the existential challenge facing today's organizations, and presents a compelling, effective solution.

Tale of the converted: how complex social problems have made me question the use of data in driving impact - Burgoyne, John (Impact of Social Sciences, 2019)
15 Shares In practice the way in which research impacts and influences policy and society is often thought to be a rational, ordered and linear process. Whilst this might represent a ‘common sense’ understanding of research impact, in this cross-post John Burgoyne reflects on how upending the primacy of data and embracing complexity can lead to a more nuanced and effective understanding of research impact.

Taking Stock of Empowerment Evaluation: An Empirical Review - Miller, Robin Lin; Campbell, Rebecca (American Journal of Evaluation, 2006)
Empowerment evaluation entered the evaluation lexicon in 1993. Since that time, it has attracted many adherents, as well as vocal detractors. A prominent issue in the debates on empowerment evaluation concerns the extent to which empowerment evaluation can be readily distinguished from other approaches to evaluation that share with it an emphasis on participatory and collaborative processes, capacity development, and evaluation use. A second issue concerns the extent to which empowerment evaluation actually leads to empowered outcomes for those who have participated in the evaluation process and those who are the intended beneficiaries of the social programs that were the objects of evaluation. The authors systematically examined 47 case examples of empowerment evaluation published from 1994 through June 2005. The results suggest wide variation among practitioners in adherence to empowerment evaluation principles and weak emphasis on the attainment of empowered outcomes for program beneficiaries. Implications for theory and practice are discussed.

Taking scale into account in transparency and accountability initiatives - Fox, Jonathan (MAVC Research Summary, 2016)
We know that gaining access to information and raising citizen voices are not the same as achieving accountability. It is important to look beyond the symptoms of accountability failure, and consider how to tackle the causes. This short research summary discusses different understandings of scale, one important aspect of making transparency and accountability initiatives more strategic. Scale shapes both the causes of accountability failure and the tactics and strategies needed to address it.

Taking responsibility for complexity: how implementation can achieve results in the face of complex problems - Jones, Harry (ODI, 2011)

Taking Innovations to Scale: Methods, Applications and Lessons - Cooley, Larry; Linn, Johannes F. (R4D, 2014)
The international development community increasingly recognizes the need to go beyond fragmented, one-of projects. In response, there is now much talk and some action on scaling up successful innovations and pilot projects with an explicit goal of achieving sustainable impact at scale. However, many questions remain about the practical implications of pursuing a systematic scaling up approach and about how the approaches being pursued by diferent institutions and practitioners relate to each other.

Systems Thinking For Social Change: A Practical Guide to Solving Complex Problems, Avoiding Unintended Consequences, and Achieving Lasting Results - Stroh, David Peter (Chelsea Green Publishing, 2015)
Donors, leaders of nonprofits, and public policy makers usually have the best of intentions to serve society and improve social conditions. But often their solutions fall far short of what they want to accomplish and what is truly needed. Moreover, the answers they propose and fund often produce the opposite of what they want over time. We end up with temporary shelters that increase homelessness, drug busts that increase drug-related crime, or food aid that increases starvation. How do these unintended consequences come about and how can we avoid them? By applying conventional thinking to complex social problems, we often perpetuate the very problems we try so hard to solve, but it is possible to think differently, and get different results. Systems Thinking for Social Change enables readers to contribute more effectively to society by helping them understand what systems thinking is and why it is so important in their work. It also gives concrete guidance on how to incorporate systems thinking in problem solving, decision making, and strategic planning without becoming a technical expert. Systems thinking leader David Stroh walks readers through techniques he has used to help people improve their efforts to end homelessness, improve public health, strengthen education, design a system for early childhood development, protect child welfare, develop rural economies, facilitate the reentry of formerly incarcerated people into society, resolve identity-based conflicts, and more.  The result is a highly readable, effective guide to understanding systems and using that knowledge to get the results you want.