The Relational Work of Systems Change - Millgan, Katherine; Zerda, Juanita; Kania, John (Stanford Social Innovation Review, 2022)
Collective impact efforts must prioritize working together in more relational ways to find systemic solutions to social problems. Sometimes we lose sight of a simple truth about systems: They are made up of people. Despite all of the frameworks and tools at our disposal and all of our learning as a field of practice, purely technical, rational approaches to systems change will not make much of a dent in shifting power or altering our most deeply held beliefs. If most collective impact efforts fall short of supporting people to change in fundamentally consciousness-altering ways, then, the system they are a part of will not significantly change either. However, over the past two decades, the prevailing view among many funders, board members, and institutional leaders has been that only quantifiable and predetermined outcomes can create impact. But if the interrelated, devastating, and deepening crises and divisions over the past two years have taught us anything, it is that complex, adaptive problems defy tidy logic models and reductive technical solutions. It is time to invest our collective energy in more relational and emergent approaches to transforming systems.

The relationship between adaptive management of social-ecological systems and law: a systematic review - Frohlich, Miguel F.; Jacobson, Chris; Fidelman, Pedro; Smith, Timothy F. (Ecology and Society, 2018)
Adaptive management has been considered a valuable approach for managing social-ecological systems involving high levels of complexity and uncertainty. However, many obstacles still hamper its implementation. Law is often seen as a barrier for moving adaptive management beyond theory, although there has been no synthesis on the challenges of legal constraints or how to overcome them. We contribute to filling this knowledge gap by providing a systematic review of the peer-reviewed literature on the relationship between adaptive management and law in relation to social-ecological systems. We analyze how the scholarship defines the concept of adaptive management, identifies the legal barriers to adaptive management, and the legal strategies suggested for enabling this approach. Research efforts in this domain are still highly geographically concentrated in the United States of America, unveiling gaps concerning the analysis of other legal jurisdictions. Overall, our results show that more flexible legal frameworks can allow for adaptive management without undermining the role of law in providing stability to social interactions. Achieving this balance will likely require the reform of existing laws, regulations, and other legal instruments. Legal reforms can facilitate the emergence of adaptive governance, with the potential to support not only adaptive management implementation but also to make law itself more adaptive.

The rise of the randomistas: on the experimental turn in international aid - Donovan, Kevin P. (Economy and Society, 2018)
In recent years, the use of experimental methodologies has emerged as a central means of evaluating international aid interventions. Today, proponents of randomized control trials (so-called randomistas) are among the most influential of development experts. This paper examines the growth of this thought collective, analysing how uncertainty has become a central concern of development institutions. It demonstrates that transformations within the aid industry – including the influence of evidence-based policy, the economization of development and the retreat from macro-planning – created the conditions of possibility for experimentation. Within this field, the randomistas adeptly pursued a variety of rhetorical, affective, methodological and organizational strategies that emphasized the lack of credible knowledge within aid and the ability of experiments to rectify the situation. Importantly, they have insisted on the moral worth of experimentation; indeed, the experimental ethic has been proposed as the way to change the spirit of development. Through causal certitude, they propose to reduce human suffering. The rise of experimentation has not, however, eliminated accusations of uncertainty; rather, it has redistributed the means through which knowledge about development is considered credible.
Keywords: Development; Evidence; Experimentation; aid; uncertainty

The road to adaptive management: knowledge, leadership, culture and rules - Byrne, Karri Goeldner; Sparkman, Timothy; Fowler, Ben (The BEAM Exchange, 2016)
Keywords: IMPORTANT; Practice

The road to results: designing and conducting effective development evaluations - Imas, Morra; G, Linda; Rist, Ray C. (The World Bank, 2009)
The analytical, conceptual, and political framework of development is changing dramatically. The new development agenda calls for broader understandings of sectors, countries, development strategies, and policies. It emphasizes learning and continuous feedback at all phases of the development cycle. As the development agenda grows in scope and complexity, development evaluation follows suit. Development evaluator are moving away from traditional implementation and output-focused evaluation models toward results-based evaluation models, as the development community calls for results and embraces the millennium development goals. As the development community shifts its focus away from projects in order to comprehensively address country challenges, development evaluators are seeking methods with which to assess results at the country, sector, theme, policy, and even global levels. As the development community recognizes the importance of not only a comprehensive but also a coordinated approach to developing country challenges and emphasizes partnerships, development evaluators are increasingly engaged in joint evaluations. These joint evaluations, while advantageous in many respects, add to the complexity of development evaluation (OECD 2006). Additionally, development evaluators increasingly face the measurement challenge of determining the performance of an individual development organization in this broader context and of identifying its contribution. This text is intended as a tool for use in building development evaluation capacity. It aims to help development evaluators think about and explore the new evaluation architecture and especially to design and conduct evaluations that focus on results in meeting the challenges of development.

The Role of External Actors in Supporting Social and Political Action towards Empowerment and Accountability with a Focus on Fragile, Conflict- and Violence-Affected Settings - Christie, Angela; Burge, Richard (IDS and ITAD, 2017)
This paper explores the role and experience of external actors, particularly donors, in supporting social and political action in fragile, conflict and violence affected settings. Evidence is distilled from a wide range of synthesised sources to generate relevant findings and questions in relation to what we know and what we don’t. Included among the source material is a 2016 macro-evaluation of DFID’s empowerment and accountability (E&A) programmes which examined over 50 DFID funded projects. Themes which emerge relate to: how external actors need to think about the context and work politically; who are the most appropriate social and political actors to support in E&A; whether a direct or indirect approach to support for E&A achieves more tangible outcomes; whether external actors should move beyond short-term tools and tactics focused on one-sided engagement; and whether programmes should be designed around more strategic, multi-faceted interventions. The paper concludes with identifying a number of gaps in the evidence which are translated into a range of questions which could potentially inform the Action for Empowerment and Accountability (A4EA) research programme.

The Role of Outcome Mapping in Developing a Rural Telemedicine System - Tucker, William; Blake, Edwin (University of the Western Cape, 2008)
We describe the use of Outcome Mapping to guide the design of a rural telemedicine consultation system in South Africa. While Outcome Mapping was not primarily intended to guide design, we show that it tied in well with a cyclical participatory design method for an Information and Communication Technology for Development project

The role of research and learning in adaptive programming - Babon, Andrea; Denney, Lisa (Devpolicy Blog from the Development Policy Centre, 2018)
Andrea Babon and Lisa Denney explore how learning partners - a common feature of aid programs - can operate and feed into programs.

The role of social learning in adaptiveness: insights from water management - Lebel, Louis; Grothmann, Torsten; Siebenhüner, Bernd (International Environmental Agreements: Politics, Law and Economics, 2010)
The article introduces the notion of adaptiveness and discusses the role of social learning in it. Adaptiveness refers to the capacity of a social actor or social–ecological system to adapt in response to, or in anticipation of, changes in the environment. We explore arguments both from a theoretical perspective and through illustrations from case studies of water management in the Alps of Europe and Mekong in southeast Asia. We propose and illustrate that social learning processes are important for building adaptiveness in several ways and at different scales. Social learning can help cope with informational uncertainty; reduce normative uncertainty; build consensus on criteria for monitoring and evaluation; empower stakeholders to take adaptive actions; reduce conflicts and identify synergies between adaptations; and improve fairness of decisions and actions. Findings in the case studies provide some support for these generalizations but often with caveats related to diversity of stakeholder interests, levels of shared understanding versus contested knowledge and scale of coordination. For this reason, we suggest that future work pays greater attention to issues of agency, knowledge and scale: What strategies have individuals and organizations pursued in successful examples of social learning? How are the boundaries and interactions between science, policy and practice managed? How does social learning occur across spatial and temporal scales?
Keywords: Adaptation; European Alps; Fairness; Mekong River; Social learning; Uncertainty; Water management

The Samaritan's Dilemma: The Political Economy of Development Aid - Gibson, Clark C.; Andersson, Krister; Ostrom, Elinor; Shivakumar, Sujai (Oxford University Press, 2005)
What's wrong with foreign aid? Many policymakers, aid practitioners, and scholars have called into question its ability to increase economic growth, alleviate poverty, or promote social development. At the macro level, only tenuous links between development aid and improved living conditions have been found. At the micro level, only a few programs outlast donor support and even fewer appear to achieve lasting improvements. The authors of this book argue that much of aid's failure is related to the institutions that structure its delivery. These institutions govern the complex relationships between the main actors in the aid delivery system and often generate a series of perverse incentives that promote inefficient and unsustainable outcomes. In their analysis, the authors apply the theoretical insights of the new institutional economics to several settings. First, they investigate the institutions of Sida, the Swedish aid agency, to analyze how that aid agency's institutions can produce incentives inimical to desired outcomes, contrary to the desires of its own staff. Second, the authors use cases from India, a country with low aid dependence, and Zambia, a country with high aid dependence, to explore how institutions on the ground in recipient countries also mediate the effectiveness of aid. Throughout the book, the authors offer suggestions about how to improve aid's effectiveness. These suggestions include how to structure evaluations in order to improve outcomes, how to employ agency staff to gain from their on-the-ground experience, and how to engage stakeholders as "owners" in the design, resource mobilization, learning, and evaluation processes of development assistance programs.

The SAVI programme in Nigeria: Towards politically smart, locally led devlopment - Booth, David; Chambers, Victoria (ODI, 2014)
 More examples are needed of aid programming that works by being responsive to country realities: politically smart, problem-driven and locally led  DFID’s SAVI programme has revealed a hitherto untapped potential for change leading to better development results at state level in Nigeria  SAVI provides low-profile support to state-level organisations and partnerships, building their capacity to engage constructively with government  It avoid the pitfalls of a donor-driven approach by ‘taking the money off the table’  This illustrates the power of facilitated multi-stakeholder engagement and the disadvantages of seeing this in terms of ‘supply side’ and ‘demand side’ governance  The set-up of the DFID suite of state-level programmes, with separately managed sector support and ‘governance’ initiatives, has limited realisation of the potential  Key enabling conditions were that DFID provided space for an experience-based design process and permitted tangible results to be judged retrospectively, not pre-programmed

The Science in Adaptive Management - Ripley, Matt; Jaccard, Sabine (ILO, 2016)
‘Adaptive management’ is all the rage in international development circles. But to avoid yet another buzzword – we need to learn from the experience of natural resource science.
Keywords: IMPORTANT

The Science of Using Science: Researching the Use of Research Evidence in Decision-Making - Langer, Laurenz; Tripney, Janice; Gough, David (EPPI-Centre, Social Science Research Unit, UCL Institute of Education, University College London, 2016)

The Scrum Guide - Schwaber, Ken; Sutherland, Jeff (scrum.org, 2016)

The Secret Sauce of Development Professionals: Tools for Assessing TOR Potential to Source Scalable Learning Interventions - Barton, Adam (Research on Improving Systems of Education (RISE), 2023)
Terms of reference (TORs) play an outsized role in driving scalable educational programming. These procurement documents shape, constrain, and signal programme priorities and possibilities. Successful funders and implementers across the globe hold rich processual knowledge about this documentation, which they use to draft and assess TORs. This project explores such best-practice knowledge around TOR review, seeking to support the design and implementation of educational programmes that can improve learning at scale in developing contexts.

The Social Realities of Knowledge for Development - Georgalakis, James; Jessani, Nasreen; Oronje, Rose; Ramalingam, Ben (IDS, 2017)
This edited collection of peer-reviewed papers explores critical challenges faced by organisations and individuals involved in evidence-informed development through a diverse set of case studies and t...

The Soul in the Computer: The Story of a Corporate Revolutionary - Waugh, Barbara (Inner Ocean Publishing, 2001)
When Barbara Waugh joined the Hewlett-Packard Corporation in the mid-80's, this 60's radical encountered a company with a benign but topdown leadership. As she progressed from recruiting manager to world change manager, she used a set of radical tools to transform its corporate culture and to help realize the true potential of The HP Way.

The struggle for organisational change: how the ActionAid Accountability, Learning and Planning System emerged - Scott-Villiers, Patta (Policy & Practice, 2002)
Change is driven not only by good ideas, but also by disagreement and frustration. This article takes the reader through a selective organisational history of the British NGO ActionAid from 1998 to 2001, looking at events and changes that had a bearing on the

The Success Case Method: A Simple Evaluation Tool to Identify Critical Success Factors and Program Impa - Bell, Catherine; McDonalds, Diane (Australian Evaluation Society Inc., 2006)
Identification and reporting of critical success factors and program impact in an efficient, yet comprehensive manner is an inherent difficulty facing many evaluators of large-scale evaluations. This paper details how two evaluators encountered such problems in the initial review of a large-scale initiative and then successfully addressed these issues through the application of the Success Case Method in a subsequent evaluation of the same program. The Success Case Method is a down-to-earth evaluation tool that can be used for: finding out what is working and what is not, which also provides accurate and trustworthy information that can be used to make timely decisions (Brinkerhoff, 2003, p.3). This paper reports on the advantages of applying this approach to the evaluation of the Primary Welfare Officer Initiative (PWOI), a program that aims to improve the capacity of schools to support students at risk of disengagement and who are not achieving their educational potential.

The Systems Work of Social Change: How to Harness Connection, Context, and Power to Cultivate Deep and Enduring Change - Rayner, Cynthia; Bonnici, François (OUP Oxford, 2021)
The issues of poverty, inequality, racial justice, and climate change have never been more pressing or paralyzing. Current approaches to social change, which rely on industrial models of production and power to "solve" social problems, are not helping. In fact, they are designed to entrench the status quo. In The Systems Work of Social Change, Cynthia Rayner and François Bonnici draw on two hundred years of history and a treasure trove of stories of committed social changemakers to uncover principles and practices for social change that radically depart from these approaches. Rather than delivering "solutions," these principles and practices focus on the process of change itself. Through rich storytelling and lucid analysis, Rayner and Bonnici show that connection, context, and power sit at the heart of the change process, ensuring broader agency for people and communities to create social systems that are responsive and representative in a rapidly changing world. Simple yet profound, this book distills a timely set of lessons for practitioners, leaders, scholars, and policymakers.

The Toyota Way: 14 Management Principles from the World's Greatest Manufacturer - Liker, Jeffrey K. (McGraw-Hill, 2004)
How to speed up business processes, improve quality, and cut costs in any industryIn factories around the world, Toyota consistently makes the highest-quality cars with the fewest defects of any competing manufacturer, while using fewer man-hours, less on-hand inventory, and half the floor space of its competitors. The Toyota Way is the first book for a general audience that explains the management principles and business philosophy behind Toyota's worldwide reputation for quality and reliability.Complete with profiles of organizations that have successfully adopted Toyota's principles, this book shows managers in every industry how to improve business processes by:Eliminating wasted time and resources Building quality into workplace systems Finding low-cost but reliable alternatives to expensive new technology Producing in small quantities Turning every employee into a quality control inspector

The Truth of the Work: Theories of Change in a changing world - Reeler, Doug; van Blerk, Rubert (The Community Development Resource Association, 2017)

The UNDP Accelerator Labs enter a year of maturity: let a thousand flowers bloom! - Annual report 2022 - UNDP accelerator labs (UNDP, 2022)
The UNDP Accelerator Labs were designed as an agile and dynamic Network to allow communication and information transfer between 91 Accelerator Labs in 115 countries, and with the global innovation ecosystem, UNDP as a whole, and thousands of partners including grassroots innovators and their communities. The accumulated knowledge of this Network creates new pathways to the solutions that hold the key to sustainable development problems. What it looked like and how it unfolded last year will be illuminated in this annual report: The UNDP Accelerator Labs enter a year of maturity: let a thousand flowers bloom!

The unofficial SCRUM checklist - Kniberg, Henrik (CRISP, 2010)

The usability of climate information in sub-national planning in India, Kenya and Uganda: the role of social learning and intermediary organisations - Fisher, Susannah; Dodman, David; Epp, Marissa Van; Garside, Ben (Climatic Change, 2018)
Abstract Research on using climate information has often focused on the interaction between users and producers and the technical fit of information for real decision-making. However, due to resource and capacity constraints within both user and producer communities, this approach will not always be feasible or indeed necessary depending on the decisions at hand. These contexts have been relatively under-explored by scholars, and this paper provides an original empirical contribution using three case studies of sub-national governments in India, Kenya and Uganda. In the paper, we analyse how social learning supports changing the usability of climate information and the role of intermediary organisations in these processes. Firstly, the paper shows that intermediaries often choose to build the commitment to project aims rather than using climate information as an entry point to working on climate change, and this allows them to instigate challenging learning processes. Secondly, there are barriers to iterative processes and critical reflection with government stakeholders but these processes can gain traction when built into institutional practices such as formal M&E processes. Lastly, social learning can broaden the framing of climate change from a single sector issue to a multi-sectoral one. We conclude by arguing that bringing together scholarship on social learning with that on the usability of climate information can deepen understanding of the dynamic context in which the information becomes usable. The evidence from the case studies shows that learning processes can alter this context across scales.

The Use and Abuse of the Logical Framework Approach: A Review of International Development NGOs' Experiences - Bakewell, Oliver; Garbutt, Anne (Sida, 2005)
The logical framework approach (LFA) has come to play a central role in the planning and management of development interventions over the last twenty years. Although the logical framework has become universally known, it is far from universally liked. It has been the subject of much criticism over the years, concerning both the theoretical basis of the approach, and the way it is applied in practice. In this review, we have attempted to take stock of the current views of international development NGOs on the LFA and the ways in which they use it.
Publisher: Swedish International Development Cooperation Agency

The water of Systems Change - Kania, John; Kramer, Mark; Senge, Peter (FSG, 2018)
Foundations involved in systems change can increase their odds for success by focusing on the least explicit but most powerful conditions for change, while also turning the lens on themselves. The Water of Systems Change aims to clarify what it means to shift these conditions. We offer the “inverted triangle” framework as an actionable model for funders and others interested in creating systems change, particularly those who are working to advance equity. Top Takeaways Systems change is about advancing equity by shifting the conditions that hold a problem in place. To fully embrace systems change, funders should be prepared to see how their own ways of thinking and acting must change as well. Shifts in system conditions are more likely to be sustained when working at three different levels of change: explicit, semi-explicit, and implicit.

The water of Systems Change: Action learning exercise - Kania, John; Kramer, Mark; Senge, Peter (FSG, 2018)
Based on the “inverted triangle” framework presented in The Water of Systems Change, this activity is designed to help individuals think systemically about social change, explore what is happening below the surface on issues they care about, and determine how they and their organizations can pursue large-scale change in a disciplined and holistic manner. The exercise is divided into 3 parts: Part I uses the “inverted pyramid” introduced in The Water of Systems Change to perform an external assessment of opportunities to make progress on the social or environmental issue you are focused on. Part II uses the same framework to consider internal conditions within yourself and your organization that should change in order for you to better support progress on your issue. Part III takes what was developed in Parts I and II and asks “What to do next?”

The Whistler principles to accelerate innovation for development impact - G7 (G7, 2018)
The Whistler principles to accelerate innovation for development impact : 2018 G7 Summit – Canada 2018 G7 Presidency – Charlevoix, Quebec

The White Man's Burden: Why the West's Efforts to Aid the Rest Have Done So Much Ill and So Little: Why the West's Efforts to Aid the Rest Have Done So Much Ill and So Little Good - Easterly, William (Oxford University Press, 2007)
We are all aware of the extreme hunger and poverty that afflict the world's poor. We hear the facts, see the images on television, buy the T-shirt and are moved as individuals and governments to dig deep into our pockets. Yet what happens to all this aid? Why after 50 years and $2.3 trillion are there still children dying for lack of twelve cents medicine? Why are there so many people still living on less than $1 a day without clean water, food, sanitation, shelter, education or medicine? In The White Man's Burden William Easterly, acclaimed author and former economist at the World Bank, addresses these twin tragedies head on. While recognising the energy and compassion behind the campaign to make poverty history he argues urgently and powerfully that grand plans and good intentions are a part of the problem not the solution. Giving aid is not enough, we must ensure that it reaches the people who need it most and the only way to make this happens is through accountability and by learning from past experiences. Without claiming to have all the answers, William Easterly chastises the complacent and patronising attitude of the West that attempts to impose solutions from above. In this book, which is by turns angry, moving, irreverent but always rigorous, he calls on each and everyone of us to take responsibility, whether donors, aid workers or ordinary citizens, so that more aid reaches the people it is supposed to help, the mother who cannot feed her children, the little girl who has to collect firewood rather than go to school, the father who cannot work because he has been crippled by war.

Theories of Change for Promoting Empowerment and Accountability in Fragile and Conflict-Affected Settings - Green, Duncan (IDS, 2017)
This paper explores the current state of thinking among a range of aid actors (multilaterals, bilateral, applied scholars and international non-governmental organisations) on how to promote empowerment and accountability in fragile, conflict and violence affected settings. It seeks to identify trends, gaps and weaknesses in that thinking, and propose research questions and hypotheses to test. Three underlying sources of confusion are identified that are hindering progress on both understanding empowerment and accountability in fragile, conflict and violence affected settings, and taking helpful action to promote it. They are: Theory of endogenous change (e.g. on how empowerment and accountability arise in situ) versus the theory of action of an external intervention; Fragility versus conflict: there is no clear justification for combining these different aspects into a single category; and Empowerment versus accountability: donor analysis and practice has been overwhelmingly weighted towards accountability, exhibiting limited understanding or interest in the nature of power.
Keywords: A4EA; External actors; Participation

Theories of change in international development: Communication, learning, or accountability? - Valters, Craig (JSRP, 2014)

Theories of Change: time for a radical approach to learning in development - Valters, Craig (ODI, 2015)
The Theory of Change approach demands a radical shift towards more and better learning in development thinking and practice, creating a productive and much-needed space for critical reflection.

Theory amidst complexity – using process tracing in ex-post evaluations - Krueger, Kate; Wright, Molly (New Directions for Evaluation, 2022)
Evaluators who take a complexity-aware approach must consider tradeoffs related to theoretical parsimony, falsifiability, and measurement validity. These tradeoffs may be particularly pronounced with ex-post evaluation designs in which program theory development and monitoring frameworks are often completed before the evaluator is engaged. In this chapter, we argue that theory-based evaluation (TBE) approaches can address unique ex-post evaluation challenges that complexity-aware evaluation (CAE) alone cannot, and that these two sets of approaches are complimentary. We will outline strategies that evaluators may use to conduct rigorous ex-post evaluations of democracy, human rights, and governance (DRG) interventions that merge CAE's inductive approaches with a theory-testing structure. It will illustrate these strategies with two case studies of ex-post evaluation using process tracing (PT).
_eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/ev.20524

Theory-Based Approaches to Evaluation: Concepts and Practices - Treasury Board of Canada Secretariat (Government of Canada, 2021)
This document introduces some of the key concepts of theory-based approaches to evaluation. It is hoped that readers will be encouraged by the information and advice provided in this document and will explore the use (e.g., through pilot evaluations) of theory-based approaches to evaluation in a federal setting. To support this, Sections 1.0 to 8.0 of the document describe the general application of theory-based approaches to evaluation, and Sections 9.0 and 10.0 discuss the potential application of theory-based approaches to a range of federal programs. This document is neither an exhaustive training program in theory-based evaluation nor a step-by-step guide to undertaking a theory-based evaluation. Evaluators who wish to integrate theory-based approaches into their practices are encouraged to pursue additional readings (including those referenced in this document) and, as appropriate, to seek additional support in undertaking a theory-based evaluation.
Last Modified: 2021-03-22

Theory of Action: Creating Craddle to Career Proof Points - Strive Together (Strive Together, 2014)
StriveTogether’s Theory of Action provides a framework for improving educational outcomes and ensuring a community transforms how it serves children.

Theory of Change - Rogers, Patricia (UNICEF, 2014)

Theory of Change Analysis: Building Robust Theories of Change - Mayne, John (Canadian Journal of Program Evaluation, 2017)
Models for theories of change vary widely as do how they are used. What constitutes a good or robust theory of change has not been discussed much. This article sets out and discusses criteria for robust theories of change. As well, it discusses how these criteria can be used to undertake a vigorous assessment of a theory of change. A solid analysis of a theory of change can be extremely useful, both for designing or assessing the designs of an intervention as well as for the design of monitoring regimes and evaluations. The article concludes with a discussion about carrying out a theory of change analysis and an example.

Theory of Change: From novice to master changemaker - Changeroo (2020)
Theory of Change is more than just a tool or instrument. It is a mindset! A mindset to optimise impact management. As the cornerstone of impact management it is indispensable to any purpose-driven organisation targeting social or environmental value creation. It offers you the cornerstone of a learning approach toward change and impact. A way to build a mindset and organisational culture of critical reflection, co-creation with stakeholders and constant analysis of what works, why, for whom and under what circumstances. Are you ready to take impact management to the next level with the help of Theory of Change? We offer you the premier online course to learn everything about this approach.

Theory of Change in complex Research for Development programmes: challenges and solutions from the Global Challenges Research Fund - Chapman, Sarah; Boodhoo, Adiilah; Duffy, Carren; Goodman, Suki; Michalopoulou, Maria (The European Journal of Development Research, 2023)
The United Kingdom Research and Innovation (UKRI) Global Challenges Research Fund (GCRF) aimed to address global challenges to achieve the United Nations (UN) Sustainable Development Goals through 12 interdisciplinary research hubs. This research documents key lessons learned around working with Theory of Change (ToC) to guide Monitoring, Evaluation and Learning (MEL) within these complex research for development hubs. Interviews and document reviews were conducted in ten of the research hubs. The results revealed that only one hub invested in an explicit visual system mapping approach, and that funder timelines, budget constraints and issues with capacity and expertise limited the application of these approaches across all hubs. In contrast, many hubs attempted to deal with visual complexity by means of ether constructing multiple, nested ToCs, or a conscious simplification of complexity through reducing their ToC towards a straightforward and uncomplicated chain model or spherical model. While the former approach had some value, most hubs struggled to find capacity to support the full articulation of nested ToCs. In contrast, the latter approach resulted in ToCs which lacked detail or mechanism articulation, but which nevertheless were often ‘fit for purpose’ in ensuring effective communication and coherence across diverse stakeholders and sub-projects. We conclude that in instances where the reporting, funding and management cycles of complex research for development programmes cannot be adapted to properly support learning-based approaches to ToC development, imposing simplicity in the ToC might be fit for purpose. This might also be preferable to more complex visual approaches that are only partially realised.

Theory of change in ten steps - Noble, James (NPC, 2019)

Theory of change software - Better Evaluation (2023)
There are a number of options when it comes to using software to help create a logic model. These range from generic word processing tools (Word, Powerpoint, or their Google Doc or Mac equivalents), to software that has been specifically tailored for visualising Theories of Change, like TOCO or Miradi. You should consider what resources you have to invest in software, both in terms of cost and in time to learn and use the features. If you only have a short timeframe and have simple needs, then a basic tool may suit you better than some of the more complex software available. It's important to investigate a few options and see what is going to be best for you.

Theory of Change Thinking in Practice - van Es, Marjan; Guijt, Irene; Vogel, Isabel (2015)
Want to know better how your interventions can contribute to change? A Theory of Change (ToC) approach helps in deepening your understanding - and that of your partners - of how you collectively think change happens and what the effect will be of your intervention. Not only does it show what political, social, economic, and/or cultural factors are in play, it also clarifies your assumptions. Once a ToC has been developed, it can be used to continually reflect on it in ways that allow for adaptation and checking of assumptions of your intervention. This user friendly guideline helps you to use a Theory of Change approach. Theories of change are the ideas and beliefs people have – consciously or not – about why and how the world and people change. How people perceive and understand change and the world around them is infused by their underlying beliefs about life, human nature and society. They are deep drivers of people’s behaviour and of the choices they make. Social change processes are complex and characterised by non-linear feedback loops: our own actions interact with those of others and a myriad of influencing factors. This triggers reactions that cannot be foreseen and makes outcomes of change interventions unpredictable. Given these uncertainties, how can we plan strategically and sensibly? How can social change initiatives move forward in emerging change processes in a flexible way, while remaining focused on the goal? In this context of complexity, Hivos has found a theory of change (ToC) approach useful in guiding its strategic thinking and action, as well as its collaborative efforts with others. As it fosters critical questioning of all aspects of change interventions and supports adaptive planning and management in response to diverse and quickly changing contexts. It contributes to the quality and transparency of strategic thinking, and therefore to personal, organisational and social learning. This guide builds on the experiences of Hivos working with a ToC approach. It is a practical guide for Hivos staff in applying a Theory of Change approach, but is also very useful for others working on social change such as social entrepreneurs and innovators. This guide builds on the work of a ToC Learning Group initiated by Hivos and comprising of staff of the Centre for Development Innovation (CDI) of Wageningen University and Research Centre and of experts Iñigo Retolaza Eguren, Isabel Vogel and Irene Guijt. For current thinking and work on the use of Theory of Change thinking in complex change processes, see http://www.theoryofchange.nl

Theory of Change Workbook: A Step-by-Step Process for Developing or Strengthening Theories of Change - Salib, Monalisa (USAID, 2022)
While over time theories of change have become synonymous with simple if/then statements, a strong theory of change should actually be a much more detailed, context-specific articulation of how we *theorize* change will happen under a program.

“There’s no money for that.” Three Ways to Resource Collaborating, Learning, and Adapting - Salib, Monalisa (USAID Learning Lab, 2016)
This blog is the third in an ongoing series exploring the components of USAID's CLA Framework. Here is the first blog on organizational culture and the second on effective learning.

Thinking and working politically: An introduction to key ideas, examples and further reading - Laws, Ed; Marquette, Heather (2018)

Thinking and Working Politically – Are We Seeing the Emergence of a Second Orthodoxy? - Teskey, Graham (Abt Associates, 2017)
There now is a persuasive volume of evidence that demonstrates that capacity and technical knowledge alone are insufficient to change deeply entrenched political interests and bureaucratic norms. These critiques demonstrate that an understanding of power asymmetries is frequently the critical missing ingredient in project design and implementation. Many eminent thinkers have looked at the difference between success and failure in development, and all point to the primacy of domestic politics. This point has not been lost on development agencies and some have tried to provoke greater attention to the role that politics plays. However, this recognition is yet to pass into the mainstream of development practice. Despite the slow but sure accretion of this knowledge the international community seems to be wedded to doing development traditionally. The purpose of this paper is to consider the extent to which a ‘second orthodoxy’ is slowly emerging which can stand alongside, and in some cases may supplant, the ‘first orthodoxy’ of the traditional project framework. Care has to be taken in making this argument, as there is certainly no consensus within the development community on its importance, and even among advocates, there are slightly differing interpretations of what this second orthodoxy looks like. Further, it is not absolutely clear that the two orthodoxies can co-exist. The paper does not call for any ‘paradigm shift’ in how development practitioners conceptualise programs and projects, nor does it demand that the project framework be scrapped; the former would be impossible and the latter undesirable. Equally readers will find no claims that Doing Development Differently or ‘Thinking and Working Politically’ will always and everywhere guarantee better development outcomes. Rather, the paper seeks to summarise how the two orthodoxies differ, where the second orthodoxy now stands, and propose how it can be taken forward in practical terms.

Thinking and Working Politically: from theory building to building an evidence base - Dasandi, Niheer; Marquette, Heather; Robinson, Mark (DLP, 2016)
This paper discusses the steps required to build a robust evidence base for 'thinking and working politically' (TWP) in development. It argues that better understanding what works, when and why is an important step in moving TWP into mainstream development programming. The paper reviews the existing evidence base on TWP, building on this and on other literature on public sector reform and 'pockets of effectiveness' to suggest research questions, case study selection criteria, and a four-level analytical framework: 1) political context; 2) sector; 3) organisation; and 4) individual. The framework aims to help build a 'rigorous enough' evidence base to show whether and how TWP happens and whether or not it influences the effectiveness of programme implementation and outcomes. The paper also calls for more focus on gender issues, and on different – and often more fragile – political contexts.
Keywords: IMPORTANT

Thinking and Working Politically in development - Coalitions for Change in The Philippines - Sidel, John T.; Faustino, Jaime (The Asia Foundation, 2020)
The Asia Foundation and the Australian Embassy in the Philippines today released a new publication, Thinking and Working Politically in Development: Coalitions for Change in the Philippines. Written by London School of Economics and Political Science Professor John T. Sidel and The Asia Foundation’s Jaime Faustino, the book examines the first phase of the Coalitions for Change program (2012-2018) and the contributions to key development policy reforms in the Philippines. The book is a rigorous treatment of the Coalitions for Change program’s transformative policy reforms—alongside lessons from its failures—across diverse policy arenas and in a wide variety of cities and provinces. The chapters are organized thematically: excise tax reform (Chapter 2), land governance reform (Chapter 3), education (Chapter 4), electoral reform (Chapter 5), disaster risk reduction and management (Chapter 6), and subnational governance reform and conflict resolution in Mindanao (Chapter 7). The co-authors together combine an independent, academic perspective on the program’s impacts (Sidel) with a front-row view of doing policy reform in the Philippines – both its political and technical dimensions (Faustino). Based on the empirical research and comparative analysis undertaken by the authors, the book articulates – and substantiates – a strong set of arguments that help to explain the program’s mixed pattern of achievements and disappointments. Overall, the book concludes that the seven-year program achieved significant and sustainable impact using problem-driven, adaptive, and iterative approaches to developmental change. The authors assert the program was at the forefront of notable development approaches: aid effectiveness and development around thinking and working politically, doing development differently, and adaptive programming. Graham Teskey, an early advocate of ‘thinking and working politically’ explores how development agencies can replicate the conditions for success in his Afterword. With illustrative case studies and analyses, the book provides valuable lessons for policymakers, scholars, bilateral agencies, think-tanks, and anyone interested in successfully maneuvering the shifting dimensions of development in the Philippines and elsewhere.

Thinking and Working Politically in Economic Development Programmes – Some Sprints and Stumbles from a DFID Programme in Kyrgyzstan - Koleros, Andrew; Rinnert, David (From Poverty to Power, 2019)
A DFID programme in Kyrgyzstan offers useful insights into how the Thinking and Working Politically approach can escape from its governance ghetto
Keywords: Case Study

Thinking and working politically in large, multi-sector Facilities: lessons to date - Teskey, Graham; Tyrrel, Lavinia (Abt Associates, 2017)

Thinking and working politically in Somalia: A case study on the Somalia Stability Fund - Laws, Ed (TWP Coommunity of Practice and ODI, 2018)

Thinking and Working Politically in the Land Sector in Mekong Region - Burns, Tony; Ingalls, Micah; Rickersey, Kate (2022)
In recent decades, the World Bank and many bilateral development partners have provided funding to support land administration reform. Traditional land administration reform projects focus on the economic and technical design of interventions based on a library of best practice, commonly avoiding the “messy politics” typically involved in land governance. Experience and lessons from land administration reform initiatives have been documented and a recurrent theme is that many projects fail to create effective, transformative change and gain the critical mass, and the community participation, necessary to ensure the sustainability of land administration reform. Over the last decade there have been concerted efforts to develop more politically informed ways of thinking and working using a range of methodologies referred to, variously, as Thinking and Working Politicallyi (TWP), Problem Driven Iterative Adaptation (PDIA) and Doing Development Differently (DDD). There is little evidence that these different approaches have been applied in the land sector.

Thinking and working politically in the transparency and accountability field - Halloran, Brendan (Transparency & Accountability Initiative, 2014)

Thinking and Working Politically: Learning from practice. Overview to Special Issue - McCulloch, Neil; Piron, Laure-Hélène (Development Policy Review, 2019)
Over the last 15 years, a set of ideas now referred to as “thinking and working politically” (TWP) has coalesced into a “second orthodoxy” about how to take context into account when implementing development interventions. This approach stresses the importance of obtaining a better understanding of the local context (“thinking politically”) in order to support local actors to bring about sustainable developmental change (“working politically”). However, the evidence base to justify this new approach remains thin, despite a growing number of programmes which purport to be implementing it. Officials in development agencies struggle with putting it into practice and it is unclear how TWP differs—or not—from similar approaches, such as Problem Driven Iterative Adaptation (PDIA) and Doing Development Differently (DDD). This Special Issue sheds light on what TWP means in practice by examining a set of initiatives undertaken by both development partners and government departments in Nigeria, the Occupied Palestinian Territories, China and India. This overview article outlines, in brief, each of the Special Issue's four papers and then draws out five lessons—for funders and for practitioners—from across all the papers. Our five lessons are: (1) the fundamental importance of undertaking political economy analysis (PEA) to adapt programmes to their contexts; (2) the importance of having a realistic level of ambition for interventions; (3) the need to support local ownership—not just “agreement ownership” (between a donor agency and government) or local “management ownership” of the programme, but critically “driver ownership” by generating trust with the key local actors driving change; (4) the need for a more effective set of tools for measuring results in complex programmes that attempt to achieve improvements in long-run governance; and, (5) that although the political economy of donors is often seen as a barrier to applying TWP, the articles show how much can be done with a TWP approach if the analysis takes into account the political economy of donors as well as that of the local context. We conclude with a set of operational recommendations for donors and implementors, as well as suggestions of avenues for further research.
Keywords: Adaptation; Development programmes; Political economy analysis; Reform space; thinking and working politically

Thinking and Working Politically: Lessons from FOSTER in Nigeria - Lopez Lucia, Elisa; Buckley, Joanna; Marquette, Heather; McCulloch, Neil (DLP Program, 2017)
The Facility for Oil Sector Transparency and Reform (FOSTER) was a £14 million programme that has helped Nigeria to transform its governance of the oil and gas industry. FOSTER ran from 2011 to mid-2016, and used an explicit ‘thinking and working politically’ (TWP) approach. It was funded by the UK Department for International Development (DFID) and managed by Oxford Policy Management (OPM). This paper seeks to identify the factors that drove – or constrained – FOSTER’s achievements, and asks what this can tell us about TWP, particularly in challenging political and sectoral contexts. FOSTER sought to help strengthen oversight and accountability in Nigeria’s oil sector. It aimed to support reformers within government institutions that ‘supply’ accountability (those governing how oil and gas revenues are collected and managed), and to support civil society organisations, parliament, the media and the Nigeria Extractive Industries Transparency Initiative to ‘demand’ reform. In addition, FOSTER commissioned a series of studies and provided media training to help broaden understanding of the sector and highlight the need for reform. This paper examines the outcomes from five ‘clusters’ of FOSTER interventions. The FOSTER team viewed the first three of these in the list below as successful, whereas the latter two did not deliver on expectations but offer important opportunities for learning: • Support to the Nigerian Extractive Industries Transparency Initiative • Support to demand-side actors to promote transparency and accountability in the oil sector • Support for the passage of the Petroleum Industry Bill • An oil spill-mapping social media project • Support to the Department of Petroleum Resources The analysis drew on 44 semi-structured interviews conducted during a month of fieldwork in Abuja and Lagos; on reviews of the programme’s monitoring, evaluation and learning frameworks; and on newspaper articles and grey literature on Nigeria’s oil sector.2

Thinking and Working Politically on Health Systems Resilience: Learning from the experience of Cameroon, Nepal and South Africa during COVID-19 - Williams, Gareth (TWP Community of Practice, 2022)

Thinking and Working Politically: Professional Development Reading Pack - Booth, David (GSDRC Applied Knowledge services, 2015)

Thinking and working politically: Reviewing the evidence on the integration of politics into development practice over the past decade - Laws, Ed; Marquette, Heather (TWP Community of Practice, 2018)

Thinking and Working Politically through Applied Political Economy Analysis. A guide for practitioners - Rocha Menocal, Alina; Cassidy, Marc; Swift, Sarah; Jacobstein, David; Rothblum, Corinne; Tservil, Ilona (USAID, 2018)
Thinking and Working Politically (TWP) through Applied Political Economy Analysis (PEA). A guide for practitioners Have you ever done everything right in a development program — followed every technical best practice — but still missed the mark? When this happens, it often relates to factors in the context beyond any external development actor’s ability to control.

Thinking and Working politically to support developmental leadership and coalitions: The Pacific Leadership Program - Denney, Lisa; McLaren, Rebecca (DLP Program, 2016)

Thinking and Working Politically: What does it mean, Why is it important and How do you do it? - Leftwich, Adrian (Politics, Leadership and Coalitions in Development: Policy Implications of the DLP Research Evidence, Research and Policy Workshop, 2011)
This paper suggests that working politically in a developmental context means directing attention and support to the agents of reform and development (leaders and organisations). This allows investment in the local processes that will resolve problems – such as problems of collective action – through the work of alliances and coalitions. Hence, it will drive the formation and consolidation of the locally appropriate, feasible and legitimate institutions that are most likely to advance development outcomes. The Developmental Leadership Program defines politics as the pervasive, unavoidable and necessary activities of conflict, negotiation and compromise involved in group decision-making about how resources are to be used, produced and distributed. Thinking politically means understanding that both political and technical dimensions are central to developmental outcomes. It also means: Understanding that ‘agency’ matters. That is, that people have the potential to change things, but always withhin the context of given institutional arrangements, which contain both constraints and opportunities. Leaders, organisations and followers think, strategise and attempt to resolve problems in different ways in the same contexts. Understanding leadership as a political process that mobilises people and resources in support of a goal: leaders seldom work on their own. Realising that overcoming collective action problems is a major challenge of development. Collective action problems occur when people with diverse (often competing) interests struggle to agree on an organisational arrangement from which they would all benefit. Understanding that coalitions (formal or informal) are a crucial political mechanism for the resolution of collective action problems. Paying attention to the detailed inner politics of regimes, sectors or issues (‘micro-politics’). This includes understanding who the players are, where they come from, their organisational affiliations, ideologies and interests and the political dynamics involved. (Many political analysis tools are inadequate for this level of detail.) Recognising that processes are as important as projects in development, and vary from context to context. Working politically in development means supporting, brokering, facilitating and aiding the emergence and practices of (public or private) developmental or reform leaderships, organisations, networks and coalitions at any level, and across all sectors. It means helping them to respond to, and work with, initiatives and requests from local individuals and groups. Working politically can also involve: Investing in the effectiveness of developmental coalitions by enhancing the political capacity of organisations in negotiation, advocacy, communication and the generation of constructive policy options. Rethinking higher educational support programmes so that they supplement a skills focus with strategies that help to build networks, and encourage the understanding of collective action problems and of the importance of providing public goods. Acquiring a deep and detailed knowledge of, and long-term exposure to, the country or issue concerned. Respectful and sensitive understanding of local political dynamics and cultural norms. Employing more social scientists and a well-trained, politically savvy workforce, both local and international, with the capacity to ‘read’ the politics. In particular, coalitions can help drive the endogenous politics of developmental reforms by: 1) achieving a specific policy goal; 2) opening up debate on a previously taboo issue; 3) deepening and strengthening the coalition’s internal organisation and relationships for future purposes; and 4) increasing the capacity of constituent organisations. It is also important to understand that: Developmental leaderships and coalitions often emerge in response to a critical juncture – a threat, challenge or danger – or a new opportunity. What matters is whether leaders have the knowledge, education, vision, prior experience and networks to seize such opportunities. The character and conditionality of funding by donors or supporters can make or break a coalition. Are tight conditions applied? Are funding arrangements transparent?

Thinking and working politically: What have we learned since 2013 - Teskey, Graham (TWP Community of Practice, 2021)
The Thinking and Working Politically (TWP) Community of Practice (CoP) was established at a small meeting tacked on at the end of a meeting of Governance Advisers working for the United Kingdom’s Department of International Development (DFID) on South and South-East Asian countries, held in Delhi in November 2013. Since then, a number of meetings have been held throughout the world, each addressing different issues; ‘TWP’ has entered the lexicon of mainstream development; the CoP has expanded to more than 300 people; a Washington DC chapter has been established; and the International CoP has been granted modest funding from DFID’s successor, the Foreign, Commonwealth and Development Office (FCDO) and from Australia’s Department of Foreign Affairs and Trade (DFAT). It is legitimate to ask, however, what has been achieved operationally: how have the ideas underpinning TWP affected operational practice? This short paper traces the evolution of the idea and practice of TWP from 2013 to late 2021, and identifies what we have learned. What has been successful, and what has not? I asked in 2017 whether TWP had become a second orthodoxy (Teskey, 2017). Did this represent hubris or was 2017 in some ways the apogee of what might rather grandly be called the TWP ‘movement’?

Thinking and working politically: What have we learned since 2013? – FP2P - Green, Duncan (From Poverty to Power, 2022)
It’s always a red letter day when a new paper from Graham Teskey drops. His most recent is Thinking and working politically: What have we learned since 2013? For those that don’t know him, Graham is a consummate insider-outsider within the aid sector – long stints at DFID (UK), DFAT (Australia) and now Abt (Management Consultants). From this vantage point he has been one of the leading proponents of ‘thinking and working politically’, always ready to call out the hand-wavey academics and demand some practical lessons, please. This paper is part biography of an idea, setting out the timeline, moments and key documents and policy wins in the evolution of TWP (which seems to have involved a lot of seminars that I missed due to Oxfam’s meagre travel budget). The other part is, to be honest, a bit of a lament – a study in ‘Why Change Hasn’t Happened’, because TWP has ‘got lost in the maelstrom’ of the wider, largely negative, changes in the aid sector. Overall, it’s a brilliant summary, and one I’ll be recommending to my increasingly long-suffering activism students….

Thinking and working politically with technology: State of the art meets art of the state - Thampi, Gopa; Nixon, Nicola (From Poverty to Power, 2020)
Based on its work in Sri Lanka, The Asia Foundation argues for greater attention to the local political dynamics into which digital solutions are introduced

Thinking and Working Politically (Yangon, October 2016) - British Council (British Council Myanmar, 2017)
On 3-4 October 2016, British Council, Pyoe Pin, The Asia Foundation and UK DFID co-hosted a two day conference on ‘Thinking and Working Politically’ (TWP) for more effective and sustainable development assistance. The success or failure of development programmes is, in many – if not most – cases, determined by domestic politics within countries, rather than by the technical elegance of programme design by external donors. The event brought together international donors, implementing agencies and local partners. Participants compared experiences on what has worked, where and why – both in Myanmar, and across the world including case studies from Sudan, Zambia and the Philippines. Throughout the conference, participants familiarised themselves with politically smart development approaches and what it means to think and work politically in Myanmar. This has laid foundations for greater collaboration on TWP to help meet Myanmar’s critical development challenges.

Thinking and working with political settlements - Kelsall, Tim (ODI, 2016)
• In recent years, Political Settlements Analysis (PSA) has become increasingly influential in academic and policy circles • Despite its intuitive appeal, it seems difficult to use in practice • PSA has a natural affinity with Adaptive Development, Thinking and Working Politically, and Doing Development Differently approaches • By answering the simple diagnostic questions supplied here, development partners can identify the types of political settlements in which they work, and draw some broad operational implications

Thinking big: How to use theory of change for systems change - Abercrombie, Rob; Boswell, Katie; Thomasoo, Rosanna (NPC, 2018)
We think that, applied well, theory of change can support charities and funders to take a systemic approach to their work. This report identifies five common pitfalls that organisations fall into when using theory of change, and walks through five rules of thumb that will help organisations to use the approach to tackle complex problems. We think that, applied well, theory of change can support charities and funders to take a systemic approach to their work. This report identifies five common pitfalls that organisations fall into when using theory of change, and walks through five rules of thumb that will help organisations to use the approach to tackle complex problems.

Thinking in Systems: A Primer - Meadows, Donella H. (Chelsea Green Publishing, 2008)
In the years following her role as the lead author of the international bestseller, Limits to Growth—the first book to show the consequences of unchecked growth on a finite planet— Donella Meadows remained a pioneer of environmental and social analysis until her untimely death in 2001.Thinking in Systems, is a concise and crucial book offering insight for problem solving on scales ranging from the personal to the global. Edited by the Sustainability Institute’s Diana Wright, this essential primer brings systems thinking out of the realm of computers and equations and into the tangible world, showing readers how to develop the systems-thinking skills that thought leaders across the globe consider critical for 21st-century life.Some of the biggest problems facing the world—war, hunger, poverty, and environmental degradation—are essentially system failures. They cannot be solved by fixing one piece in isolation from the others, because even seemingly minor details have enormous power to undermine the best efforts of too-narrow thinking.While readers will learn the conceptual tools and methods of systems thinking, the heart of the book is grander than methodology. Donella Meadows was known as much for nurturing positive outcomes as she was for delving into the science behind global dilemmas. She reminds readers to pay attention to what is important, not just what is quantifiable, to stay humble, and to stay a learner.In a world growing ever more complicated, crowded, and interdependent, Thinking in Systems helps readers avoid confusion and helplessness, the first step toward finding proactive and effective solutions.

Thinking Tools Studio - Waters Center (Waters Center for Systems Thinking, 2021)
Tools to help you Think

This startup uses machine learning and satellite imagery to predict crop yields - Brokaw, Alex (The Verge, 2016)
Mark Johnson wants to beat the United States Department of Agriculture at its own game: predicting yields of America's crops. The USDA puts boots on the ground, deploying hundreds of workers to...

Thoughts on the use of hypotheses in adaptive management - Sparkman, Timothy (BEAM Exchange, 2015)
New insights, opinions and perspectives on market systems development, from experts and practitioners.

Three Approaches to Monitoring: Feedback Systems, Participatory Monitoring and Evaluation and Logical Frameworks - Jacobs, Alex; Barnett, Chris; Ponsford, Richard (IDS Bulletin, 2010)
This article compares key attributes, strengths and weaknesses of three different approaches to monitoring development interventions: the logical framework approach, participatory monitoring and evaluation (PM&E) and feedback systems. Academic and practitioner literature describes how logframes meet the needs of senior decision-makers to summarise, organise and compare projects. PM&E meets the needs of field staff to work sensitively with intended beneficiaries and support their learning and empowerment. Feedback systems appear to link the two, providing performance data for managers and creating incentives for implementing staff to focus on their intended beneficiaries. Feedback systems build on the rich heritage of PM&E and are compatible with logframes. They may help provide a manageable and effective approach to accountability that links the means and the ends of development interventions. Feedback systems are at an early stage of development. There is a lot to learn about how and where they work best.

Three out of Four Practical Lessons about right fitting MEL for Additive Effects - Guerzovich, Florencia (Medium, 2023)
This is a series about Monitoring, Evaluating and Learning (MEL) whether sets of interventions/portfolios are adding more together than each one would produce on their own. In post 1, I pointed to coherence, the new OECD-DAC evaluation criteria as a way to bridge the ambition of bringing bigger change with the MEL world. In post 2, I shared 3 of 4 practical lessons I’ve learned in experimenting with MEL systems and exercises that focus explicitly on interactions of interventions/portfolios. In the third post, I bring Paul Pierson’s groundbreaking argument for social science to MEL. Paraphrasing, most contemporary MEL takes a “snapshot” view of interventions and portfolios, distorting their effects and meaning by ripping them from their temporal context. Instead, we should place in time interventions/portfolios with the ambition to add more than the sum of the part by constructing MEL systems looking at “moving pictures” rather than taking snapshots.

TICTeC 2018 - The Making All Voices Count programme: new lessons about donor-funded civic tech - mySociety (2018)
Keywords: Accountability; Civic Tech; IDS; TICTeC; transparency

Time for a Donor Funding Charter? - kiwanja.net (Donor's Chapter, 2014)

Time to let go: remaking humanitarian action for the modern era - Bennett, Christina (ODI, 2016)
As the international humanitarian system faces a crisis of legitimacy, the Humanitarian Policy Group’s landmark report proposes a new model of humanitarian action.

Time to Listen: Hearing People on the Receiving End of International Aid - Anderson, Mary B.; Brown, Dayna; Jean, Isabella (CDA Collaborative Learning Projects, 2012)
Does the way international assistance is organized make sense? Is it working as we mean it to? This book approaches these questions through the experiences of people living on the receiving side of international assistance. It reports on the ideas, insights, and analyses of almost 6,000 people across 20 countries where international aid has been provided. From such a range of locations and people, one might expect vastly different ideas and opinions. However, remarkably consistent patterns and common judgments emerged. In the midst of difference, there was striking unanimity and consistency about the processes and the effects of the international aid system. Using their words, their experiences, and their ideas, this book describes why the cumulative impacts of international aid efforts have not met expectations. It describes a way forward to make changes that, according to those on the receiving end, will lead to more effective and lasting results.

Timely evaluation in international development - Webster, Jayne; Exley, Josephine; Copestake, James; Davies, Rick; Hargreaves, James (Journal of Development Effectiveness, 2018)
Impact and process evaluations are increasingly used in international development; however they are generally retrospective in outlook. A more timely approach to evaluation aims to identify necessary, feasible and effective changes during a programme or intervention’s lifetime. This paper aims to identify, categorise, describe and critically appraise methods to support more timely evaluation in international development. Potential methods were identified through scoping seminar, public symposium, targeted review of the literature, and the authors’ own experiences and opinions. Findings from the different data sources were reviewed collectively by the author group and triangulated to develop an analytical framework. We identified four purposes of timely evaluation for international development, and critiqued the use of approaches against four dimensions of timeliness and flexibility. Whilst we found significant interest in more timely approaches to evaluation in international development, there was a dearth of published empirical evidence upon which to base strong recommendations. There is significant potential for timely evaluation to improve international development outcomes. New approaches to mixing and adapting existing methods, together with new technologies offer increased potential. Research is needed to provide an empirical evidence base upon which to further develop the application, across sectors and contexts, of timely evaluation in international development.
Keywords: Adaptive learning; Outcome evaluation; Programme improvement; impact evaluation

Tiny Tools - Measuring Change in Communities and Groups - Causemann, Bernward; Gohl, Eberhard; Brenner, Verena (Impact+, 2012)
Introduction to the Overview: Tiny Tools Why “Tiny Tools” for assessing change? Currently, change is mostly assessed by NGO staff or external experts. The vision of this paper is that communities assess and reflect change themselves and make use of that reflection with appropriate tools. All the tools presented here are relatively quick and easy to learn (therefore “tiny”). With Tiny Tools we can assess change in one session. They can therefore be used where there are not baselines. They are structured and systematic, and they are all widely tested: Experience shows that these tools lead to new insights, mobilise enthusiasm and increase the capacity of communities to bring about further change. The Tiny Tools are in line with what Participatory Rural Appraisal (PRA) wanted to achieve. Many are slight variations of PRA tools. For a detailed description of concepts, see the NGO-IDEAs Impact Toolbox (www.ngo-ideas.net/impact_toolbox) and the NGO-IDEAs Manual Self-Effectiveness (www.ngo-ideas.net/monitoring_self_effectiveness). The tools are designed to visualise change, but also enable communities to reflect on the reasons of change or verify assessments. They may be implemented once or continuously over time. We know that the time of community members is precious, and limited. Therefore all Tiny Tools can be performed in a relatively short session, provided facilitators (it could be field staff or project officers) are experienced – and the community knows and trusts them. The amount of time spent on the application of the tools may however be prolonged according to the needs of a community or NGO. All of these tools are easy to learn for a facilitator experienced in participatory processes. Which tool should be introduced to which community? It is typically the decision of a development organisation (or external experts) which tools they want to introduce into a community. The staff need to assess which tool will lead to learning and action. It could also be that the staff realise aspects of change that they do not understand well enough. These tools are good for exploring change that we have not planned for and not anticipated. They are also good for exploring change in a context where we have no prior information. Communities are the best experts for their situation, but we emphasise that the tools should be used in ways that benefit and empower the communities or individuals participating. The tool implementations should lead to consequences on the grassroots as well as the NGO level. All Tiny Tools can be integrated into PIAR, the Analysis tool in the NGO-IDEAs Impact Toolbox. Also, the Tiny Tools can help to prepare for the application of the Toolbox tools. They help to make people aware of changes that can be observed. The following box gives some hints how Tiny Tools relate to the Impact Toolbox tools, and to what extent they help to attribute change to development interventions.

Tips for Conducting a Gender Analysis at the Activity or Project Level - Cozzarelli, Cathy (USAID, 2010)
I. What is gender analysis? II. Relevant sections of the ADS III. Process – What should you do to collect the information you need to conduct a gender analysis at the activity or project level? IV. What questions should you ask in the context of doing your gender analysis? - Access - Knowledge, Beliefs, and Perceptions - Practices and Participation - Time and Space - Legal Rights and Status - Power and Decision-making IV. What should you do after you ask these questions?

Tips for Finding Unusual Allies and Building Innovative Alliances - Jacobstein, David (USAID Learning Lab, 2018)
One of the truisms of thinking and working politically (TWP) is that it requires looking differently at how stakeholders relate to a given development challenge or process, and building coalitions of the “right actors at the right time” who can drive forward progress while working with the grain of the context. While it’s easy to call for coalitions for change and diverse stakeholder engagement, identifying allies beyond those already seized with an issue, and finding ways to collaborate with stakeholders who may have different reasons for joining a coalition, is a challenging task. These are some suggested tips to improve working in that fashion.

Tips on Learning from Context: Formal and Informal Approaches to Understanding the Local Political Economy - Swift, Sarah (USAID, 2018)
Successfully adapting your programmatic efforts and policy engagement to the context depends on maintaining your understanding of that context. Given this, continuous learning and feedback loops–not only about your programming, but also about the environment you are working within–are important components of USAID’s work. Since our environments are always changing, in ways big and small, this can be intimidating. One can imagine a scenario where learning consumes the limited time and budgets available, especially for small programs. The question becomes: How can we learn enough, at the right times, to limit missed opportunities and warning signs, while avoiding being consumed by data collection and analysis that never influences our work? This document capitalizes on the experiences of USAID staff as well as emerging learning from other donors and researchers to highlight a range of approaches–formal and informal, time-bound and continuous–that can support ongoing learning within the operational tempo of a busy Mission team or Operating Unit.

Toolkit Digitalisation: Tools to Support Strategic Planning and Implementation - GIZ (2017)

Tools for Knowledge and Learning: A Guide for Development and Humanitarian Organisations - Ramalingam, Ben (ODI, 2006)
This toolkit presents entry points and references to the wide range of tools and methods that have been used to facilitate improved knowledge and learning in the development and humanitarian sectors.

Tools for supporting sustainable natural resource management and livelihoods - Ashley, Holly; Kenton, Nicole; Milligan, Angela (2013)
OCLC: 951490115

Top-down vs. Bottom-up Hierarchy: Or, How to Design a Self-Managed Organization - Sisney, Lex (Organizational Physics - Systems thinking for breakthrough business performance, 2016)
Top-down vs. Bottom-up Hierarchy: Or, How to Design a Self-Managed Organization

Top Tips: How to design and manage adaptive programmes - Valters, Craig; Wild, Leni (Overseas Development Institute, 2019)
Within DFID, there is now a commitment to more flexible and adaptive programming. This recognises that: • DFID works in contexts that continuously evolve and change, sometimes in unpredictable ways. To respond to this, the agency needs to remain flexible – to expect change and have a good understanding of context, with resources that can be adjusted and scope to change direction if needed. All DFID programmes should be able to do this. • Some DFID programmes aim to support change in complex systems, behaviours and incentives. Efforts to address women’s empowerment, improve sanitation or build more sustainable health systems, for instance, all require engagement with the way in which complex systems operate and the people and behaviours within them. Trying to deliver reforms in these circumstances is challenging because the pathway to reform itself will be unclear: as a reform is rolled out, the system itself will react and respond. These types of programmes therefore need to build in from the start deliberate processes of learning and testing, to allow for adaptations as more information is gathered for what works over time. These top tips are concerned with programmes that aim to be flexible and adaptive – which work in dynamic contexts and are trying to address complex problems. While there is growing commitment to these approaches, feedback suggests staff still have questions about how to do this well. This document highlights some of the commonly reported issues related to adaptive programming and a set of tips, strategies and examples to help in addressing them. It is aimed at programme managers and advisors who may be Senior Responsible Owners (SROs) or those managing and supporting adaptive programming in a range of ways. We have collated these lessons from discussions with country offices and SROs, feedback from surveys and the wider evidence. We have looked specifically at the adaptive programmes we can find in the DFID portfolio, but this is not an exhaustive list. It should be noted that there is as yet no wide variety of case law to review, but there is a growing set of examples within DFID that can provide continuous learning for the organisation.

Towards an Alternative Development Management Paradigm? - Shutt, Cathy (Expertgruppen för biståndsanalys (EBA), 2016)
Demonstrating results has been a concern in international development cooperation ever since it was started and in recent years there has been an increased focus on achieving and reporting on “results”. Despite the fact that everyone involved in development cooperation wants to make a difference there has been a growing criticism from practitioners about the “results agenda” based on a concern that the approaches used are not fit for purpose. In the EBA-report, Cathy Shutt, at the University of Sussex, scrutinizes the recent critical debate about results based management, and the main arguments and motives behind the criticism. She shows that the debate is not only a matter of obsessive measurement and reporting of meaningless numbers for political accountability, but also a matter of problematic assumptions and how we think about development, evidence and learning. In the report, Shutt also explores what could be learned from those who are not just critiquing results based management approaches but also proposing alternatives. Are these new alternatives an answer to the criticism?
Keywords: IMPORTANT

Towards an evidence base on the value of social learning-oriented approaches in the context of climate change and food security - Epp, Marissa Van; Garside, Ben (Environmental Policy and Governance, 2019)
Attention to social learning's potential to improve development outcomes in the context of climate change and food security challenges is growing. Yet evidence supporting the wide range of assertions about the outcomes of social learning processes is insufficient. More work is needed to understand when and how a social learning-oriented approach is effective. We respond to the gap in evidence by piloting the Climate Change and Social Learning initiative's monitoring and evaluation framework for social learning. Our objectives are to begin building an evidence base and to test the theory of change behind the framework. Using a peer-assist approach, we apply the framework to eight case studies in partnership with five initiatives. We analyse trends in evidence gathered across the case studies in four dimensions of social learning (engagement, iterative learning, capacity development, and challenging institutions) along three dimensions of change (process, learning outcomes, and changes in values and practice).
Keywords: Climate change adaptation; Monitoring and Evaluation; Social learning; food security

Towards characterizing the adaptive capacity of farmer-managed irrigation systems: learnings from Nepal - Thapa, Bhuwan; Scott, Christopher; Wester, Philippus; Varady, Robert (Environmental change assessments, 2016)
Small-scale irrigation systems managed by farmers are facing multiple challenges including competing water demand, climatic variability and change, and socioeconomic transformation. Though the relevant institutions for irrigation management have developed coping and adaptation mechanisms, the intensity and frequency of the changes have weakened their institutional adaptive capacity. Using case examples mostly from Nepal, this paper studies the interconnections between seven key dimensions of adaptive capacity: the five capitals (human, financial, natural, social, and physical), governance, and learning. Long-term adaptation requires harnessing the synergies and tradeoffs between generic adaptive capacity that fosters broader development goals and specific adaptive capacity that strengthens climate-risk management. Measuring and addressing the interrelations among the seven adaptive-capacity dimensions aids in strengthening the long term sustainability of farmer-managed irrigation systems.

Towards evidence-informed adaptive management - Hernandez, Kevin; Ramalingam, Ben; Wild, Leni (ODI/GLAM, 2019)
Development and humanitarian organisations seeking to be adaptive have emphasised the need to be transparent about complexity and uncertainty; to be honest about their inability to control what happens; and to design programmes that change over time to become more appropriate and relevant. At their heart, adaptive management approaches emphasise the ability to lean, 'unlearn' and adapt programming accordingly. The cornerstone of effective learning is the creation, gathering, accumulation, interpretation and use of data and evidence. This working paper provides development professionals with tools, strategies and ideas to help them use evidence for adaptive management in practical and evidence-informed ways. Key messages - Evidence is central to effective and rigorous adaptive management. However, despite this central importance, exactly how evidence has been used to inform decisions for adapting development and humanitarian programmes in the past remains unobservable to many. - There is a need to strengthen and document evidence-informed adaptive management. This working paper proposes a roadmap to do this. - Those seeking to use evidence for adaptive management will need to manage trade-offs between ensuring a rigorous, documented (and auditable) trail of evidence-informed actions, being pragmatic about the time and resources allocated to documentation and recognising that it may be necessary to proceed without rigorous evidence when it is unavailable.

Towards excellence: Policy and action research for sustainable development - iied (The International Institute for Environment and Development, 2012)

Towards informed and multi-faceted wildlife trade interventions - Challender, Daniel W.S.; Harrop, Stuart R.; MacMillan, Douglas C. (Global Ecology and Conservation, 2015)
International trade in wildlife is a key threat to biodiversity conservation. CITES, the Convention on International Trade in Endangered Species of Wild Fauna and Flora, seeks to ensure international wildlife trade is sustainable, relying on trade bans and controls. However, there has been little comprehensive review of its effectiveness and here we review approaches taken to regulate wildlife trade in CITES. Although assessing its effectiveness is problematic, we assert that CITES boasts few measurable conservation successes. We attribute this to: non-compliance, an over reliance on regulation, lack of knowledge and monitoring of listed species, ignorance of market forces, and influence among CITES actors. To more effectively manage trade we argue that interventions should go beyond regulation and should be multi-faceted, reflecting the complexity of wildlife trade. To inform these interventions we assert an intensive research effort is needed around six key areas: (1) factors undermining wildlife trade governance at the national level, (2) determining sustainable harvest rates for, and adaptive management of CITES species, (3) gaining the buy-in of local communities in implementing CITES, (4) supply and demand based market interventions, (5) means of quantifying illicit trade, and (6) political processes and influence within CITES.
Keywords: CITES; Community conservation; Compliance; Economics; Regulation; Wildlife trade

Towards ‘Targeted Systems Change’ - Rye, Sam (Fieldnotes by Sam Rye, 2019)
Modelling and communicating how to shift systems

Towards transformative social learning on the path to 1.5 degrees - Macintyre, Thomas; Lotz-Sisitka, Heila; Wals, Arjen; Vogel, Coleen; Tassone, Valentina (Current Opinion in Environmental Sustainability, 2018)

Transformation, politics and implementation: smart implementation in governance programs - Kirsch, Renate; Siehl, Elke; Stockmayer, Albrecht (Nomos, 2017)
Working in environments characterised by a high degree of uncertainty, uncontrollability and unpredictability, development agents try to organise complex realities into manageable units. What principles influence the decision on adequate approaches and necessary steps? Through theoretical considerations and nine case studies, the GIZ traces implementation processes and identifies underlying guiding principles which provide the flexibility and adaptability that is necessary for acting in complex contexts. Main findings show that an adaptive and reflexive management structure is crucial for successful implementation. Quick iteration and tight feedback loops facilitate adaptation and reorientation. Contextsensitive knowledge and constant monitoring create a space for learning and innovation. A joint vision for the future which is used for orientation purposes and can be modified according to new findings and developments fosters fruitful cooperation.
OCLC: 1000398466

Transformative Networks Are Multiscalar - Holley, June (NetworkWeaver, 2018)
This is an excerpt from the Network Weaver Handbook. I’ll be writing an update with my latest research and thinking on the topic in the coming weeks so stay tuned! June Holley How does tr…

Transformative project design - Kehrer, Daniel (GIZ, 2020)
There are many definitions of the term ‘transformation’ or ‘transformational change’. The first section of the report develops a basic understanding of transformations or transitions (used synonymously) viewed from various perspectives. In this, transformations are defined as processes that use disruptive innovations to change systems into fundamentally new systems that subsequently form the new mainstream. Section two describes existing approaches to environmental and climate finance in international cooperation and discusses them in light of the proposed definition. All of the approaches have the potential to be further refined and in that process often to increase the precision of what is understood by each type of transformation. The definitions already state which criteria and indicators are referred to and how relevant they are. There is wide diversity in the type of criteria and indicators used by the various organisations, and how they are classified, but certain common features can be identified and with the aid of the literature on transformations they can be combined to form a comprehensive framework. With this in mind, the derivation of quality criteria for transformative interventions is explained in section 3.1. Transformational change at one and the same time calls for big decisions and innumerable projects in a particular field of transformation; the projects cannot be planned on the drawing board but still should be coordinated with each other. Section 3.2 offers guidance on this. Section 3.3 argues in favour of focusing more closely on the ‘process promise’ and employing a more iterative and more adaptable commissioning procedure. Finally, section 3.4 introduces two types of indicators under the various criteria: design indicators, which measure the quality of interventions that are aimed at influencing transformations (process orientation), and outcome indicators, which measure the process and/or progress of a transformation itself.

Transforming governance: how can technology help reshape democracy? - Leighninger, Matt (Institute of Development Studies, 2016)
Around the world, people are asking how we can make democracy work in new and better ways. We are frustrated by political systems in which voting is the only legitimate political act, concerned that many republics don’t have the strength or appeal to withstand authoritarian figures, and disillusioned by the inability of many countries to address the fundamental challenges of health, education and economic development. If we want to create democracies in which citizens have meaningful roles in shaping public decisions and solving public problems, we should be asking a number of questions about civic tech, including: • How can online tools best support new forms of democracy? • What are the examples of how this has happened? • What are some variables to consider in comparing these examples? • How can we learn from each other as we move forward? This background note has been developed to help democratic innovators explore these questions and examine how their work can provide answers.

Transforming governance: what role for technologies? - Edwards, Duncan; Brock, Karen; McGee, Rosie (MAVC, 2016)
The technological innovations of the last two decades – cell phones, tablets, open data and social media – mean that governments and citizens can interact like never before. Around the world, in different contexts, citizens have fast-increasing access to information and communications technologies (ICTs) that enable them to monitor government performance and express their views on it in real time. In February 2016, a learning event in Manila, convened by Making All Voices Count, brought together 55 researchers and practitioners from 15 countries. They all work on using new technologies for accountable governance. They shared their diverse experiences, reflected on how they approach transformative governance, and visited Filipino accountable governance initiatives. This report shares some of what they learned.
Keywords: IMPORTANT

Transforming M&E for Uncertain and Complex Contexts: The UNDP’s Innovation Sandbox Approach - Fraser, Dugan; Haldrup, Søren (Powered by Evidence Podcast, 2022)
How can we transform monitoring and evaluation (M&E) into a more adaptive, emergent process to address uncertainty and complexity in todays’ world? How do we move from compliance and accountability to learning – to support better, more timely, decisions? Join GEI Program Manager, Dugan Fraser, as he discusses these questions and others with Special Guest, Søren Haldrup, from UNDP's Strategic Innovation Unit where he manages UNDP's innovation facility and leads a new initiative called the M&E Sandbox.

Transforming our work: Getting ready for transformational projects - Kehrer, Daniel; Flossmann-Kraus, Ursula; Ronco Alarcon, Sabrina Valeria; Albers, Vivien; Aschmann, Gwendolin (GIZ, 2020)

Transparency, Participation, & Accountability Grantmaking Strategy (THE WILLIAM AND FLORA HEWLETT FOUNDATION, 2015)

Triangulation, Respondent Validation, and Democratic Participation in Mixed Methods Research - Torrance, Harry (Journal of Mixed Methods Research, 2012)
Over the past 10 years or so the “Field” of “Mixed Methods Research” (MMR) has increasingly been exerting itself as something separate, novel, and significant, with some advocates claiming paradigmatic status. Triangulation is an important component of mixed methods designs. Triangulation has its origins in attempts to validate research findings by generating and comparing different sorts of data, and different respondents’ perspectives, on the topic under investigation. Respondent validation has sometimes been included in such processes, but it is an element that has not attracted significant attention from the MMR community. The article argues that attention to respondent validation is a significant issue for methodological debate and that it should be an important aspect of the development of democratic participation in MMR.

Try, learn, adapt, repeat: T/A Learn reflections - Alan (www.globalintegrity.org, 2015)
By Alan Hudson — November 16, 2015. I spent last week in Rio de Janeiro (tough assignment, I know), participating in the Transparency and Accountability Initiative’s third T/A Learn Annual Workshop. As the report of the second Annual Workshop, held...

Twenty years of UK governance programmes in Nigeria - Piron, Laure-Hélène; Cummings, Clare; Williams, Gareth; Derbyshire, Helen; Hadley, Sierd (ODI, 2021)
This Flagship report analyses 20 years of governance programmes in Nigeria funded by the UK Department for International Development (DFID) and the Foreign, Commonwealth and Development Office (FCDO) in the North-western states of Jigawa (since 2001), Kano (since 2005) and Kaduna (since 2006), as well as the North-eastern state of Yobe (since 2011). The report’s main research question is whether, how, under what conditions and for whom UK-funded state-level governance programmes in Nigeria have contributed to sustained changes in governance, and related changes in health and education. ... The report concludes with the following recommendations: To international development partners: 1. Invest for the long term – 10 to 20 years – combining support for both state and nonstate actors. 2. Ensure programmes have the strategic-level mandate, managerial capacity and frontline staff skills to pursue politically savvy opportunities. 3. Take PEA to the next level by unpacking causal mechanisms, understanding incentives and designing interventions to make change happen. 4. Give governance programmes the ability to flex between core governance and service delivery issues. 5. Incentivise greater collaboration between governance and sector programmes. 6. Incentivise greater attention to gender, and to social inclusion beyond disability issues, in governance programming. To FCDO: 7. Empower and resource FCDO teams to enable TWP programmes, ensuring decision-making by country teams to respond to local priorities. 8. Re-imagine TWP for FCDO Nigeria, giving implementers the space to operate in TWP ways. 9. Incentivise stronger collaboration between PERL, Lafiya (health programme) and the Partnership for Learning for All in Nigerian Education. 10. Invest in impact data analysis. To partner governments in Nigeria and beyond: 11. Explicitly set out the objectives for which you would like to receive assistance. 12. Use TWP principles to decide how development partners can support your political objectives and the scope for politically-feasible and mutually-beneficial collaboration. 13. Invest in the coordination of development partners. To non-state partners in Nigeria and beyond: 14. Join coalitions to achieve your priorities. 15. Select development partners which can strengthen your skills, not just fund your activities.

Twinning “Practices of Change” With “Theory of Change”: Room for Emergence in Advocacy Evaluation - Arensman, Bodille; van Waegeningh, Cornelie; van Wessel, Margit (American Journal of Evaluation, 2018)
Theory of change (ToC) is currently the approach for the evaluation and planning of international development programs. This approach is considered especially suitable for complex interventions. We question this assumption and argue that ToC’s focus on cause–effect logic and intended outcomes does not do justice to the recursive nature of complex interventions such as advocacy. Supported by our work as evaluators, and specifically our case study of an advocacy program on child rights, we illustrate how advocacy evolves through recursive interactions, with outcomes that are emergent rather than predictable. We propose putting “practices of change” at the center by emphasizing human interactions, using the analytical lenses of strategies as practice and recursiveness. This provides room for emergent outcomes and implies a different use of ToC. In this article, we make a clear distinction between theoretical reality models and the real world of practices.

Two decades of public sector innovation: building an analytical framework from a systematic literature review of types, strategies, conditions, and results - Criado, J. Ignacio; Alcaide-Muñoz, Laura; Liarte, Irene (Public Management Review, 2023)
Scholarly attention in innovation in the public sector is growing rapidly, provoking analytical complexity. We developed a systematic literature review about Public Sector Innovation (PSI), analysing 169 articles published between 2001 and 2021, using PRISMA. We present a comprehensive approach to PSI testing and empirically develop an analytical framework based on the most common combinations of the studied dimensions. Additionally, we propose three main research avenues for the future of PSI: (1) studying PSI in different contexts, (2) expanding the analysis of configurations in PSI initiatives, and (3) analysing ambidextrous strategies to support the practical implementation of PSI.
Publisher: Routledge _eprint: https://doi.org/10.1080/14719037.2023.2254310

Two Loops Guide - Colchester, Joss (Si Network, 2023)
The Two Loop model is a nonlinear theory of change based upon the ideas of living systems created by Margaret Wheatley & Deborah Frieze. It provides us with insight into the simultaneous growth and decline process that are underway within a system during a transition period. In this way, it provides a heuristic for us to better try and recognize and connect the past to the future during a change process. It likewise gives us the possibility to try and come to some consensus about where we might be as a group in this process of change and the best actions to take at different stages. This guide will be of relevance for anyone involved in a complex organizational change process.

Two Paths to Supporting Grassroots Innovation - Cooper, Nathan; Hazeldine, Shaun; Quaggiotto, Giulio (Stanford Social Innovation Review, 2017)
An innovation experiment in Indonesia yields insights on how international development organizations can effectively foster innovation within the communities they aim to help.

Two Tunes, One Dance: Keeping Programming Agile - Learning Lab (USAID Learning Lab, 2017)

TWP CoP (Thinking and Working Politically - Community of Practice, 2016)

Typology of sociotechnical transition pathways - Geels, Frank W.; Schot, Johan (Research Policy, 2007)
Contributing to debates about transitions and system changes, this article has two aims. First, it uses criticisms on the multi-level perspective as stepping stones for further conceptual reﬁnements. Second, it develops a typology of four transition pathways: transformation, reconﬁguration, technological substitution, and de-alignment and re-alignment. These pathways differ in combinations of timing and nature of multi-level interactions. They are illustrated with historical examples.

Uncertainty and COVID-19: A turning point for Monitoring Evaluation, Research and Learning? - A discussion note for aid actors, policymakers and practitioners - Tyrrel, Lavinia; Roche, Chris; Jackson, Elisabeth (Abt Associates, 2020)
The COVID-19 pandemic has significantly shifted the context in which aid and development is being delivered. The global scale of the pandemic and the speed at which it is spreading mean that the ‘normal’ economic, ideological and organisational influences which shape (if not determine) aid delivery are in flux. This means that – for a relatively short-period – there is scope for aid actors to work collectively to embed more locally-led, politically-informed and adaptive forms of MERL in aid and development practice. These forms of Monitoring Evaluation Research and Learning (MERL) are not only well-suited to the current global pandemic. They also offer ways for aid program decision makers and practitioners to make sense of the complex and uncertain contexts in which much development work takes place. Applying locally-led, politically-informed and adaptive forms of MERL in the COVID-19 context and beyond requires a shift in mindset and approaches. Situations of complexity, in which it is difficult to predict the relationships between cause and effect, do not lend themselves to linear approaches and fixed indicators. Instead, they require ‘navigation by judgement’, ongoing learning and adaptation and greater privileging of local knowledge, and of the perspectives of those who are often excluded. Rather than being focused on upwards accountability, simple numbers and good news stories, the core function of MERL in this context is to support a better understanding – in real-time – of the changing operating context, to generate learning about the immediate impact of policy and program responses and their longer-term effects, and to inform decision making by front line staff. Whether the opportunities afforded by this ‘critical juncture’ are realised will depend on the degree to which those in the aid and development sector use this opportunity to promote a shift in the deep incentive structures within which development agencies are embedded. On the one hand, the pandemic underscores the limits of the linear understandings of change which underpin many orthodox approaches to planning, design and associated MERL. On the other hand, there is a vested interest in the status quo amongst many organisations, consultants, researchers and MERL practitioners. This is because approaches which promote locally-led development inevitably require those in power to relinquish control. While a range of factors make this shift difficult, there is more scope to change internal ways of working in development agencies than is commonly acknowledged. There is no time like the present to advocate for a ‘new normal’ for MERL.

Uncertainty, Precaution, and Adaptive Management in Wildlife Trade - Wiersema, Annecoos (Michigan Journal of International Law, 2015)

Unconditional cash support sparks transformation: A story from CLARISSA Social Protection Intervention in Dhaka - Aktar, Afrin; Debnath, Raj; Kashfi, Sharmin (CLARISSA, 2023)
The CLARISSA Social Protection (SP) intervention provided six months of unconditional cash transfers to every household in the Gojmohol neighbourhood,...

Understanding and governing learning in sustainability transitions: A review - van Mierlo, Barbara; Beers, Pieter J. (Environmental Innovation and Societal Transitions, 2018)
Many transitions scholars underscore the importance of learning in sustainability transitions, but the associated learning processes have hardly been conceptualised. The diverse, well-established research fields related to learning are broadly ignored or loosely applied. In this paper, we systematically explore four interesting learning traditions in terms of their value for gaining an in-depth understanding of learning in sustainability transitions and their relevance for fostering learning, by connecting them to key features of transitions. The selected learning traditions from different disciplinary backgrounds provide valuable insights. None of them sufficiently addresses the complexity of transitions. They include, however, a diversity of relevant learning contexts. We conclude that they have value for investigating new areas such as learning in socio-technological regimes and in later phases of a transition, while enlightening forms of learning that have not yet been fully recognised in transition studies, such as superficial learning, unlearning, and learning to resist change.
Keywords: Collaborative learning; Interactive learning; Organizational learning; Social learning; Sustainability transition

Understanding Governance from the Margins: What Does It Mean In Practice? - Barnes, Katrina, Katrina, Barnes; Anderson, Colin; de Chassy, Stephanie; Ahmed, Affaf; Ali, Mudabbir; Aung, Myo Min; Chaimite, Egidio; Joshi, Anuradha; Khan, Danyal; Loureiro, Miguel; Posse, Lucio; Rowlands, Jo; et al. (Institute of Development Studies (IDS), 2021)
What does governance look like ‘from below’ – from the perspectives of poor and marginalised households? How do patterns of conflict affect that? These were the questions at the heart of the Governance at the Margins research project. Over three years from 2017-2020 we worked to explore this through in-depth study in conflict-affected areas of Mozambique, Myanmar, and Pakistan. Our research teams interviewed the same people regularly over that time, finding out how they resolved problems and interacted with authorities. In this paper we connect what we found to the realities and complexities of development practice, drawing on the input of 20 experienced practitioners working in bilateral and multilateral development agencies and international NGOs, who generously gave their time to help us think through the practical implications of our wealth of findings.

Understanding Indicators And Monitoring For Sustainability In The Context Of Complex Social-Ecological Systems - Haider, L. Jamila; Iribarrem, Alvaro; Gardner, Toby; Latawiec, Agnieszka E; Alves-Pinto, Helena; Strassburg, Bernardo (De Gruyter Open, 2015)

Understanding Networks: The functions of research policy networks - Mendizabal, Enrique (ODI, 2006)
We are constantly talking about networks. Banks use their networks to offer global services to customers; airlines fly passengers all over the world via their networks of partners; news agencies use media networks to keep us informed every minute of the day; and terrorist networks threaten citizens around the world. The importance of networks extends to the development sector: they organise civil society to advocate for and implement change; they link the local with the global, the private with the public; and they provide spaces for the creation, sharing and dissemination of knowledge. In a way, networks seem to make anything and everything happen. But we have yet to understand what they are and what they can and cannot do. In the development literature, a huge variety of policy and social network concepts and applications exists. This paper attempts to set out a framework to help clarify what research policy networks do.

Understanding Political Economy Analysis and Thinking and Working Politically - Whaites, Alan; Piron, Laure-Hélène; Menocal, Alina Rocha; Teskey, Graham (FCDO and TWP CoP, 2023)
This guide is adapted from work by the UK Foreign, Commonwealth and Development Office (FCDO) with inputs from members of the Thinking and Working Politically Community of Practice (TWP CoP). It outlines how to understand and use a set of analytical tools that are collectively known as Political Economy Analysis (PEA). The guide aims to equip practitioners to act in an informed manner, given that development objectives are invariably politically complex, and entail engaging with counterparts’ political incentives and preferences. The guide summarises different types of tools – from very light-touch to more in-depth approaches – and provides advice on how development professionals can decide what is most appropriate in a given context, with illustrations based on the experiences of teams working on these issues. This guide will help development professionals and others to make use of PEA and to apply it to their own specific needs. The first part of the guide offers a general picture of the approach. The second part provides more specific guidance for those who are tasked with deploying a PEA. Contents –> Main audience What is PEA, its role and purpose (Section 2) –> General information for all readers The main elements of PEA (Section 3) Thinking and Working Politically (Section 4) –> Core information for teams planning and using PEA How to ensure quality (Section 5) –> Essential reading for those directly responsible for a PEA Important concepts and terminology (Annex) –> General information for all readers

Understanding Social Accountability: Politics, Power and Building New Social Contracts - Hickey, Sam; King, Sophie (The Journal of Development Studies, 2016)
Calls to deepen levels of social accountability within social protection interventions need to be informed by the now extensive experience of promoting social accountability in developing countries. Drawing on a systematic review of over 90 social accountability interventions, including some involving social protection, this paper shows that politics and context are critical to shaping their success. We argue that the politics of social protection and of social accountability resonate strongly with the broader project of transforming state-society relations in developing countries. This requires a reconceptualisation of social accountability and social protection in terms of the broader development of ‘social contracts’, and that the current emphasis on promoting bottom-up forms of accountability needs to be balanced by efforts to strengthen and legitimise public authority in developing countries.

Understanding Strategic Capacity in Constituency-Based Organizations - Jane Booth-Tobin; Kal Munis; Lynsy Smithson-Stanley; Hahrie Han (The P3 Lab, Johns Hopkins University, 2021)
Movement organizations work in inherently uncertain political environments. Whether an organization is advocating for a new minimum wage, working to close a private prison, or seeking to influence an election, the terrain they are operating on shifts nearly every day. That is increasingly true as political uncertainty rises in the 21st century, particularly for historically race-class subjugated communities. Any movement-based organization seeking to build, exercise, and win political power must have sophisticated strategic capacities to be able to navigate these uncertain, dynamic, and constantly shifting political environments. Yet, our knowledge of how movements can nurture the kind of strategic capacities that allows them to build constituencies and leadership that can operate in the flexible ways needed for these dynamic circumstances is limited. This report seeks to synthesize what is currently known about organizations that successfully build and wield strategic capacity, with a particular eye toward how it might apply to constituency-based organizations. The report concludes with an assessment and facilitated conversation guide to support movements and movement organizations in understanding how developed (or not) their strategic capacities are.

Understanding the Conditions for fostering the right kind of innovation - Edwards, Duncan (Making All Voices Count, 2014)
MAVC's Duncan Edwards reflects on the first in a series of thematic discussions led by the Institute of Development Studies. The second of two posts.

Understanding ‘the users’ in Technology for Transparency and Accountability Initiatives - Wanjiku Kelbert, Alexandra; McGee, Rosemary; Carlitz, Ruth (2013)

Understanding ‘theory of change’ in international development: A review of existing knowledge - Stein, Danielle; Valters, Craig (LSE, 2012)
This is a review by Danielle Stein and Craig Valters of the concepts and debates within ‘Theory of Change’ (ToC) material, resulting from a search and detailed analysis of available donor, agency and expert guidance documents. The review was undertaken as part of a Justice and Security Research Program (JSRP) and The Asia Foundation (TAF) collaborative project, and focuses on the field of international development.

UNDP Digital Leadership Learning Modules - UNDP (United Nations Development Programme, 2022)
In order to support the digital transformation of government operations Digital Learning Modules for Civil Servants are available, an off-the-shelf package of capacity development in form of replicable training modules to empower public servants at both the local and central government level to be leaders of digital transformation for delivering better public services. The modules cover a multitude of fundamental areas: comprehending digital government and services, human-centered design for inclusivity and agile learning cycles; feature the importance of security and privacy, the value of data and how to manage data and technology related risks; spotlight the key role of supportive leadership and offer practical tools for assessing and overcoming main barriers to ensure a successful digital transformation journey.

Uniting Against Corruption - A Playbook on Anti-Corruption Collective Action - UN Global Compact (UN Global Compact, 2021)
The 2021 guide provides an easy-to-follow six-step approach on how to develop, implement, and sustain a CA, with respect to the reader’s local corruption landscape and potential stakeholders. The adaptive framework proposed can be used to address corruption challenges, mitigate possible business risks, and achieve optimal results.

Unpacking Mechanisms in Climate Resilient Agriculture Interventions - Barrett, Sam; D'Errico, Stefano; Anderson, Simon; Nebsu, Bayu (New Directions for Evaluation, 2020)
The investigation of causal mechanisms has the capacity to provide donors and implementing institutions with a greater understanding of people's reasoning and reactions as they work with interventions. This chapter contributes to the literature by identifying behavioral mechanisms generated through engagement with climate-resilient agriculture interventions within a larger livelihood project in Ethiopia. It works through the steps that enabled the study to unpack the black box between the climate-smart interventions and the outcome of crop production. The first step was a matching-based sampling design, following households over 3 years with six biannual surveys, and setting up a quasi-experimental evaluation setting. The second step used the data generated from the surveys in difference-in-difference models to assess the impact of the intervention on crop production. Third, to gain insight into the mechanisms at work, Focus Group Discussions (FGD) were conducted with smallholder farmer project beneficiaries. The FGDs revealed what the beneficiaries themselves considered the key mechanisms generated from the intervention, thus forming the bridge between the interventions and outcome. The result was an evaluation design enabling deeper insight into attribution claims. The findings offered novel insights for policymakers about how the climate-resilient interventions worked for the people themselves and shedding light on the inner workings of the climate-smart technologies. Finally, they provided key stakeholders (commissioning agency and implementing organizations) with a powerful means by which to learn about the last project, so to better plan for the next iteration and improve the climate resilience of smallholder farmers.

Unpacking 'Participation': models, meanings and practices - Cornwall, A. (Community Development Journal, 2008)

Unpacking the concept of political will to confront corruption - Brinkerhoff, Derek W. (U4 Anti-Corruption Resource Centre, 2010)
Quite often, "lack of political will" is identified as the culprit for poorly performing anti-corruption programmes. Yet despite the frequency with which it is used to explain unsatisfactory reform outcomes, political will remains under-defined and poorly understood. Further, assessments are often conducted retrospectively, looking back at failed programmes. By applying a model of political will that specifies a set of action-based components that are observable and measurable, and amenable to external reinforcement and support, more clarity regarding the degree of political will can be achieved.

Urban climate adaptation and the reshaping of state–society relations: The politics of community knowledge and mobilisation in Indore, India - Chu, Eric K (Urban Studies, 2018)
Current research on climate change adaptation in cities highlights the role of local governments in facilitating adaptation actions, but rarely assesses whether (and if so, how) local communities organise around emerging climate priorities to affect political change. This paper explores changing state–society relationships through the reconstitution of community collectives and advocacy organisations for advancing climate change adaptation in the Indian city of Indore. The paper shows that communities are indeed recognising the need for adaptation but are, at the same time, integrating adaptation actions with existing strategies for advocating development rights. Communities are also rebuilding alliances between municipal and local institutions for public service and infrastructure provision, which point to the centrality of community politics in urban climate adaptation processes. However, such mobilisations are often dependent on existing political networks and a legacy of advocacy around poverty alleviation needs, which sideline more transformative agendas around inclusiveness, equity, and resilient urban futures.

Urban climate change adaptation as social learning: Exploring the process and politics - Fisher, Susannah; Dodman, David (Environmental Policy and Governance, 2019)
Responses to climate change that build on adaptive natural resource management conceptualise social learning processes as having the potential to form a key component of climate adaptation. Social learning processes represent a way of managing the inherent uncertainties and interconnectedness of adaptation issues through ongoing learning, iterative reflection, and change of responses over time. Although the theoretical case is emerging for social learning as adaptation, there is limited empirical evidence of how these processes play out as local governments engage in urban adaptation planning. This paper starts to address this gap by examining social learning processes in two cities in India. We show how the social learning processes interact with complex governance contexts in the two cities and how evidence of outcomes is emerging across individuals, networks, and systems. We go on to argue that there are several areas of social learning that need further theorisation to support its application in the urban context. First, theories of social learning need to allow for unequal power relationships to continue to shape learning processes and take into account structural and historical dynamics as well as relational forms of power. Second, the way that scale is understood needs to be reopened as a point of analysis to understand how scalar concepts are used by actors to frame and locate problems and solutions rather than being understood as fixed and immutable.
Keywords: Climate change; India; Social learning; governance; urban planning

USAID ADS 201 - Operational Policy for the Program Cycle (Update 01/23/2021) - USAID (USAID, 2021)
The Program Cycle is USAID’s operational model for planning, delivering, assessing, and adapting development programming in a given region or country to advance U.S. foreign policy. It encompasses guidance and procedures for: 1) Making strategic decisions at the regional or country level about programmatic areas of focus and associated resources; 2) Designing projects and supportive activities to implement strategic plans; and 3) Learning from performance monitoring, evaluations, and other relevant sources of information to make course corrections as needed and inform future programming.

USAID ADS 201 - Operational Policy for the Program Cycle (Update 05/22/2023) - USAID (USAID, 2023)
The Program Cycle is USAID’s operational model for planning, delivering, assessing, and adapting development programming in a given region or country to advance U.S. foreign policy. It encompasses guidance and procedures for: 1) Making strategic decisions at the regional or country level about programmatic areas of focus and associated resources; 2) Designing supportive projects and/or activities to implement these strategic plans; and 3) Learning from performance monitoring, evaluations, and other relevant sources of information to make course corrections as needed and inform future programming.

USAID ADS 201 - Program Cycle Operational Policy (Update 1/23/2017) - USAID (USAID, 2017)
The Program Cycle is USAID’s operational model for planning, delivering, assessing, and adapting development programming in a given region or country to advance U.S. foreign policy. It encompasses guidance and procedures for: 1) Making strategic decisions at the regional or country level about programmatic areas of focus and associated resources; 2) Designing projects and supportive activities to implement strategic plans; and 3) Learning from performance monitoring, evaluations, and other relevant sources of information to make course corrections as needed and inform future programming.

USAID ADS 201 - Program Cycle Operational Policy (Update 10/29/2018) - USAID (USAID, 2018)

USAID Applied Political Economy Analysis - Field Guide - Cammack, Diana (USAID, 2016)
Political Economy Analysis (PEA) is a field-research methodology used to explore not simply how things happen in an aid-recipient country, but why things happen. It results in a written assessment with recommendations for a mission's County Development Cooperation Strategy (CDCS), project or activity design, or course correction during implementation.USAID's Applied PEA is a problem-focused method specially intended to be used by Mission staff to inform the design of aid interventions at any phase of the USAID program cycle and at any level of effort.

USAID/Colombia Introduces Political Economy Analysis to Better Adapt Programming to Local Contexts - Sharp, Preston (USAID, 2015)

USAID Risk Appetite Statement - USAID (USAID, 2018)

USAID’s Data Quality Standards & Conducting a DQA - USAID (2014)

USAID Wildlife Asia as a case study in adaptive rigour - Ziegler, Jessica (ODI/GLAM, 2020)
This briefing note looks at how the United States Agency for International Development (USAID) Wildlife Asia programme has operationalised the concepts of adaptive rigour and adaptive management as part of its approach to collaborating, learning and adapting. As described by the Global Learning for Adaptive Management (GLAM) initiative, adaptive rigour is about ensuring that the data, information, methods, processes and systems that underpin adaptive management are robust, systematic and high‑quality. Key messages When faced with programmatic complexity, it is important to take an adaptive approach driven by continuous and iterative monitoring, evaluation and learning (MEL). USAID Wildlife Asia, which works to advance regional action towards ending illegal wildlife trafficking in Southeast Asia and China, has embraced this approach as a way of operationalising adaptive rigour. Throughout programming, MEL approaches should reflect the characteristics of adaptive rigour: comprehensiveness, usefulness, practicality, timeliness and support. Utilising performance monitoring and research in order to test and revise technical approaches and employing mixed methods to collect both qualitative and quantitative data, as well as looking for relevant lessons generated by others, can ensure access to the most useful information for decision-making throughout implementation. For adaptive management, it is not enough to monitor, evaluate and learn; it is also essential to pause and reflect in order to analyse and process evidence gained through MEL with colleagues and stakeholders to reach the right conclusions and make good decisions.

Use Case and Requirements Analysis in a Remote Rural Context in Mali - Bon, Anna; de Boer, Victor; Gyan, Nana Baah; van Aart, Chris; De Leenheer, Pieter; Tuyp, Wendelien; Boyera, Stephane; Froumentin, Max; Grewal, Aman; Allen, Mary; Tangara, Amadou; Akkermans, Hans (Requirements Engineering: Foundation for Software Quality, 2013)
[Context & motivation] Few studies have reported on a systematic use case and requirements analysis of low-tech, low-resource contexts such as rural Africa. This, despite the widespread agreement on the importance of Information and Communication Technologies (ICT) for social and rural development, and despite the large number of ICT projects targeting underprivileged communities. [Question/problem] Unfamiliarity with the local context and differences in cultural and educational backgrounds between end-users and software engineers are the challenges for requirements engineering (RE) we encountered. [Principal ideas/results] We describe a systematic approach to RE in developing areas, based on the Living Lab methodology. Our approach is supported by extensive field research and based on co-creation within a multi-disciplinary and multi-cultural team of developers and users. This approach creates a shared understanding of the problem and its local context, and optimizes communication. [Contribution] We illustrate the approach using a case study of web- and voice-based communication services, that we developed for a rural context in Mali.

Use of environmental sensors and sensor networks to develop water and salinity budgets for seasonal wetland real-time water quality management - Quinn, Nigel W. T.; Ortega, Ricardo; Rahilly, Patrick J. A.; Royer, Caleb W. (Environmental Modelling & Software, 2010)
Management of river salt loads in a complex and highly regulated river basin such as the San Joaquin River Basin of California presents significant challenges for current Information Technology. Computer-based numerical models are used as a means of simulating hydrologic processes and water quality within the basin and can be useful tools for organizing Basin data in a structured and readily accessible manner. These models can also be used to extend information derived from environmental sensors within existing monitoring networks to areas outside these systems based on similarity factors – since it would be cost prohibitive to collect data for every channel or pollutant source within the Basin. A common feature of all hydrologic and water quality models is the ability to perform mass balances. This paper describes the use of a number of state-of-the-art sensor technologies that have been deployed to obtain water and salinity mass balances for a 60,000ha tract of seasonally managed wetlands in the San Joaquin River Basin of California. These sensor technologies are being combined with more traditional environmental monitoring techniques to support real-time salinity management (RTSM) in the River Basin. Two of these new technology applications: YSI-Econet (which supports continuous flow and salinity monitoring of surface water deliveries and seasonal wetland drainage); and electromagnetic salinity mapping (a remote sensing technology for mapping soil salinity in the surface soils) – have not previously been reported in the literature. Continuous sensor deployments that experience more widespread use include: weather station sensor arrays – used to estimate wetland pond evaporation and moist soil plant evapotranspiration; high resolution multi-spectral imagery – used to discriminate between and estimate the area of wetland moist soil plant vegetation; and groundwater level sensors – used primarily to estimate seepage losses beneath a wetland pond during flood-up. Important issues associated with quality assurance of continuous data are discussed and the application of a state-of-the-art software product AQUARIUS, which streamlines the process of data error correction and dissemination, is described as an essential element of ensuring successful RTSM implementation in the San Joaquin River Basin.
Keywords: Environmental decision support; Forecasting; Sensor networks; Sensors; Water quality

Useful Theory of Change Models - Mayne, John (Canadian Journal of Program Evaluation, 2015)
Although theories of change are frequently discussed in the evaluation literature and there is general agreement on what a theory of change is conceptually, there is actually little agreement beyond the big picture of just what a theory of change comprises, what it shows, how it can be represented, and how it can be used. This article outlines models for theories of change and their development that have proven quite useful for both straightforward and more complex interventions. The models are intuitive, flexible, and well-defined in terms of their components, and they link directly to rigorous models of causality. The models provide a structured framework for developing useful theories of change and analyzing the intervention they represent.

Using a Participatory Theory Driven Evaluation Approach to Identify Causal Mechanisms in Innovation Processes - Blundo‐Canto, Genowefa; Devaux‐Spatarakis, Agathe; Mathé, Syndhia; Faure, Guy; Cerdan, Claire (New Directions for Evaluation, 2020)
Applied agricultural research institutes play different roles in complex agricultural innovation processes, contributing to them with other actors. To foster learning and usable knowledge on how research actions influence such lasting innovation processes, there is a need to identify the causal mechanisms linking these actions and the effects of the changes they enable. A participatory, theory-driven, ex-post evaluation method, ImpresS, was developed by the French Agricultural Research Center for International Development (Cirad). ImpresS reconstructs the innovation history and its impact pathway by analyzing behavioral mechanisms linked to stakeholders' individual reactions and responses, and underlying process mechanisms at a group level. ImpresS relies on iterative updating and refinement and on triangulating data sources and collection methods to ensure internal validity and to increase credibility by enabling different actors to express their viewpoints. Drawing on an in-depth case study, we discuss how ImpresS makes it possible to draw robust conclusions on causal mechanisms while posing challenges linked to the group dynamics and power imbalances commonly encountered in participatory methods. As demonstrated by the case study, ImpresS generates policy-relevant knowledge for future research projects. It also demonstrates how research actions can help coconstruct lasting dynamics that can survive fluctuating institutional support. Distinguishing between behavioral and process mechanisms benefits knowledge use as it makes it possible to disentangle the conditions that trigger changes in a given context while generating research questions concerning the external validity of mechanism hypotheses.

Using a ‘Partnership Rubric’ in Participatory Evaluations - Snijder, Mieke; Hicks, Jacky; Paul, Sukanta; Arulanantham, Amit; Apgar, Marina; Afroze, Jiniya; Karki, Shanta; Mareschal, Sophie; Prieto Martín, Pedro; Uddin, Forhad; Veitch, Helen (Institute of Development Studies, 2023)
Programmes that aim to tackle complex societal issues, such as the worst forms of child labour, require rich partnerships that bring together different perspectives. CLARISSA’s consortium partnership adopts an empowerment approach to the interventions we deliver and our ways of working together. Part of this approach involves ongoing reflection and learning about how we work together in our partnership, and how this can be adapted if needed. This learning note focuses on a method used in CLARISSA to both reflect on and strengthen how we work in partnerships – the partnership rubric. We found that using the rubric flexibly was key to mitigating some of the challenges of such a complex consortium. This included using it in different sizes of forum, with different levels of preparation. Periodically adapting it for country context and as new partners came on board also helped ensure a shared sense of our preferred ways of working as the project progressed.
Accepted: 2023-07-13T10:20:02Z Publisher: Institute of Development Studies

Using a social learning configuration to increase Vietnamese smallholder farmers’ adaptive capacity to respond to climate change - Phuong, Le Thi Hong; Wals, Arjen; Sen, Le Thi Hoa; Hoa, Nguyen Quoc; Lu, Phan Van; Biesbroek, Robbert (Local Environment, 2018)
Social learning is crucial for local smallholder farmers in developing countries to improve their adaptive capacity and to adapt to the current and projected impacts of climate change. While it is widely acknowledged that social learning is a necessary condition for adaptation, few studies have systematically investigated under which conditions particular forms of social learning are most successful in improving adaptive capacity of the most vulnerable groups. This study aims to design, implement and evaluate a social learning configuration in a coastal community in Vietnam. We make use of various methods during four workshop-based interventions with local smallholder farmers: interviews with key farmers and commune leaders, farmer-to-farmer learning, participatory observations and focus group discussions. The methods for evaluation of social learning configuration include in-depth interviews, focus group discussions and structured survey interviews. Our findings show that the social learning configuration used in this study leads to an increased problem ownership, an enhanced knowledge-base with regard to climate change impacts and production adaptation options, improved ability to see connections and interdependencies and finally, strengthened relationships and social cohesion. The results suggest that increased social learning in the community leads to increase in adaptive capacity of smallholder farmers and improves both their economic and environmental sustainability. We discuss the key lessons for designing learning configurations that can successfully enhance adaptive capacity and smallholder farmers’ agency and responsiveness to the challenges posed by climate change impacts.
Keywords: Adaptive capacity; Social learning; Vietnamese smallholder farmers

Using Actor-Based Theories Of Change to Conduct Robust Contribution Analysis in Complex Settings - Koleros, Andrew; Mayne, John (Canadian Journal of Program Evaluation, 2019)
The use of theories of change (ToCs) is a hallmark of sound evaluation practice. As interventions have become more complex, the development of ToCs that adequately unpack this complexity has become more challenging. Equally important is the development of evaluable ToCs, necessary for conducting robust theory-based evaluation approaches such as contribution analysis (CA). This article explores one approach to tackling these challenges through the use of nested actor-based ToCs using the case of an impact evaluation of a complex police-reform program in the Democratic Republic of Congo, describing how evaluable nested actor-based ToCs were built to structure the evaluation.
Keywords: Behavioural strategy; COM-B

Using adaptive development to support feminist action - O’Neil, Tam (ODI, 2016)
This paper looks at how adaptive development is being applied by gender programmes and argues that gender and adaptive development communities have much to offer each other.

Using Adaptive Management to Meet Conservation Goals - Franklin, Thomas M; Helinski, Ronald; Manale, Andrew (Fish and Wildlife Response to Farm Bill Conservation Practices, 2007)
Natural resource professionals should know whether or not they are doing an effective job of managing natural resources. Their decision-making process should produce the kind of results desired by the public, elected officials, and their agencies’ leadership. With billions of dollars spent each year on managing natural resources, accountability is more important than ever. Producing results is the key to success. Managers must have the necessary data to make enlightened decisions during program implementation—not just at the conclusion of a program. Adaptive management is described as an adapt-and-learn methodology as it pertains to implementing Farm Bill conservation practices. Four regional case studies describe how adaptive management is being applied by practicing fish and wildlife managers. Indicators were identified to monitor and evaluate contributions to fish and wildlife habitat for each of the case studies. Data collected at each stage of the studies were used to make mid-course adjustments that enabled leadership to improve or enhance ongoing management actions.

Using adaptive monitoring, evaluation and learning in programme design - Nzegwu, Femi (INASP, 2018)

Using adaptive processes and adverse outcome pathways to develop meaningful, robust, and actionable environmental monitoring programs - Arciszewski, Tim J.; Munkittrick, Kelly R.; Scrimgeour, Garry J.; Dubé, Monique G.; Wrona, Fred J.; Hazewinkel, Rod R. (Integrated Environmental Assessment and Management, 2017)
The primary goals of environmental monitoring are to indicate whether unexpected changes related to development are occurring in the physical, chemical, and biological attributes of ecosystems and to inform meaningful management intervention. Although achieving these objectives is conceptually simple, varying scientific and social challenges often result in their breakdown. Conceptualizing, designing, and operating programs that better delineate monitoring, management, and risk assessment processes supported by hypothesis-driven approaches, strong inference, and adverse outcome pathways can overcome many of the challenges. Generally, a robust monitoring program is characterized by hypothesis-driven questions associated with potential adverse outcomes and feedback loops informed by data. Specifically, key and basic features are predictions of future observations (triggers) and mechanisms to respond to success or failure of those predictions (tiers). The adaptive processes accelerate or decelerate the effort to highlight and overcome ignorance while preventing the potentially unnecessary escalation of unguided monitoring and management. The deployment of the mutually reinforcing components can allow for more meaningful and actionable monitoring programs that better associate activities with consequences. Integr Environ Assess Manag 2017;13:877–891. © 2017 The Authors. Integrated Environmental Assessment and Management Published by Wiley Periodicals, Inc. on behalf of Society of Environmental Toxicology & Chemistry (SETAC)
Keywords: Adaptive monitoring; Environmental management; Environmental monitoring; Tier; Trigger

Using AI to disrupt business as usual in small evaluation firms - Sabarre, Nina R.; Beckmann, Blake; Bhaskara, Sahiti; Doll, Kathleen (New Directions for Evaluation, 2023)
While many knowledge workers may fear that the rise of artificial intelligence (AI) will threaten their jobs, this article argues that small evaluation businesses should embrace AI tools to increase their value in the marketplace and remain relevant. In this article, consultants from a research, evaluation, and strategy firm, Intention 2 Impact, Inc., make a case for using AI tools to disrupt business as usual in evaluation from theoretical and practical perspectives. Theoretically, AI may be another example of technology that was initially feared but is now ubiquitous in society. Using concrete examples, the authors describe how businesses and evaluators have evolved to keep up with changes in supply and demand. Lastly, it is posited that embracing AI will save time for those working in small businesses, which can ultimately increase added value and profitability.
_eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/ev.20562

Using beneficiary feedback to improve development programmes: findings from a multi-country pilot - World Vision (World Vision, 2016)
This briefing summarises the findings from Beneficiary Feedback Mechanisms pilots and is intended to inform organisations and their funders about the development and implementation of feedback mechanisms.

Using Data to Influence Government Decisions. Opportunities and Challenges for User-Centered Design to Improve Governance Data Impact - Reboot (Reboot & OSF, 2015)

Using elements of DCED Standards for CLA - Mitra, Bilash; Jalil, Mohammad Muaz (2018)
Introduction used in the DCED-BEAM seminar in Nairobi

Using Emergence to Take Social Innovation to Scale - Wheatley, Margaret; Frieze, Deborah (The Shambhala Institute, 2007)
In spite of current ads and slogans, the world doesn’t change one person at a time. It changes as networks of relationships form among people who discover they share a common cause and vision of what’s possible. This is good news for those of us intent on changing the world and creating a positive future. Rather than worry about critical mass, our work is to foster critical connections. We don’t need to convince large numbers of people to change; instead, we need to connect with kindred spirits. Through these relationships, we will develop the new knowledge, practices, courage, and commitment that lead to broad-based change. But networks aren’t the whole story. As networks grow and transform into active, working communities of practice, we discover how Life truly changes, which is through emergence. When separate, local efforts connect with each other as networks, then strengthen as communities of practice, suddenly and surprisingly a new system emerges at a greater level of scale. This system of influence possesses qualities and capacities that were unknown in the individuals. It isn’t that they were hidden; they simply don’t exist until the system emerges. They are properties of the system, not the individual, but once there, individuals possess them. And the system that emerges always possesses greater power and influence than is possible through planned, incremental change. Emergence is how Life creates radical change and takes things to scale. Emergence has a life-cycle. It begins with networks, shifts to intentional communities of practice and evolves into powerful systems capable of global influence. Since its inception in 1992, The Berkana Institute has striven to learn how living systems work, how they emerge from networks to communities to systems of influence. In our global work—primarily with economically poor communities in many different nations—we have experimented actively with emergence in many different contexts. We have demonstrated what’s possible when we connect people across difference and distance. By applying the lessons of living systems and working intentionally with emergence and its life-cycle, we have become confident that local social innovations can be taken to scale and provide solutions to many of the world’s most intractable issues.

Using evidence to influence policy: Oxfam’s experience - Mayne, Ruth; Green, Duncan; Guijt, Irene; Walsh, Martin; English, Richard; Cairney, Paul (Palgrave Communications, 2018)
Policymaking is rarely ‘evidence-based’. Rather, policy can only be strongly evidence-informed if its advocates act effectively. Policy theories suggest that they can do so by learning the rules of political systems, and by forming relationships and networks with key actors to build up enough knowledge of their environment and trust from their audience. This knowledge allows them to craft effective inﬂuencing strategies, such as to tell a persuasive and timely story about an urgent policy problem and its most feasible solution. Empirical case studies help explain when, how, and why such strategies work in context. If analysed carefully, they can provide transferable lessons for researchers and advocates that are seeking to inform or inﬂuence policymaking. Oxfam Great Britain has become an experienced and effective advocate of evidence-informed policy change, offering lessons for building effective action. In this article, we combine insights from policy studies with speciﬁc case studies of Oxfam campaigns to describe four ways to promote the uptake of research evidence in policy: (1) learn how policymaking works, (2) design evidence to maximise its inﬂuence on speciﬁc audiences, (3) design and use additional inﬂuencing strategies such as insider persuasion or outsider pressure, and adapt the presentation of evidence and inﬂuencing strategies to the changing context, and (4) embrace trial and error. The supply of evidence is one important but insufﬁcient part of this story.

Using Evidence - What works? - Breckon, Jonathan; Dodson, Jane (Alliance for Useful Evidence, 2016)

Using Information on Results in Program Management – The case of Samarth-NMDP in Nepal - Stewart, Tim; Joshi, Sanju; Miehlbradt, Alexandra (The Donor Committee for Enterprise Development, 2015)
Keywords: Case Report

Using middle-level theory to improve programme and evaluation design - Cartwright, N (CEDIL, 2020)
What can middle-level theory do? Middle-level theory (MLT) has several uses in development planning and evaluation. It helps predict whether a programme can be expected to work in a new setting. It offers insights into what design features are needed for success. It provides invaluable information for monitoring to see if the programme is on track and to fix problems that arise. It reveals the causal processes and related assumptions to be tested in an evaluation and helps identify evaluation questions. It helps in interpreting evaluation findings, assessing their relevance and locating a description of them that is useful for programme design and evaluation in other settings

Using Participatory Process Evaluation to Understand the Dynamics of Change in a Nutrition Education Programme - Cornwall, Andrea (IDS Working Papers, 2014)
With roots in approaches to popular education and participatory action research that place the learner and the ‘beneficiary’ of development at the centre of enquiry and action, the participatory visualisation methods associated with Participatory Rural Appraisal have been widely used as tools for learning and accountability. In this article, I reflect on lessons learnt from using these methods in a participatory process evaluation of an educational programme aimed at addressing chronic malnutrition in an East African country. Building on this experience, I explore the educative and empowering dimensions of participatory visualisation methods, and consider the contribution that these methods can make to effective evaluation.
Keywords: Kenya; nutrition; participatory impact evaluation; process evaluation; randomised controlled trials

Using Participatory Statistics to Examine the Impact of Interventions to Eradicate Slavery: Lessons from the Field - Oosterhoff, P.; Bharadwaj, S.; Burns, D.; Raj, A. M.; Nanda, R. B.; Narayanan, P. (2016)
This CDI Practice Paper by Pauline Oosterhoff, Sowmyaa Bharadwaj, Danny Burns, Aruna Mohan Raj, Rituu B. Nanda and Pradeep Narayanan reflects on the use of participatory statistics to assess the impact of interventions to eradicate slavery and bonded labour. It deals with: (1) the challenges of estimating changes in the magnitude of various forms of slavery; (2) the potential of combining participatory approaches with statistical principles to generate robust data for assessing impact of slavery eradication; and (3) the practical and ethical questions in relation to working with people living within a context of modern slavery. The paper draws lessons from the realities of using participatory statistics to support the evaluation of a slavery eradication programme in North India.

Using PDIA to Put Data Into Action - Bhatia, Vinisha; Powell, Josh (Development Gateway, 2017)
We recently wrote about how the data for development community needs to take a more context aware, demand-driven approach to data. Applying theories of change...

Using political economy analysis in conflict, security and justice programmes - Denney, Lisa (ODI, 2016)

Using Randomization in Development Economics Research: A Toolkit - Duflo, Esther; Glennerster, Rachel; Kremer, Michael (National Bureau of Economic Research, 2006)
This paper is a practical guide (a toolkit) for researchers, students and practitioners wishing to introduce randomization as part of a research design in the field. It first covers the rationale for the use of randomization, as a solution to selection bias and a partial solution to publication biases. Second, it discusses various ways in which randomization can be practically introduced in a field settings. Third, it discusses designs issues such as sample size requirements, stratification, level of randomization and data collection methods. Fourth, it discusses how to analyze data from randomized evaluations when there are departures from the basic framework. It reviews in particular how to handle imperfect compliance and externalities. Finally, it discusses some of the issues involved in drawing general conclusions from randomized evaluations, including the necessary use of theory as a guide when designing evaluations and interpreting results.

Using Research Evidence - A practice guide - Breckon, Jonathan (Alliance for Useful Evidence, 2016)

Using stories in evaluation: Participatory Narrative Inquiry and Sensemaking (2022)
Sensemaking and Participatory Narrative Inquiry (PNI) are similar approaches, based on collecting stories about a real life experience from a large number of stakeholders on a topic of interest to the evaluation, and giving the storytellers themselves the responsibility for analyzing and making sense of the stories. Because a large number of stories are collected and self-interpreted, it is possible to conduct quantitative analysis of recurrent themes, perspectives and feelings emerging in the narratives. By combining elements of qualitative and quantitative research, these approaches help to make sense of complex and evolving realities. This session presented the general approach of Sensemaking and PNI. Panelists discussed their experiences with this method, recently used in IFAD and WFP’s evaluations and invited participants to share their own experiences with using stories in evaluation.

Using Systemic M&E Tools in Feed The Future Uganda: Sensemaker ® - Webinar - USAID Learning Lab (2015)
This webinar is part of a series organized by SEEP's Market Facilitation Initiative (MaFI), USAID's LEO project and the BEAM Exchange as a part of the "Learning with the Toolmakers" webinar series. As part of a new cycle of webinars focusing on inclusive market facilitation tools. In this series, Eric Derks and Leanne Rasmussen will share learning from this five-year, multi-million dollar USAID program, the objective of which is to increase Ugandan farmers’ use of good quality agro-inputs by fostering more inclusive systemic changes in the agro-inputs industry. Using Systemic M&E Tools in Feed The Future Uganda: Sensemaker ® This third webinar in the series, titled “,” will look at how the project team used this tool and method to monitor systemic change. Leanne and Eric will share their experiences with using the tool and give recommendations to other practitioners who are interested in applying it. What is Sensemaker ®? SenseMaker combines an innovative research methodology with patented software to collect and analyze large quantities of narratives in order to understand complex change. It brings together insights from complexity sciences, anthropology, and cognitive science. It uses participants’ narratives to uncover foundational attitudes and norms that inform and influence behavior. This webinar is organized by SEEP's Market Facilitation Initiative (MaFI), USAID's LEO project and the BEAM Exchange as a part of the "Learning with the Toolmakers" webinar series.

Using Systemigrams in Problem Definition: A Case Study in Maritime Resilience for Homeland Security - Sauser, Brian; Mansouri, Mo; Omer, Mayada (Journal of Homeland Security and Emergency Management, 2011)
The concept of resilience has been used among a diversity of fields with a myriad of definitions. A systems approach to discovering the essence of resilience could aid in understanding its concept and provide opportunities to distinguish its systemic characteristics that can be identified, planned, or analyzed regardless of the field in which it is considered. In order to begin executing such an approach, a comprehensive study of the literature on the topic and circumstances in which resilience has been used or referred to in several fields of studies is necessary. In this paper, the conceptual common denominator of resilience is identified based on the results of a literature survey and according to the way it has been used in different contexts. This basis leads to the objective of this effort, and that is to recognize the systemic characteristics of resilience and demonstrate the defining of a universally accepted definition. Using a soft systems methodology and a supporting systemic diagramming technique entitled Systemigrams, we present the formulation of defining resilience in maritime homeland security. In this effort, many stakeholders contributed their thoughts and concerns on the meaning and operational use of resilience through a repetitive process to formulate a definition of the term. The result of this methodic approach is a general definition of resilience that has been refined in a collaborative environment via the application the Boardman Soft Systems Methodology.

Using what we know: How to ensure tech projects meet the brief - Walker, Tom (Making All Voices Count, 2017)
Making tech effective - building on what we already know

Utilization focused evaluation: a primer for evaluators - Ramirez, Ricardo; Brodhead, Dal (Southbound, 2013)
Ramírez, R., & Brodhead, D. (2013). Utilization focused evaluation: A primer for evaluators. Penang, Malaysia: Southbound. Retrieved from http://evaluationinpractice.files.wordpress.com/2013/04/ufeenglishprimer... This book, authored by Ricardo Ramírez and Dal Brodhead, is designed to support evaluators and program managers implement Utilization-focused evaluation (UFE). It includes detailed discussion of the 12 steps for implementing UFE and also provides a number of case studies to guide the user. Excerpt "Throughout this Primer we refer to the value of having a mentor to assist an evaluator who is using UFE for the first time. Our collective experiences with UFE indicated having a mentor was, for many UFE participants, an essential support and it reflects how we learned and mentored UFE. Evaluators may use elements of a UFE in their work naturally, for example by engaging users in planning the process or in assisting them in the utilization of findings. This Primer, however, walks the reader through UFE by systematically covering all of the 12 steps. It reflects deeply on the UFE evaluation practice and builds from it." (Ramírez & Brodhead 2013) Contents What is Utilization Focused Evaluation? 1 The UFE Framework Summarized in Steps 3 The DECI Project 6 The UFE Steps Illustrated with Project Examples 9 Step 1 Assessing Program Readiness 10 Step 2 Assessing Evaluators’ Readiness 18 Step 3 Identifying Primary Intended Users 24 Step 4 Situational Analysis 31 Step 5 Identification of Primary Intended Users 38 Step 6 Focusing the Evaluation 44 Step 7 Evaluation Design 54 Step 8 Simulation of Use 58 Step 9 Data Collection 62 Step 10 Data Analysis 65 Step 11 Facilitation of Use 68 Step 12 Meta Evaluation 72 Summary About What Each Step Entails 76 What Benefit Does UFE Bring to Commissioners of Evaluation? 81 Take Away Lessons 83 Postscript 87 The UFE Checklist 89 Case Studies 103 Recommended Reading 110
OCLC: 856648540

Utilization-focused evaluation for agricultural innovation - Patton, Michael Quinn; Horton, D (CGIAR, 2009)
Utilization-focused evaluation (UFE) is based on the principle that an evaluation should be judged by its utility. So no matter how technically sound and methodologically elegant, an evaluation is not truly a good evaluation unless the findings are used. UFE is a framework for enhancing the likelihood that evaluation findings will be used and lessons will be learnt from the evaluation process. This Brief, based on the book Utilization-focused evaluation, introduces this approach to evaluation, outlines key steps in the evaluation process, identifies some of the main benefits of UFE, and provides two examples of UFE in the context of programmes aimed at promoting agricultural innovation.

Utilization-Focused Evaluation (U-FE) Checklist - Patton, Michael Quinn (The Evaluation Center, 2013)
Utilization-Focused Evaluation begins with the premise that evaluations should be judged by their utility and actual use; therefore, evaluators should facilitate the evaluation process and design any evaluation with careful consideration of how everything that is done, from beginning to end, will affect use. Use concerns how real people in the real world apply evaluation findings and experience and learn from the evaluation process. The checklist is based on Essentials of Utilization-Focused Evaluation (Patton, 2012, Sage Publications). All references in the checklist to exhibits and menus refer to this book. Step 1 Assess and build program and organizational readiness for utilization-focused evaluation. Step 2 Assess and enhance evaluator readiness and competence to undertake a utilizationfocused evaluation. Step 3 Identify, organize, and engage primary intended users. Step 4 Conduct situation analysis with primary intended users Step 5 Identify primary intended uses by establishing the evaluation’s priority purposes. Step 6 Consider and build in process uses if appropriate. Step 7 Focus priority evaluation questions. Step 8 Check that fundamental areas for evaluation inquiry are being adequately addressed. Step 9 Determine what intervention model or theory of change is being evaluated. Step 10 Negotiate appropriate methods to generate credible findings and support intended use by intended users. Step 11 Make sure intended users understand potential controversies about methods and their implications. Step 12 Simulate use of findings. Step 13 Gather data with ongoing attention to use. Step 14 Organize and present the data for use by primary intended users. Step 15 Prepare an evaluation report to facilitate use and disseminate significant findings to expand influence. Step 16 Follow up with primary intended users to facilitate and enhance use. Step 17 Metaevaluation of use: Be accountable, learn, and improve

Value for Investment. A Practical Evaluation Theory - King, Julian (Kinnect Group, 2016)
I am a public policy consultant from Auckland, New Zealand. My practice specializes in evaluation and economic analysis. In this booklet I set out a model for evaluating value for investment (VFI) in social programs. The model defines VFI as an evaluative question about an economic problem. It uses explicit evaluative reasoning to provide a clear answer to the VFI question. Methods are matched to context, to provide the specific mix of evidence (economic and/or other) needed to support a wellreasoned, well-evidenced evaluative judgment.

Value for Investment: Application and Insights. Youth Primary Mental Health and Addictions Evaluation - King, Julian; Crocket, Alicia; Field, Adrian (Dovetail Consulting, 2023)
What’s in the guide? This new document provides: An overview of the VfI approach, including the conceptual principles and processes underpinning it A worked example of the approach in action: evaluating the Youth Primary Mental Health and Addictions initiative in New Zealand Transferrable learning for others considering the use of the VfI approach.

Value for money and adaptive programming - Approaches, measures and management - Laws, Ed; Valters, Craig (ODI, 2021)
- The United Kingdom’s Foreign, Commonwealth and Development Office (FCDO)’s standard economy, efficiency, effectiveness/cost-effectiveness and equity (4E) framework is still relevant for approaching, measuring and managing value for money (VfM) for adaptive programmes. • However, this framework needs to be reframed to capture and incentivise flexibility, learning and adaptation. • VfM appraisal and reporting should be done in a way that draws on beneficiary feedback and informs good decision-making, rather than just being a compliance exercise. • If VfM appraisal and reporting cannot be done appropriately for adaptive programmes, it should be avoided or minimised. There is a risk of diverting time and resources from more suitable tools and methods.

Valuing peace: delivering and demonstrating mediation results - Dilemmas & options for mediators - Wadley, Ian (Centre for Humanitarian Dialogue, 2017)
Essential points for practitioners and donors • Mediation offers a cost-effective and proven method for resolving armed conflict. Between 1985 and 2015, 75 per cent of armed conflicts in the world were resolved through agreement rather than by force. In most cases these processes will have involved third party facilitation or support. • Professional mediators understand the high stakes involved in their work to prevent, mitigate and resolve armed conflict. In addition, they and their financial supporters are increasingly required to demonstrate ‘value-for-money’ to ensure continued funding. • However, traditional monitoring and evaluation (M&E) methods are not well suited to this task, typically imposing artificially linear project models on a dynamic conflict situation, as well as compliance reporting that moves attention away from real value. • Traditional M&E methods tend to focus on documenting the past and generating vast amounts of data, rather than enabling timely adaptation of the project in the present. • Traditional M&E approaches rely heavily on external evaluation consultants. Even in the best of cases this may interfere with the mediation process and impose a heavy time burden on the project team, leading to low acceptance of traditional M&E approaches by mediation practitioners. • In contrast, an ideal M&E approach for mediation should deliver useful insights in even the most dynamic and sensitive mediation environments, impose a light reporting burden, and be readily accepted by mediation teams. It should protect discretion and trust, enable rapid adaptation, and also provide some assurance that donor funds are being well spent.

VANUATU GOVERNANCE FOR GROWTH PROGRAM – REVIEW - Warner, Robert; Gouy, Jonathan; Samson, Anthony (2017)

Varieties of Participation in Complex Governance - Fung, Archon (Public Administration Review, 2006)
The multifaceted challenges of contemporary governance demand a complex account of the ways in which those who are subject to laws and policies should participate in making them. This article develops a framework for understanding the range of institutional possibilities for public participation. Mechanisms of participation vary along three important dimensions: who participates, how participants communicate with one another and make decisions together, and how discussions are linked with policy or public action. These three dimensions constitute a space in which any particular mechanism of participation can be located. Different regions of this institutional design space are more and less suited to addressing important problems of democratic governance such as legitimacy, justice, and effective administration.

VCoL in action: How to use micro-VCoLs to learn optimally on the fly - Dawson, Theo (Medium, 2019)
VCoL (the virtuous cycle of learning), is designed to optimize learning while leveraging human´s natural motivational system. It’s easiest to tap into this motivational system when VCoLs are small, focused, relevant, and habitual. We call VCoLs with these characteristics micro-VCoLs. What is a micro-VCoL? Micro-VCoLs are frequently iterated learning cycles that are embedded in everyday activities. Like any VCoL, they involve setting a learning goal, gathering information, applying information, and reflecting on outcomes (preferably with input from others). But in the case of the micro-VCoL, the focus is on the smaller skills (micro-skills) that make up complex sets of skills.

Virtual Facilitation Techniques for Work Teams and Communities of Practice. A guide for designing and running dynamic and engaging remote sessions and meetings - AKF (2023)
This free guide aims to build the skills and confidence of people designing and facilitating virtual meetings, including online community of practice sessions. By the time they have gone through this guide, community of practice facilitators will be able to: Design an engaging and participatory virtual session, Develop an effective, varied and realistic agenda for a virtual session, Apply a wide range of virtual facilitation techniques, and Using technology to facilitate virtual sessions. This toolkit was developed by the Aga Khan Foundation.

Virtuous cycles of learning: Redesigning testing during the digital revolution - Dawson, Theo; Stein, Zachary (2011)
This paper explores positive new directions for the future of educational testing by examining trends at the interface of the learning sciences and advances in educational technologies. A brief history of the relation between testing and technology sets the stage for a look at emerging “edu-tech” trends and what these might mean for the future of testing. This historical-critical look at past and present testing practices reveals that the learning sciences have been less influential in shaping the growth of testing infrastructures than cumulative advances in technology that have enabled large-scale standardization and automation. We argue that during the current “digital revolution” the learning sciences ought to assume more responsibility for shaping the adoption of new testing technologies. We propose a set of principles that, if followed, would move tomorrow’s testing infrastructures toward learning-centric design. Combining the affordances of new digital technologies with advances in our understanding of learning make it possible to build tests that promote multi-level learning in educational systems, catalyzing virtuous cycles of learning for everyone they affect—students, teachers, school leaders, policy makers, and researchers. The DiscoTest™ Initiative is presented as a reform effort that is guided by these design principles, serving as an example of positive new possibilities for testing at the interface of the learning sciences and new educational technologies.

Virtuous cycles of learning: Using formative, embedded, and diagnostic developmental assessments in a large-scale leadership program - Stein, Z.; Dawson, Theo; Van Rossum, Zachary; Rothaizer, Joel; Hill, S. (Journal of Integral Theory and Practice, 2014)
This article presents preliminary results from a series of ongoing action-research projects involving the use of embedded diagnostic developmental assessments (called LectaTests™) in leadership education contexts. These findings are presented to support a particular metatheoretical approach to learning and education in which embedded assessments form a crucial part of ongoing virtuous cycles of action, feedback, support, and learning. We present two types of evidence. First, we compare developmental growth across eight program evaluations in which LectaTests were and were not embedded. Second, we examine how embedding LectaTests in a large-scale leadership development program affected the growth of managers and their direct reports. We review these findings with an eye toward detecting the benefits of using developmental assessment as embedded diagnostics alongside their use as research instruments. We begin by using Integral Theory to structure a discussion about the ideal function of developmental assessments in educational contexts.

Virtuous cycles of learning (VCoL) and the +7 skills - Lectica (Lectica Live, 2020)
VCoL is a cycle of goal setting, information seeking, application, and reflection. Its +7 skills include reflectivity, awareness, seeking and evaluating information, making connections, applying knowledge, seeking and working with feedback, and recognizing and overcoming built-in biases. VCoLing engages the whole learner. By this, we mean that it engages learners emotionally, physically, and intellectually, leveraging both conscious and unconscious mental processes. VCoLing ensures that new knowledge is integrated into existing knowledge in a way that makes it useful and "sticky." When people work with our assessments, they're not only building knowledge, they're also nurturing the dispositions and skills required for a lifetime of learning and development.

Voice or chatter? Making ICTs work for transformative engagement: research report summary - Gurumurthy, Anita; Bharthur, Deepti; Chami, Nandini (IDS, 2017)
What are the conditions in democratic governance that make information and communication technology (ICT)-mediated citizen engagement transformative? While substantial scholarship exists on the role of the Internet and digital technologies in triggering moments of political disruption and cascading upheavals, academic interest in the sort of deep change that transforms institutional cultures of democratic governance, occurring in ‘slow time’, has been relatively muted. This study attempts to fill this gap. It is inspired by the idea of participation in everyday democracy and seeks to explore how ICT-mediated citizen engagement can promote democratic governance and amplify citizen voice. The study involved empirical explorations of citizen engagement initiatives in eight sites – two in Asia (India and Philippines), one in Africa (South Africa), three in South America (Brazil, Colombia, Uruguay) and two in Europe (Netherlands and Spain).

Voices of the poor: can anyone hear us? - Naraya, Deepa*Patel (The World Bank, 2000)
This book is the first in a three-part series, about the common patterns that emerged from the poor people's experiences in many different places. Chapter 1 sets out the conceptual framework and methodology. Chapter 2 discusses poverty from the perspective of the poor. Chapter 3 examines poor people's experience with the state, and includes case studies of access to health care and education. Chapter 4 addresses the nature and quality of poor people's interactions with civil society. Chapter 5 considers the household as a key social institution, and discusses gender relations within households and how these relations affect and are affected by larger institutions of society. Chapter 6 focuses on social fragmentation, and includes a discussion of social cohesion and social exclusion. Chapter 7 concludes the analysis and proposes some policy recommendations. The analysis leads to these conclusions: 1) poverty is multidimensional; 2) the state has been largely ineffective in reaching the poor; 3) the role of nongovernmental organizations (NGOs) in the lives of the poor is limited, forcing the poor to depend primarily on their own informal networks; 4) households are crumbling under the stresses of poverty; and 5) the social fabric - poor people's only

VOICES - On speaking, mediation, representation and listening - Oswald, Katy (MAVC, 2014)

Volume 3: Participatory Monitoring, Evaluation, and Learning in Complex Adaptive Environments - SACE (SACE Program, 2018)
This volume is the last in a series of papers about systems approaches in complex environments, which includes the use of the collective impact model to address large-scale social problems, and the application of participant-driven MEL techniques across 17 networks of civil society organizations. It is based on the experiences of Root Change and Chemonics, two development partners working on a USAID civic engagement project in Nigeria (2013-2018), as well as hundreds of civil society organization partners. This is the final paper in the series and aims to highlight how the adaptation of participatory monitoring, evaluation, and learning techniques (e.g., most significant change, outcome mapping, and outcome harvesting) evolved and ultimately empowered cluster members. The first paper in the series presented a brief introduction to systems approaches in advocacy settings, the SACE theory of change, and the scope of Root Change’s work as technical lead on capacity building and measurement. The second volume aims to address the innovative use of the advocacy strategy matrix, adapted from work by the Center for Evaluation Innovation, for collective impact and the Collective Impact Model, an approach that engages multiple players in working together to solve complex social problems.

W(h)ither sanctions? - Aston, Tom (Thomas Aston LinkedIn pulse, 2020)
Considerations on where and when sanctions fit into the conception of social accountability is a nudge toward better and more granular descriptions of what work is being undertaken effectively in which situations.

Walking the adaptive talk - Denney, Lisa (Devpolicy Blog from the Development Policy Centre, 2018)
The first in a three-part series on adaptive aid.Lisa Denney clarifies the confusion.

Walking the Long Road Together - Stilger, Bob (Afternow: When We Cannot See the Future Where Do We Begin?, 2017)
On March 11, 2011, overwhelming and incomprehensible disaster struck the northeast coast of Japan. Life for those in the region would never be the same. This book is about the awakening that follows disaster. About the minutes and months and years that come after now. It is about what happens when we're smacked on the side of the head and open our eyes, startled out of the trance in which we have been living our days. It is about the opportunities always present, often invisible, to create the lives we want, now. AfterNow chronicles the author's journey with the Japanese people over 6 years – his own story of awakening after plunging into this disaster and the stories from people who found where to take their first step, and the next. It offers the tools and processes and worldview people discovered to create what comes after now. It is built around two big ideas. The first is that after disaster, we find our way forward, together. We come awake, together. Disaster obliterates the past, plunges the present into chaos and cocoons the future. We need each other to see and build the new. The second idea is that we don't have to wait for the tragedy of disaster to make the communities and lives we want. We can engage each other with respect, curiosity and generosity and begin to co-create what we want, now. We live in a period of precipitous, unpredictable change. The book is for those who want to make this time more livable and less insane. In Japan and all over the world, we are living in the messy middle where old forms are falling apart and new possibilities are in early stages. The ground is pulled out from under us on a regular basis. Our work right now is to learn to coexist with the messiness. We need to keep trying things, to keep learning. We need to remain focused on our purpose and follow the braided strand of intention and surrender as we find our way forward. embracing radical uncertainty, showing up as fully as we can each moment, each breath.

Was bedeutet “Staying Engaged” im Kontext der aktuellen Krise in Nicaragua? Überlegungen und Strategien der ALAK (Internal memo) - SDC (SDC, 2018)
«Mitigation» (im Sinne von Notlinderung) und «Transformation» sind die zwei Schlagworte, an welchen sich die Neuausrichtung des Portfolios in Nicaragua über die nächsten Monate orientieren wird. Ziel ist es, dass die Schweiz ihr über die letzten Jahrzehnte akquiriertes politisches Kapital und ihre Expertise nutzt, um zu einer Linderung der Auswirkung der Krise für die Bevölkerung beizutragen und mithilft die Grundlagen für eine Transformation der politischen Kultur und eine langfristig angelegte Demokratisierung zu schaffen.

Watering the Grassroots: A Strategy for Social Movement Support - Joyce, Mary (Transparency & Accountability Initiative, 2015)
In this third and final think piece exploring the role of grassroots organizations and movements for state accountability (find the previous pieces here and here), the author Mary Joyce, proposes new thinking about how funders and other external organizations can best support social movements. Funding and other support for popular organizations and movements is not straightforward, and there are potential risks and distortions involved. Interested supporters need to clearly identify and articulate these obstacles in their discussions with movement activists before pursuing and funding or other support activities. This think piece outlines several potential avenues of support: small, flexible grants; funding intermediary organizations; providing external consultants or researchers to work with movements; and other options as well. These suggestions provide ideas for funders and other organizations seeking to move beyond projects to supporting robust accountability ecosystems, in which grassroots organizations and movements play a critical role.

We created this MEL system for you, now please own it! | From Poverty to Power - Pasanen, Tiina; Yanguas, Pablo (2021)
External consultants, learning partners or critical friends -whatever we call them- can seldom change the system or organisational (learning) culture from outside. So, how can Monitoring Evaluation and Learning (MEL) consultants support real change instead of creating tools or processes that are quickly forgotten without any real institutional ownership? Consultants and learning partners can seldom change a learning system or organisational culture – it just does not work like that. What they can do is interrogate existing practices, introduce new ideas, and support change processes already underway to ensure lasting, transformative impact. They are a multiplier for homegrown change initiatives, not a substitute. Don’t hire MEL consultants to sell you tools or tell you what to do. Hire them because you need a critical friend along the path of organisational change. Own, then learn – not the other way round.

We have experimented with different approaches to systems transformation — here are five insights - Haldrup, Søren Vester (UNDP Innovation, 2021)
At UNDP Innovation we are on a journey to shift our approach to innovation to help tackle complex development challenges. In short, we are moving away from single point solutions, and instead we are…

‘We have the solutions to our own problems’: supporting civil society in Nigeria - Overseas Development Institute (ODI, 2014)
Development assistance programmes that start from careful analysis of what works and what does not in country contexts are still remarkably rare. One reason for this is the lack of well documented examples of ‘politically’ smart aid programming. To this end, this film outlines the experience of the State Accountability and Voice Initiative (SAVI), a DFID-funded programme in Nigeria providing support to civil society, media and governmental organisations.