Doing Development Differently at Scale - Pellini, Arnaldo; Karetji, Petrarca C.; Soekadis, Ade (Knowledge, Politics and Policymaking in Indonesia, 2018)
In recent decades there has been an increasing recognition that politics and political institutions matter for development. There is also a much greater interest in contextually grounded approaches. This has stemmed from an acknowledgement that purely technocratic approaches to development often result in failure because they do not take into account the nature of political institutions. Nor do they take account of the context in a particular developing country and the interests and incentives of powerful national actors. Policy processes are embedded in specific social, political and organisational contexts. Approaches that focus on implementing universal best practices in evidence-informed policymaking are unlikely to be successful. Instead, what is needed is an approach that takes the local context as the starting point for understanding what issues are relevant to policymakers and developing contextually appropriate solutions. The authors of this chapter reflect on the management approaches and systems that may be required to enable and support large-scale development programmes to be flexible and adaptive to the local policy context and circumstances. The chapter argues that such programmes struggle to adopt adaptive management principle and that to do that at scale requires some changes in the way such programmes are managed.
Keywords: Adaptive Management; Doing development differently; Evidence-informed policymaking; Indonesia; Knowledge sector; Thinking and working politically

Review of Selected DFAT Facilities: Independent Consultant Report to DFAT, Key Findings - Pieper, Lynn (DFAT, 2018)
For the purposes of this report, a facility is defined as an aid delivery mechanism that provides flexible (adaptive and responsive) services managed in an integrated way. Objectives (or endof-facility outcomes) are specified, but the pathways to deliver them are left unspecified. The facility is a highly relevant model for delivering Australian aid effectively. Achievement of the Sustainable Development Goals depends on flexible approaches that work across sectors and that integrate significant cross-cutting themes such as gender equality and social inclusion. Efficient DFAT management of a $4 billion aid program requires a shift to fewer and larger initiatives, to make best use of limited internal management resources while still enabling policy and program choices that can have real impact. Facilities and other flexible delivery mechanisms offer significant potential for better development results. They can: enable collaborative and responsive partnership approaches to gain traction; allow activities to experiment and adapt based on progress, demand and contextual changes; and provide the opportunity for outcome-focused coherence across sectors, enabling the whole to be more than the sum of the parts. Facilities are not new, but they are different today. Facilities have existed since at least the mid-1990s. What is new is that some facilities today are very large; and the flexibility they enable is increasingly and consciously being used to strengthen links between the technical and the political, for more effective development results. This is a positive trend, but it adds enormously to their complexity and visibility, creates new risks, and has resulted in role confusion (especially in early years of implementation) between DFAT and its contractors.

Positive Deviance Initiative - Positive Deviance Initiative (2018)

Poverty Stoplight - povertystoplight.org (2018)
What is the Poverty Stoplight? The Stoplight is a tool that seeks to activate the potential of families and communities to lift themselves out of poverty. Using a technology platform, it offers a self-assessment survey and intervention model that enables people to develop practical solutions to overcome their specific needs. We work with organizations from different sectors around the world and bring together a network of powerful actors with one clear mission: eliminate poverty worldwide. The Stoplight Community is comprised of government agencies, private companies, small and medium-sized enterprises, non-profits, cooperatives, microfinance organizations, academic institutions, and sports clubs, among others.

Decision-Making and Data Use Landscaping [at DFID] - Powell, Josh; Orton-Vipond, Sarah; Bhatia, Vinisha; Kilroy, Annie (Development Gateway, 2018)
As DFID aims to harness the Data Revolution, ensuring that data1 drive decision-making, public accountability, and the achievement of the Sustainable Development Goals (SDGs), ensuring that systems, processes, and skills for data are aligned with these objectives is paramount. Across sector policy teams, country offices, and various analytical and technical cadres, different strengths and weaknesses, as well as needs and ambitions exist. To inform a strategic approach to data, as framed in its forthcoming Data Roadmap, DFID collaborated with Development Gateway to perform a Decision and Data Use Landscaping study. This report details lessons learned from approximately 60 interviews across 4 DFID country offices, all sector policy teams, senior managers, and various analytical and technical cadres and offices.

Snapshot of Adaptive Management in Peacebuilding Programs - Queen, Emily Forsyth; Baumgardner-Zuzik, Jessica; Hume, Elizabeth; Greenberg, Melanie (Alliance for Peacebuilding, 2018)
The Alliance for Peacebuilding developed the report Snapshot of Adaptive Management in Peacebuilding Programs with support from Humanity United. This report examines how existing organizational programs are designing and learning from adaptive management in a conflict effected and fragile states. It further provides practical recommendations for applying adaptive management to peacebuilding programs based on synthesis … Continue reading "Snapshot of Adaptive Management in Peacebuilding Programs"
Keywords: KEY

What are you afraid of: Collective leadership and its learning implications - Raelin, Joseph A (Management Learning, 2018)
In this provocation, the author attempts to cite the advantages of collective leadership while acknowledging the objections and fears of challengers. Collective leadership is seen as remote because it defies the traditional view of leadership as an individualistic attractive quality that not only protects us but is efficient when applied. Nevertheless, the collective alternative may not only be advisable but required in a connected world featuring a networked economy. The contemporary socio-politico-economic environment requires the contribution of, creativity from, and collaboration among multiple agents providing a dynamic concentration of management and knowledge. If we are to accept and recognize the contribution of a collective leadership, its development would require an entirely different learning model. In particular, collective leadership development occurs as an acute immersion into the practices that are embedded within in situ material–discursive relations—in other words, among people, objects, and their institutions.

What We Do: Getting Beyond Statistics - Sense Guide (Sensemaker narrative monitoring, 2018)
Our approach Understanding daily life reality with micro-narratives Narratives and more specifically micro-narratives are a fundamental and ancient way by which humans interpret their experience and make decisions. SenseMaker® provides the ability to capture and understand those narratives. Through the web or app environment the software allows the capture of pictures, recordings and writing in various combinations to reflect how the respondents are making sense of the world. Reducing cognitive bias with self signification In a patented method, the respondent then interprets their own story into a series of abstract constructs (‘signifiers’) that feel more like a game than a survey, but allow profound meaning to emerge. This interpretation adds layers of meaning rather than simply interpreting the story and provides quantitative data to detect visual patterns among stories. The patterns are linked back to the original material enabling a deeper dive into individual stories. If the researcher first look for patterns in the metadata using statistical or visual tools, he or she is less likely to be biased by content and prematurely converge on an interpretation. Evidence based insights that enables action The output of SenseMaker® is statistical data backed up by explanatory narrative. This means that advocacy is an integral part of the system. Numbers on their own appear objective but are not persuasive; anecdotes on their own may be persuasive but are not objective. SenseMaker® puts the two together and provides a powerful means of persuasion. It also enables action. Instead of saying “How do we create a culture of X?” we say “How do we create more stories like this and fewer stories like that?” Then, as actions are initiated, we see the impact in real time.

Exploring new territories for evaluation - Sharp, Cathy (Collective Leadership for Scotland, 2018)
Drawing on action research, this paper recasts evaluation as ‘action inquiry’, an embedded evaluative learning practice that can help navigate complexity when enacting collective leadership. It is offered as an invitation to inquiry amongst a reasonably well-informed audience of policy makers and practitioners who work in and for public services. It will particularly interest those who provide research, evaluation and facilitation support, and those seeking to develop a more relational approach to research and evaluation. Action inquiry is a model of practising change together in environments where ‘nothing is clear, and everything keeps changing’ that significantly challenges the prevailing discourse on evaluation. Action inquiry can be wrapped around and enmeshed within initiatives and programmes that work with complexity - anywhere where success will depend on the quality of relationships that can be developed. The paper reviews some important interrelated concepts that underpin the ideals of collective leadership and public service reform and which confront deeply embedded traditional notions of leadership, expertise and participation. These offer important challenges to ideas about how change happens and recognise that relationships are at the heart of practising change. This warrants a re-examination of the high expectations of evidence-based or informed practice. Collective leadership makes new demands of evidence as it rests on help to determine ‘wise actions’ in real-life situations. This confronts the practical reality of how to work together in conditions often expressed as ‘dynamic’ or ‘turbulent’ and the added human complexities of power, emotions and relationships; too often these elements are denied or avoided aspects of a change process. Facilitated action inquiry makes these elements part of the conversations, in the midst of ‘work-as-we-are-doing-it’, to increase areas of choice for individuals and a group as a whole. Within public policy, there is an overwhelming amount of evidence about ‘what works’ yet change seems to be stubborn and slow. The paper explores some of the deep-rooted vestiges of a ‘hierarchy of evidence’ and assumptions about standardisation and generalisability that act as a ‘barrier to transformation’. These include the narrow framing of what counts as evidence and consequent relegation of community perspectives, lived experience and practice-based evidence. The paper acknowledges the clear appetite for different approaches to evaluation, especially those that better reflect deeply held values and avoid creating a culture of ‘gaming’, rooted in fear of failure and loss of funding, at the expense of learning. The need for new forms of developmental evaluative thinking, collaborative inquiry and action research to create embedded learning is well overdue. Action inquiry is a desirable and necessary response to the complex situations and challenges of human services and recognises the essentialness of knowledge co-production. It is a model of co-creation at every stage and endorses the idea that people learn from participation in evaluation and by testing theories of change through action. Action inquiry builds on the idea of inquiry, or a moment-to-moment awareness and quality of attention and draws from several elements of action research practice. It sees inquiry as an intervention in itself, one that furthermore, explicitly seeks to enhance the probability of the success of a programme, focus on learning, the collaborative development of practice-based knowledge and positive relationships. The paper highlights the importance of building inquiry into living systems, the role of facilitation, systemic inquiry, and evaluative thinking. It proposes an expansion of ideas of appreciation as a relational and collaborative practice that is a driver of emergence. Social recognition that acknowledges someone’s social value to the community and implies mutual moral obligations to cooperation and participation is particularly crucial in a work context that requires successful coordination and multiple contributions to achieve results across hierarchies of position, professional rank and sectors. Hence, appreciation goes beyond the idea of positivity to include social recognition, valuing more explicit forms of inquiry, building participants’ aspirations to design new social systems and acting in new ways to embed change. In developing this discussion, the paper contributes to emerging dialogues about the need for a model of ‘5th generation evaluation’. Such a model would be based on the idea that appreciative and challenging inquiry that is contextual, relational and open-minded will create better opportunities for change and development. The paper sets out some ‘provocative propositions’ that can help us to navigate this terrain, perhaps of a fledgling ‘5th generation approach’ to inquiry. Facilitated action inquiry can hold the key to developing both new knowledge and an adaptive, collaborative and improvisational skill-set, able to respond in new ways to systemic and complex issues on the ground. It’s common to hear the expression ‘it’s all about relationships’ and it is clearly time to shift our focus to relationships; not relationships as ‘things’, but as co-created and dynamic relational processes in which we are embedded. In this way we can bring new qualities to our talking to each other about our various and shared visions of a better future.

Exploring new territories for evaluation - Provocative propositions - Sharp, Cathy (2018)

Tips on Learning from Context: Formal and Informal Approaches to Understanding the Local Political Economy - Swift, Sarah (USAID, 2018)
Successfully adapting your programmatic efforts and policy engagement to the context depends on maintaining your understanding of that context. Given this, continuous learning and feedback loops–not only about your programming, but also about the environment you are working within–are important components of USAID’s work. Since our environments are always changing, in ways big and small, this can be intimidating. One can imagine a scenario where learning consumes the limited time and budgets available, especially for small programs. The question becomes: How can we learn enough, at the right times, to limit missed opportunities and warning signs, while avoiding being consumed by data collection and analysis that never influences our work? This document capitalizes on the experiences of USAID staff as well as emerging learning from other donors and researchers to highlight a range of approaches–formal and informal, time-bound and continuous–that can support ongoing learning within the operational tempo of a busy Mission team or Operating Unit.

Werner Ulrich's Homepage - Ulrich, Werne (2018)
This website provides a variety of resources from Werner Ulrich's work in a range of philosophical and research areas with a particular focus on his own work in critical systems thinking and practice or, Critical Systems Heuristics (CSH).

A Framework for Freshwater Ecosystem Management - UN Enviornment (2018)

Discussion Note: Complexity-Aware Monitoring - USAID (USAID, 2018)
This Discussion Note complements ADS 201 and outlines general principles and promising approaches for monitoring complex aspects of USAID development assistance. Complexity-aware monitoring is a type of complementary monitoring that is useful when results are difficult to predict due to dynamic contexts or unclear cause and-effect relationships. Key principles of the Program Cycle include applying analytic rigor, managing adaptively, and utilizing a range of approaches to achieve results. ADS 201.3.5.5 identifies three types of program monitoring – performance, context, and complementary. All USAID programming incorporates performance monitoring and should include context monitoring. Performance monitoring “is the ongoing and systematic collection of performance indicator data and other quantitative or qualitative information to reveal whether implementation is on track and whether expected results are being achieved.” Context monitoring is “[t]he systematic collection of information about conditions and external factors relevant to the implementation and performance of an operating units (OU’s) strategy, projects, and activities.” As stated in ADS 201.3.5.5, complementary monitoring may be used by missions and Washington OUs to complement performance and context monitoring in situations where results are difficult to predict due to dynamic contexts or unclear cause-andeffect relationships. This Discussion Note provides an explanation of when to use complementary monitoring approaches that are complexity-aware and summarizes the three principles of complexity-aware monitoring.

The Global Wildlife Program - Knowledge Platform - 2016-2018 - WB (The World Bank, 2018)

Evaluating development projects: exploring a synthesis model of the logical framework approach and outcome mapping - Yang, Ting (2018)
Under the current results-driven development agenda, sound evaluation, and a corresponding evaluation toolkit, need to be in place to examine whether and to what extent development interventions have achieved their targeted objectives and results, and to generate lessons for further development learning and improvement. My review of the literature shows that innovative and appropriate evaluation approaches are needed to address key challenges in evaluation such as the tension between learning and accountability objectives, the need to unpack the mechanisms linking outputs and outcomes or goal, and to add an actor perspective. Irrespective of project type, the Logical Framework Approach (LFA) is often a standard requirement of major official donor agencies on projects they fund, so as to fulfil bureaucratic imperatives. However, it is often considered inadequate in addressing key challenges in development evaluation. Given the dominant status of the LFA with such strong support from donors, it is helpful to seek a ‘middle way’: a combination of the LFA with other approaches in order to address some of its inadequacies, while satisfying donor agencies’ requirements. A synthesis of the LFA and Outcome Mapping (OM) is one such option. This thesis explores the practical value and usefulness of a synthesis model empirically. Applying the model in two case study aid projects, I found that it serves well as a theory-based evaluation tool with a double-stranded (actor strand and results chain) theory of change. The model helps reconcile learning and accountability and add explanatory power and an explicit actor perspective. It also helps establish causation and enable attribution claims at various results levels with its different elements. The model has some limitations but my results suggest it can be usefully adopted. The choice of its application depends on project evaluation context and purpose in specific cases.
Book Title: Evaluating development projects: exploring a synthesis model of the logical framework approach and outcome mapping

Engaging Stakeholders in Planning for Sea Level Rise and Resilience - Yusuf, Juita-Elena (Wie); John, Burton St; Covi, Michelle; Nicula, J. Gail (Journal of Contemporary Water Research & Education, 2018)
This case study describes a region-wide, multi-sectoral, and whole-of-community stakeholder engagement approach for addressing sea level rise (SLR) and flooding. This approach was implemented through a university-led community engagement event, the Hampton Roads Resilient Region Reality Check (H4RC), which allowed an examination of its effectiveness as a mechanism for capturing community-wide perceptions regarding SLR, flooding, and associated risks; engaging stakeholders in discussion within and across different groups; and assessing community willingness to address flooding and SLR. The results show that the event helped participants broaden their perspectives and understanding of flooding and SLR. In an approach that called for participants to engage in social learning across social networks, the event had some effect on individual efficacy. However, there was little impact on participants' already-established perception that the region does not possess significant willingness to take action.
Keywords: Social learning; flooding; resilience; social capital; stakeholder engagement

Doing Accountability Differently: A 'Vertically Integrated' Approach - Amakom, Uzochukwu; Fashola, Temitope; Gay, Charles; Shutt, Cathy (Christian Aid, 2018)

Supporting innovation and the use of technologies in accountability initiatives: lessons from Making All Voices Count - Edwards, Duncan; Hudson, Hannah; Anderson, Colin; McGee, Rosemary; Brock, Karen (IDS, 2018)
Making All Voices Count was an international initative that harnessed the power of innovation and new technologies to support effective, accountable governance. Focusing on six countries in Africa and Asia, the programme was implemented by a consortium of implementing partners, and used funding from four donors to make grants to support new ideas that amplified the voices of citizens, and enabled governments to listen and respond. From the start, Making All Voices Count was also a learning programme. The objective of this learning was not only to bring about change during the programme’s life cycle, but also to leave a legacy that would help to ensure that future governance programmes and initiatives seeking to capitalise on the transformative potential of innovation and technology are more informed, inclusive and impactful. This programme learning report emerged from a wider process of analysing, discussing and synthesising the data and learning from the programme, which wove together evidence-based learning about technology for accountable governance initiatives with experiential learning on how best to support such work. The report highlights five of the lessons learned from Making All Voices Count about how – and how not – to run large, complex programmes that intend to support innovation in governance.

Reflection methods: Tools to make learning more meaningful - Gordijn, Femke; Eernstman, Natalia; Helder, Jan; Brouwer, Herman (Wageningen Centre for Development Innovation, 2018)
This handbook summarises methods that can be used to facilitate the process of reflection on the knowledge and experiences people acquire during a capacity development trajectory or training event. We believe that by explicitly integrating reflection in the learning process the learning will become clearer and better articulated and will contribute more strongly to meaningful change. Therefore we advise facilitators to deliberately include reflective learning sessions in their process design and implementation. This handbook can inspire you to do so and provides many methods which help to facilitate this.

Innovation lifecycle and the missing middle - Gray, Ian; McClure, Dan (Managing Humanitarian Innovation - The cutting edge of aid, 2018)

Appropriating technology for accountability: messages from Making All Voices Count - McGee, Rosemary; Edwards, Duncan; Hudson, Hannah; Anderson, Colin; Feruglio, Francesca (IDS, 2018)
Making All Voices Count was a programme designed to solve the ‘grand challenge’ of creating more effective democratic governance and accountability around the world. It used funding from four donors to support the development and spread of innovative ideas for solving governance problems – many of them involving tools and platforms based on mobile phone and web technologies. Between 2013 and 2017, the programme made grants for innovation and scaling projects that aimed to amplify the voices of citizens and enable governments to listen and respond. It also conducted research and issued research grants to explore the roles that technology can play in securing responsive, accountable government and building an evidence base. This synthesis report reviews the Making All Voices Count’s four-and-a-half years of operational experience and learning. It shares 14 key messages on the roles technologies can play in enabling citizen voice and accountable and responsive governance. These messages are presented in four sections: (1) Applying technologies as technical fixes to solve service delivery problems; (2) Applying technologies to broader, systemic governance challenges ; (3) Applying technologies to build the foundations of democratic and accountable governance systems; (4) Applying technologies for the public ‘bad’, when tech can be dangerous for democracy. The tech optimism of the era in which the programme was conceived can now be reappraised from the better-informed vantage point of hindsight. Making All Voices Count’s wealth of diverse and grounded experience and documentation provides an evidence base that should enable a more sober and mature position of tech realism as the field of tech for accountable governance continues to evolve.

Developmental evaluation: Bridging the gaps between proposal, program, and practice , Developmental evaluation: Bridging the gaps between proposal, program, and practice - Lawrence, Rachael B.; Rallis, Sharon F.; Davis, Laura C.; Harrington, Karen (Evaluation, 2018)
Developmental evaluation supports grant-funded initiatives seeking innovation and change. Programs born from aspirational grant language and plans often need guidance as they work toward creating workable models for social innovation. This article describes the challenge of designing and implementing complex programs and presents a case that illustrates how a program moves from proposal to practice. The Massachusetts Charter Public School Association Capacity Building Network is a complex intervention, funded by the US federal government, aimed at raising school capacity to serve students with disabilities and English language learners. Developmental evaluation served to bridge the gaps between an aspirational proposal, an ambitious and ambiguous program plan, and emerging practices to serve this population of students. Jointly reviewing our experience in this developmental evaluation, the evaluation team and a program director share important thematic lessons learned about the developmental evaluation approach., Developmental evaluation supports grant-funded initiatives seeking innovation and change. Programs born from aspirational grant language and plans often need guidance as they work toward creating workable models for social innovation. This article describes the challenge of designing and implementing complex programs and presents a case that illustrates how a program moves from proposal to practice. The Massachusetts Charter Public School Association Capacity Building Network is a complex intervention, funded by the US federal government, aimed at raising school capacity to serve students with disabilities and English language learners. Developmental evaluation served to bridge the gaps between an aspirational proposal, an ambitious and ambiguous program plan, and emerging practices to serve this population of students. Jointly reviewing our experience in this developmental evaluation, the evaluation team and a program director share important thematic lessons learned about the developmental evaluation approach.

The rise of the randomistas: on the experimental turn in international aid - Donovan, Kevin P. (Economy and Society, 2018)
In recent years, the use of experimental methodologies has emerged as a central means of evaluating international aid interventions. Today, proponents of randomized control trials (so-called randomistas) are among the most influential of development experts. This paper examines the growth of this thought collective, analysing how uncertainty has become a central concern of development institutions. It demonstrates that transformations within the aid industry – including the influence of evidence-based policy, the economization of development and the retreat from macro-planning – created the conditions of possibility for experimentation. Within this field, the randomistas adeptly pursued a variety of rhetorical, affective, methodological and organizational strategies that emphasized the lack of credible knowledge within aid and the ability of experiments to rectify the situation. Importantly, they have insisted on the moral worth of experimentation; indeed, the experimental ethic has been proposed as the way to change the spirit of development. Through causal certitude, they propose to reduce human suffering. The rise of experimentation has not, however, eliminated accusations of uncertainty; rather, it has redistributed the means through which knowledge about development is considered credible.
Keywords: Development; Evidence; Experimentation; aid; uncertainty

Making good on donors’ desire to Do Development Differently - Honig, Dan; Gulrajani, Nilima (Third World Quarterly, 2018)
AbstractForeign aid donors are increasingly focused on changing the way their development agencies function. This discourse has focused on desired qualities, including greater knowledge of local contextual realities, appropriate adaptation to context and greater flexibility to respond to changing circumstances. We argue that more attention needs to be devoted to the achievement of these qualities and turn to contingency theory to identify some under-exploited ways to ?do development differently?. The qualities sought by donors are emergent properties of complex organisational systems and will only be achieved through a micro-level and interlinked focus on the fundamentals of organisation.

Adapting to learn and learning to adapt: Practical insights from international development projects - Brinkerhoff, Derick; Frazer, Sarah (RTI, 2018)
Adaptive programming and management principles focused on learning, experimentation, and evidence-based decision making are gaining traction with donor agencies and implementing partners in international development. Adaptation calls for using learning to inform adjustments during project implementation. This requires information gathering methods that promote reflection, learning and adaption, beyond reporting on pre-specified data. A focus on adaptation changes traditional thinking about program cycle.

Adapting to Learn and Learning to Adapt: Practical Insights from International Development Projects - Brinkerhoff, Derick W.; Frazer, Sarah; McGregor, Lisa (RTI Press, 2018)
Adaptive programming and management principles focused on learning, experimentation, and evidence-based decision making are gaining traction with donor agencies and implementing partners in international development. Adaptation calls for using learning to inform adjustments during project implementation. This requires information gathering methods that promote reflection, learning, and adaption, beyond reporting on pre-specified data. A focus on adaptation changes traditional thinking about program cycle. It both erases the boundaries between design, implementation, and evaluation and reframes thinking to consider the complexity of development problems and nonlinear change pathways.Supportive management structures and processes are crucial for fostering adaptive management. Implementers and donors are experimenting with how procurement, contracting, work planning, and reporting can be modified to foster adaptive programming. Well-designed monitoring, evaluation, and learning systems can go beyond meeting accountability and reporting requirements to produce data and learning for evidence-based decision making and adaptive management. It is important to continue experimenting and learning to integrate adaptive programming and management into the operational policies and practices of donor agencies, country partners, and implementers. We need to devote ongoing effort to build the evidence base for the contributions of adaptive management to achieving international development results.

Program Cycle - Discussion Note: Adaptive Management - USAID (USAID, 2018)
This Discussion Note complements ADS 201.3.1.2 Program Cycle Principles by elaborating on Principle 2: Manage Adaptively through Continuous Learning. This Discussion Note is intended for USAID staff interested in learning about recent and promising practices in adaptive management across the Program Cycle.

Diffusion Of Innovations Theory, Principles, And Practice - Dearing, James W.; Cox, Jeffrey G. (Health Affairs, 2018)
Aspects of the research and practice paradigm known as the diffusion of innovations are applicable to the complex context of health care, for both explanatory and interventionist purposes. This article answers the question, “What is diffusion?” by identifying the parameters of diffusion processes: what they are, how they operate, and why worthy innovations in health care do not spread more rapidly. We clarify how the diffusion of innovations is related to processes of dissemination and implementation, sustainability, improvement activity, and scale-up, and we suggest the diffusion principles that can be readily used in the design of interventions.
Publisher: Health Affairs

Politically informed, gender aware programming: Five lessons from practice - Derbyshire, Helen; Gibson, Sam; Hudson, David; Roche, Chris (DLP Program, 2018)

From Silos to Synergy: Learning from politically informed, gender aware programs - Derbyshire, Helen; Siow, Orlanda; Gibson, Sam; Hudson, David; Roche, Chris (DLP Program, 2018)

The Whistler principles to accelerate innovation for development impact - G7 (G7, 2018)
The Whistler principles to accelerate innovation for development impact : 2018 G7 Summit – Canada 2018 G7 Presidency – Charlevoix, Quebec

DFID’s approach to value for money in programme and portfolio management - ICAI (Independent Commission for Aid Impact (ICAI), 2018)
ICAI published this review on DFID’s approach to value for money in February 2018, and as value for money is both a process and an outcome and cuts across all aspects of DFID’s operations, did not score this review. We made five recommendations and published a follow-up to this review in July 2019. All UK government departments are required to achieve value for money in their use of public funds. In recent years, DFID has been working to build value for money considerations further into its management processes and its relationships with implementers and multilateral partners, establishing itself as a global champion on value for money. Review This review was published in February. Though it was not rated, ICAI made five recommendations, and found that the Department for International Development’s approach to value for money was helping to make UK aid spending go further, but improvements are still needed. Findings This review found that DFID has strengthened its processes and systems for ensuring it gains maximum value for each pound spent, has taken swift remedial action to tackle under-performing programmes, and has become a strong global champion on value for money. The review also found that DFID has been diligent in its efforts to cut waste, detect fraud, and improve efficiency, and that this work is improving the return on the UK investment in aid. However, the review found that DFID’s approach was not adequately reporting and capturing results and value for money at the country portfolio level, or how programmes work together to deliver lasting impact, including reducing future dependency on aid. It also found that weakness in the annual review process could undermine DFID’s approach to value for money. It found that targets were frequently revised, and that there could be pressures for optimistic scoring of programmes. Recommendations Based on this review, we made the following five recommendations to help DFID improve its approach to value for money still further: DFID country offices should articulate cross-cutting value for money objectives at the country portfolio level, and should report periodically on progress at that level. Drawing on its experience with introducing adaptive programming, DFID should encourage programmes to experiment with different ways of delivering results more cost-effectively, particularly for more complex programming. DFID should ensure that principles of development effectiveness – such as ensuring partner country leadership, building national capacity and empowering beneficiaries – are more explicit in its value for money approach. Programmes should reflect these principles in their value for money frameworks, and where appropriate incorporate qualitative indicators of progress at that level. DFID should be more explicit about the assumptions underlying the economic case in its business cases, and ensure that these are taken into account in programme monitoring. Delivery plans should specify points in the programme cycle when the economic case should be fully reassessed. Senior responsible owners should also determine whether a reassessment is needed following material changes in the programme, results targets or context. Annual review scores should include an assessment of whether programmes are likely to achieve their intended outcomes in a cost-effective way. DFID should consider introducing further quality assurance into the setting and adjustment of logframe targets.

Case Study Research and Applications: Design and Methods - Yin, Dr Robert K. (SAGE Publications, Inc, 2018)
Winner of the 2019 McGuffey Longevity Award from the Textbook & Academic Authors Association (TAA) Recognized as one of the most cited methodology books in the social sciences, the Sixth Edition of Robert K. Yin′s bestselling text provides a complete portal to the world of case study research. With the integration of 11 applications in this edition, the book gives readers access to exemplary case studies drawn from a wide variety of academic and applied fields. Ultimately, Case Study Research and Applications will guide students in the successful use and application ofthe case study research method.

OPM’s approach to assessing Value for Money - King, Julian; OPM (Oxford Policy Management, 2018)
This document offers practical guidance for assessing value for money (VfM) in international development programmes. Since 2016, evaluation expert Julian King has been working with OPM to develop and deploy a robust approach to VfM assessment. The approach combines cutting-edge evaluation practice with concepts from economic evaluation to respond to donor requirements for accountability and good resource allocation, as well as to support reflection, learning, and adaptive management.

Complexity & Development 2.0: From Agreeing We Should Adapt to Creating the Conditions that Enable Adaptation - Ang, Yuen Yuen (2018)
The field of global development has reached a critical turning point. Almost gone is the mechanical, one-size-fits-all “good governance” paradigm of the past. In its place is a growing embrace of complexity and systems thinking. While this is an encouraging shift in the right direction, the discussion mostly ends by concluding that we should adapt. Yuen Yuen Ang urges that it’s time to take our conversation on “complexity & development” to the next level: how to enable adaptation. Effective adaptation doesn’t automatically arise just because we desire it—rather, it requires certain enabling conditions. In How China Escaped the Poverty Trap (2016), she introduces a generic complexity 2.0 framework that she terms “directed improvisation.” Effective adaptation, Yuen Yuen argues, requires a paradoxical blend of top-down direction and bottom-up improvisation. Such a system can be created—and produce dramatic results and adaptive solutions—even within a closed political regime like China.

Why We Lie About Aid: Development and the Messy Politics of Change - Yanguas, Pablo (Zed Books, 2018)
Foreign aid is about charity. International development is about technical fixes. At least that is what we, as donor publics, are constantly told. The result is a highly dysfunctional aid system which mistakes short-term results for long-term transformation and gets attacked across the political spectrum, with the right claiming we spend too much, and the left that we don't spend enough. The reality, as Yanguas argues in this highly provocative book, is that aid isn't – or at least shouldn't be – about levels of spending, nor interventions shackled to vague notions of ‘accountability’ and ‘ownership’. Instead, a different approach is possible, one that acknowledges aid as being about struggle, about taking sides, about politics. It is an approach that has been quietly applied by innovative development practitioners around the world, providing political coverage for local reformers to open up spaces for change. Drawing on a variety of convention-defying stories from a variety of countries – from Britain to the US, Sierra Leone to Honduras – Yanguas provides an eye-opening account of what we really mean when we talk about aid.

An Introduction to the DCED Standard for Results Measurement - Bekkers, Nabanita Sen (2018)
Introduction used in the DCED-BEAM seminar

Using elements of DCED Standards for CLA - Mitra, Bilash; Jalil, Mohammad Muaz (2018)
Introduction used in the DCED-BEAM seminar in Nairobi

The Debate about RCTs in Development is over. We won. They lost. - Pritchett, Lant (2018)
There has been a debate in development economics over the last 20 years as some claimed the use of RCTs as a tool for independent impact evaluation would significantly improve development practice and hence development. While right about the methodological claims about the superiority of randomization to produce cleaner estimates of the LATE (local average treatment effect) of projects and programs, this, in and of itself, does not change development practice. All of the five claims needed to sustain a positive model in which RCT/IIE has a major positive impact are demonstrably false. The proponents of RCTs have responded to losing the first round decisively by changing significantly both their claims and their practice.

Adaptive management: why we find it so hard to operationalise - Teskey, Graham (Abt Associates - Governance Soapbox, 2018)

DRG Center practical tips to implement more context-adaptive programming - Jacobstein, David (#AdaptDev, 2018)
Hi #adaptdevers, The cross-sectoral programs team in the DRG Center have been working in support of ways that programming can be made more aware of, and responsive to, context considerations that have to do with incentives and relationships between different actors - often called power dynamics or political economy. Following several discussions with field folks, we were asked to come up with simple and practical tips that could help staff to implement more context-adaptive programming, or to better Work Politically to use TWP jargon. With assistance from many of our field staff and partners, we've put together three documents (to start) that have now been cleared to share publicly: • Tips on Making Your Solicitations Invite Context-Driven Adaptive Programming - suggestions spanning most sections of a typical solicitation to better weave in Thinking and Working Politically. I'm particularly excited that this document contains embedded links to excerpts from a set of solicitations that model good practice. You can also find a summary of all the excerpts from real solicitations, and links onward to the public posting of those solicitations on Fed Biz Ops or Grants.gov, here. • Tips on Power Dynamics and Theories of Change - suggestions relevant to those working on project designs and logic models. • Tips for Better Use of Advisory Councils - suggestions to set up better advisory bodies that help you to incorporate political economy more automatically into your programmatic adjustments. I hope that you'll find these practical and helpful! Feedback is always welcome. Best, David

Thinking big: How to use theory of change for systems change - Abercrombie, Rob; Boswell, Katie; Thomasoo, Rosanna (NPC, 2018)
We think that, applied well, theory of change can support charities and funders to take a systemic approach to their work. This report identifies five common pitfalls that organisations fall into when using theory of change, and walks through five rules of thumb that will help organisations to use the approach to tackle complex problems. We think that, applied well, theory of change can support charities and funders to take a systemic approach to their work. This report identifies five common pitfalls that organisations fall into when using theory of change, and walks through five rules of thumb that will help organisations to use the approach to tackle complex problems.

Thinking and working politically: An introduction to key ideas, examples and further reading - Laws, Ed; Marquette, Heather (2018)

Thinking and working politically: Reviewing the evidence on the integration of politics into development practice over the past decade - Laws, Ed; Marquette, Heather (TWP Community of Practice, 2018)

Human-Centered, Systems-Minded Design - Both, Thomas (Stanford Social Innovation Review, 2018)
Both human-centered and systems-thinking methods fit within an effective design approach, and can work in conjunction to address social challenges.

Managing Humanitarian Innovation: The cutting edge of aid - James, Eric; Taylor, Abigail (Practical Action Publishing, 2018)
The challenges facing humanitarian logistics are huge. Refugee camps present enormously challenging environments in which sudden spikes in demand, difficult to access locations, disruptions due to conflict or disasters, as well as normal supply chain problems are commonplace. This means that orders for medical and other supplies can take weeks and sometimes months to fulfil, severely impeding humanitarian operations. There is also a lack of or slow adoption of technology routinely used elsewhere. In addition, humanitarian logistics are also expensive. When customs clearance, transportation, storage, middlemen and administration are added in, the costs of basic items are often exorbitant. Managing Humanitarian Innovation presents a new approach that is beginning to transform the way humanitarian logistics are conducted. Innovation in logistics includes disrupting and improving supply chains through the use of technology, especially 3D printers, and engaging people to manage this approach. The book discusses what innovation is, and strategies for supporting it; it describes practical innovations and how they have been applied; and it outlines how innovation labs can be run. Finally it covers how to fund innovation and it suggests how humanitarian innovation might develop in the future. This book brings together the real experience of practitioners who have made innovation work. It is a collaborative work written by and for the community of people involved in humanitarian innovation, in particular in the making and manufacturing of humanitarian supplies. The book is full of practical and actionable points of value to the humanitarian community. Managing Humanitarian Innovation is essential reading for humanitarian practitioners as well as volunteers and others involved in humanitarian supplies provision. It is equally helpful to thought leaders, policy makers and educators.

How do we know what works? Interview with Prof. Michael Woolcock, Lead Social Scientist at the World Bank - Evans, Alice (2018)
Dr Alice Evans and leading experts discuss growth, governance, & gender inequalities. Alice is a Lecturer at King's College London, and Faculty Associate at the Harvard Kennedy School.
2018-03-17

Managing to Adapt: Analysing adaptive management for planning, monitoring, evaluation, and learning - Desai, Harsh; Maneo, Gabriele; Pellfolk, Erica; Schlingheider, Annika (Oxfam, 2018)
Adaptive management is at the heart of ‘Doing Development Differently’. It emerges from stakeholders’ calls for development programmes to be more flexible and responsive to their contexts. Whether it becomes a mainstreamed practice depends on how much it is

Incubating policy for economic transformation: Lessons from Nepal - Booth, David (ODI, 2018)

Global Affairs Canada: an approach to development innovation - GAC (Global Affairs Canada, 2018)
For Global Affairs Canada, development innovation includes new or improved business models, policy practices, approaches, technologies, behavioral insights or ways of delivering products and services that benefit and empower the poorest and most vulnerable people in developing countries.

Digital Principles into practice - HDIF (HDIF, 2018)

Playbook for innovation learning. 35 diagrams to support talking and thinking about learning for innovation - Leurs, Bas; Roberts, Isobel (Nesta, 2018)

Skills, atitudes and behaviours that fuel public innovation - a guide to getting the most from Nesta's Competency Framework for Experimenting and Public Problem Solving - Nesta (Nesta, 2018)

How Does Developing Enforcement Capacity Reduce Wildlife Crime? Increasing program effectiveness by understanding common assumptions - Price, Claire; Buff, Jesse; Peabody, Shawn; Present, Tess; Lauck, Liz (USAID, 2018)
"How Does Developing Enforcement Capacity Reduce Wildlife Crime?" summarizes findings from the literature around four key assumptions about capacity building for enforcement and prosecution. Using the experiences and evidence summarized in this brief, program designers and implementing partners should be able to increase the effectiveness and efficiency of their capacity building efforts.

Thinking and Working Politically through Applied Political Economy Analysis. A guide for practitioners - Rocha Menocal, Alina; Cassidy, Marc; Swift, Sarah; Jacobstein, David; Rothblum, Corinne; Tservil, Ilona (USAID, 2018)
Thinking and Working Politically (TWP) through Applied Political Economy Analysis (PEA). A guide for practitioners Have you ever done everything right in a development program — followed every technical best practice — but still missed the mark? When this happens, it often relates to factors in the context beyond any external development actor’s ability to control.

Program Cycle - Discussion Note: Managing Monitoring, Evaluation, and Learning Platforms - USAID (USAID, 2018)
This Discussion Note complements ADS 201.3.1.2 Program Cycle Principles by elaborating on Principle 2: Manage Adaptively through Continuous Learning. This Discussion Note is intended for USAID staff interested in learning about recent and promising practices in adaptive management across the Program Cycle.

Small-scale farmers in a 1.5°C future: The importance of local social dynamics as an enabling factor for implementation and scaling of climate-smart agriculture - Martinez-Baron, Deissy; Orjuela, Guillermo; Renzoni, Giampiero; Loboguerrero Rodríguez, Ana María; Prager, Steven D (Sustainability governance and transformation 2018, 2018)
Climate-smart agriculture (CSA) has the potential to help farmers implement both adaptation and mitigation practices. The mitigation aspect of CSA is often not considered by farmers due to a high discount rate and, as such, adaptation is usually the priority concern. This review article offers perspective on this issue and highlights two key gaps in the literature: (i) understanding of factors related to the uptake of adaptation practices with co-benefits for mitigation and, (ii) the role of social networks to better enable rapid, widespread implementation of CSA, the latter being critical to bringing CSA to scale. The systematic review treated literature on synergies between adaptation, mitigation and social networks in the rural sector, as well as case studies illustrating the importance of social networks in climate change interventions when addressing synergies in adaptation and mitigation. We find that additional research is required that explicitly focuses on how social networks and social capital may be harnessed to hasten the adoption and uptake of highly synergistic CSA practices. This will facilitate both adaptation in the near term and contribute to mitigation at scale, allowing small-scale farmers to both benefit from and contribute to a 1.5°C future.

The Dilemmas of Citizen Inclusion in Urban Planning and Governance to Enable a 1.5 °C Climate Change Scenario - Chu, Eric; Schenk, Todd; Patterson, James (Urban Planning, 2018)
Cities around the world are facilitating ambitious and inclusive action on climate change by adopting participatory and collaborative planning approaches. However, given the major political, spatial, and scalar interdependencies involved, the extent to which these planning tools equip cities to realise 1.5 °C climate change scenarios is unclear. This article draws upon emerging knowledge in the fields of urban planning and urban climate governance to explore complementary insights into how cities can pursue ambitious and inclusive climate action to realise 1.5 °C climate change scenarios. We observe that urban planning scholarship is often under-appreciated in urban climate governance research, while conversely, promising urban planning tools and approaches can be limited by the contested realities of urban climate governance. By thematically reviewing diverse examples of urban climate action across the globe, we identify three key categories of planning dilemmas: institutional heterogeneity, scalar mismatch, and equity and justice concerns. We argue that lessons from urban planning and urban climate governance scholarship should be integrated to better understand how cities can realise 1.5 °C climate change scenarios in practice.

Thinking and working politically in Somalia: A case study on the Somalia Stability Fund - Laws, Ed (TWP Coommunity of Practice and ODI, 2018)

Prioritizing and Selecting Strategic Approaches in USAID Biodiversity Programming - Stem, Caroline; Swaminathan, Vinaya; Flores, Marco (USAID, 2018)
This guide supplements Biodiversity How-To Guide 2: Using Results Chains to Depict Theories of Change in USAID Biodiversity Programming. Step 4, Brainstorming Strategic Approaches, involves generating a suite of potential strategic approaches for a design team to consider. Step 5 introduces the practice of prioritizing and selecting among these draft strategic approaches but does not provide in-depth guidance on the process and criteria for doing so.

Combating Wildlife Trafficking Case Study Compilation: Capacity Building for Enforcement and Prosecution - USAID (2018)

Program Cycle - Discussion Note: Designing Monitoring, Evaluation, and Learning Platforms - USAID (USAID, 2018)
This Discussion Note complements ADS 201.3.1.2 Program Cycle Principles by elaborating on Principle 2: Manage Adaptively through Continuous Learning. This Discussion Note is intended for USAID staff interested in learning about recent and promising practices in adaptive management across the Program Cycle.

Approaches for addressing complexity in programme theory: Experiences in applying the Actor-based Change (ABC) Framework to a variety of international development programmes and evaluations - Koleros, Andrew; Oldenbeuving, Mark (2018)

TICTeC 2018 - The Making All Voices Count programme: new lessons about donor-funded civic tech - mySociety (2018)
Keywords: Accountability; Civic Tech; IDS; TICTeC; transparency

What's in a name? Unpacking “participatory” environmental monitoring - Turreira-García, Nerea; Lund, Jens; Domínguez, Pablo; Carrillo-Anglés, Elena; Brummer, Mathias; Duenn, Priya; Reyes-García, Victoria (Ecology and Society, 2018)
Turreira-García, N., J. F. Lund, P. Domínguez, E. Carrillo-Anglés, M. C. Brummer, P. Duenn, and V. Reyes-García. 2018. What's in a name? Unpacking “participatory” environmental monitoring. Ecology and Society 23(2):24. https://doi.org/10.5751/ES-10144-230224

Fostering Learning and Effectiveness through Collaboration: A New Collaborative on Transparency, Accountability, and Participation (TAI, 2018)
What are the features, values, and practices of effective learning organizations? How do learning practices contribute to more effective programming? And, how can collaborations between academics, researchers and practitioners better support learning organizations in the global South? These are just a few of the questions that a new global learning collaborative seeks to explore. In …

How Adaptive Management is challenging the monitoring and evaluation of complex programmes - Simister, Nigel (INTRAC, 2018)
By Nigel Simister Adaptive management is a broad approach designed to support development or humanitarian programmes in complex or uncertain …

How Decent is Decent Work? Using SenseMaker to understand workers’ experiences - Mager, Franziska; Smith, Becca; Gujit, Irene (Oxfam, 2018)

Assessing the Demand for a Global Evidence Network. Mapping Existing Initiatives and Understanding Network Lessons and Opportunities - Gandolfo, Ari; Taddese, Abeba (Results for all, 2018)

State of the Field Review: Fiscal Transparency and Accountability - Rudiger, Anja (International Budget Partnership, 2018)

USAID Risk Appetite Statement - USAID (USAID, 2018)

Twinning “Practices of Change” With “Theory of Change”: Room for Emergence in Advocacy Evaluation - Arensman, Bodille; van Waegeningh, Cornelie; van Wessel, Margit (American Journal of Evaluation, 2018)
Theory of change (ToC) is currently the approach for the evaluation and planning of international development programs. This approach is considered especially suitable for complex interventions. We question this assumption and argue that ToC’s focus on cause–effect logic and intended outcomes does not do justice to the recursive nature of complex interventions such as advocacy. Supported by our work as evaluators, and specifically our case study of an advocacy program on child rights, we illustrate how advocacy evolves through recursive interactions, with outcomes that are emergent rather than predictable. We propose putting “practices of change” at the center by emphasizing human interactions, using the analytical lenses of strategies as practice and recursiveness. This provides room for emergent outcomes and implies a different use of ToC. In this article, we make a clear distinction between theoretical reality models and the real world of practices.

In pursuit of the deep and sustained shifts necessary for adaptive management - Simister, Nigel (INTRAC, 2018)
The final blog in Nigel Simister's series on adaptive management and the M&E of complex projects and programmes.

Marine Conservation Outcomes are More Likely when Fishers Participate as Citizen Scientists: Case Studies from the Mexican Mesoamerican Reef - Fulton, Stuart; Caamal-Madrigal, Jacobo; Aguilar-Perera, Alfonso; Bourillón, Luis; Heyman, William D. (Citizen Science: Theory and Practice, 2018)
Small-scale fishers on Caribbean coral reefs have exploited fish spawning aggregations (FSAs) for generations, but intense fishing has led to the loss of traditional aggregation sites. In many areas, the traditional ecological knowledge (TEK) of fishers has contributed greatly to the characterization of spawning aggregations and implementation of local conservation initiatives. TEK has identified more than 40 potential FSA sites along the coast of the Mexican Mesoamerican Reef. These sites have been characterised and scientifically validated, in some cases with traditional western science and in others, with a participatory citizen-science approach. The objective of this work is to compare the science and conservation outcomes at these FSA sites. We report that those FSA sites where scientific surveys were conducted without community participation remain unprotected. By contrast, the FSAs where local fishers were engaged in characterization and subsequent monitoring are now protected at the behest of the fishers themselves. Conservation initiatives to protect FSAs can be more effective through a combination of TEK, western science, and participatory citizen science involving local fishers.
Keywords: Citizen science; Fishers; Spawning Aggregation; Traditional Ecological Knowledge

Context-Driven Adaptation (Overview) - Jacobstein, David (USAID Learning Lab, 2018)
CONTEXT-DRIVEN ADAPTATION COLLECTION

Learning for social-ecological change: a qualitative review of outcomes across empirical literature in natural resource management - Suškevičs, Monika; Hahn, Thomas; Rodela, Romina; Macura, Biljana; Pahl-Wostl, Claudia (Journal of Environmental Planning and Management, 2018)

3 fallacies of embracing complexity - Ang, Yuen Yuen (UNDP Blog, 2018)
Global development is seeing an exciting paradigm shift. Increasingly, leaders and practitioners recognize that development is not a “complicated” challenge that can be neatly parsed out into separate problems and siloed departments, like assembling a car. Rather, the various tasks of development—poverty eradication, improving governance, climate action, gender equality, and so on—are all connected, making development a “complex” challenge.

MLE or MEL in adaptive programming? - Pellini, Arnaldo (Knowledge counts, 2018)

Scaling Up Inclusive Approaches for Marginalised and Vulnerable People - Carter, Becky; Joshi, Anu; Remme, Michelle (2018)
This rapid review summarises the evidence on how to scale up inclusive approaches to complex social change. It looks at how to design scalable inclusive change interventions, as well as how to plan and manage the scale-up process. Focusing on interventions with the aim of reaching the most marginalised and transform social norms, it covers programmes aiming to deliver inclusive outcomes for women and girls (with a particular focus on preventing violence against women and girls) and persons with disabilities. To date, many interventions seeking to change harmful gender and disability norms have been implemented as small-scale projects. There are limited experiences of scale-up and fewer evaluations of these experiences. However, there are some documented case studies as well as emerging analysis that draw out lessons learned. From this evidence base, this rapid desk review identifies eight critical issues commonly highlighted as important considerations when scaling up inclusive change interventions: 1. Opportunities for systemic approach, including integrating political and community-level scale-up, and coordinating across multiple sectors and stakeholders 2. Political support for scale-up 3. Strategic choices: balancing reach, speed, cost, quality, equity, and sustainability 4. Catalysing change: tipping points, diffusion effects, and local champions 5. Locally grounded, participatory, and adaptive approaches 6. Long-term approaches with funding models to match 7. Cost-effective and financially feasible scale-up strategies 8. Measuring impact and sustainability.

Humanitarian Innovation Guide - ELHRA (2018)
The Humanitarian Innovation Guide is a growing online resource to help individuals and organisations define humanitarian problems and successfully develop innovative solutions. ABOUT THE GUIDE The humanitarian sector is investing in exciting innovations, but it is not yet producing a steady pipeline of well-designed solutions that effectively address problems, evidence their impact, and have the potential to be scaled. As stated in a recent independent evaluation of the Humanitarian Innovation Fund (Triple Line, 2017), a review of the innovation ecosystem in 2015 found significant gaps in resources for innovation, including a shortage of guidance on the skills needed to manage successful innovation projects. These findings were echoed in the research carried out to inform this resource. As part of a grant agreement with the European Commission to provide financial and technical support to emerging humanitarian innovations, and in line with our strategic aim to develop the sector’s skills and capabilities in humanitarian innovation, this resource aims to translate our own learning, along with learning from across the sector, into a practical, grounded guide for innovators working in humanitarian contexts. Building on our unique position in the sector, the Humanitarian Innovation Guide is designed to provide targeted support to individuals and organisations attempting to develop innovative solutions to the challenges facing humanitarian assistance, resulting in a more effective humanitarian response. The Guide is written with two audiences in mind: humanitarian practitioners who are seeking to develop a new approach to their work and want to apply an innovation lens to solving problems; and social entrepreneurs from outside the sector who have identified an opportunity to engage with the sector and need a humanitarian framework to contextualise their innovation plans. We also hope that it will be a useful resource for innovation managers who are tasked with supporting innovation in their agencies, labs or networks. As the first step-by-step guide to managing innovation in the humanitarian sector, we hope that its continued development will better enable individuals, organisations and the wider sector to: Plan the activities involved in an innovation process and systematise the management of innovation. Manage a successful innovation project and generate evidence for innovation. Ensure that innovations are developed in an ethical way, with full consideration of risks and responsibilities.

Addressing Maladaptive Coping Strategies of Local Communities to Changes in Ecosystem Service Provisions Using the DPSIR Framework - Ehara, Makoto; Hyakumura, Kimihiko; Sato, Ren'ya; Kurosawa, Kiyoshi; Araya, Kunio; Sokh, Heng; Kohsaka, Ryo (Ecological Economics, 2018)
The Driver-Pressure-State-Impact-Response (DPSIR) framework has been applied to various environmental problems at multiple spatial and temporal scales and attempts have been made to conceptually improve the framework to encompass various stakeholder perspectives. However, recent literature experiences in the field have challenged the inclusive character of the framework applications. In particular, the framework's inability to incorporate the aggregated informal responses of people affected by changes in ecosystem service provisions has not been fully addressed. This limits the framework's validity in categorizing and disseminating information for addressing particular environmental challenges. Herein, we address this problem by analyzing a case study of deforestation and its impact on non-timber forest product collections by rural residents in Cambodia. We incorporate the concept of maladaptive coping strategies into the DPSIR framework and then further elaborate Ness et al.'s (2010) approach of merging the DPSIR framework with Hägerstrand's (2001) system of nested spatial domains. This conceptualizes the incorporation of the aggregated informal responses into the system, as exemplified in the case study.
Keywords: DPSIR framework; Ecosystem services; Maladaptive coping strategy; Nested spatial domains

Beyond the tools: supporting adaptation when organisational resources and capacities are in short supply - Fünfgeld, Hartmut; Lonsdale, Kate; Bosomworth, Karyn (Climatic Change, 2018)
Climate change adaptation is increasingly concerned with how organisations develop capacity to adapt to uncertain futures. A participatory action research project conducted in Victoria, Australia, examined how health and social service organisations developed their organisational adaptive capacity through the use of adaptation decision-support tools. It can be challenging for any organisation to select and apply a decision-support tool, but this is particularly the case where resources and capacities are limited. For most organisations, climate change is only one of a complex set of dynamic stressors they must consider in meeting organisational goals. This paper shows that while decision-support tools can help co-generate knowledge and facilitate customised organisational adaptation processes, for them to be practically helpful for organisations with limited resources and capacities, intensive collaborative and discursive processes are needed to adjust such tools to fit specific organisational contexts and needs. Facilitators and participatory approaches that enable co-inquiry can play a critical role in supplementing scarce resources and initiating adaptation processes that go well beyond the scope and purpose of the decision-support tool used. Organisations working effectively with decision-support tools to adapt to climate change will need to feel ownership of them and have confidence in modifying them to suit their particular adaptation needs and organisational goals.
Keywords: Adaptive capacity; Climate change; Community services; Decision-support tools; Facilitation; Health and social services; Organizational change

Simplicity, Accountability and Relationships: Three ways to ensure MEL supports Adaptive Management - Roche, Chris (From Poverty to Power, 2018)
Based on a recent discussion in Manila, Chris Roche reflects on how Monitoring, Evaluation and Learning can better support 'adaptive programming'.

Barriers and enablers to climate change adaptation in hierarchical governance systems: the case of Vietnam - Phuong, Le Thi Hong; Biesbroek, G. Robbert; Wals, Arjen E. J. (Journal of Environmental Policy & Planning, 2018)
Governments fulfil important roles in increasing the adaptive capacity of local communities to respond to climate change impacts, particularly in developing countries. Existing studies on how governments enable and constrain the ways in which local level communities learn and build their adaptive capacity, however, generally adopt network or market-oriented types of governance. However, the most vulnerable regions to climate change impact in the world are generally governed through hierarchical policy systems. This research aims to understand how the hierarchical policy system in Vietnam creates enables and/or constrains the policy capacity of policy actors to contribute to effective climate change adaptation. We conducted interviews (n = 26) with key actors at multiple levels of government. Our findings show the importance of clear legal institutions, available financing for implementing policies, and the training of governmental staff, particularly at district and commune levels where the policy capacities are generally too low to deal with climate change impacts. We conclude that any efforts to support local actors (i.e. smallholder farmers) should include investments in policy capacity to ensure uptake and upscaling of adaptation actions more broadly.

The fashion for agile management is spreading - The Economist (The Economist, 2018)
Executives need to be a cross between Spider-Man and Simone Biles

Adaptive Programming in Fragile, Conflict and Violence-Affected Settings, What Works and Under What Conditions?: The Case of Pyoe Pin, Myanmar - Christie, Angela; Green, Duncan (Itad, Oxfam and IDS, 2018)
This paper examines adaptive approaches in aid programming in a fragile, conflict and violence-affected setting (FCVAS), namely Myanmar. A combination of desk review and field research has been used to examine some of the assertions around the ‘adaptive management’ approach, which has arisen in recent years as a response to critiques of overly rigid, pre-designed, blue-print and linear project plans. This paper explores if and how adaptive approaches, including rapid learning and planning responses (fast feedback loops and agile programming) are particularly relevant and useful for promoting empowerment and accountability in such ‘messy places’. This case study focuses on Pyoe Pin (‘Young Shoots’), a DFID-funded, British Council managed governance programme, which has been running since 2007.
Keywords: A4EA; Adaptive Development; Economy; Fishery

What can the Thinking and Working Politically community learn from peace and conflict mediation? - Douglas, Alex (From Poverty to Power, 2018)
Wily aid practitioners have long understood the importance of adapting their programs to the political environment, and even use their activities to push politics in a progressive direction. But this magic was spun secretly, hidden behind logframes and results frameworks. Only recently has a range of programs been permitted to escape the dead hand of technocracy. But there was one corner of the development and humanitarian world that never needed to shroud its political ambitions; those of us working on resolving violent conflicts. Donors have always understood our work could never be disembodied from politics. This field included elements of the UN, regional organisations, and NGOs, such as the one I work for: the Centre for Humanitarian Dialogue. With a new focus on development being enabled by a series of ‘deals’ between different actors, it seems timely to examine the strategies used to reach peace agreements and whether they contain broader lessons for TWP/DDD/Adaptive Management.

Adaptive Peacebuilding Programming Through Effective Feedback Loops: Promising Practices - Barnard-Webster, Kiely; Jean, Isabella (CDA, 2018)
This case study report was developed by CDA’s part of Peacebuilding Evaluation Consortium collaborative research on the use of feedback loops in support of adaptive programming. Feedback loops are just one element of adaptive programming and are defined and used in different ways by organizations working on social change, peace and development issues. This document includes key findings from our desk review of reports and grey literature, key informant interviews, observations documented during CDA’s advisory and learning engagements with peacebuilding partners as well as the case study on SFCG’s feedback processes in Burundi. The findings are most relevant to program and M&E staff but have implications for senior management and policymakers in light of growing interest in strengthening adaptive management.

Independent Review of Facilities: review and management response - DFAT (DFAT, 2018)

Guidelines for designing and monitoring social accountability interventions - Franco, Erika Lopez; Shankland, Alex (IDS, 2018)

Opportunities for Using Complexity-Aware Approaches to Theory of Change - Goodier, Sarah; Apgar, Marina (IDS, 2018)
The purpose of this briefing note is to review opportunities for using complexity aware approaches to Theory of Change (ToC) to inform the SDC approach. It provides an overview of complexity-aware approaches and then focuses on demonstrating how complexity thinking can support programming by building on the frameworks currently being used in the project/programme cycle management (PCM) processes. It is aimed at SDC staff, in particular Programme Officers and staff of partner organisations involved in the management of SDC interventions.

State of the Art on Use of Theory of Change in the Development Sector - Goodier, Sarah; Apgar, Marina; Clark, Louise (IDS, 2018)
The purpose of this briefing note is to add to SDC’s understanding of Theory of Change (ToC), drawing on the literature and practice to sketch out the current state of the art approach. This involves expanding on ToC beyond SDC’s current practice of using Impact Hypotheses (IH) to bridge it to operational practice and use ToC more explicitly in the project/programme cycle management (PCM) processes. Sharing the state of the art on use of ToC in the development sector, this briefing note outlines what a ToC is, what it is used for and why it is needed in the development sector. It discusses ToC as both a process and a product, providing step by step guidance on how to facilitate a ToC process. The differences between a ToC and a logframe are highlighted. Some key criteria for recognising when you have a ‘good’ ToC are also included. This brief is aimed at SDC staff, in particular Programme Officers, and staff of partner organisations involved in the management of SDC interventions.

Using adaptive monitoring, evaluation and learning in programme design - Nzegwu, Femi (INASP, 2018)

Making humanitarian response more flexible: Challenges and questions - Obrecht, Alice; Bourne, S. (ALNAP/ODI, 2018)

Using a social learning configuration to increase Vietnamese smallholder farmers’ adaptive capacity to respond to climate change - Phuong, Le Thi Hong; Wals, Arjen; Sen, Le Thi Hoa; Hoa, Nguyen Quoc; Lu, Phan Van; Biesbroek, Robbert (Local Environment, 2018)
Social learning is crucial for local smallholder farmers in developing countries to improve their adaptive capacity and to adapt to the current and projected impacts of climate change. While it is widely acknowledged that social learning is a necessary condition for adaptation, few studies have systematically investigated under which conditions particular forms of social learning are most successful in improving adaptive capacity of the most vulnerable groups. This study aims to design, implement and evaluate a social learning configuration in a coastal community in Vietnam. We make use of various methods during four workshop-based interventions with local smallholder farmers: interviews with key farmers and commune leaders, farmer-to-farmer learning, participatory observations and focus group discussions. The methods for evaluation of social learning configuration include in-depth interviews, focus group discussions and structured survey interviews. Our findings show that the social learning configuration used in this study leads to an increased problem ownership, an enhanced knowledge-base with regard to climate change impacts and production adaptation options, improved ability to see connections and interdependencies and finally, strengthened relationships and social cohesion. The results suggest that increased social learning in the community leads to increase in adaptive capacity of smallholder farmers and improves both their economic and environmental sustainability. We discuss the key lessons for designing learning configurations that can successfully enhance adaptive capacity and smallholder farmers’ agency and responsiveness to the challenges posed by climate change impacts.
Keywords: Adaptive capacity; Social learning; Vietnamese smallholder farmers

Q&A: Complexity-Aware Planning for Stabilization Programming - Martins, Christy (DAI - Checkpoint, 2018)

Procuring and Managing Adaptively: 5 Case Studies of Adaptive Mechanisms - Pryor, Tony (USAID Learning Lab, USAID, 2018)
Flexibility in program management is essential in all of the countries where USAID works. This is especially true in non-permissive environments (NPEs), where the ability to learn and adapt quickly to changing circumstances can help USAID staff members achieve their desired outcomes.

Learning to make a difference: Christian Aid Ireland’s adaptive programme management in governance, gender, peace building and human rights - Booth, David; Balfe, Karol; Gallagher, Róisín; Kilcullen, Gráinne; O'Boyle, Sarah; Tiernan, Alix (ODI, 2018)
This paper assesses the relevance of adaptive or trial-and-error approaches to the field of governance, peace building and human rights. Tackling the problems of poverty, vulnerability and exclusion that persist in parts of the world that continue to be affected by violence or political insecurity is difficult for several reasons. For one, because of the complexity of the prevailing social, economic and political systems, solutions to chronic problems are far from obvious. One response to this aspect of the challenge is adaptive programme design and management. This paper is the product of a multi-year collaboration between ODI and the core team of Christian Aid Ireland to assess the relevance of adaptive or trial-and-error approaches to the field of governance, peace building and human rights. It explains the basis on which Christian Aid Ireland’s current five-year programme has become committed to an adaptive approach. It then describes and seeks to draw lessons from the programme’s first year of experience, considering the possible implications for implementation over the coming years. The authors find that to get full benefits from the move to adaptive management, the new ways of working and their underlying principles will need to become more embedded in organisational practices and cultures.

Achieving value for money through procurement. Part 2: DFID’s approach to value for money through tendering and contract management - A performance review - ICAI (Independent Commission for Aid Impact (ICAI), 2018)
Summary In 2016-17, the Department for International Development (DFID) spent £1.4 billion, or 14% of its budget, through commercial suppliers on contracts ranging from school construction to family planning services and the delivery of humanitarian aid. The quality of its procurement and contract management – how it engages and manages commercial firms to support the delivery of aid programmes on time, to budget and at the appropriate quality – is a key driver of value for money for UK aid. It is also a subject of considerable Parliamentary and public interest. In recent years, DFID has implemented a range of initiatives to strengthen its procurement practices and embed commercial capability across the department – including its 2017 Supplier Review, undertaken to address concerns about excessive profit-making by DFID suppliers. This review on achieving value for money through procurement (part 2) was published in September 2018. We awarded a green-amber score and made three recommendations to government. The follow-up to this review was published in July 2020, and rated the government’s response as ‘inadequate’, as a result of DFID’s failure to put in place a formal contract management regime, despite the risks this entails for programme results. We will return to this in the next follow-up in summer 2021. Review Our review found an appropriate overall approach to procurement with good performance in most areas of tendering, but significant weaknesses in contract management. We therefore awarded a green-amber score and made three recommendations to government. Findings Since 2015, DFID has progressed towards a more mature procurement approach. DFID’s tender process follows current EU legislation and UK government guidelines and cross-government peer reviews confirm improvements in DFID’s procurement approach. The Supplier Review lent momentum to the reforms but risks having unintended consequences. Poor consultation with suppliers has heightened the risk of unintended consequences. DFID is reviewing its business processes to protect aid recipients from sexual abuse and exploitation. DFID does not always choose the most appropriate procurement process but a new strategic sourcing process has resulted in stronger procurement planning. DFID has built up its commercial capability, but this will need to be an ongoing process. The contract management function in DFID is poorly defined and contracts are frequently amended or extended beyond their advertised length and values. Inception phases are often too short for adequate preparation and planning. Progress on flexible and adaptive programming will require more innovative approaches to tendering and contract management. Recommendations Before the next major revision of its supplier code and contracting terms, or future changes that may materially affect suppliers, DFID should conduct an effective consultation process with its supplier market, to ensure informed decisions and minimise the risks of unintended consequences. DFID should accelerate its timetable for acquiring a suitable management information system for procurement, to ensure that its commercial decisions are informed by data. DFID should instigate a formal contract management regime, underpinned by appropriate training and guidance and supported by a senior official responsible for contract management across the department. The new regime should include appropriate adaptive contract management techniques, to ensure that supplier accountability is balanced with the need for innovation and adaptive management in pursuit of development results.

Integrating Food Security and Wild Caught Fisheries Management in USAID Programming. Illustrative situation Model and Results Chain - Swaminathan, Vinaya; Best, Barbara; Ajroud, Brittany (USAID, 2018)
Integrating Food Security and Wild Caught Fisheries Management in USAID Programming is an illustrative case example that demonstrates how two adaptive management programming tools—situation models and results chains—can help USAID staff and its partners to better design and implement activities that integrate food security, nutrition, and sustainable management of wild fisheries.

Building a global learning alliance on adaptive management - Wild, Leni; Ramalingam, Ben (ODI, 2018)

Evidence to Action: Research to Address Illegal Wildlife Trade - Milner-Gulland, E. J.; Cugniere, Laure; Hinsley, Amy; Phelps, Jacob; Rolfe, Michael 't Sas; Veríssimo, Diogo (2018)
Tools and expertise to improve the evidence base for national and international Illegal Wildlife Trade policy already exist but are underutilised. Tapping into these resources would produce substantive benefits for wildlife conservation and associated sectors, enabling governments to better meet their obligations under the Sustainable Development Goals and international biodiversity conventions. This can be achieved through enhanced funding support for inter-sectoral research collaborations, engaging researchers in priority setting and programme design, increasing developing country research capacity and engaging researchers and community voices in policy processes. This briefing, addressed to policy makers and practitioners, is part of the 2018 Evidence to Action: Research to Address Illegal Wildlife Trade event programme, organised by five of the UK’s most active IWT research institutions, to support the London 2018 IWT Conference.

Walking the adaptive talk - Denney, Lisa (Devpolicy Blog from the Development Policy Centre, 2018)
The first in a three-part series on adaptive aid.Lisa Denney clarifies the confusion.

A guide to agile communication - Defra digital - DEFRA Digital (Departmetn for Environment, Food & Rural Affairs (UK), 2018)
This guide is intended for: people planning communications activity on behalf of agile teams people doing the communications activity (especially blogging, presenting, or filmmaking) people who manage the people described above, who want to understand what they're doing and why The government service standard encourages teams to work in the open as much as possible, echoing item 10 in the government design principles, “make things open, it makes them better”. This guide was written to help teams do just that.

Monitoring and evaluation for adaptive programming - Roche, Chris; Kelly, Linda (Devpolicy Blog from the Development Policy Centre, 2018)
Chris Roche and Linda Kelly with six take-aways on what is being tried and learnt in setting up monitoring and evaluation frameworks for adaptive programs.

The role of research and learning in adaptive programming - Babon, Andrea; Denney, Lisa (Devpolicy Blog from the Development Policy Centre, 2018)
Andrea Babon and Lisa Denney explore how learning partners - a common feature of aid programs - can operate and feed into programs.

Sounding clever or being smart? – How to do more with less in evaluating governance programmes - Aston, Tom (Care Insights, 2018)
About a decade ago, the development sector fell into the same trap the financial services industry did in the mid-1990s. We were all seduced by clever...

Iterative Design and Monitoring for Adaptive Management: How Causal Link Monitoring can help - Britt, Heather; Hummelbrunner, Richard; Green, Jackie (Better Evaluation, 2018)
Development actors are embracing the concept and practice of adaptive management, using evidence to inform ongoing revisions throughout implementation. In this guest blog, Heather Britt, Richard Hummelbrunner and Jackie Greene discuss a practical approach that donors and partners can use to agree on what’s most important to monitor as a project continues to evolve.

A systematic review of adaptations of evidence-based public health interventions globally - Escoffery, Cam; Lebow-Skelley, E.; Haardoerfer, R.; Boing, E.; Udelson, H.; Wood, R.; Hartman, M.; Fernandez, M. E.; Mullen, P. D. (Implementation Science, 2018)
Adaptations of evidence-based interventions (EBIs) often occur. However, little is known about the reasons for adaptation, the adaptation process, and outcomes of adapted EBIs. To address this gap, we conducted a systematic review to answer the following questions: (1) What are the reasons for and common types of adaptations being made to EBIs in community settings as reported in the published literature? (2) What steps are described in making adaptations to EBIs? and (3) What outcomes are assessed in evaluations of adapted EBIs?

Collective intelligence and achieving the Sustainable Development Goals - Mulgan, Geoff (nesta, 2018)
Collective intelligence and achieving the Sustainable Development Goals

Going Local 2.0: How to Reform Development Agencies to Make Localized Aid More Than Talk - Ang, Yuen Yuen (Stanford Social Innovation Review, 2018)
More and more global aid agencies believe they should replace one-size-fits-all best practices with locally tailored solutions, but they must shift from just agreeing to “go local” to preparing development experts for the task by taking on three major problems with their internal practices.

Bringing Participation into Complexity-Aware MEL: What is the evidence? - Apgar, Marina; Higdon, Grace Lyn (2018)

Gendered voices for climate action - Fisher, Susannah; Shakya, Clare (iied Working Paper, 2018)
Including local women and men who have experienced the impacts of climate change in decision-making forums is key to developing a just process hearing local voices and experiences. The Paris Agreement signs up the international community to delivering countrydriven, gender-responsive climate action. Including local women and men will be critical to this transition and to achieving the scale and pace of change needed through both procedural and distributional justice. However, there is scarce evidence on how these voices and experiences can impact on and strengthen climate responses, or how best to enable and facilitate this participation.

Caja de Herramientas PDIA - Un enfoque “hazlo tú mismo” para resolver problemas complejos - Samji, Salimah; Andrews, Matt; Pritchett, Lant; Woolcock, MIchael (Center for International Development at Harvard University, 2018)
(Spanish version of he PDIA toolkit) The PDIAtoolkit is designed to guide you through the process of solving complex problems which requires working in teams. We call it a Do-it-Yourself (DIY) kit, where the ‘you’ is a committed team of 4-6 people mobilized to work together to solve a complex problem that cannot be solved by one person.

PDIA Toolkit - A DIY Approach to Solving Complex Problems - Samji, Salimah; Andrews, Matt; Pritchett, Lant; Woolcock, MIchael (Center for International Development at Harvard University, 2018)
The PDIAtoolkit is designed to guide you through the process of solving complex problems which requires working in teams. We call it a Do-it-Yourself (DIY) kit, where the ‘you’ is a committed team of 4-6 people mobilized to work together to solve a complex problem that cannot be solved by one person.

Learning from adaptive programmes - 10 lessons and 10 case studies - Valters, Craig (Overseas Development Institute, 2018)
Internal DFID document from the DevAdapt Programme. Based on another previous document (also internal).

Understanding and governing learning in sustainability transitions: A review - van Mierlo, Barbara; Beers, Pieter J. (Environmental Innovation and Societal Transitions, 2018)
Many transitions scholars underscore the importance of learning in sustainability transitions, but the associated learning processes have hardly been conceptualised. The diverse, well-established research fields related to learning are broadly ignored or loosely applied. In this paper, we systematically explore four interesting learning traditions in terms of their value for gaining an in-depth understanding of learning in sustainability transitions and their relevance for fostering learning, by connecting them to key features of transitions. The selected learning traditions from different disciplinary backgrounds provide valuable insights. None of them sufficiently addresses the complexity of transitions. They include, however, a diversity of relevant learning contexts. We conclude that they have value for investigating new areas such as learning in socio-technological regimes and in later phases of a transition, while enlightening forms of learning that have not yet been fully recognised in transition studies, such as superficial learning, unlearning, and learning to resist change.
Keywords: Collaborative learning; Interactive learning; Organizational learning; Social learning; Sustainability transition

Representing theories of change: technical challenges with evaluation consequences - Davies, Rick (Journal of Development Effectiveness, 2018)
This paper looks at the technical issues associated with the representation of Theories of Change and the implications of design choices for the evaluability of those theories. The focus is on the description of connections between events rather than the events themselves, because this is seen as a widespread design weakness. Using examples and evidence from Internet sources six structural problems are described along with their consequences for evaluation. The paper then outlines a range of different ways of addressing these problems that could be used by programme designers, implementers and evaluators. The paper concludes with some caution speculating on why the design problems are so endemic but also pointing a way forward. Four strands of work are identified that CEDIL and DFID could invest in to develop solutions identified in the paper.
Keywords: Evaluation; evaluability; representation; theory of change

Timely evaluation in international development - Webster, Jayne; Exley, Josephine; Copestake, James; Davies, Rick; Hargreaves, James (Journal of Development Effectiveness, 2018)
Impact and process evaluations are increasingly used in international development; however they are generally retrospective in outlook. A more timely approach to evaluation aims to identify necessary, feasible and effective changes during a programme or intervention’s lifetime. This paper aims to identify, categorise, describe and critically appraise methods to support more timely evaluation in international development. Potential methods were identified through scoping seminar, public symposium, targeted review of the literature, and the authors’ own experiences and opinions. Findings from the different data sources were reviewed collectively by the author group and triangulated to develop an analytical framework. We identified four purposes of timely evaluation for international development, and critiqued the use of approaches against four dimensions of timeliness and flexibility. Whilst we found significant interest in more timely approaches to evaluation in international development, there was a dearth of published empirical evidence upon which to base strong recommendations. There is significant potential for timely evaluation to improve international development outcomes. New approaches to mixing and adapting existing methods, together with new technologies offer increased potential. Research is needed to provide an empirical evidence base upon which to further develop the application, across sectors and contexts, of timely evaluation in international development.
Keywords: Adaptive learning; Outcome evaluation; Programme improvement; impact evaluation

Enabling collaborative synthesis in multi-partner programmes - Cochrane, Logan; Cundill, Georgina (Development in Practice, 2018)
Multi-partner consortia have emerged as an important modality for knowledge generation to address complex sustainability challenges. Establishing eﬀective multi-partner consortia involves signiﬁcant investment. This article shares lessons from the Collaborative Adaptation Research Initiative in Africa and Asia (CARIAA), which aims to support policy and practice for climate change adaptation through a consortium model. Key lessons include the need to facilitate collaborative spaces to build trust and identify common interests, while accepting that this is not a guarantee of success; the importance of programmatic leadership to achieve synthesis; and the value of strategic planning in supporting motivation and alignment between partners.

Putting Gender into Political Economy Analysis: why it matters and how to do it - Brown, Emily; Haines, Rebecca; O’Neil, Tam (From Poverty to Power, 2018)
Gender specialists from Oxfam and Care introduce a new guide that covers both theory and practice of including gender in political economy analysis.
Keywords: Gender

Portfolios of Agile Projects: A Complex Adaptive Systems’ Agent Perspective - Sweetman, Roger; Conboy, Kieran (Project Management Journal, 2018)
While agile approaches can be extremely effective at a project level, they can impose significant complexity and a need for adaptiveness at the project portfolio level. While this has proven to be highly problematic, there is little research on how to manage a set of agile projects at the project portfolio level. What limited research that does exist often assumes that portfolio-level agility can be achieved by simply scaling project level agile approaches such as Scrum. This study uses a complex adaptive systems lens, focusing specifically on the properties of projects as agents in a complex adaptive portfolio to critically appraise current thinking on portfolio management in an agile context. We then draw on a set of 30 expert interviews to develop 16 complex adaptive systems (CAS)-based propositions as to how portfolios of agile projects can be managed effectively. We also outline an agenda for future research and discuss the differences between a CAS-based approach to portfolio management and traditional approaches.

Advancing Work with the Grain at USAID - Jacobstein, David (USAID Learning Lab, 2018)
In December 2017, I wrote a blog about some of the insights gained during a workshop on Context-Driven Adaptation, where many of our sharpest field officers shared the ways that they assessed and adapted to shifts in context to keep programming relevant and effective.

Outcome Mapping FAQs - Outcome Mapping Learning Community (Outcome Mapping, 2018)
FAQ resource produced by IDRC's Evaluation Unit, with contributions from Kaia Ambrose, Sarah, Earl, Jan Van Ongevalle and Julius Nyangaga. We've added it here to answer some of your OM related questions.

Getting Past the Rhetoric #1: Tendering for ‘Thinking and Working Politically’ in Large Facilities - Tyrrel, Lavinia (Abt Associates - Governance Soapbox, 2018)

USAID ADS 201 - Program Cycle Operational Policy (Update 10/29/2018) - USAID (USAID, 2018)

Course: Introduction to Collaborating, Learning and Adapting (CLA) in the Program Cycle - USAID LEARN (USAID Learning Lab, 2018)

Getting Past the Rhetoric #2: Managing for ‘Thinking and Working Politically’ in Large Facilities - Tyrrel, Lavinia (Abt Associates - Governance Soapbox, 2018)

Sample criteria to select case studies for evaluation - Methods Lab (2018)
Time and budget constraints often mean that organisations are unable to evaluate all of their programmes, and large programmes, operating in multiple locations, are unable to evaluate all project sites. This tool introduces two sets of criteria to support evaluators and programme managers to select case studies or programmes for evaluation: i) information about how relevant or feasible evaluation is for individual programmes, and ii) across the overall portfolio, strategic thinking around what types of cases are most important to understand. This tool was developed by Anne Buffardi, Irene Guijt, Simon Hearn and Tiina Pasanen for use in The Methods Lab projects.

Guidance: Rigor and Reproducibility in Grant Applications | grants.nih.gov - NIH (National Institutes of Health, 2018)

Old Wine in New Bottles? 6 ways to tell if a programme is really ‘doing development differently’ - Green, Duncan (From Poverty to Power, 2018)
Some top adaptive management exponents give their top tips on how to distinguish spin from reality, when looking at an avowedly AM programme

Revisiting the Foundational Assumptions of Fiscal Transparency and Accountability Work - Carothers, Thomas; Brechenmacher, Saskia (International Budget Partnership, 2018)
The Fiscal Futures team recently updated the foundational assumptions of fiscal transparency and accountability work to fit today’s world. Learn more.

Connect. Learn. Adapt. Repeat - Practicing adaptive management in complex, conflict-affected environments: barriers and promising practices - Queen, Emily Forsyth (2018)
To shift aid culture toward adaptive management, we can: - Stay humble, empathetic, and build skills in facilitation and listening. - Focus on working with more flexible foundations or individual donors. Or, work for more rigid donors and help make their policies more flexible. - Get clearer about goals and processes while finding ways to be less specific and more committed to local leadership about pathways to get to the goal. - Resist looking for a magic adaptive management tool and instead get clearer about when teams make what kinds of decisions and matching to tools that support that decision-making. - Validate that everyone’s perspective is a form of data and try out simple ways to document how teams learns and changes. - Broaden and ground the idea of expertise – remembering that, especially when working with folx on the margins, people are the only experts on their own life. Practitioners must also examine how dominant patriarchal, white supremacist, colonial ideas have pushed us toward wanting more control, less flexibility, and less space for equitable decision making.

Evaluation and learning in complex, rapidly changing health systems: China’s management of health sector reform - Xiao, Yue; Husain, Lewis; Bloom, Gerald (Globalization and Health, 2018)
Healthcare systems are increasingly recognised as complex, in which a range of non-linear and emergent behaviours occur. China’s healthcare system is no exception. The hugeness of China, and the variation in conditions in different jurisdictions present very substantial challenges to reformers, and militate against adopting one-size-fits-all policy solutions. As a consequence, approaches to change management in China have frequently emphasised the importance of sub-national experimentation, innovation, and learning. Multiple mechanisms exist within the government structure to allow and encourage flexible implementation of policies, and tailoring of reforms to context. These limit the risk of large-scale policy failures and play a role in exploring new reform directions and potentially systemically-useful practices. They have helped in managing the huge transition that China has undergone from the 1970s onwards. China has historically made use of a number of mechanisms to encourage learning from innovative and emergent policy practices. Policy evaluation is increasingly becoming a tool used to probe emergent practices and inform iterative policy making/refining. This paper examines the case of a central policy research institute whose mandate includes evaluating reforms and providing feedback to the health ministry. Evaluation approaches being used are evolving as Chinese research agencies become increasingly professionalised, and in response to the increasing complexity of reforms. The paper argues that learning from widespread innovation and experimentation is challenging, but necessary for stewardship of large, and rapidly-changing systems.

Parliament and the people - Rumbul, Rebecca; Moulder, Gemma; Parsons, Alex (2018)
How digital technologies are shaping democratic information flow in Sub-Saharan Africa

Adaptive Programming in Fragile, Conflict and Violence-Affected Settings, What Works and Under What Conditions?: The Case of PERL, Nigeria - Punton, Melanie; Burge, Richard (Itad, Oxfam and IDS, 2018)
This paper examines adaptive approaches to aid programming in Nigeria. Through field research and desk reviews, we have investigated some of the assertions around the ‘adaptive management and programming’ approach, which has arisen in recent years as a response to critiques of overly rigid, pre-designed, blueprint and linear project plans. This is the second of three case studies in a series which explore if and how adaptive approaches, including rapid learning and planning responses, are particularly relevant and useful for promoting empowerment and accountability in fragile, conflict and violence-affected settings (FCVAS). This case study focuses on PERL (Partnership to Engage, Reform and Learn) in Nigeria, a five-year governance programme (2016-21) with a total budget of £100 million. It aims to promote better service delivery through bringing together government and citizens groups to collectively address governance challenges. PERL is viewed by DFID as the final stage of a 20-year investment, building on learning, experience and partnerships from 15 years of DFID-funded governance programming in Nigeria. It was designed to incorporate learning and adaptation through a ‘living’ theory of change, continuous political economy analysis at different levels, adaptive implementation by location-based delivery teams who are encouraged to be flexible and let partners take the lead, regular learning and reflection, and adaptive resourcing, HR and administrative systems. The case study draws on a conceptual framework (the ‘adaptive triangle’) that looks at three types of adaptation – adaptive management, adaptive programming and adaptive delivery – and the interconnections and tensions between them.
Keywords: A4EA; Adaptive Development; Economy; Fishery

Doing Development Differently in the Global South - Workshop Report - CARE (CARE and British Council, 2018)

Seeking balanced ownership in changing development cooperation relationships - Keijzer, Niels; Klingebiel, Stephan; Örnemark, Charlotte; Scholtes, Fabian (Expert Group for Aid Studies, 2018)
According to the Paris Declaration and the 2030 Agenda, ownership is a prerequisite for effective development cooperation. How can the principle of ownership be promoted in today’s complex development cooperation, in which the numbers of actors have increased? This is the subject of the Expert Group for Aid Studies report Seeking balanced ownership in changing development cooperation relationships. The report contains two country case studies – on Liberia and Rwanda – as well as interviews with the Swedish International Development Cooperation Agency (Sida) and the Ministry for Foreign Affairs, and studies on documents concerning ownership in a Swedish development cooperation context. The authors note that ownership remains relevant as a guiding principle in international development cooperation. The trend from country-to-country cooperation to various forms of support through UN bodies and specialised global funds has created new conditions and competing interests for ownership. An understanding of ownership and how it can be promoted in the complex reality of today needs to be thoroughly re-examined. The study recommends the following: 1. Starting a discussion within the OECD-DAC on effective development cooperation that has global ownership right up to the end of the process. 2. Establishing an international code of conduct in accordance with agreed ownership principles concerning development cooperation funding to and via UN bodies and global funds. 3. Sweden should formulate an explicit policy and approach for how to promote ownership in development cooperation that includes numerous partners.

Modern Slavery Prevention and Responses in South Asia: An Evidence Map - Oosterhoff, Pauline; Yunus, Raudah; Jensen, Charity; Somerwell, Francis; Pocock, Nicola (DFID, 2018)
The Asia Pacific region has the highest numbers of both slavery and child labour victims in the world. The International Labour Organization (ILO) estimates that 16.5 million and 8.4 million persons were in situations of forced labour and forced marriage respectively in Asia Pacific, among 40.3 million in modern slavery globally (ILO & Walk Free Foundation 2017). Although there is a growing body of research and evaluations on specific sub-sectors and interest in the worst forms of labour exploitation, there has not yet been a systematic scoping or synthesis of studies that would help policymakers understand ‘what works’ to reduce the prevalence of “Modern Slavery”2(MS) in the countries of interest to DFID (India, Nepal, Bangladesh, Pakistan). India alone is estimated to have the largest number of people in modern slavery in the world with nearly 8 million persons living in modern slavery, followed by 3.2 million, 592,000 and 171,000 in Pakistan, Bangladesh and Nepal respectively (Walk Free Foundation 2018). While systematic reviews on interventions to reduce prevalence of trafficking, forced or bonded labour or slavery exist, these have not focused on the target countries of interest to DFID. Previous systematic reviews have focussed on particular types of MS, such as cross border sexual exploitation globally (van der Laan et al. 2011), labour exploitation in Europe (Cockbain et al. 2018) or community based interventions for safer migration programming in low and middle income countries (LMICs) (Zimmerman et al. 2016). Several systematic reviews focus specifically on health needs and post-trafficking care or interventions (Ottisova et al. 2016; Muraya & Fry 2016; Hemmings et al. 2016; Dell et al. 2017), and research methods and tools used in trafficking in persons (TIP) and health research (Cannon et al. 2018; Doherty et al. 2016). A recent global review and evidence map of MS interventions found some interventions in the target countries, but the outcomes were not specified (Bryant & Joudo 2018). In this Evidence Map, we address this gap in evidence for India, Nepal, Bangladesh and Pakistan specifically, scoping the range of Modern Slavery interventions and outcomes for specific target populations (survivors, employers, landlords, services providers, criminal justice officials) and at different levels (individual, community, state). This map is foremost targeted to DFID and its partners in India, Nepal, Bangladesh and Pakistan to inform evidence-based policy making. We hope that it is also useful to academics and practitioners working to address modern slavery, or in intervention areas or locations described.

Evaluation of the market systems development approach: Lessons for expanded use and adaptive management at Sida Volume I: Evaluation Report - Ruffer, Tim; Bailey, Helen; Dahlgren, Stefan; Spaven, Patrick; Winters, Mark (Sida, 2018)
This report presents the findings of an evaluation of Sida’s management of the market systems development (MSD) approach. It aims to inform thinking on how Sida can best manage its growing portfolio of MSD programs. Beyond this, it provides insights relevant to Sida’s wider support to complex and adaptive programs. The evaluation identified several factors that affect Sida’s ability to ensure that conducive conditions are in place for effective MSD programs and good development programming more generally. Sida’s relatively flexible framework of rules, guidelines and systems for project management provide the space needed for staff to innovate and manage adaptively. But for this to happen consistently and effectively, Sida needs to invest more deliberately in building the capacity of its staff in relevant areas. In addition, leadership and incentives are key to shaping a culture of active experimentation and learning. This needs to be supported with clearer guidance for those involved in the design and appraisal of MSD projects; and strengthened oversight of project performance, including through adjustments to Sida’s contracts and funding agreements.

Evaluation of the market systems development approach: Lessons for expanded use and adaptive management at Sida Volume II: Case studies - Ruffer, Tim; Bailey, Helen; Dahlgren, Stefan; Spaven, Patrick; Winters, Mark (Sida, 2018)
This report presents the findings of an evaluation of Sida’s management of the market systems development (MSD) approach. It aims to inform thinking on how Sida can best manage its growing portfolio of MSD programs. Beyond this, it provides insights relevant to Sida’s wider support to complex and adaptive programs. The evaluation identified several factors that affect Sida’s ability to ensure that conducive conditions are in place for effective MSD programs and good development programming more generally. Sida’s relatively flexible framework of rules, guidelines and systems for project management provide the space needed for staff to innovate and manage adaptively. But for this to happen consistently and effectively, Sida needs to invest more deliberately in building the capacity of its staff in relevant areas. In addition, leadership and incentives are key to shaping a culture of active experimentation and learning. This needs to be supported with clearer guidance for those involved in the design and appraisal of MSD projects; and strengthened oversight of project performance, including through adjustments to Sida’s contracts and funding agreements.

Volume 3: Participatory Monitoring, Evaluation, and Learning in Complex Adaptive Environments - SACE (SACE Program, 2018)
This volume is the last in a series of papers about systems approaches in complex environments, which includes the use of the collective impact model to address large-scale social problems, and the application of participant-driven MEL techniques across 17 networks of civil society organizations. It is based on the experiences of Root Change and Chemonics, two development partners working on a USAID civic engagement project in Nigeria (2013-2018), as well as hundreds of civil society organization partners. This is the final paper in the series and aims to highlight how the adaptation of participatory monitoring, evaluation, and learning techniques (e.g., most significant change, outcome mapping, and outcome harvesting) evolved and ultimately empowered cluster members. The first paper in the series presented a brief introduction to systems approaches in advocacy settings, the SACE theory of change, and the scope of Root Change’s work as technical lead on capacity building and measurement. The second volume aims to address the innovative use of the advocacy strategy matrix, adapted from work by the Center for Evaluation Innovation, for collective impact and the Collective Impact Model, an approach that engages multiple players in working together to solve complex social problems.

Acquisition and Assistance Strategy - USAID (USAID, 2018)
The U.S. Agency for International Development (USAID) of tomorrow is one in which the Agency enables partner countries to plan, resource, and manage their own development through strengthened capacity and commitment — this is the essence of the Journey to Self-Reliance. In Fiscal Year (FY) 2018, the Agency obligated over 80 percent of its programmatic funding — a total of $17 billion — through acquisition and assistance (A&A) mechanisms. Partnering and procurement are central to how we do our work. Therefore, we must think holistically about with whom we work and how we work, if we are to achieve our ambitious goals for the USAID of tomorrow. The purpose of this document is to provide a transparent strategy that guides changes to Agency policy and practice for both our staff and implementing partners in how we approach our core A&A work. This strategy, which builds on previous and current reform efforts, outlines the shifts we will make to embrace a self-reliance model for A&A and move concretely toward the goal of ending the need for foreign assistance. GUIDING PRINCIPLES OF PARTNERING AT USAID USAID’s partnering approaches have evolved significantly over time as we have tested new and innovative ways of working. The principles outlined below support the Journey to Self-Reliance by empowering our staff and partners to produce results-driven solutions responsive to partner country needs and priorities — building capacity and commitment based on creative and entrepreneurial approaches that have already begun to develop. The Agency must move beyond our traditional approaches to embrace greater collaboration, co-design, and co-financing to improve upon our models of partnering.

Was bedeutet “Staying Engaged” im Kontext der aktuellen Krise in Nicaragua? Überlegungen und Strategien der ALAK (Internal memo) - SDC (SDC, 2018)
«Mitigation» (im Sinne von Notlinderung) und «Transformation» sind die zwei Schlagworte, an welchen sich die Neuausrichtung des Portfolios in Nicaragua über die nächsten Monate orientieren wird. Ziel ist es, dass die Schweiz ihr über die letzten Jahrzehnte akquiriertes politisches Kapital und ihre Expertise nutzt, um zu einer Linderung der Auswirkung der Krise für die Bevölkerung beizutragen und mithilft die Grundlagen für eine Transformation der politischen Kultur und eine langfristig angelegte Demokratisierung zu schaffen.

Debiasing: a systematic discipline and delight for development professionals - Chambers, Robert (Institute of Development Studies, 2018)
Do we really need debiasing, yet another word? Yes, unless anyone can improve on it, because we need a word to describe a rigorous discipline we development professionals need for grounded realism. This has been coming on me slowly. But now explorations and ‘aha!’ moments in India have accumulated and combined into an epiphany. For […]

Transformative Networks Are Multiscalar - Holley, June (NetworkWeaver, 2018)
This is an excerpt from the Network Weaver Handbook. I’ll be writing an update with my latest research and thinking on the topic in the coming weeks so stay tuned! June Holley How does tr…

How should donors manage adaptively? Market Systems Development as a case study. - Itad (Itad, 2018)
Itad has recently completed a strategic evaluation for Sida to help them work through how they can best manage programmes that are adaptive and apply systems approaches - the conclusions from the evaluation about what funders need to do to manage adaptively are of broader relevance.

Working the System: What We’ve Learned About Strengthening Accountability - Nugent, Sarah (Chemonics International, 2018)
When designing a new project, how often do we set out to strengthen a particular actor’s or institution’s ability to “hold government to account?” What does that mean exactly? Maybe the better question to ask is: what is the most effective way to strengthen accountability in our development work? And then, what does it look …

Conflict and Human Rights Shareweb (2019)

Positive deviance, big data, and development: A systematic literature review - Albanna, Basma; Heeks, Richard (The Electronic Journal of Information Systems in Developing Countries, 2019)
Positive deviance is a growing approach in international development that identifies those within a population who are outperforming their peers in some way, eg, children in low-income families who are well nourished when those around them are not. Analysing and then disseminating the behaviours and other factors underpinning positive deviance are demonstrably effective in delivering development results. However, positive deviance faces a number of challenges that are restricting its diffusion. In this paper, using a systematic literature review, we analyse the current state of positive deviance and the potential for big data to address the challenges facing positive deviance. From this, we evaluate the promise of “big data-based positive deviance”: This would analyse typical sources of big data in developing countries—mobile phone records, social media, remote sensing data, etc—to identify both positive deviants and the factors underpinning their superior performance. While big data cannot solve all the challenges facing positive deviance as a development tool, they could reduce time, cost, and effort; identify positive deviants in new or better ways; and enable positive deviance to break out of its current preoccupation with public health into domains such as agriculture, education, and urban planning. In turn, positive deviance could provide a new and systematic basis for extracting real-world development impacts from big data.
_eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/isd2.12063
Keywords: big data; developing countries; machine learning; mobile data; positive deviance; systematic literature review

Integrating Big Data and Thick Data to Transform Public Services Delivery - Ang, Yuen Yuen (IBM Center for The Business of Government, 2019)
This report explains how public organizations can combine big data and thick data to transform public services delivery—a strategy called mixed analytics. Governments can greatly enhance the value of big data by combining it with “thick” data—rich qualitative information about users, such as their values, goals, and consumption behavior, obtained by observing or interacting with them in their daily lives. Big data holds great promise for improving public services delivery and innovation in government, but they are not a panacea . Having lots of data can be overwhelming or have little utility if the data are “thin”—that is, they lack meaning for users or fail to capture issues that matter most . By yielding insights into what citizens really care about and how they consume services, thick data can inform both the collection and analysis of big data. This report introduces the concept of “mixed analytics,” integrating big data and thick data to transform government decision making, public services delivery, and communication. The report presents three case studies of organizations that employ mixed analytics at the international, federal, and city level, respectively. Together, this research offers a set of transferable lessons for agencies at all levels of government: Lesson 1: Big data is a means to an end, rather than an end. Lesson 2: Thick data can identify unexpected problems or previously unexpressed needs. Lesson 3: Thick data can inform the analysis of big data. Lesson 4: Mixed analytics can offer both scale and depth. Lesson 5: Applying technology is a social activity, not an isolated technical task. Lesson 6: The best solutions are not always high-tech. The report concludes with five actionable recommendations for public managers. Make data and technology relevant to the people who use it. Leverage thick data at appropriate stages of the problem-solving process. Build an interdisciplinary team of quantitative and qualitative experts who work closely with stakeholders. Combine big and thick data to improve communication Improve government agencies’ knowledge of mixed research methods. This report builds on multiple past IBM Center reports about how government can leverage data and analytics to improve decisions, including Data-Driven Government: The Role of Chief Data Officers, by Jane Wiseman; Ten Actions to Implement Big Data Initiatives: A Study of 65 Cities, by Alfred Ho and Bo McCall, and Realizing The Promise of Big Data, by Kevin DeSouza. The report also complements several chapters that assess the past and potential use of data across the public sector in our recent book, Government For The Future: Reflection and Vision For Tomorrow’s Leaders. At a time when the US and other governments continue to enhance their use of data as a strategic asset for transformation, we hope that Professor Ang’s report provides useful insights for government managers and stakeholders.

Developmental Evaluation: How Barriers & Enablers Emerge Over Time - Baylor, Rebecca; Fatehi, Y. K.; Esper, H. (USAID, 2019)

Digital Development: Elements of a Critical ICT4D Theory and Praxis - Bon, Anna; Akkermans, Hans (Information and Communication Technologies for Development. Strengthening Southern-Driven Cooperation as a Catalyst for ICT4D, 2019)
In recent years, critical research literature in ICT4D has grown. It is widely accepted that theory is to inform practice. However, the inverse directionality, practice informs theory, is much less present in ICT4D, including in critical research. In this paper, we discuss ways how ICT4D research and theory may be better informed by practice—in terms of (i) recognizing praxis-oriented research paradigms and integrating their results, (ii) development of foundational theories, (iii) critical analysis of ICT4D emerging policies, and (iv) positioning ICT4D in the wider development debate. This suggests several elements or directions in which critical research has the potential to push current boundaries of ICT4D in terms of content as well as relevance.
Keywords: Action research paradigm; Critical research; Network complexity theory; Principles for Digital Development

Polycentric Systems of Governance: A Theoretical Model for the Commons - Carlisle, Keith; Gruby, Rebecca L. (Policy Studies Journal, 2019)
Polycentricity is a fundamental concept in commons scholarship that connotes a complex form of governance with multiple centers of semiautonomous decision making. If the decision-making centers take each other into account in competitive and cooperative relationships and have recourse to conflict resolution mechanisms, they may be regarded as a polycentric governance system. In the context of natural resource governance, commons scholars have ascribed a number of advantages to polycentric governance systems, most notably enhanced adaptive capacity, provision of good institutional fit for natural resource systems, and mitigation of risk on account of redundant governance actors and institutions. Despite the popularity of the concept, systematic development of polycentricity, including its posited advantages, is lacking in the commons literature. To build greater clarity and specificity around the concept, we develop a theoretical model of a polycentric governance system with a focus on the features necessary or conducive for achieving the functioning predicted by commons scholars. The model is comprised of attributes, which constitute the definitional elements, and enabling conditions, which specify additional institutional features for achieving functionality in the commons. The model we propose takes the concept a step further toward specificity without sacrificing the generality necessary for contextual application and further development.
_eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1111/psj.12212

Scale Up Sourcebook - Cooley, Larry; Howard, Julie (Purdue University, 2019)
The Scale Up Sourcebook is informed and inspired by the September 2018 conference, Innovations in Agriculture: Scaling Up to Reach Millions, organized by Purdue University, in partnership with the African Development Bank. The Sourcebook consolidates, extends, and disseminates some of the scaling insights presented at the Purdue conference. It is intended as an easy-to-use guidebook targeted to a broad and diverse audience of stakeholders associated with scaling agricultural technologies and innovations to meet the needs of the world’s poor. The Sourcebook has nine chapters: designing with scale in mind; assessing scalability; using commercial markets to drive scaling; financing the transition to scale; creating an enabling environment for scale; tailoring metrics, monitoring, and evaluation to support sustainable outcomes at scale; and the critical role of intermediary and donor organizations. The Sourcebook provides guidance, tips, and examples, along with links and references to additional resources on scale up.

Inclusive Social Accountability - Counterpart International (Counterpart International, 2019)
Counterpart International’s Inclusive Social Accountability (ISA) developmental framework integrates elements of social inclusion and community accountability into one comprehensive approach.

Large-Scale Transdisciplinary Collaboration for Adaptation Research: Challenges and Insights - Cundill, Georgina; Harvey, Blane; Tebboth, Mark; Cochrane, Logan; Currie‐Alder, Bruce; Vincent, Katharine; Lawn, Jon; Nicholls, Robert J.; Scodanibbio, Lucia; Prakash, Anjal; New, Mark; Wester, Philippus; et al. (Global Challenges, 2019)
An increasing number of research programs seek to support adaptation to climate change through the engagement of large-scale transdisciplinary networks that span countries and continents. While transdisciplinary research processes have been a topic of reflection, practice, and refinement for some time, these trends now mean that the global change research community needs to reflect and learn how to pursue collaborative research on a large scale. This paper shares insights from a seven-year climate change adaptation research program that supports collaboration between more than 450 researchers and practitioners across four consortia and 17 countries. The experience confirms the importance of attention to careful design for transdisciplinary collaboration, but also highlights that this alone is not enough. The success of well-designed transdisciplinary research processes is also strongly influenced by relational and systemic features of collaborative relationships. Relational features include interpersonal trust, mutual respect, and leadership styles, while systemic features include legal partnership agreements, power asymmetries between partners, and institutional values and cultures. In the new arena of large-scale collaborative science efforts, enablers of transdisciplinary collaboration include dedicated project coordinators, leaders at multiple levels, and the availability of small amounts of flexible funds to enable nimble responses to opportunities and unexpected collaborations.
Keywords: Climate change; collaboration; transdisciplinarity

Pocket Guide to Systems Wayfinding - Davidson, Seanna (The Systems School, 2019)

EvalC3 - Davies, Rick (2019)
Tools for developing, exploring and evaluating predictive models of expected outcomes

DFID Smart Rules: Better Programme Delivery - version X (2019.01) - DFID (DFID, 2019)

Breaking the Mould: Alternative approaches to monitoring and evaluation - Dillon, Neil (ALNAP, 2019)
This paper looks at a range of M&E innovations that are designed specifically to provide input to ongoing iterative decision-making and learning at the project level. It identifies three key areas for potential innovation: 1) timing of M&E data provision; 2) flexibility of M&E frameworks to evolve with programme change; and 3) approaches to integrate diverse perspectives on project implementation in a meaningful way. It then looks at a collection of approaches currently being used in each of these three areas through a series of ‘practice examples’, considering the key lessons learned. Finally, the paper discusses the major opportunities and challenges for applying and scaling up the use of these approaches inside the humanitarian sector.

Back to the Drawing Board: How to improve monitoring of outcomes - Dillon, Neil; Sundberg, Amelie (ODI/ALNAP, 2019)

Towards an evidence base on the value of social learning-oriented approaches in the context of climate change and food security - Epp, Marissa Van; Garside, Ben (Environmental Policy and Governance, 2019)
Attention to social learning's potential to improve development outcomes in the context of climate change and food security challenges is growing. Yet evidence supporting the wide range of assertions about the outcomes of social learning processes is insufficient. More work is needed to understand when and how a social learning-oriented approach is effective. We respond to the gap in evidence by piloting the Climate Change and Social Learning initiative's monitoring and evaluation framework for social learning. Our objectives are to begin building an evidence base and to test the theory of change behind the framework. Using a peer-assist approach, we apply the framework to eight case studies in partnership with five initiatives. We analyse trends in evidence gathered across the case studies in four dimensions of social learning (engagement, iterative learning, capacity development, and challenging institutions) along three dimensions of change (process, learning outcomes, and changes in values and practice).
Keywords: Climate change adaptation; Monitoring and Evaluation; Social learning; food security

Urban climate change adaptation as social learning: Exploring the process and politics - Fisher, Susannah; Dodman, David (Environmental Policy and Governance, 2019)
Responses to climate change that build on adaptive natural resource management conceptualise social learning processes as having the potential to form a key component of climate adaptation. Social learning processes represent a way of managing the inherent uncertainties and interconnectedness of adaptation issues through ongoing learning, iterative reflection, and change of responses over time. Although the theoretical case is emerging for social learning as adaptation, there is limited empirical evidence of how these processes play out as local governments engage in urban adaptation planning. This paper starts to address this gap by examining social learning processes in two cities in India. We show how the social learning processes interact with complex governance contexts in the two cities and how evidence of outcomes is emerging across individuals, networks, and systems. We go on to argue that there are several areas of social learning that need further theorisation to support its application in the urban context. First, theories of social learning need to allow for unequal power relationships to continue to shape learning processes and take into account structural and historical dynamics as well as relational forms of power. Second, the way that scale is understood needs to be reopened as a point of analysis to understand how scalar concepts are used by actors to frame and locate problems and solutions rather than being understood as fixed and immutable.
Keywords: Climate change; India; Social learning; governance; urban planning

Empowerment and Accountability in difficult settings: What are we learning? - Gaventa, John; Oswald, Katy (IDS, 2019)
Empowerment and Accountability in Difficult Settings: What Are We Learning? Key Messages Emerging from the Action for Empowerment and Accountability Programme Empowerment and accountability have long been part of the international development vocabulary and a core part of governance, social development and civil society programmes. Yet, much of what has been learnt about these approaches has been drawn from studies in somewhat stable, open and middle-income places around the world. Less is known about how empowerment and accountability are achieved through social and political action in more difficult settings – those faced by institutional fragility, conflict, violence, and closing civic space. This document highlights key messages emerging from the work of the Action for Empowerment and Accountability Research Programme (A4EA), and the implications for how donors, policy makers and practitioners support strategies for empowerment and accountability in fragile, conflict and violence affected settings (FCVAS). Our eight key messages have strong implications for the theories of change used for effective programming in the field.

Adaptive Management Practice in the UK Government - The MUVA case - HLS (Human Learning Systems, 2019)
Case study about the MUVA programme in Mozambique. (Maybe it "misses the point of AP which is not learning for learning. Is learning for impact. The word impact doesn’t even come up once!") Adaptive Management programming within the Foreign & Commonwealth Development Office demonstrates that the UK Government has examples of optimising for learning within its existing management practice. However, currently, the adaptive management practices are unhelpfully framed by an approach which limits both their effectiveness and scope. The programmes use learning as their metastrategy. They succeed in connecting practicebased learning with strategic learning, and make a shift towards reframing accountability as accountability for learning. This learning strategy is enabled by funding and contract management arrangements which prioritise learning. Both at macro-level of programme management and micro level of de-risking experimentation and enabling necessary failure by decoupling people’s job security from potential failure.

When Reporting Undermines Performance: The Costs of Politically Constrained Organizational Autonomy in Foreign Aid Implementation - Honig, Daniel (International Organization, 2019)

Monitoring and Result Measurement for Adaptive Programming - How to Use Data to Manage a MSD Program: Lessons from PRISMA - Khan, Khaled; Seely, Kevin; Ridwan, Mustika; Mulya, Bodhiya (PRISMA, 2019)
Using monitoring data to improve interventions is harder than it seems. Decision-makers are often busy implementing activities, unclear about their roles in data collection and analysis, and uncertain what data matters most or when. PRISMA, an AUD77 million agricultural Market Systems Development (MSD) programme funded by DFAT Australia, has encountered these challenges. With the programme completing its first five year phase, this case study shares ten key lessons divided into three sections: shaping the culture, developing systems, and top management decisions. These lessons aim to help program, sector and intervention managers make better use of monitoring data to improve interventions.

Joint Programming in Conflict-Affected and Fragile States - Koenig, Sibylle; Brusset, Emery (Joint Programming - EU, 2019)
On the Joint Programming Practices from the EU in fragile settings

Community-based monitoring of Indigenous food security in a changing climate: Global trends and future directions - Lam, Steven; Dodd, Warren; Skinner, Kelly; Papadopoulos, Andrew; Zivot, Chloe; Ford, James; Garcia, Patricia J.; Team, IHACC Research; Harper, Sherilee L. (Environmental Research Letters, 2019)
Climate change is expected to exacerbate existing food security challenges, especially in Indigenous communities worldwide. Community-based monitoring is considered a promising strategy to improve monitoring of, and local adaptation to climatic and environmental change. Yet, it is unclear how this approach can be applied in food security or Indigenous contexts. The objectives of this paper are to: 1) review and synthesize the published literature on community-based monitoring of Indigenous food security; and, 2) identify gaps and trends in these monitoring efforts in the context of climate change. Using a systematic search and screening process, we identified 86 published articles. To be included, articles had to be published in a journal, describe a community-based monitoring system, describe any aspect of food security, and explicitly mention an Indigenous community. Relevant articles were thematically analyzed to characterize elements of community-based monitoring in the context of climate change. Results show that the number of articles published over time was steady and increased more than two-fold within the last five years. The reviewed articles reported on monitoring mainly in North America (37%) and South America (28%). In general, monitoring was either collaborative with local communities (51%) or externally-driven (37%), and focused primarily on tracking wildlife (29%), followed by natural resources (16%), environmental change (15%), fisheries (13%), climate change (9%), or some combination of these topics (18%). This review provides an evidence-base on the uses, characteristics, and opportunities of community-based monitoring, to guide future food security monitoring efforts in the context of climate change.

Supporting users with the OutNav approash - Matter of Focus (2019)
This report has been generated in OutNav, using the theory-based approach to evaluation pioneered by Matter of Focus. Example of a report from the tool, explaining OutNav approach

Thinking and Working Politically: Learning from practice. Overview to Special Issue - McCulloch, Neil; Piron, Laure-Hélène (Development Policy Review, 2019)
Over the last 15 years, a set of ideas now referred to as “thinking and working politically” (TWP) has coalesced into a “second orthodoxy” about how to take context into account when implementing development interventions. This approach stresses the importance of obtaining a better understanding of the local context (“thinking politically”) in order to support local actors to bring about sustainable developmental change (“working politically”). However, the evidence base to justify this new approach remains thin, despite a growing number of programmes which purport to be implementing it. Officials in development agencies struggle with putting it into practice and it is unclear how TWP differs—or not—from similar approaches, such as Problem Driven Iterative Adaptation (PDIA) and Doing Development Differently (DDD). This Special Issue sheds light on what TWP means in practice by examining a set of initiatives undertaken by both development partners and government departments in Nigeria, the Occupied Palestinian Territories, China and India. This overview article outlines, in brief, each of the Special Issue's four papers and then draws out five lessons—for funders and for practitioners—from across all the papers. Our five lessons are: (1) the fundamental importance of undertaking political economy analysis (PEA) to adapt programmes to their contexts; (2) the importance of having a realistic level of ambition for interventions; (3) the need to support local ownership—not just “agreement ownership” (between a donor agency and government) or local “management ownership” of the programme, but critically “driver ownership” by generating trust with the key local actors driving change; (4) the need for a more effective set of tools for measuring results in complex programmes that attempt to achieve improvements in long-run governance; and, (5) that although the political economy of donors is often seen as a barrier to applying TWP, the articles show how much can be done with a TWP approach if the analysis takes into account the political economy of donors as well as that of the local context. We conclude with a set of operational recommendations for donors and implementors, as well as suggestions of avenues for further research.
Keywords: Adaptation; Development programmes; Political economy analysis; Reform space; thinking and working politically

DAC Peer Review of Switzerland - 2019 - OECD (OECD, 2019)

Evaluation of development programmes - OECD - OECD (2019)
Data & research on evaluation of development programmes inc. paris declaration, budget support, multilateral effectiveness, impact evaluation, joint evaluations, governance, aid for trade

Planning & Navigating Social Change - Tools for Pacific voyagers - Orr, Douglas Epeli; Cavatore, Maria; Aston, Tom (Oxfam, 2019)
Those working to advance social change in the Pacific must understand, work with and respond to the complex and changing relationships and dynamics of power that exist within such networks, and situate their work in the context of decolonisation and self-determination. But the approaches typically used by NGOs to plan our projects and programs have failed to give due attention to these dynamics. The result is that our projects fall short of achieving their promise, despite being technically sound and logical. In this guide, we aim to provide a process and tools that prioritise and draw out the rich, often implicit, knowledge that Pacific Islanders have about our contexts to plan and manage social change initiatives in a manner that values and responds to this ocean of relationships. Drawing from these relationship-based and voyaging traditions, we emphasise the need to: • frame change in terms of change in people; e.g. change in the situation of groups of people and change in terms of the actions of people; • identify a course towards a particular ‘change destination’; • identify the signs to read that will help you determine where you are on that course; • be constantly attentive to the context as you make the journey, and • be ready to adjust your course in response to changes in your context. To support this way of working, we have selected a number of tools from approaches that we believe fit. In particular, we have drawn from the following approaches: • Thinking and Working Politically and other ‘politically aware’ approaches that recognise that the success of a development initiative will be determined by the interplay of relationships of power within a particular context, not just by having the right technical solution; • Outcome mapping because of its focus on people and relationships, and on identifying and supporting needed changes in the behaviour of specific actors in relation to others. This is key, because it’s individuals who deliver services, individuals who decide whether to allocate budget and resources to address a problem, and individuals who make the choice to believe whether a service is relevant to solving their issues; • Adaptive management because of its recognition that development initiatives take place within complex and changing systems and need to adjust to these and that this requires ongoing learning and adaptation.

Monitoring And Evaluation Tools and Approaches to Support Adaptive Management - Pasanen, Tiina (GLAM, 2019)

The Rapid Evaluation, Action, and Learning (REAL) Approach: A toolkit to measure and refine changes and interventions in health campaigns - PATH (PATH, 2019)
Evaluative Tools for Improving Campaign Effectiveness Public health campaigns aim to control disease or deliver essential health services and products through time-limited and periodic channels. Many countries use campaigns to augment or replace routine service delivery, to target certain populations, or to accelerate progress towards coverage targets. The Root Cause Analysis and Rapid Evaluation, Action, and Learning toolkits present a systematic but flexible approach to identifying the root causes of campaign bottlenecks and then designing, testing, and refining solutions to optimize potential impact. These toolkits respond to a growing need for “fit-for-purpose” rapid-testing, adaptive learning approaches to evaluation and the need for a culture shift toward iterative adaptation and improvement that integrates measurement and evidence-informed decision-making into daily practice. The comprehensive package of toolkits, in addition to the individual Root Cause Analysis toolkit and Rapid Evaluation, Action, and Learning toolkit are available below.

Identifying general trends and patterns in complex systems research: An overview of theoretical and practical implications - Preiser, Rika (Systems Research and Behavioral Science, 2019)
Research on complex systems is becoming more prolific, and there is a need to provide some point of orientation to researchers and practitioners that are drawing on the body of literature that informs the field of complexity research. In this paper, I aim to give an overview of the development of the field and offer some overarching trends and patterns that are recognizable in research on complex systems. The paper then draws on the work to provide six organizing principles of complex systems to inform practical implications and methods for studying and understanding complex systems.
Keywords: complex systems; heuristics; trends and patterns

Defining and using evidence in conservation practice - Salafsky, Nick; Boshoven, Judith; Burivalova, Zuzana; Dubois, Natalie S.; Gomez, Andres; Johnson, Arlyne; Lee, Aileen; Margoluis, Richard; Morrison, John; Muir, Matthew; Pratt, Stephen C.; Pullin, Andrew S.; et al. (Conservation Science and Practice, 2019)
There is growing interest in evidence-based conservation, yet there are no widely accepted standard definitions of evidence, let alone guidance on how to use it in the context of conservation and natural resource management practice. In this paper, we first draw on insights of evidence-based practice from different disciplines to define evidence as being the “relevant information used to assess one or more hypotheses related to a question of interest.” We then construct a typology of different kinds of information, hypotheses, and evidence and show how these different types can be used in different steps of conservation practice. In particular, we distinguish between specific evidence used to assess project hypotheses and generic evidence used to assess generic hypotheses. We next build on this typology to develop a decision tree to support practitioners in how to appropriately use available specific and generic evidence in a given conservation situation. Finally, we conclude with a discussion of how to better promote and enable evidence-based conservation in both projects and across the discipline of conservation. Our hope is that by understanding and using evidence better, conservation can both become more effective and attract increased support from society.
Keywords: Adaptive Management; Evidence-based conservation; Evidence-based practice; Natural resource management; Project management; biodiversity; environmental evidence

What is Uncertainty and Why Does it Matter? - Scoones, Ian (STEPS centre, 2019)
Uncertainty defines our times. Whether it is in relation to climate change, disease outbreaks, financial volatility, natural disasters or political settlements, every media headline seems to assert that things are uncertain, and increasingly so. Uncertainty, where we do not know the probabilities of either likelihoods or outcomes, is different to risk, the implications of which are explored in this paper through five different ways of thinking about uncertainty, derived from highly diverse literatures encompassing societal, political, cultural, practice and individual perspectives. The paper continues by examining how these perspectives relate to four domains: finance and banking; critical infrastructures; disease outbreaks and climate change; natural hazards and disasters. Reflecting on these experiences, the paper argues that embracing uncertainty raises some fundamental challenges. It means questioning simple, linear perspectives on modernity and progress. It means rethinking expertise and including diverse knowledges in deliberations about the future. It means understanding how uncertainties emerge in social, political and economic contexts, and how uncertainties affect different people, depending on class, gender, race, age and other dimensions of social difference. And, if uncertainty is not reducible to probabilistic risk, it means a radically different approach to governance; one that rejects control-oriented, technocratic approaches in favour of more tentative, adaptive, hopeful and caring responses. The paper concludes by asking whether we can learn from those who live with and from uncertainty – including pastoralists in marginal settings – as part of a wider conversation about embracing uncertainties to meet the challenges of our turbulent world.

Managing and Adapting a development program: Lessons from PRISMA - Seely, Kevin (PRISMA, 2019)
This case study is part of the AIP-Rural Learning Series. Funders and implementers of international development programs largely agree that adaptive management is industry best practice. Most development experts also broadly agree on what ‘adaptive management’ means. In this case study, we use a common definition of ‘adaptive management’, including the following features: Flexibility. Implementers create, modify and drop interventions when circumstances change or new information emerges, in order to tailor strategies to context and maximise impact. Purposeful experimentation. Implementers test different activities at the same time, monitoring them to learn what will achieve the desired impact. Since 2015, the number of publications calling for and praising adaptive management in development programs has grown fast. These publications give us an idea of the state of adaptive management in development programs. They reveal progress in some areas, such as tailoring interventions to local context and using evidence for decision-making. Yet they also reveal multiple, ongoing, real-world constraints to adaptive management. This case study explores how one development program, PRISMA, has avoided and overcome some of these constraints, whilst continuing to battle others. Four major constraints revealed in the adaptive management literature are discussed in this case study: Programs are designed in ways that make it hard to adapt interventions, target regions or sectors based on new learning or changing circumstances. Programs struggle to create an organisational culture that encourages learning and adapting. When staffing programs, recruiters prioritise sectoral expertise and length of experience over adaptive managerial competence. Program managers face pressures to spend their budgets predictably and before their program ends. Learning and testing take time and cost little, so managers feel pressure to deprioritise them. The first of these constraints is explored in the next section, ‘Design’, which looks at how the selection of target sectors and performance targets affects PRISMA implementers’ ability to manage adaptively. The third section, ‘Organisational Culture’, shares lessons on encouraging staff to test and improve interventions. Section 4, ‘Staffing’, looks at hiring adaptive managers, and freeing up their time to improve interventions. The final section summarises this case study’s key lessons. Throughout this paper, findings are based on 16 in-depth interviews with PRISMA’s junior, mid-level and senior staff, and its funders. To contextualise these findings, the authors reviewed the ‘adaptive management’ literature, and drew on their experience with development programs worldwide.

Agile distributed software development in nine Central European teams: challenges, benefits and recommendations - Stadler, Manuel; Vallon, Raoul; Pazderka, Martin; Grechenig, Thomas (Information Technology, 2019)

Doing adaptive management at Sida - Tim Ruffer; Helen Bailey; Stefan Dahlgren; Patrick Spaven; Mark Winters (SIDA, 2019)
Lessons from the market systems development approach The evaluation focuses on Sida’s management of MSD projects. The projects are applying the MSD approach with an aim to: - contribute to improved MSD programming by Sida through better management practices across the project cycle - generate recommendations on how Sida can create conducive conditions for systems approaches and adaptive programming more generally. The brief assesses Sida’s organisational capacity for adaptive management in three dimensions: - leadership and culture - staff capacities - skills, and systems and procedures

Hospicing The Old - Robinson, Cassie (Stewarding Loss, 2019)
In 2010 I was introduced to the Berkana Institutes’s Two Loop model, and I come back to it again and again. As I’ve moved across different…

Short Course - Adaptive Management, an overview - Bazaz Smith, Komal (American University, 2019)

Monitoring, Evaluating and Learning for Complex Programs in Complex Contexts: Three Facility Case Studies - Davda, Tara; Tyrrel, Lavinia (Abt Associates, 2019)

AID Programming Guide - DFAT (Australian Government, 2019)

Peacebuilding design, monitoring, and evaluation: A Training Package for participants and trainers at intermediate to advanced levels - Ernstorfer, Anita; Barnard-Webster, Kiely (Carnegie Corporation, 2019)
This training package includes 7 Training Modules and a set of Annexes (Annexes A-O). The Training Modules build on each other and should ideally be used in a sequenced way in a training setting. However, for groups with specific training needs around particular areas, modules can also be used individually, but need to be tailored by the trainers and facilitators to meet the needs of specific audiences. The annexes provide worksheets and hand-outs that can be used as resources during the training for specific modules and exercises.

Designing Monitoring and Evaluation Approaches for Learning An FOS How-To Guide - FOS (FOS, 2019)

Local Works Guidance - Round 4 - USAID (USAID, 2019)

Thinking and Working Politically in Economic Development Programmes – Some Sprints and Stumbles from a DFID Programme in Kyrgyzstan - Koleros, Andrew; Rinnert, David (From Poverty to Power, 2019)
A DFID programme in Kyrgyzstan offers useful insights into how the Thinking and Working Politically approach can escape from its governance ghetto
Keywords: Case Study

What is different about how INGOs do Adaptive Management/Doing Development Differently? - Green, Duncan (From Poverty to Power, 2019)

Towards ‘Targeted Systems Change’ - Rye, Sam (Fieldnotes by Sam Rye, 2019)
Modelling and communicating how to shift systems

Agile Development in the Age of Adaptive Management - Davis, Taryn; Orton-Vipond, Sarah; Staid, Martha (Development Gateway, 2019)
Adaptive management – the idea that development projects should respond to real life complexities and be flexible enough to respond to unforeseen changes – is an often-praised approach to doing development differently, with donors and partners exploring how to apply it within their programming.

Bringing adaptive management to life: Insights from practice - Arora, Anmol; Gogoi, Elizabeth; Joy, Divya; Kumar, Pankaj; Luthra, Rajni; Pal, Uma; Pervaiz, Arif (Oxford Policy Management, 2019)

READ ME - HOW TO USE THIS AM LIBRARY - Prieto Martin, Pedro (Institute of Development Studies, 2019)

How DFID can better manage complexity in development programming - Sharp, Samuel; Valters, Craig; Whitty, Brendan (ODI, 2019)
The United Kingdom’s (UK) Department for International Development (DFID) is an ambitious government department that is committed to reducing poverty and conflict overseas. Many of the issues on which DFID works are complex; whether focused on climate change, gender equality, health or other priorities, simple solutions rarely exist. And to tackle these complex challenges, DFID staff must interact with unpredictable systems of political, organisational and individual behaviours and incentives. There is a risk that complex problems spur more complicated programmes; that the complexity of development challenges is addressed through designing programmes with too many projects and implementers. While there may be valid reasons for this, too many of these complicated programmes will overburden staff. This briefing note is the outcome of an ongoing process within DFID to confront these issues and answer the question: how can DFID design and manage programmes to address complex development challenges without creating too much staff workload? Key messages DFID deals with complex problems, which require flexible systems to support testing, learning and adaptation. • Complex problems do not necessarily require workload-heavy delivery structures, but simpler approaches depend on delivery partners’ experience and competence. • However, programmes that tackle complex problems do require more hands-on engagement and face more workload from inflexible compliance requirements. We suggest that DFID and similar agencies: • Pay closer attention to delivery options in programme design, making use of existing options where possible and, where not, fostering local organisations through long-term investments. • Encourage programme designers to articulate how ambition matches resources and consider ‘good enough’ design. • Reduce the burden of compliance by cultivating partner autonomy, reassessing results and valuefor-money requirements and promoting more flexible contracting and procurement. • Plan and prioritise management resources across a portfolio of programmes to make sure they can be focused in the right areas, where the complexity of the problem requires greater engagement.

Can’t See the Wood For the Logframe: Integrating Logframes and Theories of Change in Development Evaluation - Freer, Gordon; Lemire, Sebastian (Canadian Journal of Program Evaluation, 2019)
There are numerous ways in which to model the underlying theory of programs. In the context of international development evaluation, the most ubiquitous are likely “logframes” and to some extent “theories of change,” both of which may serve to guide program development and management, monitoring, and evaluation. While logframes and theories of change are often developed in parallel, they are rarely fully integrated in their practical application. Drawing on lessons from a recent theory-based evaluation, this article argues that fully integrating the program theory of change within the program logframe provides for a stronger and more holistic understanding of program progress.

Using Actor-Based Theories Of Change to Conduct Robust Contribution Analysis in Complex Settings - Koleros, Andrew; Mayne, John (Canadian Journal of Program Evaluation, 2019)
The use of theories of change (ToCs) is a hallmark of sound evaluation practice. As interventions have become more complex, the development of ToCs that adequately unpack this complexity has become more challenging. Equally important is the development of evaluable ToCs, necessary for conducting robust theory-based evaluation approaches such as contribution analysis (CA). This article explores one approach to tackling these challenges through the use of nested actor-based ToCs using the case of an impact evaluation of a complex police-reform program in the Democratic Republic of Congo, describing how evaluable nested actor-based ToCs were built to structure the evaluation.
Keywords: Behavioural strategy; COM-B