Your search

This chapter focuses on facilitation given by the Innovation Caucus to provide expert academic critique to inform Innovate UK's strategy for UK business innovation. As Innovate UK's strategy developed, it became evident that several policy domains needed critical insights and evidence. An academic critical friend provided the latest academic insights, evidence and wider perspective of the actors in the UK Innovation system, insights of which policy makers often lack. The chapter gave case...

Evaluators who take a complexity-aware approach must consider tradeoffs related to theoretical parsimony, falsifiability, and measurement validity. These tradeoffs may be particularly pronounced with ex-post evaluation designs in which program theory development and monitoring frameworks are often completed before the evaluator is engaged. In this chapter, we argue that theory-based evaluation (TBE) approaches can address unique ex-post evaluation challenges that complexity-aware evaluation...

This chapter examines good practices in implementing effective Monitoring, Evaluation, and Learning (MEL) systems within complex international development Democracy, Human Rights, and Governance (DRG) programs, which are characterized by challenges of non-linearity, limited evidence of theories of change, and contextual and politically contingent nature of outcomes. The chapter presents three cases of MEL systems in complex projects implemented by Pact across distinct and diverse operating...

Background: Addressing today’s sustainability challenges requires adopting a systemic approach where social and ecological systems are treated as integrated social-ecological systems. Such systems are complex, and the international development sector increasingly recognises the need to account for the complexity of the systems that they seek to transform. Purpose: This paper sketches out the elements of a complexity-aware monitoring and evaluation (M&E) system for international...

This article explores the potential of using participatory action research as an adaptive programming modality to drive learning and innovation to tackle the drivers of (and seek to eliminate) the Worst Forms of Child Labour. We draw on our experience from early phases of implementation of a large-scale action research programme, which despite the constraints covid-19 posed in moving to full implementation and participatory engagement with children and other stakeholders on the ground, is...

Meeting the United Nations Sustainable Development Goals (SDGs) will require adapting or redirecting a variety of very complex global and local human systems. It is essential that development scholars and practitioners have tools to understand the dynamics of these systems and the key drivers of their behavior, such as barriers to progress and leverage points for driving sustainable change. System dynamics tools are well suited to address this challenge, but they must first be adapted for...

Evaluation processes that facilitate learning among advocates must be nimble, creative, and meaningful while transcending putative performance and accountability management. This article describes the experience, lessons, and trajectory of one such approach, Simple, Participatory Assessment of Real Change (SPARC), that a transnational HIV prevention research advocacy coalition pilot-tested in sub-Saharan Africa. Inspired by the pioneering work of the outcome harvesting (OH) and participatory...

Abstract Background: Program logic is one of the most used tools by the public policy evaluator. There is, however, little explanation in the evaluation literature about the logical foundations of program logic or discussion of how it may be determined if a program is logical. This paper was born on a long journey that started with program logic and ended with the logic of evaluation. Consistent throughout was the idea that the discipline of program evaluation is a pragmatic one, concerned...

Development strategies, programmes and projects are designed making assumptions concerning several variables such as future prices of outputs and inputs, exchange rates and productivity growth. However, knowledge about the future is limited. Uncertainty prevails. The usual approach to deal with uncertainty is to reduce it to risk. Uncertainty is perceived as a negative factor that should and can be eliminated. This article presents an alternative approach which recognises that radical...

Knowledge management strategies are important for firms’ competitive positioning. This paper examines how knowledge management codification and personalisation strategies are developed in response to environmental and organisational dynamics in an international non-governmental organisation. A longitudinal case study of the organisation’s strategic reformulation of its KM strategy over a 2.5 period is drawn upon. The research examines how pressures in the firm’s operating environment led to...

This commentary focuses on the difference between a theory of change and change theory, as it relates to systemic change projects in STEM higher education. A theory of change is project-specific and related to evaluation. It makes the underlying rationale of a project explicit, which supports planning, implementation, and assessment of the project. In addition, a theory of change is often required by funding agencies as part of grant proposals. In contrast, change theories represent...

This paper explores the thinking and practice of ‘action inquiry’ an embedded learning practice that can help navigate complexity when practising change together. The paper uses examples from social contexts where there are concerns about community wellbeing and health care. These are drawn from collaborative or collective leadership development programmes within public services that seek to bring new attention to the qualities of how people think, converse and interact, as part of their...

The investigation of causal mechanisms has the capacity to provide donors and implementing institutions with a greater understanding of people's reasoning and reactions as they work with interventions. This chapter contributes to the literature by identifying behavioral mechanisms generated through engagement with climate-resilient agriculture interventions within a larger livelihood project in Ethiopia. It works through the steps that enabled the study to unpack the black box between the...

This chapter argues that the credibility of causal mechanisms can be greatly increased by formulating them as statements that are both empirically falsifiable and empirically confirmable. Whether statements can be so depends on the potential availability of the relevant evidence (e.g., no evidence exists that can prove or disprove the existence of God, but good quality evidence is potentially available in many other cases). The Bayes formula can be used to measure the extent to which a given...

Applied agricultural research institutes play different roles in complex agricultural innovation processes, contributing to them with other actors. To foster learning and usable knowledge on how research actions influence such lasting innovation processes, there is a need to identify the causal mechanisms linking these actions and the effects of the changes they enable. A participatory, theory-driven, ex-post evaluation method, ImpresS, was developed by the French Agricultural Research...

Despite a wide body of literature on the importance of program theory and the need to tackle complexity to improve international development programming, the use of program theory to underpin interventions aimed at facilitating change in complex systems remains a challenge for many program practitioners. The actor-based change framework offers a pragmatic approach to address these challenges, integrating concepts and frameworks drawn from complexity science and behavioral change literature...

Realist evaluation has, over the past two decades, become a widely used approach in evaluation. The cornerstone of realist evaluation is to answer the question: What works, for whom, under what circumstances, and why. This is accomplished by explicating the causal mechanisms that, within a particular context, generate the outcomes of interest. Despite the central role of mechanisms in realist evaluation, systematic knowledge about how the term mechanism is conceptualized and operationalized...

Experimental evaluations—especially when grounded in theory-based impact evaluation—can provide insights into the mechanisms that generate program impacts. This chapter details variants of experimental evaluation designs and also analytic strategies that leverage experimental evaluation data to learn about causal mechanisms. The design variants are poised to illuminate causal mechanisms related to program implementation and the contribution of selected components of multifaceted programs....

This chapter explores the use of mechanisms within the realist evaluation of the Building Capacity to Use Research Evidence (BCURE) program, a £15.7 million initiative aiming to improve the use of evidence in decision-making in low and middle-income countries. The evaluation was commissioned to establish not just whether BCURE worked but also how and why capacity building can contribute to increased use of evidence in policymaking in the very different contexts in which the program operated....