Your search

Experimental evaluations—especially when grounded in theory-based impact evaluation—can provide insights into the mechanisms that generate program impacts. This chapter details variants of experimental evaluation designs and also analytic strategies that leverage experimental evaluation data to learn about causal mechanisms. The design variants are poised to illuminate causal mechanisms related to program implementation and the contribution of selected components of multifaceted programs....

This chapter explores the use of mechanisms within the realist evaluation of the Building Capacity to Use Research Evidence (BCURE) program, a £15.7 million initiative aiming to improve the use of evidence in decision-making in low and middle-income countries. The evaluation was commissioned to establish not just whether BCURE worked but also how and why capacity building can contribute to increased use of evidence in policymaking in the very different contexts in which the program operated....

Over the past decade, the field of development evaluation has seen a renewed interest in methodological approaches that can answer compelling causal questions about what works, for whom, and why. Development evaluators have notably started to experiment with Bayesian Process Tracing to unpack, test, and enhance their comprehension of causal mechanisms triggered by development interventions. This chapter conveys one such experience of applying Bayesian Process Tracing to the study of citizen...

Realist evaluation is an approach with a strong emphasis on causal mechanisms and the context in which they are triggered. However, recent reviews of published realist evaluations show that context is often understudied. This is problematic, as a thorough understanding of the relationship between context and causal mechanisms is crucial in assisting policymakers to make appropriate and targeted decisions that improve the intervention. Therefore, we set out to test whether combining realist...

Despite increased discussions in the community and a common understanding about the virtue of mechanism-based explanation, little is known about the true benefits and challenges of applying causal mechanism analysis in practice. This chapter aims to introduce the reader to the topic of causal mechanisms and synthesize significant findings on this special issue. It begins by laying out definitions and concepts of causal mechanisms in evaluation literature and proposes a two-way classification...

Your awesome model doesn’t get to serious scale unless others replicate it, too. Here’s how to make it happen.

Daunting social problems need scalable solutions. Here’s how to know if you’ve got one.

This paper examines how employees become simultaneously empowered and alienated by detailed, holistic knowledge of the actual operations of their organization, drawing on an inductive analysis of the experiences of employees working on organizational change teams. As employees build and scrutinize process maps of their organization, they develop a new comprehension of the structure and operation of their organization. What they had perceived as purposively designed, relatively stable, and...

Purpose – This paper aims to look at how organisational partnerships balance knowledge exploration and exploitation in contexts that are rife with paradoxes. It draws on paradox theory to examine the partnership’s response to the explore-exploit relationship.

An update on the previous September 2018 uploaded article

Despite a long-term focus on learning in natural resource management (NRM), it is still debated how learning supports sustainable real-world NRM practices. We offer a qualitative in-depth synthesis of selected scientific empirical literature (N = 53), which explores factors affecting action-oriented learning. We inductively identify eight key process-based and contextual factors discussed in this literature. Three patterns emerge from our results. First, the literature discusses both...

Abstract: This paper critically reviews evidence on ‘thinking and working politically’ in development. Scholars and practitioners have increasingly recognised that development is fundamentally political, and efforts are underway to develop more politically informed ways of thinking and working. The literature does not yet constitute a strong evidence base to link these efforts to more effective aid programming: much evidence is anecdotal, does not meet high standards of robustness, is not...

Although the decisions of policy professionals are often more consequential than those of individuals in their private capacity, there is a dearth of studies on the biases of policy professionals: those who prepare and implement policy on behalf of elected politicians. Experiments conducted on a novel subject pool of development policy professionals (public servants of the World Bank and the Department for International Development in the UK) show that policy professionals are indeed subject...

This article explores the prospects for adaptive governance in a proposed marine transboundary conservation initiative in East Africa. Adaptive governance that involves interdependent state and non-state actors learning and taking action on joint environmental problems is suggested for effective transboundary resource governance. Using the concept of adaptive co-management, the current multi-stakeholder marine governance systems in southern Kenya and northern Tanzania are compared to...

Rather than a glossy brochure that no one reads, your strategy should be an ongoing practice that informs your decisions and adapts as circumstances change. A Viewpoint from the Summer 2019 issue.

There is growing interest in studying processes of human sensemaking, as this strongly influences human and organizational behavior as well as complex system dynamics due to the diverse lenses people use to interpret and act in the world. The Cognitive Edge SenseMaker® tool is one method for capturing and making sense of people’s attitudes, perceptions, and experiences. It is used for monitoring and evaluation; mapping ideas, mind-sets, and attitudes; and detecting trends and weak...

Transdisciplinarity is not a new science per se, but a new methodology for doing science with society. A particular challenge in doing science with society is the engagement with non-academic actors to enable joint problem formulation, analysis and transformation. How this is achieved differs between contexts. The premise of this paper is that transdisciplinary research (TDR) methodologies designed for developed world contexts cannot merely be replicated and transferred to developing world...

Inadequate Monitoring and Evaluation (M&E) is often thought to hinder adaptive management of socio-ecological systems. A key influence on environmental management practices are environmental policies: however, their consequences for M&E practices have not been well-examined. We examine three policy areas - the Water Framework Directive, the Natura 2000 Directives, and the Agri-Environment Schemes of the Common Agricultural Policy - whose statutory requirements influence how the environment...