Your search
Results 14 resources
-
Realist evaluation and experimental designs are both well-established approaches to evaluation. Over the past 10 years, realist trials—evaluations purposefully combining realist evaluation and experimental designs—have emerged. Informed by a comprehensive review of published realist trials, this article examines to what extent and how realist trials align with quality standards for realist evaluations and randomized controlled trials and to what extent and how the realist and trial aspects...
-
Nearly all challenges in international development tend to be complex because they depend on constantly evolving human behaviour, systems, and contexts, involving multiple actors, entities, and processes. As a result, both the discovery and scaling of innovations to address challenges in development often involve changes in system behaviour or even system-level transformation. This is rarely a linear process over time and can result in unexpected outcomes. Existing evaluation techniques...
-
In the CEDIL Methods brief, ‘Evaluating complex interventions: What are appropriate methods?’ we identify four types of complex development interventions: long causal chain interventions, multicomponent interventions, portfolio interventions, and system-level interventions. These interventions are characterised by multiple activities, multiple outcomes, multiple components, a high level of interconnectedness, and non-linear outcomes.
-
This paper reviews promising methods for the evaluation of complex interventions that are new or have been used in a limited way. It offers a taxonomy of complex interventions in international development and draws on literature to discuss several methods that can be used to evaluate these interventions. Complex interventions are those that are characterised by multiple components, multiple stakeholders, or multiple target populations. They may also be interventions that incorporate...
-
The enthusiasm for the potential of RCTs in development rests in part on the assumption that the use of the rigorous evidence that emerges from an RCT (or from a small set of studies identified as rigorous in a “systematic” review) leads to the adoption of more effective policies, programs or projects. However, the supposed benefits of using rigorous evidence for “evidence based” policy making depend critically on the extent to which there is external validity. If estimates of causal impact...
-
Key messages • This working paper introduces a set of monitoring and evaluation (M&E) tools and approaches, discussing their potential usefulness in supporting adaptive management in development and humanitarian programmes. It emphasises adaptive programmes characterised by complex aspects, such as: (1) they are innovative; (2) they have uncertain pathways for change; or (3) they operate in uncertain or unstable environments. • The majority of these tools have been used in international...
-
There has been a debate in development economics over the last 20 years as some claimed the use of RCTs as a tool for independent impact evaluation would significantly improve development practice and hence development. While right about the methodological claims about the superiority of randomization to produce cleaner estimates of the LATE (local average treatment effect) of projects and programs, this, in and of itself, does not change development practice. All of the five claims needed...
-
In recent years, the use of experimental methodologies has emerged as a central means of evaluating international aid interventions. Today, proponents of randomized control trials (so-called randomistas) are among the most influential of development experts. This paper examines the growth of this thought collective, analysing how uncertainty has become a central concern of development institutions. It demonstrates that transformations within the aid industry – including the influence of...
-
Development economics is split between macro-development economists - who focus on economic growth, international trade, and fiscal/macro policies - and micro-development economists - who study microfinance, education, health, and other social programs. Recently there has been substantial convergence in the policy mindset exhibited by micro evaluation enthusiasts, on the one hand, and growth diagnosticians, on the other. At the same time, the randomized evaluation revolution has led to an...
-
This paper is a practical guide (a toolkit) for researchers, students and practitioners wishing to introduce randomization as part of a research design in the field. It first covers the rationale for the use of randomization, as a solution to selection bias and a partial solution to publication biases. Second, it discusses various ways in which randomization can be practically introduced in a field settings. Third, it discusses designs issues such as sample size requirements, stratification,...
-
Randomised controlled trials (RCTs), or randomised impact evaluations, are a type of impact evaluation which uses randomised access to social programmes as a means of limiting bias and generating an internally valid impact estimate.
Explore
Theme
-
MEL4 Adaptive Management
- Randomized Controlled Trials
- Case Study (2)
- Causal Mechanisms (1)
- Comparisons/Benchmarking (1)
- Contribution Analysis (1)
- Cost-Benefit Analysis (1)
- Cost-effectiveness analysis (1)
- Cross-sectional study (1)
- Data mining (1)
- Descriptive Statistics (1)
- Desk based research/lit review (1)
- Ethnography / Rapid Ethnography (1)
- Evaluating Multi-project programmes (2)
- Focus Group Discussions (1)
- MEL in International Development (3)
- Network Analysis (1)
- Objectives and options analysis (1)
- Outcome Harvesting (1)
- Outcome Mapping (2)
- Participatory Evaluation (1)
- Policy Scientific Approach (1)
- Political Economy Analysis (1)
- Portfolio Management (2)
- Process Tracing (1)
- Qualitative data analysis and grounded theory (1)
- Realist Evaluation (4)
- Rigour (1)
- Scenario Planning (1)
- Stakeholder analysis (1)
- Stakeholder Feedback (1)
- Surveys (1)
- Systems Mapping (1)
- TOC (Theory of Change) (3)
- Adaptive Approaches [+] (2)
- Cases (1)
- Sectors [+] (2)
Resource type
- Blog Post (1)
- Book (1)
- Journal Article (3)
- Presentation (1)
- Report (8)
Publication year
- Between 2000 and 2025 (13)
- Unknown (1)